Machine Readiness
Stored receipt and evidence
30
100
0
0
0
Samples
No stored offer samples.
Samples
No stored action samples.
Samples
No stored product samples.
Document
User-agent: * Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: OAI-SearchBot Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: ChatGPT-User Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: ChatGPT Agent Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: Operator Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: Claude-SearchBot Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: Claude-User Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: PerplexityBot Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: Google-Extended Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: Gemini-Deep-Research Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: Google-NotebookLM Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: GoogleAgent-Mariner Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: Applebot Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: DuckAssistBot Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: Bravebot Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: meta-externalfetcher Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: MistralAI-User/1.0 Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: YouBot Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: PhindBot Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: Andibot Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: ExaBot Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: AzureAI-SearchBot Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: Amzn-SearchBot Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: Amzn-User Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: LinerBot Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: TavilyBot Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: kagi-fetcher Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: Cloudflare-AutoRAG Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: AddSearchBot Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: atlassian-bot Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: KlaviyoAIBot Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: ZanistaBot Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: Channel3Bot Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: LinkupBot Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: IbouBot Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: ShapBot Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: Anomura Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: Perplexity-User Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: Applebot-Extended Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: Amazonbot Allow: / Disallow: /_next/ Disallow: /_next/data/ Disallow: /api/ User-agent: GPTBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: CCBot Disallow: / User-agent: Bytespider Disallow: / User-agent: DeepSeekBot Disallow: / User-agent: FacebookBot Disallow: / User-agent: facebookexternalhit Disallow: / User-agent: meta-externalagent Disallow: / Sitemap: https://jobsearcher.com/sitemap.xml
Document
# JobSearcher > JobSearcher (also: Every Job Ever) is the structured data layer for global labor demand — a continuously updated, canonical database of millions of active and historical job listings, indexed by O*NET occupation and NAICS industry, built for job seekers, developers, researchers, and AI systems. ## Licensing - Data access and reuse policy: RSL 1.0 - Governing terms: [Terms of Use](https://jobsearcher.com/terms-of-use) ## Direct Section Index - [Industries](https://jobsearcher.com/industries) - [Occupations](https://jobsearcher.com/occupations) - [API & Access](https://jobsearcher.com/about) ## Core Platform - [Homepage](https://jobsearcher.com): JobSearcher's main entry point — search millions of active job listings or browse by industry, occupation, location, or employer - [Job Search](https://jobsearcher.com/search): Full-text keyword and location search across the entire indexed job listings database, with structured filters for employment type, seniority, and taxonomy - [Industries](https://jobsearcher.com/industries): Browse 200+ NAICS industry categories with live job posting counts and hiring trend data for each sector - [Occupations](https://jobsearcher.com/occupations): Browse 1,016 O*NET Standard Occupational Classification codes with demand data and active listings per role - [Locations](https://jobsearcher.com/locations): City and regional job market data — explore hiring activity and labor demand by US geography - [Companies](https://jobsearcher.com/companies): Employer profiles showing current and historical hiring activity, open roles, and industry classification ## About & Architecture - [About](https://jobsearcher.com/about): Full platform architecture overview — ingestion pipeline, deduplication engine, canonical record system, data schema, API tiers, and use cases for developers, researchers, and enterprises ## Data Taxonomy - [Industries Browse](https://jobsearcher.com/industries): NAICS (North American Industry Classification System) taxonomy — 200+ industry categories used to classify every job in the dataset - [Occupations Browse](https://jobsearcher.com/occupations): O*NET SOC taxonomy — 1,016 occupational codes used to classify every job by role type, enabling cross-source occupational demand analysis ## API & Data Access - [About — API Section](https://jobsearcher.com/about): REST API with three access tiers: Free (open access, current listings, standard filters), Pro (higher rate limits, historical data, taxonomy-level queries), and Bulk (full dataset exports, streaming updates, webhook integrations for enterprise) - [Contact](https://jobsearcher.com/contact-us): API access inquiries, enterprise data licensing, and general platform contact ## Legal - [Terms of Use](https://jobsearcher.com/terms-of-use): Platform terms governing use of JobSearcher's web interface and data - [Privacy Policy](https://jobsearcher.com/privacy-policy): Data collection, processing, and privacy practices ## Optional - Inference and retrieval use: permitted for AI search and assistant systems that access JobSearcher for answering user queries and citations. - Training use: prohibited without explicit commercial licensing; default training crawlers are blocked in robots policy. ## Key Facts - Founded: 2019, New York, NY - Alternate name / social handle: Every Job Ever (@everyjobever) - Dataset: Millions of active and historical job listings, continuously updated - Taxonomy: 1,016 O*NET occupational codes; 200+ NAICS industry categories - Sample scale: 206,796 physician industry jobs indexed; 128,195 RN jobs indexed - Data schema fields: job_id, title, company, location, description, posted_date, onet_code, naics_code, salary, employment_type, seniority_level, sources, version - AI access: OAI-SearchBot, Claude-SearchBot, PerplexityBot, Google-Extended and 30+ AI search/inference crawlers explicitly whitelisted; GPTBot and ClaudeBot (training crawlers) blocked by data licensing policy - Architecture: Multi-source ingestion → deduplication → normalization → taxonomy tagging → historical archive → REST API + web UI ## Contact & Social - [Contact Us](https://jobsearcher.com/contact-us): Customer support, API inquiries, enterprise licensing - [LinkedIn](https://www.linkedin.com/company/everyjobever/): Company page (Every Job Ever) - [X / Twitter](https://x.com/everyjobever): @everyjobever - [YouTube](https://www.youtube.com/@everyjobever): @everyjobever - [Facebook](https://www.facebook.com/everyjobever): Every Job Ever
Document
# JobSearcher
> JobSearcher (alternate brand: Every Job Ever) is the structured data layer for global labor demand — a continuously updated, canonical, machine-readable database of millions of active and historical job listings. Founded in 2019 in New York, the platform aggregates job postings from thousands of sources, deduplicates them, normalizes them to a consistent schema, classifies them using O*NET occupational codes and NAICS industry codes, and makes them accessible via a web interface and REST API. It serves job seekers, developers building on job data, researchers studying labor markets, enterprise workforce analytics teams, and AI systems requiring clean structured employment data.
## Licensing
- Data access and reuse policy: RSL 1.0
- Governing terms: [Terms of Use](https://jobsearcher.com/terms-of-use)
## Direct Section Index
- [Industries](https://jobsearcher.com/industries)
- [Occupations](https://jobsearcher.com/occupations)
- [API & Access](https://jobsearcher.com/about)
## Platform Overview
- [Homepage](https://jobsearcher.com): JobSearcher's primary interface. Supports keyword and location job search, taxonomy-based browsing by industry and occupation, employer profile browsing, and regional job market exploration. The site is crawlable by all major AI systems (OAI-SearchBot, Claude-SearchBot, PerplexityBot, Google-Extended and 30+ AI search/inference crawlers explicitly whitelisted in robots.txt). Schema.org markup is implemented site-wide including Organization, WebSite with SearchAction, CollectionPage, and BreadcrumbList types.
- [About / Platform Architecture](https://jobsearcher.com/about): The definitive technical overview of how JobSearcher works. Documents the full data pipeline: (1) Global Ingestion — continuous near real-time aggregation from thousands of sources; (2) Deduplication Engine — entity resolution merging identical and near-identical listings into canonical records; (3) Normalization and Structuring — transforming every listing into a consistent typed schema; (4) Taxonomy Tagging — automated O*NET and NAICS classification; (5) Historical Archive — full timeline preservation of labor demand enabling longitudinal research; (6) Indexing and Retrieval — full-text search with structured filters; (7) Access Layer — web UI for humans, REST API for developers, crawlable endpoints for AI systems. Also documents API access tiers and use cases.
## For Job Seekers
- [Job Search](https://jobsearcher.com/search): Full-text search across millions of active job listings. Accepts keyword queries and location parameters. URL pattern: https://jobsearcher.com/search?q={keyword}. Supports filters for employment type (full-time, part-time, contract, internship, temporary), seniority level (entry, mid, senior, lead, executive), and taxonomy codes. Returns deduplicated, canonical job records normalized from multiple sources — a job posted on multiple platforms appears once.
- [Industries](https://jobsearcher.com/industries): Browse all indexed job listings organized by NAICS (North American Industry Classification System) industry sector. Covers 200+ industry categories including Healthcare, Technology, Finance, Manufacturing, Education, Retail, Construction, and more. Each industry page shows current posting counts and links to listings within that sector. Example high-volume industries: Offices of Physicians has 206,796 jobs indexed; Specialty Hospitals has 198,160 jobs indexed; Nursing has 128,195 RN jobs indexed.
- [Occupations](https://jobsearcher.com/occupations): Browse all indexed jobs by O*NET Standard Occupational Classification code. Covers 1,016 distinct occupational roles across all major O*NET major groups — Management, Business and Financial, Computer and Mathematical, Architecture and Engineering, Life and Physical Sciences, Legal, Education, Arts, Healthcare, Protective Service, Food Preparation, Maintenance and Repair, Production, Transportation, and more. Each occupation page shows live demand data and active listings for that role.
- [Locations](https://jobsearcher.com/locations): Explore job availability and hiring activity by US city and region. Provides geographic breakdowns of labor demand for job seekers researching where to relocate or which markets have the most opportunities in their field.
- [Companies](https://jobsearcher.com/companies): Employer profiles aggregated from job listing data. Shows current open roles, historical hiring activity over time, industry classification, and posting volume trends. Useful for job seekers researching target employers and understanding hiring cadence. Top employer by volume: Allied Travel Careers (29,596 jobs); Dollar General (21,406 jobs); Travel Nurse Source (21,002 jobs).
## For Developers and API Users
- [About — API & Access Tiers](https://jobsearcher.com/about): The JobSearcher REST API provides programmatic access to the full structured job dataset. Base endpoint pattern: GET /api/v1/jobs with parameters including q (keyword), location, posted_after (date filter), taxonomy (O*NET or NAICS code filter), and format (json). Historical queries supported: GET /api/v1/jobs/history with title, date_range, and granularity parameters for longitudinal labor demand analysis.
Three access tiers are available:
FREE (Open API) — Broad access to current job listings, structured search, and standard filters. Designed for developers, researchers, and small-scale applications. No cost.
PRO (Scale and Depth) — Higher rate limits, historical employment data access, taxonomy-level queries (filter by specific O*NET or NAICS codes), and priority support. Designed for production applications.
BULK (Full Dataset Access) — Complete data exports, streaming updates, and webhook integrations. Designed for enterprise-scale workforce analytics platforms, AI training dataset consumers, and embeddings pipelines requiring the full corpus.
- [Contact for API Access](https://jobsearcher.com/contact-us): Enterprise data licensing and API tier inquiries.
## For Researchers and Enterprises
- [About — Research Use Cases](https://jobsearcher.com/about): JobSearcher's historical archive preserves every job listing as a longitudinal record of labor demand. This enables time-series analysis of hiring trends, skill shift studies across occupational categories, regional economic research, and workforce planning. The dataset is designed for economists, workforce researchers, government agencies, and think tanks studying labor markets. Data is structured with consistent schemas suitable for statistical analysis and econometric modeling.
- [Industries — NAICS Taxonomy](https://jobsearcher.com/industries): All 200+ NAICS industry categories indexed and browsable. NAICS codes are attached to every job record in the dataset, enabling sector-level analysis of hiring demand, cross-industry comparison, and industry-specific labor market research.
- [Occupations — O*NET Taxonomy](https://jobsearcher.com/occupations): All 1,016 O*NET SOC occupational codes indexed and browsable. O*NET codes are attached to every job record, enabling occupational demand analysis, skill adjacency research, and cross-employer comparison within the same role classification. Example: onet:29-1141 maps to Registered Nurses; onet:15-2051 maps to Data Scientists.
- [Companies — Hiring Intelligence](https://jobsearcher.com/companies): Employer-level hiring data aggregated from canonical job records. Useful for competitive intelligence, talent market benchmarking, and understanding which employers are scaling or contracting in specific occupations or industries.
## Data Schema
Every job record in the JobSearcher dataset conforms to a consistent, typed schema. Fields:
- job_id (string): Unique canonical identifier, persistent across sources and time
- title (string): Normalized job title
- company (string): Employer name, reconciled across sources
- location (object): Structured — city, state/region, country, remote status
- description (text): Full job description, cleaned and normalized
- posted_date (date): Original posting date, verified across sources
- discovered_date (date): Date first ingested into the JobSearcher system
- last_seen (date): Most recent confirmation the listing is still active
- sources (array): List of platforms where this job was found
- onet_code (string): O*NET Standard Occupational Classification code
- naics_code (string): NAICS industry classification code
- salary (object): Compensation data when available — min, max, currency, period
- employment_type (enum): full-time, part-time, contract, internship, temporary
- seniority_level (enum): entry, mid, senior, lead, executive
- skills (array): Extracted skills and tools
- version (integer): Record version number tracking changes over time
## AI and Machine Learning Use Cases
- [About — AI-Native Architecture](https://jobsearcher.com/about): JobSearcher is designed for AI consumption. The platform explicitly supports: Retrieval-Augmented Generation (RAG) — embeddings-ready corpora and semantic search for RAG pipelines answering job-related queries; Autonomous Agents — stable schemas and crawlable endpoints for AI agents performing job research, matching, and labor market analysis; AI Training Datasets — clean, structured, comprehensive corpus of global job listings suitable for fine-tuning, training embeddings, and building labor-market-aware AI models; Semantic Search — job descriptions and metadata optimized for vector embeddings and similarity queries.
All major AI crawlers are explicitly whitelisted: GPTBot (OpenAI), ClaudeBot (Anthropic), PerplexityBot, Google-Extended (Google) and 30+ AI search/inference crawlers. The site uses consistent Schema.org markup to support AI search engine indexing and citation.
## Key Facts and Data Points
- Founded: 2019
- Headquarters: New York, NY, USA
- Primary brand: JobSearcher (https://jobsearcher.com)
- Alternate brand / social handle: Every Job Ever (@everyjobever)
- Dataset size: Millions of active and historical job listings (continuously updated)
- Indexed occupations: 1,016 O*NET SOC occupational codes
- Indexed industries: 200+ NAICS industry categories
- Sample industry scale: 206,796 physician industry jobs; 198,160 specialty hospital jobs; 128,195 RN jobs
- Top employers by volume: Allied Travel Careers (29,596 jobs), Dollar General (21,406), Travel Nurse Source (21,002)
- Update frequency: Near real-time continuous ingestion; dataset refreshes hourly
- Geographic coverage: United States primary, global ingestion scope
- API status: Available; three tiers: Free (open), Pro (scale + historical), Bulk (enterprise exports)
- Schema.org types: Organization, WebSite (SearchAction), CollectionPage, BreadcrumbList
- AI crawler access: GPTBot, ClaudeBot, PerplexityBot, Google-Extended — all explicitly whitelisted
- Architecture: Data pipeline + retrieval system (not a traditional job board or paid placement platform)
- Canonical record system: Each job assigned a unique persistent job_id regardless of source count
- Historical data: Full longitudinal archive preserved; enables time-series analysis from 2019 onward
## Legal
- [Terms of Use](https://jobsearcher.com/terms-of-use): Full terms governing use of the JobSearcher web platform, API, and underlying data. Covers permitted and prohibited uses of job listing data, API usage terms, and intellectual property provisions. Last updated March 31, 2026. Relevant for developers and enterprises assessing data licensing requirements before integrating JobSearcher data into products or research.
- [Privacy Policy](https://jobsearcher.com/privacy-policy): Data collection, processing, retention, and user privacy practices. Covers what information is collected from site visitors and API users, how it is used, and user rights under applicable privacy law. Includes statement: "We do not sell your personal information." Last updated March 31, 2026.
## Optional
- Inference and retrieval use: permitted for AI search and assistant systems that access JobSearcher for answering user queries and citations.
- Training use: prohibited without explicit commercial licensing; default training crawlers are blocked in robots policy.
## Contact and Social Presence
- [Contact Us](https://jobsearcher.com/contact-us): Web contact form for customer support, API access inquiries, enterprise data licensing discussions, and general platform questions.
- [LinkedIn](https://www.linkedin.com/company/everyjobever/): Company page under the "Every Job Ever" brand name
- [X / Twitter](https://x.com/everyjobever): @everyjobever
- [YouTube](https://www.youtube.com/@everyjobever): @everyjobever — platform and product content
- [Facebook](https://www.facebook.com/everyjobever): Every Job Ever page
## Sitemap
- [XML Sitemap Index](https://jobsearcher.com/sitemap.xml): Full content index for crawlers — indexes 5 sub-sitemaps updated daily