Machine Readiness
Stored receipt and evidence
14
45
0
0
0
Samples
No stored offer samples.
Samples
No stored action samples.
Samples
No stored product samples.
Document
User-Agent: * Allow: / Disallow: /api/ Disallow: /admin/ Disallow: /_next/ # Block URL-explosion (search/page/utm params create infinite duplicate URLs): Disallow: /carrier/*?q= Disallow: /carrier/*?*&q= Disallow: /carrier/*?*page= Disallow: /carrier/*?*&page= Disallow: /carrier/*?utm_ Disallow: /carrier/*?*&utm_ Disallow: /broker/*?q= Disallow: /broker/*?*&q= Disallow: /broker/*?*page= Disallow: /broker/*?*&page= Disallow: /broker/*?utm_ Disallow: /broker/*?*&utm_ # Form-handler endpoints have no SEO value: Disallow: /broker/submit/ Disallow: /broker/claim/ Crawl-delay: 2 User-Agent: Googlebot Allow: / Disallow: /api/ Disallow: /admin/ Disallow: /_next/ Disallow: /carrier/*?q= Disallow: /carrier/*?*&q= Disallow: /carrier/*?*page= Disallow: /carrier/*?*&page= Disallow: /carrier/*?utm_ Disallow: /carrier/*?*&utm_ Disallow: /broker/*?q= Disallow: /broker/*?*&q= Disallow: /broker/*?*page= Disallow: /broker/*?*&page= Disallow: /broker/*?utm_ Disallow: /broker/*?*&utm_ Disallow: /broker/submit/ Disallow: /broker/claim/ User-Agent: Bingbot Allow: / Disallow: /api/ Disallow: /admin/ Disallow: /_next/ Disallow: /carrier/*?q= Disallow: /carrier/*?*&q= Disallow: /carrier/*?*page= Disallow: /carrier/*?*&page= Disallow: /broker/*?q= Disallow: /broker/*?*&q= Disallow: /broker/*?*page= Disallow: /broker/*?*&page= Disallow: /broker/submit/ Disallow: /broker/claim/ # AI crawlers — explicitly allowed, slower crawl rate (LLM citation traffic) User-Agent: GPTBot User-Agent: ChatGPT-User User-Agent: OAI-SearchBot User-Agent: ClaudeBot User-Agent: Claude-Web User-Agent: Claude-SearchBot User-Agent: Anthropic-Web User-Agent: PerplexityBot User-Agent: Copilot User-Agent: Google-Extended User-Agent: GoogleOther User-Agent: Applebot User-Agent: Applebot-Extended User-Agent: Bytespider User-Agent: CCBot User-Agent: cohere-ai User-Agent: meta-externalagent User-Agent: Amazonbot User-Agent: YouBot Allow: / Disallow: /api/ Disallow: /admin/ Disallow: /_next/ Disallow: /carrier/*?q= Disallow: /carrier/*?*&q= Disallow: /carrier/*?*page= Disallow: /carrier/*?*&page= Disallow: /broker/*?q= Disallow: /broker/*?*&q= Disallow: /broker/*?*page= Disallow: /broker/*?*&page= Disallow: /broker/submit/ Disallow: /broker/claim/ Crawl-delay: 3 Sitemap: https://otrucking.com/sitemap.xml Sitemap: https://otrucking.com/sitemap-carriers.xml Sitemap: https://otrucking.com/sitemap-brokers.xml
Document
Not stored for this site.
Document
Not stored for this site.