User-Agent: * Allow: / Disallow: /api/ Disallow: /_next/ Disallow: /private/ Disallow: /admin/ Disallow: /sanity/ Disallow: /book-a-demo/thank-you User-Agent: Googlebot Allow: / Disallow: /api/ Disallow: /_next/ Disallow: /private/ Disallow: /sanity/ Disallow: /book-a-demo/thank-you User-Agent: Bingbot Allow: / Disallow: /api/ Disallow: /_next/ Disallow: /private/ Disallow: /sanity/ Disallow: /book-a-demo/thank-you User-Agent: GPTBot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /ai.txt Disallow: /api/ Disallow: /_next/ Disallow: /private/ User-Agent: ChatGPT-User Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /ai.txt Disallow: /api/ Disallow: /_next/ Disallow: /private/ User-Agent: anthropic-ai Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /ai.txt Disallow: /api/ Disallow: /_next/ Disallow: /private/ User-Agent: Claude-Web Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /ai.txt Disallow: /api/ Disallow: /_next/ Disallow: /private/ User-Agent: Google-Extended Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /ai.txt Disallow: /api/ Disallow: /_next/ Disallow: /private/ User-Agent: PerplexityBot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /ai.txt Disallow: /api/ Disallow: /_next/ Disallow: /private/ User-Agent: cohere-ai Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /ai.txt Disallow: /api/ Disallow: /_next/ Disallow: /private/ User-Agent: FacebookBot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /ai.txt Disallow: /api/ Disallow: /_next/ Disallow: /private/ User-Agent: Meta-ExternalAgent Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /ai.txt Disallow: /api/ Disallow: /_next/ Disallow: /private/ User-Agent: Applebot-Extended Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /ai.txt Disallow: /api/ Disallow: /_next/ Disallow: /private/ User-Agent: YouBot Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /ai.txt Disallow: /api/ Disallow: /_next/ Disallow: /private/ User-Agent: AhrefsBot User-Agent: SemrushBot User-Agent: MJ12bot User-Agent: DotBot User-Agent: BLEXBot User-Agent: MegaIndex User-Agent: Rogerbot User-Agent: DataForSeoBot Disallow: / User-Agent: CCBot Disallow: / Host: https://www.nomic.ai Sitemap: https://www.nomic.ai/sitemap.xml Sitemap: https://www.nomic.ai/news-sitemap.xml