# easyweek.io robots.txt # Default rules for all bots User-agent: * Allow: / Disallow: /api/ Disallow: /_nuxt/ Disallow: /__nuxt_content/ # OpenAI crawlers # https://platform.openai.com/docs/bots User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / # Anthropic Claude # https://docs.anthropic.com/en/docs/claude-ai-web-crawler User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / # Google AI User-agent: Google-Extended Allow: / # Microsoft/Bing AI User-agent: Bingbot Allow: / # Perplexity AI User-agent: PerplexityBot Allow: / # Meta AI User-agent: FacebookBot Allow: / User-agent: meta-externalagent Allow: / # Cohere AI User-agent: cohere-ai Allow: / # Common Crawl (used for training many AI models) User-agent: CCBot Allow: / # Sitemap Sitemap: https://easyweek.io/sitemap_index.xml # LLMs.txt (AI-readable site info) # https://llmstxt.org/ LLMs: https://easyweek.io/llms.txt