# Default rules User-agent: * Disallow: /global.asax Disallow: /app_data/ Disallow: /app_globalresources/ Disallow: /feeds/ Disallow: /redir/ Disallow: /secure/ Disallow: /account/ Disallow: /cart Disallow: /checkout # ===================================================== # AI CRAWLERS - EXPLICITLY ALLOWED # ===================================================== # OpenAI - ChatGPT User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / # Google AI (Bard, Gemini, AI Overviews) User-agent: Google-Extended Allow: / User-agent: Googlebot Allow: / # Anthropic - Claude User-agent: Claude-Web Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / # Perplexity User-agent: PerplexityBot Allow: / # Amazon - Alexa, AI services User-agent: Amazonbot Allow: / # Microsoft - Bing AI, Copilot User-agent: Bingbot Allow: / User-agent: BingPreview Allow: / # Cohere User-agent: Cohere-ai Allow: / # Meta AI User-agent: FacebookBot Allow: / User-agent: Meta-ExternalAgent Allow: / # Apple - Siri suggestions User-agent: Applebot Allow: / # You.com User-agent: YouBot Allow: / # Hugging Face User-agent: HuggingFaceBot Allow: / # Common AI research crawlers User-agent: CCBot Allow: / User-agent: AI2Bot Allow: / User-agent: Diffbot Allow: / # Sitemaps # Country Sitemaps Sitemap: https://www.sweetcare.pt/AE-sitemap.xml Sitemap: https://www.sweetcare.pt/AO-sitemap.xml Sitemap: https://www.sweetcare.pt/BR-sitemap.xml Sitemap: https://www.sweetcare.pt/CV-sitemap.xml Sitemap: https://www.sweetcare.pt/MZ-sitemap.xml Sitemap: https://www.sweetcare.pt/PT-sitemap.xml Sitemap: https://www.sweetcare.pt/ST-sitemap.xml