User-agent: * Allow: / # ============================== # 🔍 SEARCH ENGINES (INDEXAÇÃO) # ============================== User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: Slurp Allow: / # ============================== # 🤖 AI CRAWLERS (CONTROLE) # ============================== # OpenAI (ChatGPT / GPTBot) User-agent: GPTBot Allow: / # Anthropic (Claude) User-agent: ClaudeBot Allow: / # Google AI training (separado do Googlebot) User-agent: Google-Extended Allow: / # Amazon AI User-agent: Amazonbot Allow: / # Apple AI User-agent: Applebot-Extended Allow: / # Common Crawl (usado por várias IAs) User-agent: CCBot Allow: / # ByteDance / TikTok User-agent: Bytespider Allow: / # Meta AI User-agent: meta-externalagent Allow: / # ============================== # 🧠 AI SIGNALS (EXPERIMENTAL) # ============================== # Mantido para compatibilidade futura / testes Content-Signal: search=yes, ai-input=yes, ai-train=yes # ============================== # 🗺️ SITEMAP # ============================== Sitemap: https://prodoctor.net/sitemap-index.xml