User-agent: * Allow: / --- OpenAI --- User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / --- Google --- User-agent: Google-Extended Allow: / --- Anthropic (Claude) --- User-agent: ClaudeBot Allow: / --- Perplexity --- User-agent: PerplexityBot Allow: / --- Common Crawl --- User-agent: CCBot Allow: / --- You.com --- User-agent: YouBot Allow: / --- Meta --- User-agent: FacebookBot Allow: / --- Apple --- User-agent: Applebot Allow: / --- DuckDuckGo --- User-agent: DuckDuckBot Allow: / --- NeevaAI --- User-agent: NeevaBot Allow: / --- Règles globales pour tous les bots IA --- User-agent: * Disallow: /facture-.html Disallow: /erreur-page-.html Disallow: /admin/ Disallow: /admin2/ Disallow: /cache/.csv Disallow: /cache/.png Disallow: /classes/ Disallow: /factures/ Disallow: /mails/ Disallow: /page-botmin-image.html Disallow: /texte-page-spring-race-dg.html Disallow: /?sfterm= Disallow: /cdn-cgi/ Allow: /