# Standard crawlers User-Agent: * Disallow: /backend4130/ Disallow: /downloads/ Disallow: /dev/ Disallow: /newsletter.php Allow: / # AI Crawlers - Explicitly allow for visibility in AI search/answers User-Agent: GPTBot User-Agent: ChatGPT-User User-Agent: OAI-SearchBot User-Agent: ClaudeBot User-Agent: anthropic-ai User-Agent: Google-Extended User-Agent: PerplexityBot User-Agent: Applebot-Extended Allow: / Sitemap: https://www.kunstform.org/sitemap.xml