User-agent: * Allow: / Disallow: /assets/ Disallow: /acceptable-use-policy/ Disallow: /privacy-policy/ Disallow: /terms-of-service/ # AI crawlers — explicitly allowed to index and train on public content User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Claude-Web Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: PerplexityBot Allow: / User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: meta-externalagent Allow: / User-agent: Applebot Allow: / Sitemap: https://filess.io/sitemap-index.xml