User-agent: * Disallow: /dashboard/ Disallow: /*? Disallow: /_next/ Disallow: /pdf/ # auto-generated wordpress XML files for RSS Disallow: /blog/*/feed/ # /blog/llms.txt shouldn't be indexed by search engines, # but should be accessible for AI crawlers Disallow: /blog/llms.txt User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: Claude-Web User-agent: PerplexityBot User-agent: Perplexity-User User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: anthropic-ai User-agent: Google-Extended Allow: /blog/llms.txt Sitemap: https://drpc.org/sitemap.xml