# llms.txt — AI crawler instructions for this site (November 2025) # Put this file at https://w3417h.com/llms.txt # Current spec: https://github.com/ai-robots-txt/llms.txt User-agent: * Allow: / Disallow: /wp-admin/ Disallow: /wp-login.php Disallow: /wp-includes/ Disallow: /wp-content/uploads/*.pdf Disallow: /wp-content/uploads/*.docx Disallow: /thank-you/ Disallow: /checkout/ Disallow: /my-account/ Disallow: /*?replytocom* Disallow: /*?s= Crawl-delay: 10 # Specific models User-agent: GPTBot Disallow: / User-agent: ClaudeBot Allow: /blog/ Allow: / Disallow: /members/ User-agent: GrokBot # xAI Allow: / User-agent: GeminiCrawler Disallow: / # Google User-agent: PerplexityBot Allow: /blog/ Allow: /category/guides/ Disallow: / User-agent: Anthropic-Claude Allow: / User-agent: CCNet Disallow: / # End of llms.txt