# ----------------------------- # WiserAdvisor – llms.txt File # Controls how AI crawlers use site content # ----------------------------- User-Agent: GPTBot Allow: /blog/ Allow: /financial-advisor/ Allow: /article/ Disallow: /account/ Disallow: /login/ Disallow: /signup/ Disallow: /admin/ Crawl-Delay: 5 User-Agent: ClaudeBot Allow: /blog/ Allow: /financial-advisor/ Allow: /article/ Disallow: /private/ Disallow: /admin/ Crawl-Delay: 5 User-Agent: PerplexityBot Allow: /blog/ Allow: /article/ Allow: /financial-advisor/ Disallow: /account/ Disallow: /admin/ Crawl-Delay: 5 # For all other AI crawlers User-Agent: * Allow: /blog/ Allow: /article/ Allow: /financial-advisor/ Disallow: /account/ Disallow: /admin/ Crawl-Delay: 5 Directive: noai-train Directive: allowai-index