User-agent: * Allow: / Disallow: /admin/ Disallow: /supporter/ Disallow: /blogwriter/ Disallow: /api/ Disallow: /payment/ Disallow: /cgi-bin/ Disallow: /login Disallow: /register Disallow: /password/ Disallow: /horizon # AI Search Crawlers (allow — these return traffic via citations) User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: claude-web Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / User-agent: DuckAssistBot Allow: / # Block pure scrapers with no search benefit User-agent: CCBot Disallow: / User-agent: Bytespider Disallow: / Sitemap: https://prepaid-host.com/sitemap.xml