User-agent: * Disallow: /draft/ Disallow: /popupdemo/ Disallow: /rquery Disallow: /themedemo/ Disallow: /payment-link/p* Disallow: /blog/tag/ Disallow: /blog/page/ Allow: / Sitemap: https://curlec.com/sitemap.xml Crawl-delay: 1 User-agent: ia_archiver Disallow: / User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: PerplexityBot User-agent: FirecrawlAgent User-agent: AndiBot User-agent: ExaBot User-agent: PhindBot User-agent: YouBot User-agent: ClaudeBot User-agent: DuckAssistBot User-agent: Apple-Extended User-agent: Baiduspider User-agent: Yandex Disallow: /draft/ Disallow: /blog/page/ Allow: /