# =========================================== # AI CRAWLERS - Explicitly allowed # =========================================== User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Claude-Web Allow: / User-agent: anthropic-ai Allow: / User-agent: PerplexityBot Allow: / User-agent: Bytespider Allow: / User-agent: CCBot Allow: / User-agent: Google-Extended Allow: / User-agent: cohere-ai Allow: / # =========================================== # SEARCH ENGINES - Block markdown duplicates # =========================================== User-agent: Googlebot Disallow: /blog/markdown-posts/ User-agent: Bingbot Disallow: /blog/markdown-posts/ # =========================================== # DEFAULT RULES # =========================================== User-agent: * Disallow: /author/ Disallow: /comments/ Disallow: /page/ Disallow: /tag/ Disallow: /category/ Disallow: /search/ Disallow: /*?* Allow: /*?fp_ref=* User-agent: Orthogaffe Disallow: / User-agent: UbiCrawler Disallow: / User-agent: DOC Disallow: / User-agent: Zao Disallow: / User-agent: sitecheck.internetseer.com Disallow: / User-agent: Zealbot Disallow: / User-agent: MSIECrawler Disallow: / User-agent: SiteSnagger Disallow: / User-agent: WebStripper Disallow: / User-agent: WebCopier Disallow: / User-agent: Fetch Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: WebZIP Disallow: / User-agent: linko Disallow: / User-agent: HTTrack Disallow: / User-agent: Microsoft.URL.Control Disallow: / User-agent: Xenu Disallow: / User-agent: larbin Disallow: / User-agent: libwww Disallow: / User-agent: ZyBORG Disallow: / User-agent: Download Ninja Disallow: / User-agent: wget Disallow: / User-agent: grub-client Disallow: / User-agent: BotRightHere Disallow: / User-agent: WebZip Disallow: / User-agent: larbin Disallow: / User-agent: b2w/0.1 Disallow: / User-agent: Copernic Disallow: / User-agent: psbot Disallow: / User-agent: Python-urllib Disallow: / User-agent: URL_Spider_Pro Disallow: / User-agent: CherryPicker Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: WebBandit Disallow: / User-agent: EmailWolf Disallow: / User-agent: ExtractorPro Disallow: / User-agent: CopyRightCheck Disallow: / User-agent: Crescent Disallow: / User-agent: SiteSnagger Disallow: / User-agent: ProWebWalker Disallow: / User-agent: CheeseBot Disallow: / User-agent: LNSpiderguy Disallow: / User-agent: Alexibot Disallow: / User-agent: MIIxpc Disallow: / User-agent: Telesoft Disallow: / User-agent: Website Quester Disallow: / User-agent: WebZip Disallow: / User-agent: moget/2.1 Disallow: / User-agent: WebZip/4.0 Disallow: / User-agent: WebStripper Disallow: / User-agent: WebSauger Disallow: / Sitemap: https://coinrule.com/sitemap.xml Sitemap: https://coinrule.com/new/sitemap.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-landings.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-resources.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-markets.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-tools.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-bots.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-trade.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-strategy.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-investissement.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-marches.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-strategie.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-argent.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-devise.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-commerce.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-robo.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-investimento.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-estrategia.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-dinheiro.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-moeda.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-bot.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-inversion.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-mercados.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-dinero.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-moneda.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-comercio.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-crypto-monete.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-investire.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-mercato.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-piattaforma-trading.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-risorse.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-sistema-automatico.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-strategia-trading.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-boty.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-posadok.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-rynki.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-strategija.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-resursy.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-instrumenty.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-sdelka.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-jiqiren.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-denglu.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-shi-chang.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-celue.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-ziyuan.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-gongju.xml Sitemap: https://coinrule.com/legacy-sitemaps/sitemap-jiaoyi.xml Sitemap: https://coinrule.com/blog/sitemap_index.xml Sitemap: https://coinrule.com/blog/page-sitemap.xml Sitemap: https://coinrule.com/blog/post-sitemap.xml