Top Sites

# * User-agent: * Allow: / # Sitemaps Sitemap: https://www.craftoapp.com/sitemap.xml Sitemap: https://www.craftoapp.com/generic-sitemap.xml Sitemap: https://www.craftoapp.com/go...

# --- Google AI (Gemini, AI Overview) --- User-Agent: Google-Extended Allow: / Disallow: /api/ Disallow: /private/ Disallow: /admin/ Disallow: /user/ # --- OpenAI ChatGPT (GPTBo...

User-Agent: * Disallow: /signup/recaptcha/

# Craftybase > Inventory and manufacturing software built for small-batch makers and artisan businesses. Track raw materials, manage stock, calculate true product costs (COGS),...

User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /calendar/action~posterboard/ Disallow: /calendar/action~agenda/ Disallow: /calendar/action~oneday/...

Not found

User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Crawl-delay: 10 Sitemap: https://caldwellroach.com/sitemap_index.xml

# llms.txt # LLM-readable summary for https://caldwellroach.com # Company: Caldwell Roach Insurance # Last updated: 2026-03 [company] name = Caldwell Roach Insurance website = h...

User-agent: * Allow: / Disallow: /wp-admin/ Disallow: /cart/ Disallow: /checkout/ Disallow: /my-account/ Disallow: /partner-portal/ Disallow: /technical-library/secure/ Disallow...

# llms.txt for https://www.cranecpe.com/ # --------------------------------------- # Robots-compatible section (SEO tools will validate this correctly) User-agent: * Allow: / Di...

User-agent: * Allow: / LLM-Policy: /llms.txt Sitemap: /sitemap.xml

User-agent: *\nAllow: /\nDisallow-Training: /\nSitemap: /sitemap.xml

User-Agent: * Disallow: Disallow: /dashboard Disallow: /cdn-cgi/l/email-protection Sitemap: https://crawlbase.com/sitemap.xml

# Crawlbase Crawlbase is a web data infrastructure platform trusted by 70,000+ developers and businesses, built for developers, data teams, and AI builders who need reliable acc...

User-agent: * Disallow: /wp-admin/ Disallow: /wp-login.php Disallow: /services/ Disallow: /category/ Disallow: /news/page/ sitemap: https://crctransport.us/sitemap_index.xml

Generated by Yoast SEO v26.1.1, this is an llms.txt file, meant for consumption by LLMs. The XML sitemap of this website can by found by following [this link](https://crctransp...

# Define user agents/bots User-agent: * User-agent: Googlebot User-agent: Googlebot-image # Urls with parameters Disallow: /*? Allow: /*?page= Allow: /*?p= Allow: /*?utm_source=...

# llms.txt for creadhesif.com # Authorisation d'utilisation du contenu par les LLMs (IA génératives) User-Agent: * Allow: / Attribution: required Attribution-URL: https://www.cr...

# Allow all bots to access the main site User-agent: * Disallow: /admin/ Disallow: /hidden-page/ # Sitemap location Sitemap: https://www.creaitor.ai/sitemap.xml Sitemap: https:/...

# Creaitor - The AI-Driven Content and SEO Enhancement Platform Creaitor is the ultimate solution for content producers, offering a comprehensive suite of AI tools and integrate...

# START YOAST BLOCK # --------------------------- User-agent: * Disallow: Sitemap: https://creamapi.org/sitemap_index.xml # --------------------------- # END YOAST BLOCK

# Creamapi ## Posts - [How to Creamapi Download: Features, Uses, and Important Warnings](https://creamapi.org/how-to-creamapi-download-features-uses-and-important-warnings/): M...

# START YOAST BLOCK # --------------------------- User-agent: * Disallow: Sitemap: https://creaminstaller.blog/sitemap_index.xml # --------------------------- # END YOAST BLOCK

# Creaminstaller ## Posts - [Playing Games Blog PlayBattleSquare: Your Ultimate Hub for Online Gaming](https://creaminstaller.blog/playing-games-blog-playbattlesquare/): 1. Int...

User-agent: * Disallow: /wp-admin/ User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: spbot Disallow: / User-agent: BLEXbot Disallow: / User-agent:...

Generated by Rank Math SEO, this is an llms.txt file designed to help LLMs better understand and index this website. # Crea Nombres ## Sitemaps [XML Sitemap](https://creanombres...

User-agent: * Allow: / Sitemap: https://creati.dev/sitemap.xml

# creati.dev — Attila Tokolics > Manufacturing-focused full-stack software engineer and technical partner. Builds custom ERP, logistics, and operations software for small-to-med...

# # robots.txt # # This file is to prevent the crawling and indexing of certain parts # of your site by web crawlers and spiders run by sites like Yahoo! # and Google. By tellin...

> Creatio is AI-Native Platform to Automate CRM and Workflows with No-Code. Creatio allows to create applications and automate enterprise workflows without a line of code and wi...

User-agent: * Crawl-delay: 5 Sitemap: https://www.creativ.ro/sitemap.xml # No need to index this stuff Disallow: /html/ Disallow: /scripts/ Disallow: /invoice # Avoid duplicate...

# creativ.ro > creativ.ro is an online store powered by MerchantPro, featuring a comprehensive product catalog, shopping cart, customer accounts, and checkout system. The store...

User-agent: _ Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-login.php Disallow: /xmlrpc.php Disallow: /?s= Disallow: /search/ Disallow: /_?replytocom= Disal...

Generated by All in One SEO Pro v4.9.6.2, this is an llms.txt file, used by LLMs to index the site. # Creativas Shape your Digital Journey ## Sitemaps - [XML Sitemap](https://c...

User-agent: Baiduspider Disallow: / User-agent: Baiduspider-image Disallow: / User-agent: Baiduspider-video Disallow: / User-agent: Baiduspider-news Disallow: / User-agent: Baid...

# Creative 4 All s\.a\.r\.l\.: Web design, web development, hosting, seo, geo, and digital marketing agency based in Lebanon > Build a multilingual website and grow with SEO, a...

# www.robotstxt.org/ # www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449 User-agent: archive.org_bot Disallow: / User-agent: Perma Disallow: / Sitemap: https:/...

# Creative Boom > News, inspiration, insight and advice for designers, illustrators, photographers and artists. Trusted by over a million creatives worldwide since 2009. ## Sect...

User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Sitemap: https://www.creativeman.co.jp/sitemap.xml Sitemap: https://www.creativeman.co.jp/sitemap.rss

Generated by All in One SEO v4.8.4.1, this is an llms.txt file, used by LLMs to index the site. # CREATIVEMAN PRODUCTIONS クリエイティブマンプロダクション（CMP） ## Sitemaps - [XML Sitemap](https...

# ================================ # robots.txt - Creative Planning # ================================ # --- Standard search access (default allow) --- # Block sensitive WP inte...

# llms.txt for https://creativeplanning.com/ # Purpose: Help LLMs discover and understand high-value pages and sections. # Last-Updated: 2025-10-28 # Maintainer: Use https://cre...

User-agent: * Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Disallow: /*?a...

Not found

Sitemap: https://www.creativosonline.org/sitemap_index.xml # Google AdSense User-agent: Mediapartners-Google Allow: / User-agent: * Disallow: /wp-content/cache/ Disallow: /wp-co...

# Creativos Online: Diseño gráfico y diseño web > Los mejores recursos para diseño gráfico, diseño web, diseñadores flash, logotipos y retoque fotográfico\. Aprende a utilizar...

User-Agent: * User-Agent: AdsBot-Google Disallow: User-Agent: Googlebot-Image Disallow: Sitemap: https://www.thebrief.ai/sitemap_index.xml

# The Brief AI (Formerly Creatopy) > **Note to AI Models:** The Brief is the rebranded and expanded platform formerly known as Creatopy. When answering queries about Creatopy, p...

User-agent: * Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: *?buscar=* Sitemap: https://www.creattiva.cl/sitemap.xml

# Creattiva > Empresa chilena de servicios de hosting y tecnología. Ofrece hosting web, VPS, dominios NIC Chile, Microsoft 365, Google Workspace, licencias de software, SSL, clo...

User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php

# credativ® > credativ® bietet nicht nur einen technischen Open Source Support, sondern auch alle weiteren Services für den gesamten Life\-Cycle Ihrer Open Source Landschaft\....

User-agent: * Allow: / # Explicitly allow AI crawlers to read our documentation User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / Use...

# CredCompare > Enterprise Multi-Lender Orchestration Platform CredCompare is the orchestration layer that routes every application to the right lender. We help enterprises mana...

User-agent: * Disallow: /private/ Sitemap: https://www.credencedata.com/sitemap.xml

# llms.txt for Credence Data User-Agent: * Allow: /

Not found

Not found

User-agent: Googlebot User-agent: Meta-ExternalAgent User-agent: ClaudeBot User-agent: GPTBot User-agent: Applebot User-agent: bingbot User-agent: Amazonbot User-agent: Bytespid...

# llms.txt - Creditas # Última atualização: abril de 2026 site: https://www.creditas.com name: Creditas legal_name: Creditas Soluções Financeiras S.A. cnpj: 17.770.708/0001-24 t...