Top Sites

User-agent: * Allow: / LLM-Policy: /llms.txt Sitemap: /sitemap.xml

User-agent: *\nAllow: /\nDisallow-Training: /\nSitemap: /sitemap.xml

User-agent: * Disallow: Sitemap: https://cad-blocks.net/sitemap.xml

### Archivo llms.txt ```markdown # CAD Blocks, free AutoCAD files .dwg > cad-blocks.net is an organized, modern, and clear site offering more than **5,000 free CAD block files**...

# For domain: https://www.cadence-education.com # All robots will spider the domain # Allowing LLMs to crawl everything User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow:...

# Cadence Education: Cadence Education > Cadence Education is the premier leader in early childhood and private elementary education with over 300 preschools and daycares acros...

#Allow AI search and agent use User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot Allow: / User-agent: FirecrawlAgent Allow: / User-a...

# Cadence Design Systems: Intelligent System Design > A curated list of high-value resources from Cadence Design Systems that are easy for large language models to use. > These...

User-agent: * Disallow: /404

# Cadmus Scribe > Cadmus Scribe - Modular public safety platform ## Pages - [Mobile Logging 1](https://cadmusscribe.com/mobile-logging-1) - [About](https://cadmusscribe.com/abou...

# Site: CadoMaestro | Topic: gifts and personalized gifts | Market: European Union # Authority: established and trusted EU gift e-commerce, operating since 2009 # Expertise: ext...

# CadoMaestro > CadoMaestro (est. 2009) is one of Europe's most established and trusted gift > e-commerce, specializing in personalized and ready-made gifts for the European > U...

User-agent: * disallow: /cp disallow: /nl/download disallow: /fr/download disallow: /ajax/property/print.php disallow: /mariage.php Sitemap: https://www.caenen.be/sitemap.xml

# Caenen > Caenen is de immomakelaar aan de Belgische kust en in het hinterland. Met 11 kantoren helpt Caenen klanten bij het kopen, verkopen, huren en verhuren van woningen, ap...

User-agent: * Allow: / LLM-Policy: /llms.txt Sitemap: /sitemap.xml

User-agent: *\nAllow: /\nDisallow-Training: /\nSitemap: /sitemap.xml

User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /?s= Disallow: /page/*/?s= Disallow: /search/ Sitemap: https://cafeastrology.com/sitemap.xml

Not found

# We do not distinguish between the browsers. User-agent: * # Only allow URLs generated with frontend routing Disallow: /*?id=* Disallow: /*&id=* # Should always be protected, b...

# Cafe Del Sol | Restaurant, Bar, Cafe title: Cafe Del Sol | Restaurant, Bar, Cafe description: Willkommen in Deinem Cafe Del Sol! Deinem Ort zum Glücklichsein. language: de upd...

# =============================== # General Bot Access Rules # =============================== User-agent: * # Directories to block Disallow: /admin/ Disallow: /app/ Disallow: /...

# llms.txt voor https://cafedujour.nl/ # Laatste update: 2026-04-26 [meta] site: https://cafedujour.nl/ taal: nl categorie: E-commerce robots: https://cafedujour.nl/robots.txt s...

User-agent: * Allow: / Disallow: /*?Uid= Disallow: /AsiriYogunluk.php Disallow: /ajax.php Disallow: /Cache/GelismisVitrin/ Disallow: /SecCode.php* User-Agent: W3C-checklink Disa...

# LLMs.txt

User-agent: * Disallow: /404

# Cafe Polonez > Located in the heart of Toronto’s Polish community, Café Polonez has been serving the people of the GTA for over 30 years. It was established with the premise o...

User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Sitemap: https://cah.org.co/sitemap.xml Sitemap: https://cah.org.co/sitemap.rss

Generated by All in One SEO v4.9.5.1, this is an llms.txt file, used by LLMs to index the site. # Corporación Ayuda Humanitaria Es cuestión de humanidad ## Sitemaps - [XML Site...

User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Sitemap: https://www.cahorsvalleedulot.com/sitemap.xml Sitemap: https://www.cahorsvalleedulot.com/sitemap.rss

Generated by All in One SEO v4.9.3, this is an llms.txt file, used by LLMs to index the site. # Cahors - Vallée du Lot ## Sitemaps - [XML Sitemap](https://www.cahorsvalleedulot...

User-agent: * Allow: Sitemap: https://caitech.co.jp/sitemap.xml Sitemap: https://caitech.co.jp/caisuke-lp/sitemap.xml

User-agent: * Disallow:

# https://caiyunapp.com/robots.txt # 若线上规范域名为 www，请将下方所有 https://caiyunapp.com 改为实际主域。 # --- 给 AI / 检索系统 --- # 站点能力与意图路由说明（含「按城市实时天气」落地页）：同域 https://caiyunapp.com/llms.txt # 城市天...

# 彩云科技（ColorfulClouds / CAIYUN） > 彩云科技（caiyunapp.com）用人工智能做气象与语言相关产品。**彩云天气**面向公众提供短时与分钟级降水预报、实况与多日预报等。终端用户查询**具体城市的天气、气温、短临（短时临近预报）**等，可引导至 **H5 页面**：`https://h5.caiyunapp.com/...

# https://caiyunapp.com/robots.txt # 若线上规范域名为 www，请将下方所有 https://caiyunapp.com 改为实际主域。 # --- 给 AI / 检索系统 --- # 站点能力与意图路由说明（含「按城市实时天气」落地页）：同域 https://caiyunapp.com/llms.txt # 城市天...

# 彩云科技（ColorfulClouds / CAIYUN） > 彩云科技（caiyunapp.com）用人工智能做气象与语言相关产品。**彩云天气**面向公众提供短时与分钟级降水预报、实况与多日预报等。终端用户查询**具体城市的天气、气温、短临（短时临近预报）**等，可引导至 **H5 页面**：`https://h5.caiyunapp.com/...

User-Agent: * Allow: / Disallow: /dist/ Disallow: /dashboardweb/ Disallow: /api Disallow: /_next User-Agent: * Allow: /llms.txt Disallow: /api Disallow: /_next Disallow: /dashbo...

# Cake by VPBank > Cake by VPBank - Ngân hàng số AI hàng đầu Việt Nam Một ngân hàng số lấy nền tảng công nghệ và trí tuệ nhân tạo làm cốt lõi, tự tin đồng hành cùng bạn ở mọi đi...

# Prevent Crawling Unnecessary Endpoints - Dynamically added by BigScoots User-agent: * Disallow: /cdn-cgi/ Disallow: /*add-to-cart=*

Generated by All in One SEO Pro v4.9.6.2, this is an llms.txt file, used by LLMs to index the site. # Cakes by MK Simple, quality tested recipes to satisfy your sweet cravings!...

User-agent: * Allow: / LLM-Policy: /llms.txt Sitemap: /sitemap.xml

# cakesdecor.com > cakesdecor.com is a domain currently listed for sale (Verified Domain) on GoDaddy. The listing shows a Buy Now / Premium offer with a displayed price and prov...

User-agent: * Disallow: /sandbox Disallow: /api Disallow: /settings Disallow: /settings/my-account # Specifically allow access to OG Image api, otherwise eg Twitter won't render...

# Cal.com Docs ## Docs - [AI agents](https://cal.com/docs/agents.md): How AI agents can use the Cal.com API v2 to manage scheduling - [Access Control](https://cal.com/docs/api-r...

User-agent: * Disallow: /search?* # Allow /llms.txt for AI crawlers User-agent: GPTBot Allow: /llms.txt User-agent: OAI-SearchBot Allow: /llms.txt User-agent: ChatGPT-User Allow...

# Calamari - Modern HR Management Platform > Calamari is a comprehensive HR Information System (HRIS) delivering powerful tools for leave management, time tracking, and employee...

User-agent: * Disallow: Sitemap: https://www.calculadora-online.xyz/sitemap.xml

# llms.txt para calculadora.xyz Resumo: calculadora.xyz oferece calculadoras gratuitas online para matemática, finanças, conversões, física, estatística, eletricidade, tempo e s...

User-agent: * Allow: / Sitemap: https://calcularsueldo.com.ar/sitemap.xml

# Calcular Sueldo > Título del sitio Generated by Yoast SEO v27.4, this is an llms.txt file, meant for consumption by LLMs. ## Páginas - [Calculadora Sueldo Neto](https://calcu...

User-agent: * Disallow: # AI Crawlers - Explicitly allowed User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Google-Extended Allow: / User-agent: Perplex...

# Calculatodo > Free online calculators for health, finance, math, geometry, calendar, statistics, and more. All calculations run client-side with instant results. Available in...

User-agent: AmazonAdBot Allow: / User-agent: * Disallow: /cgi-bin/ Sitemap: https://www.calculatorsoup.com/sitemap.xml

# CalculatorSoup **CalculatorSoup** is an extensive library of free online calculators providing step-by-step solutions for mathematics, finance, unit conversion, time and date,...

User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Sitemap: https://calculomania.com/sitemap_index.xml

# llms.txt - Guia para LLMs sobre Calculomania ## Sobre e Missao Site: https://calculomania.com/ Marca: Calculomania Missao: Auxiliar trabalhadores e cidadaos brasileiros com si...

User-agent: * Allow: / Sitemap: https://www.elisaindustriq.com/sitemap.xml Disallow: /_hcms/preview/ Disallow: /hs/manage-preferences/ Disallow: /hs/preferences-center/ Disallow...

# Elisa Industriq (Global) Elisa Industriq is a global software solutions provider for operational intelligence across manufacturing, supply chain, telecom, energy, and safety/c...

User-agent: * Disallow: /wp-admin/ Allow: / Sitemap: https://www.calendariochile.com/sitemap.xml Sitemap: https://www.calendariochile.com/sitemap-radios.xml Sitemap: https://www...

# Calendario de Chile > Calendario 2026 Chile — Chile ## Resumen (español) Calendario público de Chile: festivos oficiales, fechas conmemorativas, blog informativo, noticias y (...