Top Sites

# Disallow all crawlers access to certain pages. User-agent: * Disallow: /img/* Disallow: /account* Disallow: /login* Disallow: /checkout* Disallow: /busca* Disallow: /quick-vie...

Not found

User-agent: * Disallow: /admin/ Disallow: /brand/dashboard Disallow: /brand/campaign/*/edit Disallow: /api/ Disallow: /log/ Disallow: /brand/create-campaign? Allow: / Allow: /br...

# CollabPals > CollabPals is a SaaS platform for organic YouTube growth through creator collaboration. 222,000+ registered creators across 32+ languages use it to exchange shout...

User-agent: * Disallow: /ajax/ Disallow: /events/ Disallow: /admin/ Disallow: /images/ Disallow: /upload/ Disallow: /*?cta=* Disallow: /*?place=* Disallow: /*?type_of_click=* Di...

# CollegeSearch.in - AI Assistant Information ## About CollegeSearch.in CollegeSearch is India's most trusted education platform, serving over 15 million students and partnered...

# Disallow all crawlers access to certain pages. User-agent: * Disallow: /img/* Disallow: /account/* Disallow: /login/* Disallow: /checkout/* Disallow: /busca/* Disallow: /quick...

Not found

# Disallow all crawlers access to certain pages. User-agent: * Disallow: /img/* Disallow: /account/* Disallow: /login/* Disallow: /checkout/* Disallow: /busca/* Disallow: /quick...

Not found

User-agent: * Allow: / Sitemap: https://comnexia.com/sitemap-index.xml # AI Crawler directives User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Google-E...

# COMNEXIA Corporation > Atlanta's premier automotive dealership IT specialists since 1991. Family-owned MSP providing managed IT services, DMS hosting, cybersecurity, VoIP, clo...

# Disallow all crawlers access to certain pages. User-agent: * Disallow: /Account/ Disallow: /checkout/ Disallow: /Site/TagDetalhe.aspx Disallow: /quick-view Allow: /institucion...

Not found

User-agent: * Allow: / User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended...

# Confetti > Confetti is an event management platform that makes it easy to create, manage, and sell tickets for events. Confetti provides tools for event organizers including t...

User-agent: * Disallow: */api/ Disallow: /ajax Disallow: */graphql Disallow: /error-pages/* Disallow: /painel/ Disallow: /checkout/ Disallow: /admin/ Disallow: /u/ Disallow: /pr...

# Consulta de Processos > Plataforma brasileira de consulta e monitoramento de processos judiciais por CPF e CNPJ, com cobertura nacional (tribunais estaduais, federais e superi...

User-agent: * Allow: / # AI crawlers (explicitly allowed) User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web All...

# Contele Teams > Sistema para gestão de equipes externas com monitoramento em tempo real. ## O que é Contele Teams é um SaaS brasileiro para gestão de equipes externas (vendas,...

User-Agent: * Allow: / Disallow: /api/ Disallow: /contractor/ Disallow: /owner/ Disallow: /admin/ User-Agent: GPTBot Allow: / Disallow: /api/ Disallow: /contractor/ Disallow: /o...

# ContractorsNearMe.ai > Find licensed contractors in your area. 141,000+ verified profiles across 50 US states. ## Docs - [Full Documentation](/llms-full.txt): Complete site do...

User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / User-agent: * Allow: / Sitemap: https://conv...

# Convalytrix > La prima piattaforma di digital analytics italiana — traccia il 100% dei dati del tuo sito in modo GDPR compliant con modelli di attribuzione machine-learning p...

User-agent: * Disallow: /admin/ Disallow: /api/ Disallow: /dashboard/ Disallow: /settings/ Disallow: /reset-password Allow: / # AI search bots — allow for citation and AI search...

# ConvertFiles.com > Free online file converter supporting 300+ formats. Convert documents, images, videos, audio, archives, eBooks, presentations, and drawings instantly withou...

# 1. Allow AI crawlers User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / # 2. Access for Search...

# ConveyThis - Website Translation & Localization > ConveyThis provides AI-powered website translation for 120+ languages with CMS plugins and a universal JS snippet. This file...

User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /customer-agreement/previous-versions/rev-april-15-2019/ Disallow: /experience-insights-free-trial/

# Conviva > Conviva is the consumer-perspective analytics platform for the agentic era. It uncovers behavioral patterns and intent driving outcomes across apps, websites, and AI...

User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Sitemap: https://www.cookiebot.com/sitemap_index.xml Sitemap: https://www.cookiebot.com/en/sitemap_index.xml S...

# Cookiebot > Cookiebot ## Other Pages - [Home Page](https://www.cookiebot.com/): PROTECTING PRIVACY The Internet has changed. Today, a trillion-dollar data economy is driving u...

User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Sitemap: https://www.cookiebot.com/sitemap_index.xml Sitemap: https://www.cookiebot.com/en/sitemap_index.xml S...

# Cookiebot > Cookiebot ## Other Pages - [Home Page](https://www.cookiebot.com/): PROTECTING PRIVACY The Internet has changed. Today, a trillion-dollar data economy is driving u...

# ALLOWs QUE DEBEN ESTAR SIEMPRE User-agent: * Allow: /*.css Allow: /*.jpeg Allow: /*.js Allow: /*.png Allow: /*.webp Allow: /*.jpg # URLS NO DEBEN APARECER User-agent: * Disall...

Not found

User-agent:* disallow:/live/

llms

User-agent: * Sitemap: https://www.coolutils.com/sitemap.xml Disallow: /cdn-cgi/l/email-protection Allow: /*.css Allow: /*.js Allow: /*.jpg Allow: /*.png Allow: /*.svg Allow: /*...

# CoolUtils File Converters > CoolUtils has been a reliable developer of 19 different file converters since 2003. Convert PDF, HTML, XLS, DOC, emails or images - we support over...

User-Agent: * Allow: / Disallow: /*.segments Disallow: /*%24d%24* Disallow: /*__PAGE__* Disallow: /*__SLOT__* Disallow: /*.segment.rsc Disallow: /*/_tree Disallow: /*/_index Dis...

# coorum（コーラム）| Asobica, Inc. > coorumは、コミュニティ運営からロイヤル顧客のデータ分析をワンストップで行い、LTVの最大化と新規顧客獲得の効率化を実現するカスタマーサクセスプラットフォームです。 ## プロダクト - [coorum トップ](https://coorum.jp/): サービス概要 - [コミュニテ...

# As a condition of accessing this website, you agree to abide by the following # content signals: # (a) If a Content-Signal = yes, you may collect content for the corresponding...

Not found

User-agent: * Allow: / Sitemap: https://www.kaily.ai/sitemap.xml

## 1. Introduction Kaily AI enables businesses to create custom ChatGPT solutions for their websites. These AI-powered chatbots engage users, automate tasks, handle customer sup...

User-Agent: * Allow: / Disallow: /studio/ Disallow: /api/ User-Agent: OAI-SearchBot Allow: / Disallow: /studio/ Disallow: /api/ User-Agent: Claude-SearchBot Allow: / Disallow: /...

# Copysmith > Copysmith is the parent company behind three specialized AI platforms — Frase, Describely, and Rytr — that together form the first GEO-native content infrastructur...

User-agent: * # Magento internal routes (not public-facing, all use URL rewrites) Disallow: /index.php/ Disallow: /catalog/ Disallow: /catalogsearch/ Disallow: /checkout/ Disall...

# coquedirect.fr > RR Commerce Europe B.V. — Online store for phone cases, tablet covers, and device accessories. ## About - Website: https://www.coquedirect.fr - Product catego...

User-agent: * Allow: /.well-known/ Allow: /hotels/sapi/json_offers.php Allow: /llms.txt Allow: /ai-instructions.txt Allow: /.well-known/openapi.json Sitemap: https://corissia.co...

# Corissia Resorts AI Context Title: Corissia Dynamic Pricing API Description: Official guidance for AI agents to retrieve live pricing, availability, and offers for Corissia Re...

User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-login.php Disallow: /xmlrpc.php Disallow: /?s= Disallow: /search/ Crawl-delay: 3 # AI crawlers:...

# Costa del Sol Noticias ## Perfil Editorial - Medio: Costa del Sol Noticias - Dominio canónico: costadelsolnoticias.com - Ámbito geográfico principal: Costa del Sol, Málaga y m...

User-Agent: * Allow: / Disallow: /auth/ User-Agent: GPTBot User-Agent: OAI-SearchBot User-Agent: ChatGPT-User User-Agent: ClaudeBot User-Agent: Claude-SearchBot User-Agent: Clau...

# Counterwatch > Counterwatch is a free desktop companion app for Overwatch and Marvel Rivals. > It provides real-time counter picks, hero matchup data, team composition > analy...

User-agent: * Allow: / Sitemap: https://country.is/sitemap.xml

# Country > Country is a free IP geolocation API. Given an IP address, it returns the corresponding ISO 3166-1 alpha-2 country code. Optionally, it can return extra fields such...

User-agent: * Disallow: LLMs-txt: https://www.couponmoto.com/llms.txt

# CouponMoto — India's Trusted Coupon & Discount Platform ## About CouponMoto (couponmoto.com) is one of India's leading coupon and discount platforms, founded in 2017 and headq...