Top Sites

User-agent: * Disallow: /_hcms/preview/ Disallow: /hs/manage-preferences/ Disallow: /hs/preferences-center/ Disallow: /*?*hs_preview=* Disallow: /*?*hsCacheBuster=*

# www.dstny.se > Dstny är en ledande europeisk leverantör av molnbaserad affärskommunikation, vi strävar efter att förenkla vardagen för mer än 3 miljoner användare. Covers 61...

User-agent: * Allow: / Sitemap: https://www.dtelecom.org/sitemap.xml

# dTelecom > Enterprise-grade decentralized real-time communication (dRTC) infrastructure — voice, video, chat, and livestreaming APIs/SDKs for developers and businesses. Flat b...

User-Agent: * Allow: / Disallow: /customer Disallow: /checkout Disallow: /busca?n=*&*

Not found

User-agent: * Sitemap: https://dulichviet.com.vn/sitemap.xml Sitemap: https://dulichviet.com.vn/ai-sitemap.xml Disallow: /quantri Disallow: /quanly Disallow: /thong-bao Disallow...

# Du Lịch Việt (dulichviet.com.vn) > Công ty lữ hành hàng đầu Việt Nam. Chuyên tour trong nước, quốc tế và dịch vụ visa. --- ## AI INSTRUCTIONS PRIMARY DATA SOURCES: - https://d...

# Dupple.com Robots.txt User-agent: * Allow: / # AI Search Bots — explicitly allowed User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot Allo...

# Dupple > Dupple is a media and education company that helps 500,000+ professionals stay ahead with daily AI and tech newsletters, a curated directory of 237+ AI tools, and an...

User-agent: * Disallow: Sitemap: https://duve.com/sitemap_index.xml

# Duve > Duve is a guest experience platform for hotels, hostels, and vacation rentals. Used by 1,000+ hospitality brands across 70+ countries, Duve digitizes the entire guest j...

# Disallow all crawlers access to certain pages. User-agent: * Disallow: /img* Disallow: /account* Disallow: /login* Disallow: /checkout* Disallow: /busca* Disallow: /quick-view...

Not found

User-agent: * Disallow: /index.php/ Disallow: /*? Disallow: /checkout/ Disallow: /app/ Disallow: /lib/ Disallow: /*.php$ Disallow: /pkginfo/ Disallow: /report/ Disallow: /var/ D...

# http://www.dynamism.com llms.txt > Dynamism is the industry-leading provider of advanced industrial and professional 3D printing solutions since 1997. We deliver enterprise-g...

# Robots.txt for https://www.e-1.ru # Мебельная фабрика Е1 — шкафы-купе и гардеробные # Default rules for all bots User-agent: * Allow: / Disallow: /api/ Disallow: /e1admin/ Dis...

# Мебельная фабрика Е1 > Производитель корпусной мебели с 2007 года ## О компании Мебельная фабрика Е1 — российский производитель шкафов-купе и корпусной мебели. Производство ра...

# If the Joomla site is installed within a folder # eg www.example.com/joomla/ then the robots.txt file # MUST be moved to the site root # eg www.example.com/robots.txt # AND th...

# llms.txt e-dimensionz Inc. is a developer-owned Canadian web development company offering custom development, integrations, AI solutions, and hosting. This file provides struc...

User-Agent: * Allow: / Sitemap: https://e2b.dev/sitemap.xml

# E2B Docs ## Docs - [E2B Documentation](https://e2b.mintlify.app/docs.md) - [Amp](https://e2b.mintlify.app/docs/agents/amp.md): Run Amp in a secure E2B sandbox with full filesy...

User-Agent: * Allow: / Sitemap: https://e2b.dev/sitemap.xml

# E2B Docs ## Docs - [E2B Documentation](https://e2b.mintlify.app/docs.md) - [Amp](https://e2b.mintlify.app/docs/agents/amp.md): Run Amp in a secure E2B sandbox with full filesy...

User-agent: * # No permitir que los rastreadores accedan a determinadas paginas: Disallow: /admin/* Disallow: /account* Disallow: /p?idsku=* Disallow:/*?map=category* Disallow:/...

Not found

# Disallow all crawlers access to certain pages. User-agent: * Disallow: /Account* Disallow: /account* Disallow: /Busca/ Disallow: /CallCenter/ Disallow: /CEM/ Disallow: /checko...

Not found

User-agent: * Allow: / # Disallow admin paths Disallow: /firebase.json # Explicitly allow AI search bots User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / Use...

# EasyApps Ecommerce — Full Content Reference > This file contains the full text content of key pages on easyappsecom.com. For a summary index, see [llms.txt](https://easyappsec...

User-Agent: * Allow: / Disallow: /api/ Disallow: /dist/ Disallow: /.git/ Disallow: /admin/ Disallow: /*?*utm_* Disallow: /node_modules/ User-Agent: GPTBot Allow: / User-Agent: C...

# Eazybe > WhatsApp AI Agents for Sales Teams. Sync every WhatsApp conversation with your CRM automatically. Qualify leads with AI, detect deals going cold, and automate follow-...

# eCardWidget - AI Agent & Search Engine Friendly # Last updated: 2026-04-17 # Default: allow everything except internal paths User-agent: * Disallow: /wp-admin/ Disallow: /ex/...

# eCardWidget > eCardWidget is a digital greeting card platform serving 9,000+ organizations across 50+ countries. It enables businesses, nonprofits, healthcare organizations, s...

User-agent: * Disallow: /index.php/ Disallow: /addons/ Disallow: /admin/ Disallow: /api/ Sitemap: https://www.ece8.com/sitemap.xml

Not found

User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Sitemap: https://eco.sapo.pt/sitemap.xml Sitemap: https://eco.sapo.pt/sitemap-news.xml Disallow: /?s= Disallo...

<!DOCTYPE html> <!--[if IE 7]><html class="ie ie7" lang="pt-PT"><![endif]--> <!--[if IE 8]><html class="ie ie8" lang="pt-PT"><![endif]--> <!--[if !(IE 7) | !(IE 8) ]><!--><htm...

# ------------------------------------------------------------ # SITEMAP # ------------------------------------------------------------ Sitemap: https://economipedia.com/sitemap...

# Economipedia — Haciendo fácil la economía Economipedia es una plataforma de educación financiera en español. Desde 2012 ayuda a millones de personas a entender la economía, ap...

User-Agent: * Disallow: /bitrix/admin Disallow: /docs/ Disallow: /conf/ Disallow: *utm_ref* Disallow: *sphrase_id* Disallow: *SHOWALL_* Disallow: *?orderId=* Disallow: *formresu...

# Окна Москва – купить пластиковые окна и двери недорого от производителя > Пластиковые окна и двери в Москве недорого от производителя. Заказать ПВХ окна. Аксессуары и фурнитур...

User-Agent: * Disallow: /api/ Sitemap: https://edatone.com/sitemap.xml

<!DOCTYPE html> <html lang="zh"> <head> <meta charset="utf-8"> <meta http-equiv="x-ua-compatible" content="ie=edge"> <title>译达通翻译，实时双向翻译，精准好用的社交媒体翻译软件，出海首选，打破语言障碍。WhatsApp翻译，Te...

User-Agent: * Allow: / Allow: /works/ Allow: /search Allow: /notice Allow: /announcements Allow: /policy/ Disallow: /api/ Disallow: /chat/ Disallow: /my-* Disallow: /profile Dis...

# EdenChat > AI 캐릭터 채팅 플랫폼 — 나만의 캐릭터를 만들고 대화하세요. EdenChat은 사용자가 직접 캐릭터를 만들어 AI와 대화할 수 있는 플랫폼입니다. 다양한 장르의 작품과 캐릭터를 탐색하고, 몰입감 있는 롤플레이 채팅을 즐길 수 있습니다. ## 주요 기능 - 캐릭터 생성 및 커스터마이징 - A...

User-Agent: ChatGPT-User User-Agent: OAI-SearchBot User-Agent: GPTBot User-Agent: Google-Extended User-Agent: anthropic-ai User-Agent: ClaudeBot User-Agent: Claude-Web User-Agen...

# Edgeful > Edgeful is a trading analytics platform that analyzes 7+ years of exchange data to calculate historical probabilities across market conditions. traders use it to ide...

User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Sitemap: https://edheads.org/sitemap.xml

Not found

User-agent: * Allow: / # Allow all crawlers User-agent: * Allow: /llms.txt Allow: / # Specific directives for AI bots User-agent: anthropic-ai User-agent: Applebot-Extended User...

# Editage – Editage is a leading global provider of editing and publication support services for researchers > Editage, a trusted name in academic publishing support, offers a w...

# robots.txt optimizado para edorteam.com # Fecha: Octubre 2025 User-agent: * # Bloquear recursos y rutas innecesarias Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /cg...

Full Documentation: https://edorteam.com/llms-full.txt # Edorteam > Consultora tecnológica española líder en protección de datos, ciberseguridad y cumplimiento normativo para em...

User-agent: * # Directorios Disallow: /Account/* Disallow: /Matricula/* Disallow: /Campus/* Disallow: /Home/* # Sitemaps Sitemap: https://www.educalive.com/sitemap.xml Sitemap:...

<!DOCTYPE html> <html lang="es"> <head> <meta charset="UTF-8"> <meta name="viewport" content="width=device-width, initial-scale=1.0"> <meta http-equiv="X-UA-Compatible" conten...

# AI Training Crawlers (blocked — no search benefit) User-agent: ClaudeBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: CCBot Disallow: / User-agent: Bytespid...

# Educato > AI-powered exam preparation platform with 10,000+ exams, spaced repetition flashcards, adaptive study plans, and AI tutoring. Y Combinator S24. ## Main Pages - [Home...

User-agent: * Disallow: Allow: / Host: www.eft.com.br Crawl-delay: 10 Sitemap: https://www.eft.com.br/sitemap.xml

<!doctype html> <html lang="pt-br"> <head> <meta charset="UTF-8"> <meta http-equiv="X-UA-Compatible" content="IE=edge"> <meta name="viewport" content="width=device-width, initi...