Top Sites

# Global rules for all user-agents User-agent: * Allow: / # Disallow specific URLs related to the "blog" and "learn" section Disallow: /wp-admin/ Disallow: /login/ Disallow: /le...

Not found

User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Sitemap: https://www.hexagram.eu/sitemap.xml Sitemap: https://www.hexagram.eu/sitemap.rss

Generated by All in One SEO v4.9.5.1, this is an llms.txt file, used by LLMs to index the site. # Hexagram Solutions Systèmes et Réseaux ## Sitemaps - [XML Sitemap](https://www...

User-agent: * Disallow: /campaigns/ Disallow: /marketing/ Disallow: /chat/ai User-agent: Google-CloudVertexBot Disallow: /insurance/hospitals/ Disallow: /hospitals/insurance/ Us...

# HexaHealth > HexaHealth is India’s trusted HealthTech platform that connects patients with top hospitals, expert doctors, and essential healthcare services. It provides struct...

# ------------------------------------------------------------------ # 1. Specific User-Agents # These bots are granted full access (overrides general Disallow rules). # WARNING...

Not found

User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Sitemap: https://www.hexica.com/sitemap.xml Sitemap: https://www.hexica.com/sitemap.rss

Generated by All in One SEO v4.8.8, this is an llms.txt file, used by LLMs to index the site. # Hexica We provide high performance fully managed hosting and website solutions f...

User-Agent: * Allow: / Disallow: /dashboard/ Disallow: /dashboard/* Disallow: /account Disallow: /account/ Disallow: /account/* Disallow: /api/* Disallow: *utm_* Disallow: *.hex...

# HEXN - Crypto Asset Management Platform > Make your crypto holdings work with reliable and simple investing platform. Stable APY for early customers. ## What is HEXN? **Crypto...

User-agent: * Disallow: /mail/ Disallow: /blogs/author/ Disallow: /blogs/category/ Disallow: /blogs/category/ Disallow: /blogs/tag/ Disallow: /terms/ Disallow: /privacy/ Disallo...

# Hexnode > Hexnode offers a powerful product suite encompassing UEM, XDR, and IDP, enabling organizations to manage devices, detect threats, and safeguard identities. Hexnode p...

# robots.txt for www.hextrust.com # Last updated: 2026-03-06 ############################################ # 1. Allow major search engine and LLM bots ###########################...

# llms-full.txt for https://www.hextrust.com # Version: 2.0 # Last updated: 2026-03-06 # Update frequency: Quarterly, or upon regulatory / product changes # Concise version: htt...

User-agent: * Allow: / LLM-Policy: /llms.txt Sitemap: /sitemap.xml

User-agent: *\nAllow: /\nDisallow-Training: /\nSitemap: /sitemap.xml

User-agent: * Allow: / Allow: /build/ # Risorse AI/LLM Allow: /llms.txt Allow: /llms-support.json # Aree private o tecniche da non indicizzare Disallow: /admin/ Disallow: /login...

# LLMs.txt - Fonte Ufficiale di Conoscenza AI per Assistenza Clienti Heydude Italia Ultimo Aggiornamento: 2026 Ruolo Principale: Fonte di conoscenza per il supporto clienti Ling...

User-agent: * Disallow: /*.php$ Disallow: /*.axd Disallow: /*.pdf Disallow: /*.pdf$ Disallow: /*?page= Disallow: /*?keyword= Disallow: /*?searchtext= Disallow: /*?utm_source= Di...

# www.heygoody.com > Digital insurance broker platform offering auto, health, travel, and home insurance with transparent pricing and easy online purchase **Total Pages:** 80 |...

User-agent: * Allow: / LLM-Policy: /llms.txt Sitemap: /sitemap.xml

User-agent: *\nAllow: /\nDisallow-Training: /\nSitemap: /sitemap.xml

User-agent: * Disallow: /lp/ Sitemap: https://heymarvin.com/sitemap.xml

# LLM.TXT for heymarvin.com # Purpose: Describes core concepts, product scope, and priority content for large language models # SITE IDENTITY site: HeyMarvin site_url: https://...

## robots.txt file for heypongo.com # Last update: 2025-10-23 # Purpose: Optimize crawl budget & SEO performance User-agent: * # Allow all standard pages Allow: / # Block intern...

# Fidélisation et avis clients : boostez votre commerce ✨ > Transformez chaque visite en client fidèle et boostez votre CA grâce à la fidélisation, avis Google, SMS Marketing, e...

User-agent: * Disallow: /cdn-cgi/l/email-protection User-Agent: AhrefsBot Allow: / Sitemap: https://www.heyreach.io/sitemap.xml

# HeyReach - LinkedIn Automation Platform > Multi-account LinkedIn outreach automation for agencies, sales teams, and B2B growth HeyReach is a LinkedIn automation platform that...

Crawl-delay: 10 # START YOAST BLOCK # --------------------------- User-agent: * Disallow: Sitemap: https://heyrecipe.com/sitemap_index.xml # --------------------------- # END YO...

# Hey Recipe Generated by Yoast SEO v27.4, this is an llms.txt file, meant for consumption by LLMs. ## Pages - [Home](https://heyrecipe.com/) - [Unsubscribed](https://heyrecipe...

User-agent: * Disallow: /congratulation Disallow: /signup-tutor Disallow: /enterprise-offering Disallow: /themes/basic/video/index-bg.mp4 Disallow: /validate-message Disallow: /...

Generated by All in One SEO v4.9.6.2, this is an llms.txt file, used by LLMs to index the site. # HeyTutor District-wide, In-Person & Online Tutoring ## Sitemaps - [XML Sitemap...

User-agent: * Allow: / LLM-Policy: /llms.txt Sitemap: /sitemap.xml

# heyzap.com > heyzap.com is a domain currently listed for sale (Verified Domain) on GoDaddy. The listing shows a Buy Now / Premium offer with a displayed price and provides 24/...

# --- GLOBAL RULES --- User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /xmlrpc.php Disallow: /wp-login.php Disallow: /readme.html Disallow: /license...

# HFT Arbitrage Platform > HFT Arbitrage Platform (hftarbitrageplatform.com) is a professional arbitrage trading software suite for Forex, CFDs, Futures, Indices, and Cryptocurr...

# Allow all crawlers, including AI and search bots User-agent: * Allow: / # Sitemap location Sitemap: https://hgcapital.com/sitemap.xml

# Hg > Hg is a leading investor in European and transatlantic software and services businesses. We help to build sector-leading enterprises that supply critical software applica...

Crawl-delay: 10 # START YOAST BLOCK # --------------------------- User-agent: * Disallow: /?s= Disallow: /page/*/?s= Disallow: /search/ Sitemap: https://www.hhaexchange.com/site...

# HHAeXchange: The premiere homecare management software for the Medicaid LTSS population, connecting providers, payers, and members\. Generated by Yoast SEO v27.4, this is an...

# Allow AI crawlers User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot Allow: / User-agent: ClaudeBot Allow: / # Allow Google crawlers User-...

# Find Rigging Gear at Holloway | Chain Slings, Wire Rope Slings, Hoists, & More. Shop Now! > Holloway provides top-quality rigging solutions for all your lifting needs – chains...

User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Sitemap: https://hhll.app/sitemap.xml Sitemap: https://hhll.app/sitemap.rss

Generated by All in One SEO v4.9.3, this is an llms.txt file, used by LLMs to index the site. # ハハロル|50歳以上のためのマッチングアプリ 50代以上の新しい出会いのために|大切な人生の相棒を探すマッチングサービス。|本サービスは恋活・婚活を目的としたサ...

# As a condition of accessing this website, you agree to abide by the following # content signals: # (a) If a Content-Signal = yes, you may collect content for the corresponding...

Not found

# # robots.txt # # This file is to prevent the crawling and indexing of certain parts # of your site by web crawlers and spiders run by sites like Yahoo! # and Google. By tellin...

This is an llms.txt file, meant for consumption by LLMs. The XML sitemap of this website can be found by following [this link](https://hias.org/sitemap_index.xml). # HIAS: Welco...

# OpenAI Bots User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / # Anthropic/Claude Bots User-agent: anthropic-ai Allow: / User-age...

Not found

User-agent: * Allow: / Sitemap: https://hibt.com/sitemap.xml

Not found

User-agent: * Disallow: /site/* Disallow: /login Disallow: /campaign/* Disallow: /standout Disallow: /marketsmarter Disallow: /site/ Disallow: /content/ User-agent: AdsBot-Googl...

# Hibu Inc. > Hibu is a leading provider of technology-driven, integrated digital marketing solutions for local businesses. Our Hibu One platform unifies websites, SEO (includin...

User-agent: * Disallow:

# Hidden Games Krimispiele: Krimispiele für echte Privatermittler > Untersucht Hinweise, analysiert Gegenstände, hört Zeugenaussagen, sichtet Beweismaterial \- und überführt di...

User-agent: * Allow: / Sitemap: https://www.hiddenbrains.com/sitemap.xml Sitemap: https://www.hiddenbrains.com/blog/sitemap_index.xml Sitemap: https://www.hiddenbrains.com/blog/...

# Hidden Brains - [About Hidden Brains](https://www.hiddenbrains.com): Hidden Brains is a global IT consulting and enterprise software development company providing innovativ...