Top Sites

User-agent: ChatGPT-User Allow: / User-agent: ChatGPTBot Allow: / User-agent: GPTBot Allow: / User-agent: Google-Extended Allow: / User-agent: ClaudeBot Allow: / User-agent: Ant...

# Purpose: Provides structured, descriptive summary of Primo's products, features, knowledge base, how-to guides, blog articles, and support pages for use in AI-based indexing a...

User-agent: * Disallow: Sitemap: https://getpublii.com/sitemap.xml

# Publii Static CMS > Desktop, offline-first, open-source Static Site CMS for creating fast, secure static websites. WordPress-like simplicity with one-click deployment; GDPR &...

Crawl-delay: 10 # START YOAST BLOCK # --------------------------- User-agent: * Disallow: Sitemap: https://getrecharge.com/sitemap_index.xml # --------------------------- # END...

# Recharge: The world’s leading subscription platform, powering 71% of subscriptions sold on Shopify stores and helping brands grow recurring revenue\. Generated by Yoast SEO v...

# As a condition of accessing this website, you agree to abide by the following # content signals: # (a) If a Content-Signal = yes, you may collect content for the corresponding...

# Redo > Redo is a returns management platform that helps e-commerce merchants streamline returns, exchanges, and claims with AI-powered automation and international warehousing...

User-agent: * Sitemap: https://getrenterra.com/sitemap.xml Sitemap: https://getrenterra.com/sitemap.xml

# Renterra > All-in-one rental management software for equipment rental businesses. Renterra is a SaaS platform that helps equipment rental companies manage inventory, quoting,...

User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-content/uploads/videos_presentacion/ Sitemap: https://www.getronics.com/sitemap_index.xml

# Getronics: Empowering your digital journey > With IT integration and digital transformation at the heart of Getronics, we are great at bringing teams together and transformin...

# As a condition of accessing this website, you agree to abide by the following # content signals: # (a) If a Content-Signal = yes, you may collect content for the corresponding...

User-agent: *\nAllow: /\nDisallow-Training: /\nSitemap: /sitemap.xml

# * User-agent: * Allow: / Disallow: /api/ Disallow: /auth/ Disallow: /dashboard Disallow: /settings Disallow: /checkout Disallow: /card-offers/search # GPTBot User-agent: GPTBo...

# Savewise > Savewise is a browser extension and web app that helps users maximize cashback, miles, and credit card points by comparing offers across 30+ shopping portals and ca...

User-agent: * Allow: / LLM-Policy: /llms.txt Sitemap: /sitemap.xml

# getsensai.com > getsensai.com is a domain currently listed for sale (Verified Domain) on GoDaddy. The listing shows a Buy Now / Premium offer with a displayed price and provid...

User-agent: * Disallow: /wp-content/uploads/wpo/wpo-plugins-tables-list.json # START YOAST BLOCK # --------------------------- User-agent: * Allow: Sitemap: https://silverfin.co...

# llms.txt for https://silverfin.com/ # Global cloud financial reporting & compliance platform for accountants. # Focus: connected data, automation, compliance, and advisory ena...

User-agent: * Allow: / Disallow: /unsubscribed/ Disallow: /error/ Disallow: /close Disallow: /t/ Disallow: /te/ Disallow: /i/ Disallow: /w/ # Certain social media sites are whit...

# Getsitecontrol: On-site and email marketing platform. > Getsitecontrol is an all-in-one marketing platform that combines email marketing and automation with a full-featured po...

User-agent: * Allow: / # AI Crawlers User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent:...

# Swan > Swan is an AI GTM Engineer that builds go-to-market workflows when you describe them in plain English. The platform combines signal detection, data enrichment, and auto...

User-agent: meta-webindexer Disallow: / User-agent: meta-externalagent Disallow: / User-agent: * Disallow: /blog/?*_page=* Allow: /blog/article/ Sitemap: https://getswipe.in/sit...

INDIA # Swipe India Information Website: https://getswipe.in/?country_code=IN BusinessName: Swipe Country: India BusinessType: SaaS, Invoicing, Accounting Description: Swipe is...

# START YOAST BLOCK # --------------------------- User-agent: * Disallow: Sitemap: https://getterms.io/sitemap_index.xml # --------------------------- # END YOAST BLOCK

# GetTerms > GetTerms is a privacy compliance platform that helps 500K+ businesses manage cookie consent, generate legal policies, and comply with GDPR, CCPA, PIPEDA, and other...

User-agent: * Disallow: /*client* Disallow: /*carrier* Allow: /*/carriers/ Allow: */carrier/new Disallow: /*terms_of_use* Disallow: /*license_contract* Disallow: /*cabinet* Disa...

# GetTransfer.com > GetTransfer.com is a global transportation marketplace for booking transfers, rides, hourly chauffeur-driven car rentals, and delivery services in 180+ count...

User-Agent: * Allow: / Disallow: /api/ Disallow: /_next/ Disallow: /admin/ Disallow: /private/ User-Agent: GPTBot Allow: / User-Agent: OAI-SearchBot Allow: / User-Agent: ChatGPT...

# Unbound AI > Unbound is an Agent Access Security Broker (AASB) purpose-built to govern AI coding agents like Claude Code, Cursor, and GitHub Copilot across enterprise engineer...

# START YOAST BLOCK # --------------------------- User-agent: * Disallow: Sitemap: https://getuntitled.ai/sitemap_index.xml # --------------------------- # END YOAST BLOCK

# Untitled Untitled is an audience intelligence platform built for eCommerce, automotive, performance marketing agencies, and other consumer-oriented businesses seeking more eff...

User-agent: * Allow: / LLM-Policy: /llms.txt Sitemap: /sitemap.xml

User-agent: *\nAllow: /\nDisallow-Training: /\nSitemap: /sitemap.xml

User-agent: * Allow: / # Explicitly allow AI crawlers User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Claude-Web Allow: / User-agent: ClaudeBot Allow:...

# Viktor - AI Coworker for Slack and Microsoft Teams > Viktor is an autonomous AI coworker that lives in Slack or Microsoft Teams, connects to 3,000+ tools, and does real work:...

# * User-agent: * Allow: / # Sitemaps Sitemap: https://getvoices.ai/sitemap.xml

# Voices AI > Voices AI is the leading AI Celebrity Voice Generator & AI Voice Cloner App > with 15M+ downloads and 180k+ reviews. Create professional-grade, realistic > AI voic...

User-agent: * Allow: / Sitemap: https://getwingman.io/sitemap.xml

# GetWingman > Help your customers make a purchase in seconds. Connect shoppers with product experts for live 1:1 consultation. GetWingman is a platform for e-commerce stores th...

User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Sitemap: https://getworkcertified.com/sitemap.xml Sitemap: https://getworkcertified.com/sitemap.rss

Generated by All in One SEO v4.9.6.2, this is an llms.txt file, used by LLMs to index the site. # Work Certified Work Certified of Southeastern Indiana provides occupational se...

User-agent: * Allow: / LLM-Policy: /llms.txt Sitemap: /sitemap.xml

User-agent: *\nAllow: /\nDisallow-Training: /\nSitemap: /sitemap.xml

User-Agent: * Allow: / Disallow: /private/ Disallow: /admin/ Disallow: /api/ Sitemap: https://www.getzep.com/sitemap.xml Sitemap: https://www.getzep.com/a/sitemap.xml

# Zep > Agent context is hard. We fixed it. Zep is the context engineering platform for AI agents—with agent memory, Graph RAG, and automated context assembly. 200ms retrieval....

User-agent: * Disallow: /nomination-for-a-gewex-panel/action~posterboard/ Disallow: /nomination-for-a-gewex-panel/action~agenda/ Disallow: /nomination-for-a-gewex-panel/action~o...

Generated by All in One SEO v4.8.5, this is an llms.txt file, used by LLMs to index the site. # GEWEX The Global Energy and Water Exchanges (GEWEX) program, a core project of th...

# robots.txt - 28.08.2024 - gewusst-wo GmbH & Co KG # # gewusst-wo.de # # # In dieser Datei wird fuer die Robots festgelegt, # welche Pfade/Dateien nicht ausgewertet werden soll...

# gewusst-wo.de llms.txt > gewusst-wo.de - das Branchenportal für die rasche und unkomplizierte Suche nach Firmen oder ganzen Branchen. Firmensuche, Branchensuche: Auf gewusst-w...

User-Agent: * # Приоритет разрешения Allow: /catalog/*/*/brend-*/ # Стандартные запреты директорий и системных файлов для всех поисковых систем Disallow: /bitrix/ Disallow: /upl...

Not found

User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php User-agent: facebookexternalhit Allow: /wp-content/uploads/ User-agent: Facebot Allow: /wp-content/uploads/ Si...

Gegenereerd door All in One SEO v4.9.6.2, dit is een llms.txt bestand, gebruikt door LLMs om de site te indexeren. # Nieuws uit Suriname | gfcnieuws.com Surinaams nieuws ## Sit...

# START RICHMOND ROBOTS # Edit this in AB Admin -> SEO -> Robots # -------------------------------------------- # Disallow access to admin areas for all bots # but make an excep...

# LLMs.txt for Guild of Fine Food # Generated: 2026-04-24 17:21:19 # Guild of Fine Food - Supporting independent food & drink User-agent: * Allow: /wp-content/uploads/ User-...

Sitemap: https://www.gflex.nl/sitemap.xml User-agent: * Disallow: *?* Disallow: *query* Sitemap: https://www.gflex.nl/sitemap.xml

# Gflex | ICT Beheer, Cybersecurity en Cloud Oplossingen (MKB, Zorg & Food/Productie) ## Bedrijfsprofiel Gflex is een betrouwbare en betrokken ICT-partner, gespecialiseerd in he...