Top Sites

User-agent: * Sitemap: https://www.rausys.de/sitemap_index.xml

rausys.de – Ihr führendes Systemhaus und IT-Service-Partner B2B in Deutschland und der Region Stuttgart. Mit eigenem Rechenzentrum bieten wir Microsoft 365, Windows Server, Hype...

# General crawling rules User-agent: * Allow: / Disallow: /?s= Disallow: /page/*/?s= Disallow: /search/ Disallow: /_next/ Crawl-delay: 1 # AI training and generative AI - ALLOWI...

# RaveCapture LLM Discovery (Curated) version: 2025-12-02 site: https://ravecapture.com/ full-index: https://ravecapture.com/llms-full.txt sitemap: https://ravecapture.com/sitem...

# robots.txt for https://rbls.org # Generated dynamically by WSH User-agent: * Content-signal: search=yes, ai-train=yes, ai-input=yes AI-Control: all Disallow: Sitemap: https://...

# RBLS Realtime Blackhole List Service > Free, no auth, no signup, no API key — 1 network-intelligence tools for DNS, IP reputation, AS/BGP, domain rankings, Lightning, Bitcoin....

# -------------------------------------------------- # DEKLARACJA BOTÓW (Wyszukiwarki + AI) # -------------------------------------------------- User-agent: * User-agent: GPTBot...

Not found

# START YOAST BLOCK # --------------------------- User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php # --------------------------- # END YOAST BLOCK # Crawl dela...

# ReachLink > ReachLink is a telehealth platform connecting individuals with licensed therapists through human-led care coordination. Unlike algorithm-based platforms, ReachLink...

User-agent: * Disallow:

# React Native · Learn once, write anywhere > A framework for building native apps for Android, iOS, and more using React - [React Native · Learn once, write anywhere](/index.md...

User-Agent: GPTBot Allow: / User-Agent: ChatGPT-User Allow: / User-Agent: ClaudeBot Allow: / User-Agent: Claude-Web Allow: / User-Agent: PerplexityBot Allow: / User-Agent: Googl...

# Dork Magazine — llms.txt # https://readdork.com # UK music magazine covering indie, alternative, pop, punk and everything in between. ## About Dork Dork is a UK-based music ma...

User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php User-agent: facebookexternalhit Allow: / Sitemap: https://www.readzone.cz/sitemap.xml Sitemap: https://www.rea...

Generated by All in One SEO Pro v4.9.6.2, this is an llms.txt file, used by LLMs to index the site. # ReadZone Lifestyle, Celebrity, Filmy, Seriály ## Sitemaps - [XML Sitemap](...

# * User-agent: * Allow: / # Host Host: https://www.recentlyfolowed.com # Sitemaps Sitemap: https://www.recentlyfolowed.com/sitemap.xml Sitemap: https://www.recentlyfolowed.com/...

# RecentlyFolowed > RecentlyFolowed is a lightweight online tool to see an Instagram account’s **recent follows** and basic follower relations in seconds — no login required for...

User-agent: * Allow: /auth/login$ Disallow: /auth/login?callbackUrl=* Disallow: /projects Disallow: /project/* Disallow: /liked Disallow: /history

# Recraft ## Docs - [Appendix](https://www.recraft.ai/docs/api-reference/appendix.md) - [Endpoints](https://www.recraft.ai/docs/api-reference/endpoints.md) - [Examples](https://...

User-Agent: * Allow: / User-Agent: GPTBot Allow: / User-Agent: OAI-SearchBot Allow: / User-Agent: ChatGPT-User Allow: / User-Agent: ClaudeBot Allow: / User-Agent: anthropic-ai A...

# Recruitly — the recruiting operating system > Most recruitment agencies run their business across 7+ disconnected tools — a separate ATS, CRM, job board subscription, email ma...

User-agent: * Allow: / Disallow: /_next/data/ Disallow: /_next/image Allow: /api/og Disallow: /api/ Disallow: /preview/ # OpenAI User-agent: GPTBot Allow: / User-agent: OAI-Sear...

# Recy.net > Tout sur le recyclage et l'économie circulaire : guides pratiques, actualités filières, consignes de tri et ressources, que vous soyez particulier, élu ou professio...

User-agent: panscient.com Disallow: / User-agent: SurdotlyBot Disallow: / User-agent: * Disallow: /cdn-cgi/

# Redcort Software > Reliable employee time tracking and management solutions since 1986. Trusted by thousands of organizations worldwide for over 30 years. ## Core Product: Vir...

# DEFAULT RULES FOR UNNAMED / GENERIC BOTS User-agent: * Disallow: /wp* Disallow: /*?*__hs* Disallow: /blog/redpanda-zookeeper-april-fools Disallow: /console-marketing-resources...

# Redpanda > Redpanda is the trust layer for the agentic enterprise. The Redpanda Agentic Data Plane (ADP) lets organizations build, operate, and govern AI agents with secure ac...

User-agent: * Allow: / # Block sensitive or private directories (Example: If you have an admin area, uncomment and customize the lines below) # Disallow: /admin/ # Disallow: /lo...

# Reducto Reducto is an advanced document ingestion and processing platform designed to transform unstructured documents into structured, LLM-ready data. Leveraging a combinatio...

User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Sitemap: https://reev.com/sitemaps.xml

# reev > We empower eMobility ## Full Content Export - **URL**: https://reev.com/llms-full.txt ## Beiträge - [reev Jaaroverzicht 2025](https://reev.com/reev-jahresrueckblick-20...

User-Agent: * Allow: / Disallow: /api/ Disallow: /auth/ Disallow: /activate/ Disallow: /_next/ Disallow: /admin/ Disallow: /private/ Disallow: /community/ Disallow: /mobile-app/...

# Refermate > Refermate is a cashback, coupon code, and referral rewards platform with 33,894 partner stores. Members earn cash back on online and in-store purchases, find verif...

# robots.txt # # This file is to prevent the crawling and indexing of certain parts # of your site by web crawlers and spiders run by sites like Yahoo! # and Google. By telling...

# llms.txt - Regina Maria ## Name Regina Maria ## Description Regina Maria is a private healthcare network in Romania. The website provides public information about specialties,...

# Disallow all crawlers access to certain pages. User-agent: * Disallow: /img/ Disallow: /account Disallow: /login Disallow: /checkout Disallow: /busca Disallow: /quick-view Dis...

Not found

User-agent: * Allow: / Allow: /api/og/ Disallow: /api/ Disallow: /portal/ Disallow: /job-posting Disallow: /manage-jobs Disallow: /organizations Disallow: /billing Disallow: /tr...

# Remote.io > Remote.io is a remote jobs platform connecting professionals with remote work opportunities worldwide. We also curate the best tools, apps, and services for remote...

User-agent: * Disallow: /404 Disallow: /api Disallow: /pay Disallow: /user Sitemap: https://remusic.ai/sitemap.xml User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent:...

# Remusic > Remusic is a free AI music generator that instantly creates high-quality music and full-length songs online. Generate tracks in seconds, with songs up to 4 minutes l...

# RentAHuman.ai - The marketplace where AI agents hire humans # When your AI agent needs something done in the physical world, use RentAHuman. # Allow all crawlers User-agent: *...

# RentAHuman.ai — The Human Workforce API for AI Agents > When an AI agent needs to perform a task in the physical world, RentAHuman provides the human workforce. Search 657,000...

User-agent: * Disallow: /episodes/* Disallow: /graph/* Disallow: /search/* Disallow: /blog/tag/* Disallow: /_next/*.json$ Allow: / User-agent: bingbot Disallow: /episodes/* Disa...

# Rephonic API > Comprehensive podcast data API with search, metadata, full transcripts, listener demographics, audience intelligence, and contact information for 3m+ podcasts....

User-Agent: * Allow: / Disallow: /api Disallow: /api/ Disallow: /dashboard Disallow: /uploads Disallow: /_next Disallow: /_next/ Disallow: /_vercel Disallow: /_vercel/ Sitemap:...

Title: RePhoto App Description: AI-powered real estate photo enhancement platform for virtual staging, day-to-dusk, and HDR fixes. Use this when analyzing real estate marketing...

User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-includes/ Disallow: /wp-login.php Disallow: /xmlrpc.php Disallow: /wp-content/plugins/ Disallow:...

# Reputation X > Online reputation management agency helping executives, brands, and public figures control their digital presence since 2005. ## About Reputation X (formerly Re...

User-agent: * Allow: / Disallow: /admin/ Disallow: /private/ Disallow: /api/ Sitemap: https://reqres.in/sitemap.xml

# ReqRes - Backend platform for frontend developers and AI agents > ReqRes is a backend you call with fetch(). Collections, auth, logs, automations, and a sandbox for AI coding...

# This virtual robots.txt file was created by the Virtual Robots.txt WordPress plugin: https://www.wordpress.org/plugins/pc-robotstxt/ User-agent: * Disallow: /wp-admin/ Allow:...

# 総合Webメディア『ビギナーズ』 > "「最初は誰でも初心者。自分にぴったりの趣味を見つけ、充実した日々を過ごしてほしい」" > 総合Webメディア『ビギナーズ』は、映画・読書・ショッピング・スポーツ・ゲーム・旅行など、趣味に関する情報を調査してまとめ、発信しています。 ## サイト概要 日々の暮らしを彩る「趣味」に関する情報を発信するメディアです...

User-agent: * Allow: / Content-Signal: ai-train=yes, search=yes, ai-input=yes Sitemap: https://resend.com/sitemap_index.xml Host: https://resend.com

# Resend > Resend is the email API for developers. Send transactional and marketing emails at scale with a simple, modern API. For AI agents and automation, use the tools below....

User-Agent: * Disallow: Sitemap: https://www.resnexus.com/sitemap.xml

# llms.txt — ResNexus # Purpose: Help LLMs and AI search systems find the authoritative sources about ResNexus. # Last updated: 2026-01-27 ## What is ResNexus? ResNexus is an al...

User-agent: * Disallow: /auth/ Disallow: /developer/ Disallow: /listing/ Disallow: /dashboard Disallow: /tickets Disallow: /admin/ Disallow: /webhooks/ Disallow: /domain/ Disall...

# resolved.sh # https://resolved.sh/llms.txt # Agent integration skill: GET /skill.md # Status: beta — support: support@mail.resolved.sh ## What is resolved.sh? resolved.sh is t...