Top Sites

# we use Shopify as our ecommerce platform # ┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓ # ┃ Robots & Agent policy ┃ # ┣━━━━━━━━━━━━━━━━━━━━━━━━━━━━...

Not found

User-Agent: * Disallow: /service-hilfe/tv-programm/ Disallow: /tv-archiv/ Disallow: /vip/ Disallow: /angebot-beschreibung/ Disallow: /buchen/ Disallow: /suchen/ Disallow: /searc...

# sonnenklar.TV > sonnenklar.TV ist Deutschlands führender Reisesender, der täglich die besten Reiseangebote präsentiert, darunter Pauschalreisen, Hotel-only Reisen, Kreuzfahrte...

# As a condition of accessing this website, you agree to abide by the following # content signals: # (a) If a Content-Signal = yes, you may collect content for the corresponding...

Not found

Sitemap: https://soogi.jp/sitemap/prefectures.xml Sitemap: https://soogi.jp/sitemap/megalopolis.xml Sitemap: https://soogi.jp/sitemap/municipalities.xml Sitemap: https://soogi.j...

Not found

# -------------------------------------------- # Soov.ee robots.txt # Eesmärk: tagada otsingumootoritele maksimaalne juurdepääs # avalikele kuulutustele ja kategooriatele, kuid...

# -------------------------------------------- # Soov.ee llms.txt # Eesmärk: lubada AI mudelitel kasutada avalikku sisu # ja tuua portaalile maksimaalselt AI-põhist liiklust, #...

User-agent: * Disallow: /admin/ Disallow: /auth/ Disallow: /assets/browser-update*.js Disallow: /email/ Disallow: /session Disallow: /user-api-key Disallow: /*?api_key* Disallow...

Not found

User-agent: * Allow: / Disallow: /wp-admin/* Disallow: /sosafe-login/ Disallow: /*?__hstc= Disallow: /*?__hssc= Disallow: /*?__hsfp= Disallow: /*&__hstc= Disallow: /*&__hssc= Di...

# SoSafe > SoSafe is a German cybersecurity company that specialises in security awareness training and human risk management. Its solutions help organisations raise employee aw...

User-agent: * Allow: /llms.txt Disallow: /admin/ Disallow: /images/ Disallow: /inc/ Disallow: /layout/ Disallow: /modules/ Disallow: /plugins/ Disallow: /script/ Disallow: /syst...

# SoSci Survey Developer Documentation for LLMs > This documentation is designed for AI coding assistants (ChatGPT, Gemini, Claude). > SoSci Survey uses a specialized, sandboxed...

User-agent: * Allow: / Disallow: /campaigns/ Sitemap: https://www.sotc.in/sitemap_index.xml Disallow: /travel-guidelines-corporate/ Disallow: /international-packages/ Disallow:...

# ========== LLM & AI CRAWLERS ========== User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Google-Extended Disallow: / User-agent: ClaudeBot Allow: / Us...

Not found

# llms.txt - SotySolar Version: 1.0 Last-Updated: 2026-02-18 Language: es Primary-Markets: España, Portugal ## About SotySolar es una empresa española especializada en energía s...

Not found

# そうだ 京都、行こう。 このファイルは「[そうだ 京都、行こう。](https://souda-kyoto.jp/)」のコンテンツに関する AI モデル（LLM）、検索エージェント、研究用途での参照・学習に関する指針を示すものです。 ## サイト概要 「そうだ 京都、行こう。」は、東海旅客鉄道株式会社（JR 東海）が運営する京都の情報を発信するウェ...

User-agent: * Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Disallow: /*?a...

# ซาวด์ดีดี ช็อป: ช้อปปิ้งเครื่องเสียงออนไลน์ จำหน่ายอุปกรณ์ระบบเสียง ระบบภาพ งาน professional จัดส่งฟรี ทั่วประเทศ > ศูนย์รวมระบบเสียง และระบบภาพ / ไลท์ติ้ง SoundDD\.shop เครื...

# we use Shopify as our ecommerce platform # ┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓ # ┃ Robots & Agent policy ┃ # ┣━━━━━━━━━━━━━━━━━━━━━━━━━━━━...

Not found

# START YOAST BLOCK # --------------------------- User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Sitemap: https://souq-alwazaif.com/sitemap.xml Sitemap: http...

Generated by Rank Math SEO, this is an llms.txt file designed to help LLMs better understand and index this website. # سوق الوظائف: أكبر منصة توظيف شاملة للباحثين عن فرص العمل ف...

Not found

Not found

Not found

# Important pages https://www.southafrica.info/about/people/language.htm # Sitemap https://www.southafrica.info/sitemap.xml

# If the Joomla site is installed within a folder # eg www.example.com/joomla/ then the robots.txt file # MUST be moved to the site root # eg www.example.com/robots.txt # AND th...

# Best South African Online Casino Gambling Guide Since 2003 <!-- Guidelines for AI Large Language Models --> <!-- Latest update: 2026-04-13 --> <!-- Generated by JSitemap Pro...

User-agent: * Sitemap: https://www.southlandloghomes.com/sitemap_index.xml Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php

Generated by Yoast SEO v25.9, this is an llms.txt file, meant for consumption by LLMs. The XML sitemap of this website can by found by following [this link](https://www.southla...

User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php User-agent: Amazonbot Disallow: / Sitemap: https://soymotero.net/sitemap_index.xml Allow: /feed/$ Disallow: /f...

Generated by Rank Math SEO, this is an llms.txt file designed to help LLMs better understand and index this website. # SoyMotero: Las últimas noticias de motos, pruebas y fichas...

User-agent: * Disallow: /wp-admin/ Disallow: /tools/ Disallow: /tools/maps/map/ Disallow: /search/ Disallow: */feed/ Disallow: */feed/rss2/ Allow: /wp-admin/admin-ajax.php Sitem...

# SPACE4GAMES: Gaming, Virtual Reality \& Entertainment > Das Gaming\-Magazin mit dem gewissen Etwas: Gründlich\. Detailliert\. Emotional und ehrlich\. Unser Angebot: Artikel,...

Not found

# spaces.in llms.txt > SPACES is an online retailer dedicated to enhancing home aesthetics and comfort through a diverse range of high-quality textiles and accessories. With a f...

# https://www.robotstxt.org/robotstxt.html User-agent: * Disallow:

Not found

### Pages with rec parameter - IAI Recommendation System User-agent: * Disallow: /*?rec=* Disallow: /*&rec=* Sitemap: https://spacetronik.pl/sitemap.xml.gz ### Automatically ban...

# Spacetronik.Store > Kompletna oferta rozwiązań technologicznych, instalacyjnych i ergonomicznych w jednym miejscu. Wszystko dla nowoczesnego domu i profesjonalnego biura. Pozn...

### Pages with rec parameter - IAI Recommendation System User-agent: * Disallow: /*?rec=* Disallow: /*&rec=* Sitemap: https://spacetronik.store/sitemap.xml.gz ### Automatically...

# Spacetronik.Store > Odkryj nowoczesne, ergonomiczne meble i akcesoria biurowe w Spacetronik. Znajdziesz tu elektryczne biurka regulowane, organizery kablowe, uchwyty monitorów...

Not found

User-Agent: * Allow: / # Sensitive paths Disallow: /wp-admin/ Disallow: /wp-login.php Disallow: /xmlrpc.php Disallow: /wp-json/ Disallow: /?author= # Usage policy Training: disa...

# we use Shopify as our ecommerce platform # ┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓ # ┃ Robots & Agent policy ┃ # ┣━━━━━━━━━━━━━━━━━━━━━━━━━━━━...

Not found

User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Crawl-delay: 10 Sitemap: https://www.sparkhire.com/sitemap.xml Sitemap: https://www.sparkhire.com/sitemap.rss

Not found

# START YOAST BLOCK # --------------------------- User-agent: * Disallow: Sitemap: https://sparque.ai/en/sitemap_index.xml # --------------------------- # END YOAST BLOCK

# SPARQUE\.AI: Smart AI Personalization > Boost conversions 20%, revenue 29%, ROI in 3 months with SPARQUE\.AI \- AI\-powered search, recommendations, and personalization trust...

User-Agent: * Disallow: /sandbox/ Disallow: /sandbox2/ Disallow: /staging/ Sitemap: https://www.spartan.edu/sitemap_index.xml

Generated by Yoast SEO v26.4, this is an llms.txt file, meant for consumption by LLMs. The XML sitemap of this website can be found by following [this link](https://www.spartan...

User-agent: AdsBot-Google Disallow: /account.php Disallow: /cart.php Disallow: /checkout.php Disallow: /finishorder.php Disallow: /login.php Disallow: /orderstatus.php Disallow:...

Not found