# ============================================================ # Robots.txt for Domain Name API # Last updated: 08.04.2026 # Contact: support@domainnameapi.com # ============================================================ # AI/LLM context file available at: # https://www.domainnameapi.com/llms.txt # ============================================================ # ---------------------------------------- # CRAWL DELAY # ---------------------------------------- User-agent: SemrushBot Crawl-delay: 10 User-agent: Yandex Crawl-delay: 5 Allow: / Host: https://www.domainnameapi.com # ---------------------------------------- # GOOGLE BOTS # ---------------------------------------- User-agent: Googlebot Allow: / User-agent: Googlebot-Image Allow: / User-agent: Googlebot-News Allow: / User-agent: GoogleOther Allow: / User-agent: GoogleOther-Image Allow: / User-agent: AdsBot-Google-Mobile Allow: / User-agent: AdsBot-Google Allow: / User-agent: Google-Extended Allow: / User-agent: Storebot-Google Allow: / # ---------------------------------------- # MICROSOFT / BING / COPILOT # ---------------------------------------- User-agent: bingbot Crawl-delay: 5 Allow: / User-agent: BingPreview Allow: / User-agent: msnbot Allow: / # ---------------------------------------- # OPENAI / CHATGPT # ---------------------------------------- User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / # ---------------------------------------- # ANTHROPIC / CLAUDE # ---------------------------------------- User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: Claude-Web Allow: / # ---------------------------------------- # PERPLEXITY AI # ---------------------------------------- User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / # ---------------------------------------- # META AI / LLAMA # ---------------------------------------- User-agent: meta-externalagent Allow: / User-agent: FacebookBot Allow: / User-agent: Meta-ExternalFetcher Allow: / # ---------------------------------------- # APPLE / SIRI # ---------------------------------------- User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / # ---------------------------------------- # AMAZON / ALEXA # ---------------------------------------- User-agent: Amazonbot Allow: / # ---------------------------------------- # OTHER AI BOTS # ---------------------------------------- # YOU.COM User-agent: YouBot Allow: / # COHERE AI User-agent: cohere-ai Allow: / # MISTRAL AI User-agent: MistralBot Allow: / # XAI / GROK User-agent: xAI Allow: / # DUCKDUCKGO AI User-agent: DuckAssistBot Allow: / User-agent: DuckDuckBot Allow: / # BRAVE SEARCH AI User-agent: Brave Allow: / # ALLEN INSTITUTE FOR AI User-agent: AI2Bot Allow: / # COMMON CRAWL User-agent: CCBot Allow: / # DIFFBOT User-agent: Diffbot Allow: / # BYTESPIDER / BYTEDANCE User-agent: Bytespider Allow: / # WEBZ.IO / OMGILI User-agent: Webzio-Extended Allow: / User-agent: omgili Allow: / User-agent: omgilibot Allow: / # ---------------------------------------- # ARAMA MOTORLARI — ASYA & BÖLGESEL # ---------------------------------------- # Baidu (Çin) User-agent: Baiduspider Allow: / User-agent: Baiduspider-image Allow: / User-agent: Baiduspider-video Allow: / User-agent: Baiduspider-news Allow: / # Naver (Güney Kore) User-agent: Yeti Allow: / # Seznam (Çek) User-agent: SeznamBot Allow: / # Sogou (Çin) User-agent: Sogou web spider Allow: / User-agent: Sogou inst spider Allow: / # 360Spider (Çin) User-agent: 360Spider Allow: / # Haosou (Çin) User-agent: HaosouSpider Allow: / # Yahoo / Oath User-agent: Slurp Allow: / # Ask.com User-agent: Teoma Allow: / # Mojeek User-agent: MojeekBot Allow: / # Exalead (Fransa) User-agent: ExaBot Allow: / # Gigablast User-agent: GigaBot Allow: / # Swiftype User-agent: Swiftbot Allow: / # ---------------------------------------- # SEO ARAÇLARI # ---------------------------------------- User-agent: AhrefsBot Allow: / User-agent: rogerbot Allow: / User-agent: MJ12bot Allow: / User-agent: MagesticSEO Allow: / User-agent: MajesticBot Allow: / User-agent: Screaming Frog SEO Spider Allow: / User-agent: RyteBot Allow: / User-agent: SEOkicks Allow: / User-agent: SistrixCrawler Allow: / User-agent: Searchmetrics Allow: / User-agent: SeobilityBot Allow: / User-agent: OnCrawl Allow: / User-agent: ContentKing Allow: / User-agent: Botify Allow: / User-agent: DeepCrawl Allow: / # ---------------------------------------- # WEB ARŞİVLEME # ---------------------------------------- User-agent: ia_archiver Allow: / User-agent: archive.org_bot Allow: / User-agent: HTTrack Allow: / User-agent: Wget Allow: / # ---------------------------------------- # HABER & İÇERİK AGREGATÖRLERİ # ---------------------------------------- User-agent: FlipboardProxy Allow: / User-agent: Flipboard Allow: / User-agent: Feedly Allow: / User-agent: FeedlyBot Allow: / User-agent: Netvibes Allow: / User-agent: NewsBlur Allow: / User-agent: InoReader Allow: / User-agent: AppleNewsBot Allow: / User-agent: MSNBot-Media Allow: / User-agent: Outbrain Allow: / User-agent: Taboola Allow: / # ---------------------------------------- # OTHERS — GENEL KURALLAR # ---------------------------------------- User-agent: * Allow: / Allow: *.js Allow: *.css Disallow: /tr/sepet Disallow: /cart Disallow: /ar/salla Disallow: /zh/gouwuche Disallow: /fa/sabad Disallow: /fr/panier Disallow: /de/warenkorb Disallow: /es/carrito Disallow: /it/carrello Disallow: /ru/korzina Disallow: /id/keranjang Disallow: /hi/thela Disallow: /bn/sepete Disallow: /pt/carrinho Disallow: /ur/cart Disallow: /ja/kato Disallow: /vi/gio-hang Disallow: /ko/jangbaguni Disallow: /bg/koshnitsa Disallow: /uk/kosyk Disallow: /az/sebet Disallow: /nl/winkelwagen Disallow: /uz/savat Disallow: /kk/sebet Disallow: /ky/arabaz Disallow: /pl/koszyk Disallow: /ro/cos Disallow: /tg/sabati Disallow: /pa/cart Disallow: /th/tong Disallow: /sw/toroli Disallow: /ms/troli Disallow: /el/kart Disallow: /he/cart Disallow: /sv/kundvagn Disallow: /fi/ostoskori Disallow: /sk/kosik Disallow: /hu/kosar Disallow: /lt/krepselis Disallow: /lv/grozs Disallow: /no/handlekurv Disallow: /hr/kosarica Disallow: /bs/korpa Disallow: /ph/cart Disallow: /da/kurv Disallow: /?ref= Disallow: /?utm_ Disallow: /?session= Disallow: /?affiliate= Disallow: /cgi-bin/ # ---------------------------------------- # SITEMAPS # ---------------------------------------- Sitemap: https://www.domainnameapi.com/sitemap_index.xml Sitemap: https://www.domainnameapi.com/en/sitemap.xml Sitemap: https://www.domainnameapi.com/en/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/tr/sitemap.xml Sitemap: https://www.domainnameapi.com/tr/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/de/sitemap.xml Sitemap: https://www.domainnameapi.com/de/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/ru/sitemap.xml Sitemap: https://www.domainnameapi.com/ru/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/id/sitemap.xml Sitemap: https://www.domainnameapi.com/id/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/hi/sitemap.xml Sitemap: https://www.domainnameapi.com/hi/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/bn/sitemap.xml Sitemap: https://www.domainnameapi.com/bn/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/ur/sitemap.xml Sitemap: https://www.domainnameapi.com/ur/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/pt/sitemap.xml Sitemap: https://www.domainnameapi.com/pt/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/ja/sitemap.xml Sitemap: https://www.domainnameapi.com/ja/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/ko/sitemap.xml Sitemap: https://www.domainnameapi.com/ko/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/az/sitemap.xml Sitemap: https://www.domainnameapi.com/az/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/kk/sitemap.xml Sitemap: https://www.domainnameapi.com/kk/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/ky/sitemap.xml Sitemap: https://www.domainnameapi.com/ky/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/uz/sitemap.xml Sitemap: https://www.domainnameapi.com/uz/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/uk/sitemap.xml Sitemap: https://www.domainnameapi.com/uk/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/pl/sitemap.xml Sitemap: https://www.domainnameapi.com/pl/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/ar/sitemap.xml Sitemap: https://www.domainnameapi.com/ar/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/fa/sitemap.xml Sitemap: https://www.domainnameapi.com/fa/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/zh/sitemap.xml Sitemap: https://www.domainnameapi.com/zh/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/sv/sitemap.xml Sitemap: https://www.domainnameapi.com/sv/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/fi/sitemap.xml Sitemap: https://www.domainnameapi.com/fi/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/sk/sitemap.xml Sitemap: https://www.domainnameapi.com/sk/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/hu/sitemap.xml Sitemap: https://www.domainnameapi.com/hu/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/lt/sitemap.xml Sitemap: https://www.domainnameapi.com/lt/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/lv/sitemap.xml Sitemap: https://www.domainnameapi.com/lv/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/no/sitemap.xml Sitemap: https://www.domainnameapi.com/no/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/th/sitemap.xml Sitemap: https://www.domainnameapi.com/th/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/vi/sitemap.xml Sitemap: https://www.domainnameapi.com/vi/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/ms/sitemap.xml Sitemap: https://www.domainnameapi.com/ms/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/el/sitemap.xml Sitemap: https://www.domainnameapi.com/el/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/sw/sitemap.xml Sitemap: https://www.domainnameapi.com/sw/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/pa/sitemap.xml Sitemap: https://www.domainnameapi.com/pa/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/ro/sitemap.xml Sitemap: https://www.domainnameapi.com/ro/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/es/sitemap.xml Sitemap: https://www.domainnameapi.com/es/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/bg/sitemap.xml Sitemap: https://www.domainnameapi.com/bg/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/fr/sitemap.xml Sitemap: https://www.domainnameapi.com/fr/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/it/sitemap.xml Sitemap: https://www.domainnameapi.com/it/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/da/sitemap.xml Sitemap: https://www.domainnameapi.com/da/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/nl/sitemap.xml Sitemap: https://www.domainnameapi.com/nl/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/tg/sitemap.xml Sitemap: https://www.domainnameapi.com/tg/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/he/sitemap.xml Sitemap: https://www.domainnameapi.com/he/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/ph/sitemap.xml Sitemap: https://www.domainnameapi.com/ph/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/hr/sitemap.xml Sitemap: https://www.domainnameapi.com/hr/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/bs/sitemap.xml Sitemap: https://www.domainnameapi.com/bs/tld_sitemap.xml Sitemap: https://www.domainnameapi.com/sr/sitemap.xml Sitemap: https://www.domainnameapi.com/sr/tld_sitemap.xml