# ============================= # ATOTO Official Website robots.txt # Optimized for SEO + AI Crawlers # ============================= # --- General Crawler Rules --- User-agent: * Disallow: /checkout Disallow: /cart Disallow: /orders Disallow: /account Disallow: /search Disallow: /policies/ Disallow: /apps/ Allow: /products/ Allow: /collections/ Allow: /blogs/ Allow: /pages/ Allow: /index Allow: / # --- AI & Extended Crawlers --- User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot Allow: / User-agent: ClaudeBot Allow: / User-agent: CCBot Allow: / User-agent: Google-Extended Allow: / User-agent: Bingbot Allow: / # --- Extra optimization --- # 优先让爬虫访问主要入口与结构化数据区域 Crawl-delay: 1 # --- Sitemap (auto updated by Shopify) --- Sitemap: https://www.atotodirect.com/sitemap.xml