# ┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓ # ┃ Solawave Robots.txt ┃ # ┃ Optimized for SEO + AI crawler accessibility ┃ # ┗━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┛ User-agent: * # Block sensitive / private areas Disallow: /admin Disallow: /cart Disallow: /orders Disallow: /checkouts/ Disallow: /checkout Disallow: /41864822952/checkouts Disallow: /41864822952/orders Disallow: /carts Disallow: /account Disallow: /*?*oseid=* Disallow: /*preview_theme_id* Disallow: /*preview_script_id* Disallow: /sf_private_access_tokens Disallow: /.well-known/shopify/monorail Disallow: /cdn/wpm/*.js # ✅ Allow policies (important for customer trust & SEO: “brand + return policy” queries) # ✅ Allow collections/blog filters — manage duplicates via canonical tags in Shopify theme # ✅ Allow site search (optional: if duplicates become a problem, re-block /search) # Sitemap for search engines Sitemap: https://www.solawave.co/sitemap.xml # ──────────────────────────────────────────────────────── # Special handling for Google Ads bot User-agent: adsbot-google Disallow: /checkouts/ Disallow: /checkout Disallow: /carts Disallow: /orders Disallow: /41864822952/checkouts Disallow: /41864822952/orders Disallow: /*?*oseid=* Disallow: /*preview_theme_id* Disallow: /*preview_script_id* Disallow: /cdn/wpm/*.js Disallow: /sf_private_access_tokens # ──────────────────────────────────────────────────────── # SEO tool & crawler rules User-agent: AhrefsBot Crawl-delay: 10 User-agent: AhrefsSiteAudit Crawl-delay: 10 User-agent: MJ12bot Crawl-delay: 10 User-agent: Pinterest Crawl-delay: 1 User-agent: Nutch Disallow: / # ──────────────────────────────────────────────────────── # AI & LLM Crawlers — explicitly allowed for maximum exposure User-agent: GPTBot # OpenAI / ChatGPT Allow: / User-agent: PerplexityBot # Perplexity AI Allow: / User-agent: ClaudeBot # Anthropic Claude Allow: / User-agent: CCBot # Common Crawl (feeds many AI models) Allow: /