# Explicitly allow Google & Ads bots to crawl everything (including /app) User-agent: Googlebot Allow: / User-agent: Googlebot-Image Allow: / User-agent: AdsBot-Google Allow: / User-agent: AdsBot-Google-Mobile Allow: / # Bing / Microsoft User-agent: bingbot Allow: / # Microsoft Advertising (used for landing-page & policy checks) User-agent: adidxbot Allow: / # (Legacy images/video crawler; still seen in the wild) User-agent: msnbot-media Allow: / User-agent: * Disallow: /checkout/ Disallow: /index.php/ Disallow: /pkginfo/ Disallow: /customer/ Disallow: /var/ Disallow: /catalog/product_compare/ Disallow: /sendfriend/ Disallow: /lib/ Disallow: /*SID= Disallow: /wishlist/ Disallow: /app/ Disallow: /report/ # Allow important category, product, and review pages to be indexed Allow: /catalog/ Allow: /product/ Allow: /review/ # Allow CSS, JS, and images to ensure proper rendering Allow: /media/ Allow: /static/ Allow: /skin/ Allow: /js/ Allow: /pub/static/ Allow: /pub/media/ Sitemap: https://www.nailgundepot.com/pub/sitemap.xml # LLM usage policy # Full policy: https://www.nailgundepot.com/llms.txt User-agent: * Allow: /llms.txt