# we use Shopify as our ecommerce platform # ┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓ # ┃ Robots & Agent policy ┃ # ┣━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┫ # ┃ Checkouts are for humans. ┃ # ┃ * Automated scraping or buy-for-me agents are not permitted. ┃ # ┃ * Legitimate integrators must use the official Checkout Kit: ┃ # ┃ https://www.shopify.com/checkout-kit ┃ # ┃ Terms of Service: https://www.shopify.com/legal/terms ┃ # ┃ Contact: bots@shopify.com ┃ # ┗━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┛ # === GOOGLE === User-agent: Googlebot Allow: / Disallow: /web-pixels* Disallow: /*web-pixel* Disallow: /cdn/wpm/*.js Disallow: /checkouts/ Disallow: /checkout Disallow: /carts Disallow: /cart Disallow: /account Disallow: /orders Disallow: /4389809/checkouts Disallow: /4389809/orders Disallow: /*preview_theme_id* Disallow: /*preview_script_id* Disallow: /*?*oseid=* Disallow: /collections/*sort_by* Disallow: /*/collections/*sort_by* Disallow: */collections/*filter*&*filter* Disallow: /search Disallow: /a/downloads/-/* Disallow: /admin Disallow: /sf_private_access_tokens Disallow: /apple-app-site-association Disallow: /.well-known/shopify/monorail Disallow: /recommendations/products Disallow: /*/recommendations/products Disallow: /products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remote Disallow: /*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remote Disallow: /collections/*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remote Disallow: /*/collections/*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remote Disallow: /*?pr_prod_strat= Disallow: /*&pr_prod_strat= Disallow: /*?pr_rec_id= Disallow: /*&pr_rec_id= Disallow: /*?pr_rec_pid= Disallow: /*&pr_rec_pid= Disallow: /*?pr_ref_pid= Disallow: /*&pr_ref_pid= Disallow: /*?pr_seq= Disallow: /*&pr_seq= Disallow: /*?_pos= Disallow: /*&_pos= Disallow: /*?_sid= Disallow: /*&_sid= Disallow: /*?_ss= Disallow: /*&_ss= Disallow: /*.atom Disallow: /*?currency= Disallow: /*¤cy= # === GOOGLE IMAGE BOT === User-agent: Googlebot-Image Allow: / Disallow: /web-pixels* Disallow: /*web-pixel* Disallow: /cdn/wpm/*.js Disallow: /checkouts/ Disallow: /checkout Disallow: /carts Disallow: /cart Disallow: /account Disallow: /orders # === GOOGLE ADS BOT === User-agent: adsbot-google Disallow: /checkouts/ Disallow: /checkout Disallow: /carts Disallow: /orders Disallow: /4389809/checkouts Disallow: /4389809/orders Disallow: /*?*oseid=* Disallow: /*preview_theme_id* Disallow: /*preview_script_id* Disallow: /cdn/wpm/*.js Disallow: /web-pixels* Disallow: /*web-pixel* Disallow: /sf_private_access_tokens Disallow: /products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remote Disallow: /*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remote Disallow: /collections/*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remote Disallow: /*/collections/*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remote # === BING === User-agent: Bingbot Allow: / Disallow: /web-pixels* Disallow: /*web-pixel* Disallow: /cdn/wpm/*.js Disallow: /checkouts/ Disallow: /checkout Disallow: /carts Disallow: /cart Disallow: /account Disallow: /orders Disallow: /4389809/checkouts Disallow: /4389809/orders Disallow: /*preview_theme_id* Disallow: /*preview_script_id* Disallow: /*?*oseid=* Disallow: /collections/*sort_by* Disallow: /*/collections/*sort_by* Disallow: */collections/*filter*&*filter* Disallow: /search Disallow: /a/downloads/-/* Disallow: /admin Disallow: /sf_private_access_tokens Disallow: /apple-app-site-association Disallow: /.well-known/shopify/monorail Disallow: /recommendations/products Disallow: /*/recommendations/products Disallow: /products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remote Disallow: /*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remote Disallow: /collections/*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remote Disallow: /*/collections/*/products/*-[a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9][a-f0-9]-remote # === DUCKDUCKGO === User-agent: DuckDuckBot Allow: / Disallow: /web-pixels* Disallow: /*web-pixel* Disallow: /cdn/wpm/*.js Disallow: /checkouts/ Disallow: /checkout Disallow: /carts Disallow: /cart Disallow: /account Disallow: /orders # === APPLE === User-agent: Applebot Allow: / Disallow: /web-pixels* Disallow: /*web-pixel* Disallow: /cdn/wpm/*.js Disallow: /checkouts/ Disallow: /checkout Disallow: /carts Disallow: /cart Disallow: /account Disallow: /orders # === SOCIAL CRAWLERS === User-agent: Pinterestbot Allow: / Disallow: /web-pixels* Disallow: /*web-pixel* Disallow: /cdn/wpm/*.js Disallow: /checkouts/ Disallow: /checkout Disallow: /carts Disallow: /cart User-agent: Pinterest Crawl-delay: 1 User-agent: FacebookExternalHit Allow: / Disallow: /web-pixels* Disallow: /*web-pixel* Disallow: /cdn/wpm/*.js Disallow: /checkouts/ Disallow: /checkout Disallow: /carts Disallow: /cart User-agent: Twitterbot Allow: / Disallow: /web-pixels* Disallow: /*web-pixel* Disallow: /cdn/wpm/*.js Disallow: /checkouts/ Disallow: /checkout Disallow: /carts Disallow: /cart # === SEO TOOLS (rate limited) === User-agent: AhrefsBot Crawl-delay: 10 Disallow: /a/downloads/-/* Disallow: /admin Disallow: /cart Disallow: /orders Disallow: /checkouts/ Disallow: /checkout Disallow: /4389809/checkouts Disallow: /4389809/orders Disallow: /carts Disallow: /account Disallow: /collections/*sort_by* Disallow: /*/collections/*sort_by* Disallow: */collections/*filter*&*filter* Disallow: /search Disallow: /sf_private_access_tokens Disallow: /apple-app-site-association Disallow: /.well-known/shopify/monorail Disallow: /cdn/wpm/*.js Disallow: /web-pixels* Disallow: /*web-pixel* Disallow: /recommendations/products Disallow: /*/recommendations/products User-agent: AhrefsSiteAudit Crawl-delay: 10 Disallow: /a/downloads/-/* Disallow: /admin Disallow: /cart Disallow: /orders Disallow: /checkouts/ Disallow: /checkout Disallow: /carts Disallow: /account Disallow: /search Disallow: /sf_private_access_tokens Disallow: /.well-known/shopify/monorail Disallow: /cdn/wpm/*.js Disallow: /web-pixels* Disallow: /*web-pixel* Disallow: /*?pr_prod_strat= Disallow: /*?pr_rec_id= Disallow: /*?pr_seq= Disallow: /web-pixels Disallow: /search User-agent: MJ12bot Crawl-delay: 10 User-agent: Nutch Disallow: / # === SITEMAP === Sitemap: https://www.goldia.com/sitemap.xml