# Crawlers Setup User-agent: * # Directories Disallow: /app/ Disallow: /bin/ Disallow: /dev/ Disallow: /lib/ Disallow: /phpserver/ Disallow: /pkginfo/ Disallow: /report/ Disallow: /setup/ Disallow: /update/ Disallow: /var/ Disallow: /vendor/ Disallow: /cdn-cgi/ # Paths Disallow: /checkout Disallow: /customer Disallow: /search Disallow: /wishlist Disallow: /catalog/category/view/ Disallow: /catalog/product/view/ Disallow: /*SID= Disallow: /blog/tag/ Disallow: /blog/archive/ Disallow: /blog/search/ # Parameters to prevent server overload Disallow: /*?customFilters Disallow: /*?priceMin Disallow: /*?priceMax Disallow: /*?sortKey Disallow: /*?sortDirection Disallow: /*?force_sid # Sitemaps Sitemap: https://www.eurokos.lt/media/eurokos_sitemap.xml Sitemap: https://www.eurokos.lt/media/blog_sitemap.xml