User-agent: * Allow: / Disallow: /cgi-bin/ Disallow: /join/ Disallow: /go/ Disallow: /goto-include-files/ Disallow: /rx/ Disallow: /cache/ Disallow: /search/ Disallow: /apc.php Disallow: /geoiptest.php # Block search/spam URLs Disallow: /*?s= Disallow: /*?replytocom= # Block feeds (waste crawl budget) Disallow: /tag/*/feed/ Disallow: /author/*/feed/ Disallow: /category/*/feed/ Disallow: /comments/feed/ # DO NOT block /page/ — it's WP pagination, needed for discovery Sitemap: https://esportbet.com/sitemap.xml