# https://www.robotstxt.org/robotstxt.html User-agent: * Disallow: /*?created_at* Disallow: /*?page=* Sitemap: https://www.phdscanner.com/sitemap.xml