# Global Rules # ----------------- User-agent: * # Wordpress Specific # ----------------- Disallow: /wp-json/ Disallow: /?rest_route= Disallow: /wp-login.php Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php # Comment Rely Links # ----------------- Disallow: *?replytocom= # User Generated Search Results # ----------------- Disallow: /?s= Disallow: /page/*/?s= Disallow: /search/ # User Generated Staging Pages # ----------------- Disallow: /staging/ # Static Files # ----------------- Disallow: /resources_doc/ # Sitemap # ----------------- Sitemap: https://bluecatnetworks.com/sitemap-index.xml # Ban bots that don't benefit us. # -------------------------------- User-agent: Nuclei User-agent: WikiDo User-agent: Riddler User-agent: PetalBot User-agent: Zoominfobot User-agent: Go-http-client User-agent: Node/simplecrawler User-agent: CazoodleBot User-agent: dotbot/1.0 User-agent: Gigabot User-agent: Barkrowler User-agent: BLEXBot User-agent: magpie-crawler Disallow: /