# Block bad and non-helpful bots # Security scanners / attack tools User-agent: Nuclei User-agent: Riddler # Commercial SEO scrapers (drain crawl budget, no benefit) User-agent: MJ12bot User-agent: dotbot User-agent: BLEXBot User-agent: Barkrowler # Data harvesters User-agent: Zoominfobot User-agent: magpie-crawler User-agent: CazoodleBot # Generic scrapers User-agent: Go-http-client User-agent: Node/simplecrawler User-agent: Gigabot # Low-value crawlers User-agent: WikiDo User-agent: PetalBot Disallow: / # Allow all legitimate bots (Google, Bing, etc.) User-agent: * Disallow: /404 Disallow: /*/blog Sitemap: https://sokapicks.com/sitemap.xml