User-agent: *
crawl-delay: 10

# Scrapers
Disallow: /*.lynkx?*
Disallow: /zoeken?*
Disallow: /login
Disallow: /whitepapers?q=*
Disallow: /whitepapers?*topic*
Disallow: /whitepapers?*text*
Disallow: /whitepapers?*published_min*
Disallow: /whitepapers?*published_max*
Disallow: /whitepapers?*searchFrom*
Disallow: /whitepapers?*searchUntil*

User-agent: Yandex
User-agent: MJ12bot
User-agent: AhrefsBot
User-agent: Sogou web spider
User-agent: Sogou spider
User-agent: Sogou inst spider
User-agent: Baiduspider
User-agent: Bytespider
Disallow: /

Sitemap: https://www.binnenlandsbestuur.nl/sitemap/index.xml.gz