# DiseaseMaps.org - Robots.txt # https://www.diseasemaps.org User-agent: * Allow: / # Block admin and user private areas Disallow: /*/administracion/ Disallow: /*/organization/ Disallow: /*/profile/ Disallow: /*/account/ Disallow: /*/messages/ # Block duplicate AMP pages Disallow: /*/top-questions/*/amp/ # Block registration/login pages Disallow: /*/login Disallow: /*/register # Sitemaps Sitemap: https://www.diseasemaps.org/sitemap.xml Sitemap: https://www.diseasemaps.org/sitemap2.xml # AI Crawlers - explicitly allowed User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / User-agent: PerplexityBot Allow: /