# START ROBOTS # G3 Ministries - Optimized for 2025 security & AI protection # Last updated: September 2025 - FIXED SOCIAL SHARING # ALLOW Social Media Crawlers (Essential for link previews) User-agent: facebookexternalhit Allow: / User-agent: Meta-ExternalAgent Allow: / User-agent: Twitterbot Allow: / User-agent: LinkedInBot Allow: / User-agent: WhatsApp Allow: / User-agent: TelegramBot Allow: / # Global rules for legitimate crawlers User-agent: * Allow: /wp-admin/admin-ajax.php Disallow: /wp-admin/ Disallow: /wp-login.php Disallow: /wp-json/ Disallow: /cdn-cgi/ Disallow: /dlm_uploads/ # Search/comment deduplication for cleaner SEO Disallow: /*?s= Disallow: /*?replytocom= # Sitemap location Sitemap: https://g3min.org/sitemap_index.xml # AI Training Crawler Blocking (2025 Critical) - CORRECTED User-agent: GPTBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Google-Extended Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: CCBot Disallow: / User-agent: Bytespider Disallow: / User-agent: PerplexityBot Disallow: / User-agent: OAI-SearchBot Disallow: / # Block non-beneficial crawlers User-agent: Riddler Disallow: / User-agent: CazoodleBot Disallow: / User-agent: Barkrowler Disallow: / User-agent: BLEXBot Disallow: / User-agent: magpie-crawler Disallow: / User-agent: Go-http-client Disallow: / User-agent: Node/simplecrawler Disallow: / User-agent: Nuclei Disallow: / User-agent: WikiDo Disallow: / User-agent: PetalBot Disallow: / User-agent: Zoominfobot Disallow: / User-agent: dotbot/1.0 Disallow: / User-agent: Gigabot Disallow: / User-agent: AdsBot-Google Disallow: / # END ROBOTS