User-agent: * Disallow: /cgi-bin/ Disallow: /wp-admin/ Disallow: /go/ Disallow: /index.php Disallow: /xmlrpc.php Disallow: *?wptheme Disallow: /?comments=* Disallow: /search? Disallow: /?p=* Disallow: /ko/ Disallow: /page/ Disallow: /wp-content/uploads/wp-import-export-lite/ User-agent: Mediapartners-Google* Allow: / User-agent: Googlebot-Image Allow: /wp-content/uploads/ User-agent: Adsbot-Google Allow: / User-agent: Googlebot-Mobile Allow: / # Specific rules for LLM Bots: Allow wide content access but maintain security # We explicitly block the backend folders again for these specific bots. User-agent: GPTBot Disallow: /cgi-bin/ Disallow: /wp-admin/ Disallow: /xmlrpc.php Disallow: /wp-content/uploads/wp-import-export-lite/ User-agent: ClaudeBot Disallow: /cgi-bin/ Disallow: /wp-admin/ Disallow: /xmlrpc.php Disallow: /wp-content/uploads/wp-import-export-lite/ User-agent: PerplexityBot Disallow: /cgi-bin/ Disallow: /wp-admin/ Disallow: /xmlrpc.php Disallow: /wp-content/uploads/wp-import-export-lite/ Sitemap: https://www.convert.com/sitemap_index.xml