User-agent: * Disallow: /wp-login.php Disallow: /wp-admin/ Disallow: /cdn-cgi/ Disallow: /create-profile Disallow: /account Allow: /wp-admin/admin-ajax.php # OpenAI - GPT models & ChatGPT Search User-agent: GPTBot Allow: / # OpenAI Search Crawler User-agent: OAI-SearchBot Allow: / # Anthropic - Claude models User-agent: ClaudeBot Allow: / # Google AI / Gemini User-agent: Google-Extended Allow: / # Perplexity AI User-agent: PerplexityBot Allow: / # Scale AI User-agent: CCBot Allow: / # Bing / Copilot / Microsoft AI User-agent: bingbot Allow: / Sitemap: https://moving2canada.com/sitemap_index.xml