# General rules for all user agents User-agent: * Disallow: /wp-content/uploads/wpforms/ Disallow: /wp-admin/ Allow: / Sitemap: https://www.uscloud.com/page-sitemap.xml Sitemap: https://www.uscloud.com/post-sitemap.xml # -- LLM / AI Crawlers -- User-agent: GPTBot # OpenAI Disallow: /wp-content/uploads/wpforms/ Disallow: /wp-admin/ Allow: / User-agent: ChatGPT-User # OpenAI chat browsing Disallow: /wp-content/uploads/wpforms/ Disallow: /wp-admin/ Allow: / User-agent: anthropic-ai # Anthropic Claude Disallow: /wp-content/uploads/wpforms/ Disallow: /wp-admin/ Allow: / User-agent: ClaudeBot # Alternative identifier for Claude Disallow: /wp-content/uploads/wpforms/ Disallow: /wp-admin/ Allow: / User-agent: Google-Extended # Google DeepMind (used for Bard/Gemini) Disallow: /wp-content/uploads/wpforms/ Disallow: /wp-admin/ Allow: / User-agent: DeepmindBot # Placeholder identifier (if adopted) Disallow: /wp-content/uploads/wpforms/ Disallow: /wp-admin/ Allow: / User-agent: CCBot # Common Crawl Bot, used in LAION datasets Disallow: /wp-content/uploads/wpforms/ Disallow: /wp-admin/ Allow: / User-agent: LAION # Placeholder for LAION-specific agent Disallow: /wp-content/uploads/wpforms/ Disallow: /wp-admin/ Allow: / User-agent: FacebookBot # Meta LLM research Disallow: /wp-content/uploads/wpforms/ Disallow: /wp-admin/ Allow: / User-agent: Applebot # Apple AI systems Disallow: /wp-content/uploads/wpforms/ Disallow: /wp-admin/ Allow: / User-agent: Amazonbot # Amazon/Alexa Disallow: /wp-content/uploads/wpforms/ Disallow: /wp-admin/ Allow: /