# # -------------------------------------------- # ROBOTS.TXT FOR UNWRAP.AI # -------------------------------------------- # 1. AI Search Agents # --------------------------------------------- User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: PerplexityBot User-agent: ClaudeBot User-agent: Claude-Web User-agent: anthropic-ai User-agent: Applebot-Extended Allow: / # 2. AI Training Bots # --------------------------------------------- User-agent: GPTBot User-agent: Google-Extended Allow: / # 3. General Bots # --------------------------------------------- User-agent: * Allow: / # 4. Sitemap # --------------------------------------------- Sitemap: https://www.unwrap.ai/sitemap.xml # _ _ _ # | | | | (_) # | | | |_ __ __ __ _ __ __ _ _ __ __ _ _ # | | | | '_ \\ \ /\ / /| '__|/ _` | '_ \ / _` | | | # | |__| | | | |\ V V / | | | (_| | |_) | | (_| | | | # \____/|_| |_| \_/\_/ |_| \__,_| .__/ \__,_| |_| # | | # |_|