# Robots.txt for https://www.e-1.ru # Мебельная фабрика Е1 — шкафы-купе и гардеробные # Default rules for all bots User-agent: * Allow: / Disallow: /api/ Disallow: /e1admin/ Disallow: /cart Disallow: /checkout Disallow: /_next/ Disallow: /private/ Disallow: /project/ # Google User-agent: Googlebot Allow: / Disallow: /api/ Disallow: /e1admin/ Disallow: /cart Disallow: /checkout Disallow: /project/ # Yandex User-agent: Yandex Allow: / Disallow: /api/ Disallow: /e1admin/ Disallow: /cart Disallow: /checkout Disallow: /project/ Crawl-delay: 1 # ===== AI/LLM Crawlers ===== # OpenAI / ChatGPT User-agent: GPTBot Allow: / Disallow: /api/ Disallow: /e1admin/ Disallow: /cart Disallow: /checkout Disallow: /project/ Crawl-delay: 2 User-agent: ChatGPT-User Allow: / # Anthropic / Claude User-agent: anthropic-ai Allow: / Disallow: /api/ Disallow: /e1admin/ Disallow: /project/ User-agent: Claude-Web Allow: / # Google AI (Bard/Gemini) User-agent: Google-Extended Allow: / Disallow: /api/ Disallow: /e1admin/ Disallow: /project/ # Perplexity User-agent: PerplexityBot Allow: / Disallow: /api/ Disallow: /e1admin/ Disallow: /project/ Crawl-delay: 2 # Microsoft/Bing AI User-agent: Bingbot Allow: / Disallow: /api/ Disallow: /e1admin/ Disallow: /project/ # Common Crawl (used by many AI models) User-agent: CCBot Allow: / Disallow: /api/ Disallow: /e1admin/ Disallow: /project/ Crawl-delay: 3 # Meta AI User-agent: FacebookBot Allow: / Disallow: /api/ Disallow: /e1admin/ Disallow: /project/ # Cohere User-agent: cohere-ai Allow: / Disallow: /api/ Disallow: /e1admin/ Disallow: /project/ # ===== Sitemap & LLM Info ===== Sitemap: https://www.e-1.ru/sitemap.xml Host: www.e-1.ru # Product feeds # YML feed for Yandex.Market: https://www.e-1.ru/yml-feed.xml # Google Merchant feed: https://www.e-1.ru/google-feed.xml # Yandex Turbo pages: https://www.e-1.ru/turbo-feed.xml # LLM-specific information files # For AI assistants: see /llms.txt for company overview # Full details: /llms-full.txt