User-agent: * Disallow: /export/ Disallow: /customizepdf/ Disallow: /matomo/ # ============================================================================ # SEO & SCRAPING TOOLS - Block # ============================================================================ User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: MJ12Bot Disallow: / User-agent: DotBot Disallow: / User-agent: Majestic Disallow: / User-agent: proximic Disallow: / # ============================================================================ # AI TRAINING & DATA HARVESTING - Block # ============================================================================ User-agent: GPTBot Disallow: / User-agent: CCBot Disallow: / User-agent: PetalBot Disallow: / User-agent: Bytespider Disallow: / User-agent: PerplexityBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: cohere-ai Disallow: / User-agent: Dataprovider.com Disallow: / User-agent: meta-externalfetcher Disallow: / # ============================================================================ # AI RETRIEVAL / SEARCH - Allow (appears in AI responses!) # ============================================================================ User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / User-agent: Perplexity-User Allow: / User-agent: MistralAI-User Allow: / User-agent: Claude-User Allow: / User-agent: Gemini-Deep-Research Allow: / User-agent: GoogleAgent Allow: / User-agent: NovaAct Allow: / Sitemap: https://calendar-yearly.com/storage/sitemap.xml