# 1. Broad Search Engine Directives User-agent: * Allow: / Allow: /pricing Allow: /documentation Allow: /templates Allow: /analytics Allow: /training Disallow: /api/ Disallow: /admin/ Disallow: /_next/ Disallow: /node_modules/ # 2. Specific AI Bot Optimization (The "GEO" Layer) # Allows AI to cite your documentation and public features User-agent: GPTBot Allow: /llms.txt Allow: /documentation/ Allow: /templates/ User-agent: Google-Extended Allow: / # This helps you show up in Google's AI Overviews User-agent: PerplexityBot Allow: /llms.txt Allow: /documentation/ # 3. Handling the "App" routes # We allow /dashboard but note: AI bots can't "log in", # so they only see the public marketing version or landing page. Allow: /dashboard Allow: /designer # 4. Global Sitemap Sitemap: https://xfigura.ai/sitemap.xml