User-agent: * Disallow: # AI Crawlers User-agent: * Allow: /llms.txt