# robots.txt for Gauntlet AI (gauntletai.com) # Allow all crawlers for most pages User-agent: * Allow: / # Disallow Mainsail Program Guidelines page (private/internal use) Disallow: /mainsail-program-guidelines Disallow: /mainsail-program-guidelines.html # Sitemap (if you have one, uncomment and add the URL) # Sitemap: https://gauntletai.com/sitemap.xml # NOTE: Subdomains require their own robots.txt files. # For labs.gauntletai.com and review.gauntletai.com, deploy robots.txt # with the following content to each subdomain: # # User-agent: * # Disallow: /