# Global
User-Agent: *
llms-txt: https://www.xfree.com/llms.txt
Crawl-delay: 5
Disallow:


User-Agent: facebookexternalhit
Disallow:

User-agent: Twitterbot
Disallow:

User-agent: Googlebot
Disallow:

Sitemap: https://xfree.com/api/external/sitemap.xml