Machine Readiness
Stored receipt and evidence
30
100
0
0
0
Samples
Offer samples
No stored offer samples.
Samples
Action samples
No stored action samples.
Samples
Product samples
No stored product samples.
Document
robots.txt
# As a condition of accessing this website, you agree to abide by the following # content signals: # (a) If a Content-Signal = yes, you may collect content for the corresponding # use. # (b) If a Content-Signal = no, you may not collect content for the # corresponding use. # (c) If the website operator does not include a Content-Signal for a # corresponding use, the website operator neither grants nor restricts # permission via Content-Signal with respect to the corresponding use. # The content signals and their meanings are: # search: building a search index and providing search results (e.g., returning # hyperlinks and short excerpts from your website's contents). Search does not # include providing AI-generated search summaries. # ai-input: inputting content into one or more AI models (e.g., retrieval # augmented generation, grounding, or other real-time taking of content for # generative AI search answers). # ai-train: training or fine-tuning AI models. # ANY RESTRICTIONS EXPRESSED VIA CONTENT SIGNALS ARE EXPRESS RESERVATIONS OF # RIGHTS UNDER ARTICLE 4 OF THE EUROPEAN UNION DIRECTIVE 2019/790 ON COPYRIGHT # AND RELATED RIGHTS IN THE DIGITAL SINGLE MARKET. # BEGIN Cloudflare Managed content User-agent: * Content-Signal: search=yes,ai-train=no Allow: / User-agent: Amazonbot Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: CloudflareBrowserRenderingCrawler Disallow: / User-agent: Google-Extended Disallow: / User-agent: GPTBot Disallow: / User-agent: meta-externalagent Disallow: / # END Cloudflare Managed Content User-agent: * Disallow: /api/ Allow: /api/_content Disallow: /_nuxt/ Disallow: /admin/ Disallow: /auth-action Disallow: /reset-password Host: https://llms-txt.io Sitemap: https://llms-txt.io/sitemap.xml Sitemap: https://llms-txt.io/es/sitemap.xml Sitemap: https://llms-txt.io/fr/sitemap.xml Sitemap: https://llms-txt.io/pt/sitemap.xml
Document
llms.txt
# #1 llms.txt file generator for AI-Friendly Websites (free) · LLMs.txt Generator > Free LLMs.txt Generator: Create AI-friendly llms.txt files for your website. Help AI systems better understand your content with the new standard for LLM-friendly documentation. ## Main - [llms-txt.io](https://llms-txt.io/) - [FAQ](https://llms-txt.io/faq) - [Login](https://llms-txt.io/login) - [Sign up](https://llms-txt.io/sign-up) ## Optional - [Blog](https://llms-txt.io/blog) - [Contact](https://llms-txt.io/contact) - [Privacy policy](https://llms-txt.io/privacy-policy) - [Terms of use](https://llms-txt.io/terms-of-use)
Document
llms-full.txt
# #1 llms.txt file generator for AI-Friendly Websites (free) · LLMs.txt Generator
> Free LLMs.txt Generator: Create AI-friendly llms.txt files for your website. Help AI systems better understand your content with the new standard for LLM-friendly documentation.
## Main
### llms-txt.io
Source: [https://llms-txt.io/](https://llms-txt.io/)
# Generate llms.txt files
for AI-friendly websites
Help AI systems understand your website
with the new standard for LLM-friendly content.
Generate
Select file type:
llms.txt llms-full.txt
Generates a basic navigation structure
## What is llms.txt?
llms.txt is a new standard that helps AI systems understand your website's content and structure more effectively.
### Optimize for AI
While robots.txt is for search crawlers, llms.txt is optimized for AI reasoning engines that need to understand your content.
### Structured navigation
Provide a streamlined view of your site's structure in a markdown format that AI systems can easily understand.
### Context optimized
Overcome AI context window limitations by providing essential information in a clean, focused format.
[ Learn more about llms.txt ](/blog/what-are-llms-txt-files)
## How it works
Generate and implement an llms.txt file for your website in three simple steps.
1
### Enter your website URL
Just provide your domain name, and our tool will analyze your website structure.
2
### Review and customize
We'll suggest an llms.txt structure based on your site. Edit it to highlight the most important content.
3
### Deploy to your website
Download the file and place it at your domain root (e.g., example.com/llms.txt).
## Example llms.txt
Here's what an llms.txt file looks like for a typical documentation site.
### Structured for AI understanding
The llms.txt format uses simple markdown that both humans and AI can read:
* H1 title defines the project or site name
* Blockquote provides a concise summary
* H2 headers organize documentation sections
* Optional section marks secondary resources
* Clear links to important content
# Project Name
> Project description with key information necessary
> for understanding the documentation.
Additional details about the project can go here.
## Documentation
- [Quick Start](https://example.com/docs/quickstart): Get started in minutes
- [API Reference](https://example.com/docs/api): Detailed API documentation
## Examples
- [Todo App](https://example.com/examples/todo): A simple todo application example
- [Authentication](https://example.com/examples/auth): Example implementing user authentication
## Optional
- [Blog](https://example.com/blog): Latest updates and tutorials
- [Community](https://example.com/community): Get help from the community
## Rapidly growing adoption
More websites and tools are adding llms.txt support every day.
### Cloudflare
[ /llms.txt ](https://developers.cloudflare.com/llms.txt)[ /llms-full.txt ](https://developers.cloudflare.com/llms-full.txt)
### X
[ /llms.txt ](https://docs.x.com/llms.txt)[ /llms-full.txt ](https://docs.x.com/llms-full.txt)
### Mangopay
[ /llms.txt ](https://docs.mangopay.com/llms.txt)[ /llms-full.txt ](https://docs.mangopay.com/llms-full.txt)
### HubSpot
[ /llms.txt ](https://developers.hubspot.com/docs/llms-full.txt)[ /llms-full.txt ](https://developers.hubspot.com/docs/llms-full.txt)
[ Find more companies ](/blog/companies-using-llms-txt-examples)
## Frequently asked questions
### What's the difference between llms.txt and robots.txt?
While robots.txt tells search crawlers which pages they can access, llms.txt helps AI systems understand your content's structure and meaning.
### Do I need to create both llms.txt and llms-full.txt?
llms.txt provides navigation structure, while the optional llms-full.txt contains complete documentation content. Our tool helps generate both.
### How do LLMs use this file?
Current AI systems don't automatically discover these files. Users can provide the file's content to AI tools, helping them better understand your site.
### Who created the llms.txt standard?
The standard was proposed by Jeremy Howard, co-founder of Answer.AI, to solve AI context window limitations when processing documentation.
[ Read full FAQ ](/faq)
## Make your site AI-friendly
Generate your llms.txt file and help AI systems better understand your content.
Generate now
### FAQ
Source: [https://llms-txt.io/faq](https://llms-txt.io/faq)
# Frequently asked
questions
## What is llms.txt?
The llms.txt file is a new web standard that provides AI systems with a streamlined, easy-to-understand version of your website content. It helps large language models (LLMs) overcome context window limitations by delivering essential information in a clean, focused format.
[What Are llms.txt Files? ](/blog/what-are-llms-txt-files)
## How is llms.txt different from robots.txt?
While robots.txt tells search crawlers which pages they can access, llms.txt helps AI systems understand your content structure and meaning. robots.txt is about permissions and access control, while llms.txt is about content comprehension.
[Robots.txt vs. llms.txt ](/blog/robots-txt-vs-llms-txt)
## What should an llms.txt file contain?
An llms.txt file must start with an H1 heading (the project name), followed by a blockquote summary of your site. Then it can include additional markdown sections with H2 headers organizing links to your important content. There is also an Optional section for secondary information.
## Do I need both llms.txt and llms-full.txt?
While llms.txt provides navigation structure, the optional llms-full.txt contains complete documentation content. For simpler websites, llms.txt alone is usually sufficient. For documentation sites, having both can be beneficial for AI comprehension.
[Do You Need Both llms.txt and llms-full.txt? ](/blog/llms-txt-and-llms-full-txt)
## How do AI systems use llms.txt files?
Current AI systems do not automatically discover these files. Users can provide the file content to AI tools (like Claude or ChatGPT) by pasting the URL, uploading the file, or copying the contents directly into their prompts. This gives the AI important context about your site.
[How Do LLMs Use the llms.txt File? ](/blog/how-do-llms-use-the-llms-txt-file)
## Who created the llms.txt standard?
The llms.txt specification was proposed by Jeremy Howard, co-founder of Answer.AI, to solve the challenge of AI systems struggling to process complex website documentation within their limited context windows.
## Where should I place the llms.txt file?
The llms.txt file should be placed at the root of your website domain (e.g., example.com/llms.txt), similar to robots.txt and sitemap.xml. This makes it easy for AI systems and users to find it.
[What Are llms.txt Files? ](/blog/what-are-llms-txt-files)
## Which companies are using llms.txt?
Adoption is growing rapidly. Companies like Anthropic, Mintlify, Cursor, and many documentation platforms have implemented llms.txt support. Any site that wants to be better understood by AI assistants can benefit from adding this file.
[7 Top Companies Using llms.txt ](/blog/companies-using-llms-txt-examples)
## How do I create an llms.txt file?
Our generator makes it simple - just enter your website URL and we will analyze your site structure to create an appropriate llms.txt file. You can then edit it to highlight the most important content before adding it to your website.
[What Are llms.txt Files? ](/blog/what-are-llms-txt-files)
## Is llms.txt only for technical documentation?
No, any website can benefit from an llms.txt file. While it is particularly valuable for technical documentation, it can also help AI systems understand e-commerce sites, blogs, personal websites, educational resources, and corporate sites. It is for any content you want AI to comprehend better.
[Is llms.txt Only for Technical Documentation? ](/blog/is-llms-txt-only-for-technical-documentation)
## How is llms.txt different from sitemap.xml?
Sitemap.xml lists all indexable pages but does not help with content processing. It contains too many pages to fit in the context window of an AI context window and does not distinguish between important and less important content. llms.txt is a curated, AI-friendly summary of your most relevant content.
## What is the format of an llms.txt file?
llms.txt uses Markdown format with a specific structure: an H1 title, a blockquote description, optional additional details, and then sections with H2 headers containing link lists. Each link should have a description. The Optional section marks content that can be skipped when context is limited.
[What Are llms.txt Files? ](/blog/what-are-llms-txt-files)
## Make your site AI-friendly
Generate your llms.txt file and help AI systems better understand your content.
[ Generate now ](/)
### Login
Source: [https://llms-txt.io/login](https://llms-txt.io/login)
[ llms-txt.io ](/)
# Sign in to your account
Don't have an account? [ Sign up ](/sign-up)
Continue with GoogleContinue with Google
OR
Continue with email
[ Forgot password? ](/reset-password)
[ Privacy policy ](/privacy-policy)[ Terms of use ](/terms-of-use)
### Sign up
Source: [https://llms-txt.io/sign-up](https://llms-txt.io/sign-up)
[ llms-txt.io ](/)
# Create an account
Already got an account? [ Log in ](/login)
Continue with GoogleContinue with Google
OR
Email
Password
Sign up with email
[ Privacy policy ](/privacy-policy)[ Terms of use ](/terms-of-use)
## Optional
### Blog
Source: [https://llms-txt.io/blog](https://llms-txt.io/blog)
*Optional content available at [https://llms-txt.io/blog](https://llms-txt.io/blog)*
### Contact
Source: [https://llms-txt.io/contact](https://llms-txt.io/contact)
*Optional content available at [https://llms-txt.io/contact](https://llms-txt.io/contact)*
### Privacy policy
Source: [https://llms-txt.io/privacy-policy](https://llms-txt.io/privacy-policy)
*Optional content available at [https://llms-txt.io/privacy-policy](https://llms-txt.io/privacy-policy)*
### Terms of use
Source: [https://llms-txt.io/terms-of-use](https://llms-txt.io/terms-of-use)
*Optional content available at [https://llms-txt.io/terms-of-use](https://llms-txt.io/terms-of-use)*