Machine Readiness
Stored receipt and evidence
20
65
0
0
0
Samples
No stored offer samples.
Samples
No stored action samples.
Samples
No stored product samples.
Document
# robots.txt for esmed.org - Allow AI bots but with rate limits # ChatGPT - Allow but slow down significantly User-agent: ChatGPT-User Crawl-delay: 10 # Allow crawling article pages and abstracts Allow: /MRA/mra/article/view/ # Limit PDF downloads - they can access but slowly Allow: /MRA/mra/article/download/ User-agent: GPTBot Crawl-delay: 10 Allow: /MRA/mra/article/view/ Allow: /MRA/mra/article/download/ # Google - Standard access User-agent: Googlebot Crawl-delay: 2 Allow: / # Bing - Standard access User-agent: bingbot Crawl-delay: 2 Allow: / # Amazon Alexa bot User-agent: Amazonbot Crawl-delay: 5 Allow: / # ByteDance (TikTok) - Slower User-agent: Bytespider Crawl-delay: 10 Allow: / # Block aggressive/unwanted bots completely User-agent: SemrushBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: MJ12bot Disallow: / # Default for all other bots User-agent: * Crawl-delay: 5 Allow: /
Document
Not stored for this site.
Document
Not stored for this site.