Machine Readiness
Stored receipt and evidence
27
90
0
0
0
Samples
No stored offer samples.
Samples
No stored action samples.
Samples
No stored product samples.
Document
User-agent: * Disallow: /url?q= Disallow: /*?*ajax=1* Disallow: /index.php/ Disallow: /*.js$ Disallow: /*.css$ User-agent: Mediapartners-Google Allow: / User-Agent: GPTBot Allow: /llms.txt Allow: /llms-full.txt Disallow: / User-Agent: anthropic-ai Allow: /llms.txt Allow: /llms-full.txt Disallow: / User-Agent: Amazonbot Allow: /llms.txt Allow: /llms-full.txt Disallow: / User-Agent: Googlebot Allow: / User-agent: Mediapartners-Google Allow: / User-Agent: Bingbot Allow: / User-Agent: Yandex Allow: / User-Agent: Exabot Allow: / LLM-Content: https://quiztest.me/llms.txt LLM-Full-Content: https://quiztest.me/llms-full.txt Sitemap: https://quiztest.me/sitemap-quiztest/sitemap.xml # 针对 Meta 爬虫的专属规则(优先级高于全局规则) User-agent: meta-externalagent # 设置抓取间隔:每 5 秒抓取 1 次,可根据服务器性能调整(单位:秒) Crawl-delay: 5 # 允许抓取标签页面(对应你收到请求的 /pl/tags 路径) Allow: /en/tags/ # 允许抓取网站首页及公开内容页(按需扩展) Allow: / Allow: /articles/ Allow: /products/ # 禁止 Meta 爬虫抓取敏感路径(与全局规则保持一致,双重保障) Disallow: /admin/ Disallow: /api/ Disallow: /private/
Document
文件不存在
Document
文件不存在