Machine Readiness
Stored receipt and evidence
20
65
0
0
0
Samples
No stored offer samples.
Samples
No stored action samples.
Samples
No stored product samples.
Document
User-agent: * Allow: / # Allow major AI crawlers User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: AhrefsBot Crawl-delay: 10 User-agent: SemrushBot Crawl-delay: 10 # Block system / technical folders Disallow: /admin/ Disallow: /login/ Disallow: /cart/ Disallow: /checkout/ Disallow: /account/ Disallow: /search Disallow: /*?* # Allow important content Allow: /wp-content/uploads/ # Block common CMS / unnecessary paths Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-login.php Disallow: /xmlrpc.php # Block search and internal queries Disallow: /?s= Disallow: /search/ # Block system and unnecessary files Disallow: /xmlrpc.php Disallow: /readme.html Disallow: /license.txt # Block filters, tracking, duplicates Disallow: /*?sort= Disallow: /*?filter= Disallow: /*?utm_= Disallow: /*&utm_= Disallow: /*?replytocom= # Allow important assets (important for SEO!) Allow: /*.css$ Allow: /*.js$ Allow: /*.jpg$ Allow: /*.jpeg$ Allow: /*.png$ Allow: /*.webp$ # Block author pages (optional, avoids duplicate content) Disallow: /author/ # Sitemap Sitemap: https://csc.lt/page-sitemap.xml
Document
# AI access policy User-agent: * Allow: / # Preferred content Preferred: https://www.csc.lt/ https://csc.lt/verslui/ https://csc.lt/privatiems/mobilusis-rysys/ https://csc.lt/apie/csc-telecom-lietuva/ # Sitemap Sitemap: https://www.csc.lt/sitemap.xml
Document
Not stored for this site.