Machine Readiness
Stored receipt and evidence
20
65
0
0
0
Samples
No stored offer samples.
Samples
No stored action samples.
Samples
No stored product samples.
Document
# ----------------------------------------------- # General Crawl Rules # ----------------------------------------------- User-agent: * Allow: / # Admin & system Disallow: /wp-admin/ Disallow: /wp-admin/admin-ajax.php Disallow: /wp-login.php Disallow: /xmlrpc.php Disallow: /wp-cron.php Disallow: /wp-content/plugins/ Disallow: /wp-content/cache/ Disallow: /wp-content/themes/ Disallow: /wp-includes/ # Internal pages Disallow: /?s= Disallow: /search # Sensitive areas Disallow: /admin/ Disallow: /dashboard/ Disallow: /staging/ Disallow: /dev/ # E-commerce (if applicable) Disallow: /cart/ Disallow: /checkout/ Disallow: /my-account/ # Tracking parameters Disallow: /*?utm_ Disallow: /*?__hs Disallow: /?sessionid= Disallow: /?commentid= Disallow: /*?__hstc= Disallow: /*?__hssc= Disallow: /*?__hsfp= Disallow: /*?utm_source= Disallow: /*?utm_medium= Disallow: /*?utm_campaign= Disallow: /*?utm_term= Disallow: /*?utm_content # Low-value pages Disallow: /blog/tag/ Disallow: /trackback/ Disallow: /cgi-bin/ # Allow assets (important for SEO) Allow: /wp-content/uploads/ Allow: *.css Allow: *.js # Sitemap Sitemap: https://cyble.com/sitemap_index.xml # Google News Crawler # ----------------------------------------------- User-agent: Googlebot-news Allow: /blog/ Allow: /knowledge-hub/ # ----------------------------------------------- # AI Retrieval Bots — Explicitly Allowed # GEO: Generative Engine Optimization # ----------------------------------------------- # Anthropic Claude User-agent: ClaudeBot Allow: / # Anthropic Claude (alternate agent) User-agent: anthropic-ai Allow: / # OpenAI ChatGPT (Training) User-agent: GPTBot Allow: / # OpenAI ChatGPT (Browsing/Retrieval) User-agent: ChatGPT-User Allow: / # Google Gemini / AI Overviews User-agent: Google-Extended Allow: / # Perplexity AI User-agent: PerplexityBot Allow: / # Apple Intelligence User-agent: Applebot-Extended Allow: / # Meta AI User-agent: FacebookBot Allow: / # Microsoft Copilot (via Bing) User-agent: Bingbot Allow: / # Amazon Alexa AI User-agent: Amazonbot Allow: / # Cohere AI User-agent: cohere-ai Allow: /
Document
Not stored for this site.
Document
Not stored for this site.