Machine Readiness
Stored receipt and evidence
20
65
0
0
0
Samples
No stored offer samples.
Samples
No stored action samples.
Samples
No stored product samples.
Document
# robots.txt - newsbreak.gr # Google - allow User-agent: Googlebot Allow: / Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /wp-json/ Disallow: /xmlrpc.php Disallow: /wp-cron.php Disallow: /wp-login.php Disallow: /?s= Disallow: /search/ # Bing - allow User-agent: bingbot Allow: / Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /wp-json/ Disallow: /xmlrpc.php Disallow: /wp-cron.php Disallow: /wp-login.php Disallow: /?s= Disallow: /search/ # Block SEO/scraper bots User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: DotBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: BLEXBot Disallow: / User-agent: PetalBot Disallow: / User-agent: SentiBot Disallow: / User-agent: coccocbot-web Disallow: / User-agent: coccocbot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: Timpibot Disallow: / User-agent: NewsRoom.BI Disallow: / User-agent: mrfCompass-Booldog Disallow: / # Default - all other bots User-agent: * Allow: / Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /wp-json/ Disallow: /xmlrpc.php Disallow: /wp-cron.php Disallow: /wp-login.php Disallow: /?s= Disallow: /feed/ Disallow: /author/*/page/ Disallow: /tag/*/feed/ Disallow: /category/*/feed/ # Sitemap Sitemap: https://www.newsbreak.gr/sitemap.xml Sitemap: https://www.newsbreak.gr/sitemap-news.xml
Document
Not stored for this site.
Document
Not stored for this site.