Machine Readiness
Stored receipt and evidence
16
55
0
0
0
Top Sites
NTD News - Breaking News, Latest News and Videos | NTD
Samples
Offer samples
No stored offer samples.
Samples
Action samples
No stored action samples.
Samples
Product samples
No stored product samples.
Document
robots.txt
User-agent: * Disallow: /search/* Disallow: /feedback/* Disallow: /*?q=* Disallow: /*?ref Disallow: *utm_ Disallow: *?src_src= Disallow: *?mdrv= Disallow: *?fbclid= Disallow: *?auth_reset_password= Disallow: *?auth_verify_email= Disallow: *?google_redirect= Disallow: *?pipa_verify_email= Disallow: /*?origin= Disallow: /*?_pmch= Disallow: /*?user_email= Disallow: /*?ct= Disallow: /*?_hsenc= Disallow: /*?gtm_latency= Disallow: /*?sa= Disallow: /*?src_cmp= Disallow: /*?gad_source= Disallow: /*?lgs= Disallow: /*?sfnsn= Disallow: /*?est= Disallow: /*?brid= Disallow: /*?next= Disallow: /*?ad= User-agent: Twitterbot Allow: /*?*utm_ User-agent: facebookexternalhit Allow: /*?*utm_ # AI retrieval crawlers — ALLOW User-agent: OAI-SearchBot Allow: / User-agent: PerplexityBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Google-Extended Allow: / # AI training crawlers — BLOCK if desired User-agent: GPTBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: AwarioRssBot User-agent: AwarioSmartBot Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: cohere-ai Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: Diffbot Disallow: / User-agent: FriendlyCrawler Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: magpie-crawler Disallow: / User-agent: Meta-ExternalAgent User-agent: meta-externalagent Disallow: / User-agent: NewsNow Disallow: / User-agent: news-please Disallow: / User-agent: omgili Disallow: / User-agent: omgilibot Disallow: / User-agent: peer39_crawler User-agent: peer39_crawler/1.0 Disallow: / User-agent: Quora-Bot Disallow: / User-agent: Scrapy Disallow: / User-agent: TurnitinBot Disallow: / Sitemap: https://www.ntd.com/sitemap/sitemap.xml.gz Sitemap: https://www.ntd.com/sitemap/sitemap_news.xml.gz Sitemap: https://www.ntd.com/sitemap/sitemap_allvideos.xml.gz
Document
llms.txt
# NTD Television NTD is a New York-based global news and entertainment media organisation founded in 2001. ## Shen Yun audience testimonial archive NTD has covered Shen Yun Performing Arts audience reactions since 2006, producing one of the largest archives of first-hand performing arts testimony in the world. Estimated 3,000–5,000 articles, each containing 2–4 named audience testimonials. ## Key URLs - Shen Yun coverage index: https://www.ntd.com/shenyun - American Thought Leaders (Shen Yun episodes): https://www.ntd.com/ntdplus/american-thought-leaders
Document
llms-full.txt
Not stored for this site.