# Thunderbit: AI Web Scraper - Scrape any website in 2 clicks

> Markdown mirror of DialtoneApp's public top-site detail page for `thunderbit.com`.

URL: https://dialtoneapp.com/top-sites/thunderbit.com/index.md
Canonical HTML: https://dialtoneapp.com/top-sites/thunderbit.com

## Summary

- Domain: `thunderbit.com`
- Website: https://thunderbit.com
- Description: callable surface | score 16 | purchase crawl only | control token required
- Label: callable_surface
- Payment surface: Not available
- Purchase boundary: crawl_only
- Control boundary: token_required
- Rank: 220695

## robots

~~~text
# *
User-agent: *
Allow: /
Disallow: /*?
Disallow: /auth/*
Disallow: /internal/*
Disallow: /product/*
Disallow: /products/*
Disallow: /extension/*
Disallow: /pricing/subscription
Disallow: /pricing/next
Disallow: /chrome-extension
Disallow: /support
Disallow: /onboarding
Disallow: /playground
Disallow: /uploads
Disallow: /login
Disallow: /blog/all-articles/*
Disallow: /*/blog/all-articles/*
Disallow: /byte/*

# Allow Google Ads and Bing Ads crawlers to access /byte/
User-agent: AdsBot-Google
Allow: /byte/*

User-agent: AdsBot-Google-Mobile
Allow: /byte/*

User-agent: adidxbot
Allow: /byte/*

# Host
Host: https://thunderbit.com

# Sitemaps
Sitemap: https://thunderbit.com/sitemap.xml
~~~

## llms

Not found.

## llms-full

Not found.