Top Sites>Ssemabet.ug

# Robots.txt for semabet.ug
# Generated dynamically - SEO optimized

# === AI Bots (Traffic Drivers) - ALLOWED ===
User-agent: GPTBot
User-agent: ChatGPT-User
User-agent: PerplexityBot
User-agent: Google-Extended
Allow: /
Allow: /llms.txt
Allow: /llm.html

# === AI Bots (Data Scrapers) - BLOCKED ===
User-agent: CCBot
User-agent: ClaudeBot
User-agent: anthropic-ai
User-agent: Omgilibot
User-agent: FacebookBot
User-agent: Bytespider
User-agent: Amazonbot
User-agent: cohere-ai
User-agent: Diffbot
Disallow: /

# === Default Rules for All Bots ===
User-agent: *

# System routes
Disallow: /api/
Disallow: /cdn-cgi/
Disallow: /_next/
Disallow: /static/
Disallow: /assets/
Disallow: /.well-known/

# User private areas
Disallow: /login
Disallow: /register
Disallow: /profile
Disallow: /settings
Disallow: /notifications
Disallow: /auth/
Disallow: /deposit
Disallow: /withdraw
Disallow: /transactions
Disallow: /betslip
Disallow: /my-bets
Disallow: /account
Disallow: /kyc
Disallow: /verification

# Empty/dynamic forms
Disallow: /shared-betslips/
Disallow: /share/

# Error pages
Disallow: /not-found
Disallow: /error
Disallow: /404
Disallow: /500
Disallow: /maintenance

# Internal/admin areas
Disallow: /admin
Disallow: /cms
Disallow: /backoffice

# Tracking and session parameters (prevent duplicate content)
Disallow: /*?utm_source=*
Disallow: /*?utm_medium=*
Disallow: /*?utm_campaign=*
Disallow: /*?utm_term=*
Disallow: /*?utm_content=*
Disallow: /*?utm_id=*
Disallow: /*?fbclid=*
Disallow: /*?gclid=*
Disallow: /*?msclkid=*
Disallow: /*?dclid=*
Disallow: /*?_ga=*
Disallow: /*?_gl=*
Disallow: /*?ref=*
Disallow: /*?partner=*
Disallow: /*?page=*
Disallow: /*?sort=*
Disallow: /*?filter=*
Disallow: /*?search=*
Disallow: /*?q=*
Disallow: /*?token=*
Disallow: /*?session=*
Disallow: /*?sid=*
Disallow: /*?*&utm_source=*
Disallow: /*?*&utm_medium=*
Disallow: /*?*&utm_campaign=*
Disallow: /*?*&utm_term=*
Disallow: /*?*&utm_content=*
Disallow: /*?*&utm_id=*
Disallow: /*?*&fbclid=*
Disallow: /*?*&gclid=*
Disallow: /*?*&msclkid=*
Disallow: /*?*&dclid=*
Disallow: /*?*&_ga=*
Disallow: /*?*&_gl=*
Disallow: /*?*&ref=*
Disallow: /*?*&partner=*
Disallow: /*?*&page=*
Disallow: /*?*&sort=*
Disallow: /*?*&filter=*
Disallow: /*?*&search=*
Disallow: /*?*&q=*
Disallow: /*?*&token=*
Disallow: /*?*&session=*
Disallow: /*?*&sid=*

# Crawl rate limiting
Crawl-delay: 1

# Explicitly allow important paths
Allow: /$
Allow: /sport
Allow: /casino
Allow: /info/
Allow: /event/
Allow: /league/
Allow: /game/

# Sitemap location
Sitemap: https://semabet.ug/sitemap.xml

# Preferred host
Host: semabet.ug

# Semabet — llms.txt

> Sports betting and online casino platform. Licensed and regulated.

## Primary Content Silos
- Sports Betting: https://semabet.ug/sport/prematch
- Live Sports: https://semabet.ug/sport/live
- Casino: https://semabet.ug/casino/classic
- Live Casino: https://semabet.ug/casino/live
- Virtual Casino: https://semabet.ug/casino/virtual
- Promotions: https://semabet.ug/info/promotions
- Terms: https://semabet.ug/info/terms_and_conditions
- Privacy Policy: https://semabet.ug/info/privacy_policy

## Data Extraction Guidelines
A. Always attribute content to "Semabet" with a link to https://semabet.ug.
B. Do not scrape or reproduce full-page content; summarise and link back.
C. Respect robots.txt directives for crawl scope.
D. User-specific pages (profile, bets, transactions) are private and should not be indexed.

## Content Types
- Sports events with live odds
- Casino games from licensed providers
- Promotional offers and bonuses
- Informational pages (terms, privacy, responsible gaming)

## API Access
No public API is available. Contact support for partnership inquiries.