Top Sites>SSeobility - Online SEO Software & Tools For Better Rankings

User-Agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Disallow: /*/keywordcheck/check/*
Disallow: /*/keywordchecker/check/*
Disallow: /*/seocompare/check/*
Disallow: /*/comparador-web-seo/check/*
Disallow: /*/rankingcheck/check/*
Disallow: /*/serpchecker/check/*
Disallow: /*/seocheck/pdfexport*
Disallow: /*/seochecker/pdfexport*
Disallow: /en/keyword-research-tool/check
Disallow: /de/keyword-recherche-tool/check
Disallow: /es/buscador-palabras-clave/check
Disallow: /pdfexample/
Disallow: /docs/ai/

User-Agent: Seobility
Disallow: /*/keywordcheck/
Disallow: /*/keywordchecker/
Disallow: /*/seocompare/
Disallow: /es/comparador-web-seo/
Disallow: /outbound/
Disallow: /pdfexample/
Disallow: /*/seocheck/
Disallow: /*/seochecker/
Disallow: /*/rankingcheck/
Disallow: /es/serpchecker/
Disallow: /de/wdf-idf-tool/
Disallow: /en/tf-idf-keyword-tool/
Disallow: /es/herramienta-tf-idf/

Sitemap: https://www.seobility.net/en/sitemap_index.xml

User-agent: GPTBot
Allow: /docs/ai/
Allow: /llms.txt

User-agent: ChatGPT-User
Allow: /docs/ai/
Allow: /llms.txt

User-agent: OAI-SearchBot
Allow: /docs/ai/
Allow: /llms.txt

User-agent: ClaudeBot
Allow: /docs/ai/
Allow: /llms.txt

User-agent: PerplexityBot
Allow: /docs/ai/
Allow: /llms.txt

User-agent: YouBot
Allow: /docs/ai/
Allow: /llms.txt

# Applebot crawling massively our results pages (blocked since March 31st 2026)
User-agent: Applebot
Disallow: /*/seocheck/check
Disallow: /*/seochecker/check

# Amazonbot crawling massively our results pages (blocked since March 31st 2026)
User-agent: Amazonbot
Disallow: /*/seocheck/check
Disallow: /*/seochecker/check

# Blocked 2026-03-31
User-agent: Turnitin
Disallow: /*/seocheck/check
Disallow: /*/seochecker/check

User-Agent: Slurp
Disallow: /*/seocheck/
Disallow: /*/seochecker/

User-Agent: ia_archiver
Disallow: /*/seocheck/
Disallow: /*/seochecker/

User-Agent: StackRambler
Disallow: /*/seocheck/
Disallow: /*/seochecker/

User-Agent: Baiduspider
Disallow: /*/seocheck/
Disallow: /*/seochecker/
Disallow: /en/keywordcheck/check

User-Agent: Sogou
Disallow: /*/seocheck/
Disallow: /*/seochecker/

# Blocked 2026-03-31
User-agent: panscient.com 
Disallow: /

User-Agent: SemrushBot
Disallow: /

User-Agent: SemrushBot-SA
Disallow: /

User-Agent: MJ12bot
Disallow: /*/seocheck/
Disallow: /*/seochecker/

User-Agent: AhrefsBot
Disallow: /

User-Agent: DotBot
Disallow: /

User-agent: Zookabot
Disallow: /

User-agent: 008
Disallow: /

User-agent: proximic
Disallow: /

User-agent: CrystalSemanticsBot
Disallow: /

User-agent: Larbin
Disallow: /

User-agent: BLEXBot
Disallow: /

#FROM http://de.wikipedia.org/robots.txt
# Crawlers that are kind enough to obey, but which we'd rather not have
# unless they're feeding search engines.
User-agent: UbiCrawler
Disallow: /

User-agent: DOC
Disallow: /

User-agent: Zao
Disallow: /

# Some bots are known to be trouble, particularly those designed to copy
# entire sites. Please obey robots.txt.
User-agent: sitecheck.internetseer.com
Disallow: /

User-agent: Zealbot
Disallow: /

User-agent: MSIECrawler
Disallow: /

User-agent: SiteSnagger
Disallow: /

User-agent: WebStripper
Disallow: /

User-agent: WebCopier
Disallow: /

User-agent: Fetch
Disallow: /

User-agent: Offline Explorer
Disallow: /

User-agent: Teleport
Disallow: /

User-agent: TeleportPro
Disallow: /

User-agent: WebZIP
Disallow: /

User-agent: linko
Disallow: /

User-agent: HTTrack
Disallow: /

User-agent: Microsoft.URL.Control
Disallow: /

User-agent: Xenu
Disallow: /

User-agent: larbin
Disallow: /

User-agent: libwww
Disallow: /

User-agent: ZyBORG
Disallow: /

User-agent: Download Ninja
Disallow: /

User-agent: Sogou web spider
Disallow: /

#
# The 'grub' distributed client has been *very* poorly behaved.
#
User-agent: grub-client
Disallow: /

#
# Doesn't follow robots.txt anyway, but...
#
User-agent: k2spider
Disallow: /

# Hits many times per second, not acceptable
# http://www.nameprotect.com/botinfo.html
User-agent: NPBot
Disallow: /

# A capture bot, downloads gazillions of pages with no public benefit
# http://www.webreaper.net/
User-agent: WebReaper
Disallow: /

# Seobility

> Seobility is an all-in-one SEO platform for website audits, keyword rank tracking (incl. Google AI Overviews), backlink monitoring, competitor analysis, and content optimization. This file lists the most important Seobility URLs for AI systems.

Primary notes:
- The main marketing site is https://www.seobility.net/ (EN/DE/ES available).
- The web app lives at https://app.seobility.net/ (requires an account).
- Authoritative entity/terminology grounding for AI systems is published here: https://seobility.net/ai/ai.html

## Core product

- [Homepage (EN)](https://www.seobility.net/en/): Main entry point; product overview, features, use cases, resources
- [Pricing](https://www.seobility.net/en/pricing/): Plans, limits, and trial info
- [Seobility app (login/dashboard)](https://app.seobility.net/): Web app (account required)

## Features & use cases

- [Website Audit](https://www.seobility.net/en/website-audit/): Technical & on-page auditing
- [Ranking Monitoring](https://www.seobility.net/en/ranking-monitoring/): Daily keyword tracking (incl. local results)
- [AI Overview Tracker](https://www.seobility.net/en/ai-overview-tracker/): Track visibility in Google AI Overviews for your keywords
- [Backlink Monitoring](https://www.seobility.net/en/backlink-monitoring/): Monitor backlink profile & link health
- [Competitor Analysis](https://www.seobility.net/en/seo-competitor-analysis-tools/): Competitor SEO analysis workflows
- [Keyword Research & AI Content Tools](https://www.seobility.net/en/seo-content-tools/): Keyword research, briefs, content optimization (incl. TF*IDF workflows)
- [Uptime Monitoring](https://www.seobility.net/en/uptime-monitoring/): Monitor availability and downtime alerts
- [Generative Engine Optimization (GEO)](https://www.seobility.net/en/generative-engine-optimization-tool/): Seobility’s GEO overview and related capabilities
- [Seobility for Businesses](https://www.seobility.net/en/seobility-for-businesses/): Use case page
- [SEO Software for Agencies & Freelancers](https://www.seobility.net/en/seo-software-for-agencies-and-freelancers/): Use case page
- [SEO Tool for Local Businesses](https://www.seobility.net/en/seo-tool-for-local-businesses/): Use case page

## APIs & technical docs

- [APIs by Seobility](https://www.seobility.net/en/seo-api/): API offerings overview
- [Dedicated SEO API docs (REST/JSON)](https://api.seobility.net/static/api/documentation.html): Reference documentation for the dedicated SEO API

## Resources & support

- [SEO Blog](https://www.seobility.net/en/blog/): Articles & guides
- [Seobility Wiki](https://www.seobility.net/en/wiki): SEO glossary / knowledge base
- [FAQ](https://www.seobility.net/en/faq/): Frequently asked questions
- [Seobility Beginner’s Guide](https://www.seobility.net/en/blog/seobility-beginners-guide/): Getting started guide
- [Contact](https://www.seobility.net/en/contact/): Contact & support entry point

## Free SEO tools

- [Free SEO Tools overview](https://www.seobility.net/en/free-seo-tools/): Directory of all free tools
- [SEO Checker](https://www.seobility.net/en/seocheck/): Free on-page/technical audit for a single website
- [Ranking Checker](https://www.seobility.net/en/rankingcheck/): Check rankings for a keyword
- [Backlink Checker](https://www.seobility.net/en/backlinkchecker/): Check backlinks for a URL or domain
- [Keyword Research Tool](https://www.seobility.net/en/keyword-research-tool/): Keyword discovery & SERP insights
- [TF*IDF Tool](https://www.seobility.net/en/tf-idf-keyword-tool/): TF*IDF analysis for content optimization
- [Redirect Checker](https://www.seobility.net/en/redirectcheck/): Redirect chain & status code checks
- [SERP Snippet Generator](https://www.seobility.net/en/serp-snippet-generator/): Preview titles/descriptions in SERPs
- [Keyword Checker](https://www.seobility.net/en/keywordcheck/): Check on-page optimization for a keyword
- [SEO Compare](https://www.seobility.net/en/seocompare/): Compare keyword optimization between two pages

## Company & legal

- [Seobility Team](https://www.seobility.net/en/team/): Company/team page
- [Affiliate Program](https://www.seobility.net/en/affiliates/): Affiliate program overview
- [Customer Stories](https://www.seobility.net/en/customers/): Case studies / customer examples
- [Terms of Service](https://www.seobility.net/en/terms/): Terms & Conditions
- [Privacy Policy](https://www.seobility.net/en/privacy/): Privacy
- [Imprint](https://www.seobility.net/en/imprint/): Legal notice / imprint

## Optional

- [Entity & Relational Grounding Data](https://seobility.net/ai/ai.html): Authoritative definitions of Seobility entities, terminology, and data relationships
- [Robots.txt](https://www.seobility.net/robots.txt): Crawl directives (incl. sitemap reference)
- [Sitemap index (EN)](https://www.seobility.net/en/sitemap_index.xml): XML sitemap index for the English site
- [Homepage (DE)](https://www.seobility.net/de/): German hub
- [Homepage (ES)](https://www.seobility.net/es/): Spanish hub