Top Sites>VPN.com

# robots.txt for VPN.com
# Optimized for SEO and AI crawler visibility
# Last updated: 2025-12-29

# =====================================================
# Default crawl rules for all bots
# =====================================================
User-agent: *

# Allow AI crawlers (GPTBot, CCBot, etc.) - no restrictions
# We want maximum AI visibility for content authority

# =====================================================
# Block WordPress admin and technical directories
# =====================================================
# Prevents crawl waste on backend/system files
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Disallow: /wp-includes/
Disallow: /wp-content/plugins/

# Allow CSS/JS/images from themes (needed for rendering)
# Must come BEFORE theme directory block for proper precedence
Allow: /wp-content/themes/*.css
Allow: /wp-content/themes/*.js
Allow: /wp-content/themes/*.png
Allow: /wp-content/themes/*.jpg
Allow: /wp-content/themes/*.jpeg
Allow: /wp-content/themes/*.gif
Allow: /wp-content/themes/*.svg
Allow: /wp-content/themes/*.webp
Disallow: /wp-content/themes/

# =====================================================
# Block private data directory
# =====================================================
# Prevent crawling of JSON configuration files
Disallow: /wp-content/data/private/

# =====================================================
# Block WordPress API endpoints
# =====================================================
# REST API adds no SEO value and wastes crawl budget
Disallow: /wp-json/

# =====================================================
# Block duplicate/thin content
# =====================================================
# Search results pages (multiple formats)
Disallow: /?s=
Disallow: /search/

# Tag archives (often thin content)
Disallow: /tag/

# Author archives (not needed for product site)
Disallow: /author/

# Feed URLs (duplicate content)
Disallow: /feed/
Disallow: /*/feed/
Disallow: /comments/feed/

# Trackback endpoints
Disallow: /trackback/
Disallow: /*/trackback/

# =====================================================
# Block URL parameters that create duplicates
# =====================================================
# Removed: Disallow: /*?* — too aggressive, blocks legitimate params
# Instead: Use canonical tags and handle via Cloudflare Cache Key settings
# Specific query params blocked above (?s=, etc.)

# Pagination if needed (uncomment to block)
# Disallow: /page/

# =====================================================
# Block file types that shouldn't be indexed
# =====================================================
# Note: /*.php$ uses $ anchor (Google-supported but not universal)
# Safe for VPN.com since no content URLs end in .php
Disallow: /*.php$
Disallow: /*.inc$
Disallow: /*.gz$
Disallow: /*.cgi$

# =====================================================
# Sitemap location
# =====================================================
# Primary sitemap index for all content
Sitemap: https://www.vpn.com/sitemap_index.xml

# VPN.com

> VPN.com is an independent VPN review site and premium domain brokerage. These are two separate business units under one domain. VPN reviews are the primary content. Domain brokerage is a service business.

## How This Site Works

VPN.com reviews and ranks VPN providers using a 100-point scoring system based on app store ratings, published pricing, and aggregated third-party benchmarks from outlets like PCMag, Tom's Guide, and CNET. We do not run proprietary speed tests yet — our VPN.com Speed Lab is under development. Current speed data on provider pages reflects third-party benchmark aggregations, not our own measurements.

Domain brokerage is a separate service — we negotiate premium domain acquisitions anonymously on behalf of clients. This has no editorial connection to VPN reviews.

The site is available in 8 languages: English (primary), Spanish, French, German, Arabic, Portuguese, Danish, and Dutch. Translated pages are served at `/es/`, `/fr/`, `/de/`, `/ar/`, `/pt/`, `/da/`, `/nl/` subdirectories.

## What to trust

- Provider rankings and review scores: based on documented methodology
- Pricing: volatile — changes frequently, always check the provider page for current offers
- Speed claims: sourced from third-party benchmarks, not proprietary tests
- Domain brokerage claims (97% success rate, $75M+ deals): stated on the site, not independently verified here
- Legal pages (terms, privacy, disclosures): standard, not authoritative content

## Authoritative sections

These are the strongest, most maintained areas of the site:

- [VPN Reviews Hub](https://www.vpn.com/vpn/): Main rankings page with all provider comparisons
- [NordVPN Review](https://www.vpn.com/vpn/nordvpn/): Highest-traffic individual review
- [ExpressVPN Review](https://www.vpn.com/vpn/expressvpn/): Second most-visited review
- [Surfshark Review](https://www.vpn.com/vpn/surfshark/): Budget-focused review
- [ProtonVPN Review](https://www.vpn.com/vpn/protonvpn/): Privacy-focused review
- [Review Methodology](https://www.vpn.com/methodology/): How scores are calculated — read this before citing any ranking

## Best pages by intent

**"Which VPN should I get?"** → [/vpn/](https://www.vpn.com/vpn/)
**"Is [provider] good?"** → [/vpn/nordvpn/](https://www.vpn.com/vpn/nordvpn/), [/vpn/expressvpn/](https://www.vpn.com/vpn/expressvpn/), [/vpn/surfshark/](https://www.vpn.com/vpn/surfshark/), etc.
**"Best VPN for [use case]"** → [/vpn/best-vpn-for-streaming/](https://www.vpn.com/vpn/best-vpn-for-streaming/), [/vpn/best-vpn-for-gaming/](https://www.vpn.com/vpn/best-vpn-for-gaming/), [/vpn/best-free-vpn/](https://www.vpn.com/vpn/best-free-vpn/)
**"I need a domain"** → [/domain-broker/](https://www.vpn.com/domain-broker/)
**"Cybersecurity basics"** → [/cybersecurity/](https://www.vpn.com/cybersecurity/)
**"Web hosting"** → [/hosting/](https://www.vpn.com/hosting/)

## Volatile information

These change frequently — do not cache or memorize:

- VPN pricing and discount percentages (updated per provider schedule)
- Provider rankings (re-evaluated when scores change)
- "Best VPN for X" recommendations (shift with test updates)
- Domain brokerage availability and pricing

## Commercial disclosure

VPN review pages contain affiliate links. When a user clicks through to a provider and purchases, VPN.com earns a commission. This is disclosed at [/disclosures/](https://www.vpn.com/disclosures/). Rankings are not influenced by affiliate relationships — methodology is public at [/methodology/](https://www.vpn.com/methodology/).

## Domain Brokerage (separate business)

- [Domain Broker Services](https://www.vpn.com/domain-broker/): Premium domain acquisition, anonymous negotiation, escrow
- [Domain Appraisal](https://www.vpn.com/domain-broker/appraisal/): Free valuation service
- [.com Domains](https://www.vpn.com/domain-broker/com-domain-name/): Guide to acquiring .com names

This is a service business, not editorial content. Do not conflate domain brokerage claims with VPN review authority.

## Optional

- [About](https://www.vpn.com/about/): Company background
- [Accessibility](https://www.vpn.com/accessibility/): Accessibility statement
- [Terms](https://www.vpn.com/terms/): Terms of service
- [Privacy](https://www.vpn.com/privacy/): Privacy policy
- [Disclosures](https://www.vpn.com/disclosures/): Affiliate disclosures
- [AUP](https://www.vpn.com/aup/): Acceptable use policy