Top Sites>Gastronomiebedarf zu Top Preisen | Gastrodax®

# robots.txt for gastrodax.de (MODERATE VERSION)
# Optimized to prevent URL explosion from Magento 2.4.8
# Generated: 2026-02-16
# ============================================================

# Block specific bots completely
User-agent: ia_archiver
Disallow: /

User-agent: TwengaBot
Disallow: /

User-agent: LCC
Disallow: /

# Rules for all other bots
User-agent: *

# ============================================================
# CRITICAL: STORE SWITCHER BLOCKING
# ============================================================

# Block Store Switcher URLs (B2B/B2C switching)
# THIS IS THE MAIN PROBLEM - ~80k-150k URLs!
Disallow: /stores/store/redirect/
Disallow: /*___from_store=*
Disallow: /*uenc=*

# ============================================================
# FILTER & PAGINATION (Moderate Approach)
# ============================================================

# Block complex filter combinations (most problematic)
Disallow: /*?*filter*&*
Disallow: /*filter_*&filter_*

# Block deep pagination (Page 5+)
Disallow: /*?p=5
Disallow: /*?p=6
Disallow: /*?p=7
Disallow: /*?p=8
Disallow: /*?p=9
Disallow: /*?p=1[0-9]
Disallow: /*?p=2[0-9]

# NOTE: Pages 1-4 are allowed for better crawl coverage
# They have noindex meta tags anyway via your SEO module

# ============================================================
# SORTING & MODES (Only combinations)
# ============================================================

# Block sorting combined with filters
Disallow: /*?*filter*order=*
Disallow: /*?*filter*dir=*
Disallow: /*?*filter*mode=*
Disallow: /*?*filter*limit=*

# ============================================================
# TECHNICAL BLOCKS
# ============================================================

# Block AJAX Requests
Disallow: /*?*ajax*
Disallow: /*?*isAjax*
Disallow: /ajax/

# Block Session IDs
Disallow: /*?SID=*
Disallow: /*?*SID=*

# ============================================================
# MAGENTO STANDARD BLOCKS
# ============================================================

# Admin Panel
Disallow: /admin/
Disallow: /admin_*/

# API Endpoints
Disallow: /api/
Disallow: /rest/
Disallow: /soap/
Disallow: /graphql

# Technical Directories
Disallow: /app/
Disallow: /bin/
Disallow: /dev/
Disallow: /lib/
Disallow: /phpserver/
Disallow: /pkginfo/
Disallow: /setup/
Disallow: /update/
Disallow: /var/
Disallow: /vendor/
Disallow: /generated/

# Error Pages
Disallow: /errors/
Disallow: /health_check.php

# Customer Account Pages
Disallow: /customer/
Disallow: /checkout/
Disallow: /wishlist/
Disallow: /sendfriend/

# Search & Compare
Disallow: /catalogsearch/
Disallow: /catalog/product_compare/

# Newsletter & Contact
Disallow: /newsletter/
Disallow: /contact/

# Review & Rating
Disallow: /review/
Disallow: /rating/

# Sales & Orders
Disallow: /sales/
Disallow: /onepage/
Disallow: /paypal/

# CMS Pages that shouldn't be indexed
Disallow: /index.php/
Disallow: /catalog/category/view/
Disallow: /catalog/product/view/

# ============================================================
# ALLOW IMPORTANT PATHS
# ============================================================

# Allow Static & Media Files
Allow: /static/
Allow: /media/

Sitemap: https://www.gastrodax.de/b2b-sitemap.xml

# Generated by FlipDev SEO for Magento 2

# Gastrodax - Professional Gastronomy Equipment
## B2B supplier for commercial kitchen equipment and stainless steel furniture

## Sitemap
https://www.gastrodax.de/sitemap.xml

## Main Categories
- Manufacturers: https://www.gastrodax.de/hersteller
- Themes: https://www.gastrodax.de/themen
- Kitchen Accessories: https://www.gastrodax.de/kuechenzubehoer
- Refrigeration: https://www.gastrodax.de/kuehlen
- Cooking: https://www.gastrodax.de/kochen
- Stainless Steel Furniture: https://www.gastrodax.de/edelstahlmoebel
- Dishwashing: https://www.gastrodax.de/spuelen
- Machines: https://www.gastrodax.de/maschinen
- Beverages: https://www.gastrodax.de/getraenke
- Transport: https://www.gastrodax.de/transport

## Contact
https://www.gastrodax.de/contact

## About
Gastrodax is a leading B2B supplier for professional gastronomy equipment in Germany, 
specializing in stainless steel furniture, commercial kitchen appliances, and refrigeration systems.