# Robots.txt flavours and serving logic # - Primary marketing domains (simplepdf.com/.us/.eu and www.*): # served by this static file and allowed to be crawled. # - Tenant branded subdomains (.simplepdf.com/.us/.eu): # no separate robots.txt variant is served. # Indexing is blocked via SSR meta robots: # `client/pages/_app.tsx` -> `` # `client/components/head/index.tsx` -> `noindex, nofollow` meta tag. # * User-agent: * Allow: / # AI crawlers (explicit allow for agent distribution) User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / # Host Host: https://simplepdf.com # Sitemaps Sitemap: https://simplepdf.com/sitemap.xml