# Twitterbot is allowed to crawl /claim links for preview cards, # but other crawlers (especially search engines) are disallowed # because claim links are sensitive and should not be indexed. User-agent: Twitterbot Allow: /claim* User-agent: * Allow: /post/* Allow: /profile/* Allow: /content/* Allow: /coin/* Allow: /beta/* Allow: /chat/* Allow: /invite/* Allow: /holiday-rewards* Allow: /og-image/* Allow: /pay/* Allow: /base-pay/* Allow: /rewards/* Allow: /swap/* Allow: /static-open-graph/* Allow: /download/* Allow: /download Allow: /app* Allow: /buy* Allow: /pay-request* Disallow: /claim* Disallow: /