# =========================================== # fmfm.jp robots.txt # =========================================== User-agent: * # Crawl delay (reduced from 30s to 10s) Crawl-delay: 10 # --- Admin / Member pages --- Disallow: /sp_reg/ Disallow: /member/ Disallow: /login Disallow: /organizer/register Disallow: /organizer/confirm Disallow: /organizer/send Disallow: /organizer/form Disallow: /organizer/forgot/ Disallow: /inquiry/ Disallow: /search Disallow: /sp_reg_test/ Disallow: /_feature/ Disallow: /webhook/ Disallow: /event_histories Disallow: /build/ # Note: CSS/JS are NOT blocked (for better SEO) # =========================================== # Googlebot # =========================================== User-agent: Googlebot # No crawl-delay for Googlebot Disallow: /sp_reg/ Disallow: /member/ Disallow: /login Disallow: /organizer/register Disallow: /organizer/confirm Disallow: /organizer/send Disallow: /organizer/form Disallow: /organizer/forgot/ Disallow: /inquiry/ Disallow: /search Disallow: /sp_reg_test/ Disallow: /_feature/ Disallow: /webhook/ Disallow: /event_histories Disallow: /build/ # =========================================== # Bingbot # =========================================== User-agent: Bingbot Crawl-delay: 10 Disallow: /sp_reg/ Disallow: /member/ Disallow: /login Disallow: /organizer/register Disallow: /organizer/confirm Disallow: /organizer/send Disallow: /organizer/form Disallow: /organizer/forgot/ Disallow: /inquiry/ Disallow: /search Disallow: /sp_reg_test/ Disallow: /_feature/ Disallow: /webhook/ Disallow: /event_histories Disallow: /build/ # =========================================== # Block harmful bots / AI scrapers # =========================================== User-agent: AhrefsBot User-agent: SemrushBot User-agent: MJ12bot User-agent: DotBot User-agent: BLEXBot User-agent: DataForSeoBot User-agent: GPTBot User-agent: CCBot User-agent: anthropic-ai User-agent: Claude-Web User-agent: Bytespider Disallow: / # =========================================== # Sitemap # =========================================== Sitemap: https://fmfm.jp/sitemap.xml