# www.robotstxt.org/ # www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449 ############################ # Google ############################ User-agent: Googlebot Disallow: /action/ Disallow: /city Disallow: /archive Disallow: /chat/ Disallow: /search/ ############################ # Yandex ############################ User-agent: Yandex Disallow: /action/ Disallow: /city Disallow: /archive Disallow: /chat/ Disallow: /search/ ############################ # Chinese search engines — BLOCK ALL ############################ # Baidu User-agent: Baiduspider Disallow: / User-agent: Baiduspider-image Disallow: / # Sogou User-agent: Sogou web spider Disallow: / User-agent: Sogou inst spider Disallow: / User-agent: Sogou News Spider Disallow: / # 360 / Haosou User-agent: 360Spider Disallow: / User-agent: HaoSouSpider Disallow: / # Shenma User-agent: Yisouspider Disallow: / # ByteDance / TikTok ecosystem User-agent: Bytespider Disallow: / # Huawei Petal Search User-agent: PetalBot Disallow: / # Other Chinese bots User-agent: YoudaoBot Disallow: / User-agent: Sosospider Disallow: / User-agent: JikeSpider Disallow: / ############################ # All other bots ############################ User-agent: * Disallow: /action/ Disallow: /city Disallow: /archive Disallow: /chat/ Disallow: /search/ ############################ # Service directives ############################ Host: mom.life Sitemap: https://mom.life/sm2/sitemap.xml Sitemap: https://mom.life/api/sitemaps/sitemap-main.xml Sitemap: https://mom.life/api/sitemaps/sitemap-landing.xml Clean-param: query&Query&referrer&direction&invitedBy&page