User-agent: * # --- Дозволяємо Google нормально сканувати --- Allow: /wp-content/uploads/ Allow: /wp-includes/js/ Allow: /wp-includes/css/ User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Allow: /wp-content/uploads/ Allow: /wp-content/themes/ Allow: /wp-content/plugins/ # --- Заборона для фідів тегів, рубрик, сторінок — щоб уникнути помилок Sitemap --- Disallow: /feed Disallow: /*/feed Disallow: /*/feed/ # --- Заборона архівів, якщо вони не потрібні в індексації --- # Якщо архіви автора не використовуються: Disallow: /author/ # Якщо ТЕГИ не повинні індексуватися (рекомендовано): Disallow: /tag/ # Якщо не хочете індексації пагінації: # Disallow: /page/ # --- Для картинок та медіафайлів (Google сам знає, але можна вказати) --- Allow: /wp-content/uploads/ #To block SemrushBot from crawling your site for different SEO and technical issues: User-agent: SiteAuditBot Disallow: / #To block SemrushBot from crawling your site for Backlink Audit tool: User-agent: SemrushBot-BA Disallow: / #To block SemrushBot from crawling your site for On Page SEO Checker tool and similar tools: User-agent: SemrushBot-SI Disallow: / #To block SemrushBot from checking URLs on your site for SWA tool: User-agent: SemrushBot-SWA Disallow: / #To block SplitSignalBot from crawling your site for SplitSignal tool: User-agent: SplitSignalBot Disallow: / #To block SemrushBot-OCOB from crawling your site for Content Toolkit: User-agent: SemrushBot-OCOB Disallow: / #To block SemrushBot-FT from crawling your site for Plagiarism Checker and similar tools: User-agent: SemrushBot-FT Disallow: / #To block RyteBot from crawling your site for tools provided by Ryte.com: User-agent: RyteBot Disallow: / #To block SemrushBot-ESI from crawling your site for services provided by Semrush Enterprise Site Intelligence: User-agent: SemrushBot-ESI Disallow: / Sitemap: https://mis.dp.ua/sitemap_index.xml # --------------------------- # END YOAST BLOCK