# START YOAST BLOCK # --------------------------- User-agent: * Disallow: /cdn-cgi/ Sitemap: https://aab-edu.net/sitemap_index.xml # --------------------------- # END YOAST BLOCK # ALLOW MAJESTIC CRAWLER # --------------------------- User-agent: MJ12bot Allow: / # Optional: Ensure it's not blocked by any wildcard rules User-agent: * Disallow: /cdn-cgi/