User-agent: *               
                          
Disallow: /cgi-bin         
Disallow: /*?               
Disallow: /wp-admin                
Disallow: *?s=              
Disallow: *&s=             
Disallow: /search/          
Disallow: /author/          
Disallow: /users/   
Disallow: */feed            
Disallow: */rss             
Disallow: */embed           
Disallow: /xmlrpc.php       
Disallow: *utm*=          
Disallow: *openstat=        
Allow: */page/ 
Allow: */uploads  
Allow: *.js 
Allow: *.css
Allow: *.jpg
Allow: *.jpeg
Allow: *.png

Sitemap: https://cleverbots.ru/sitemap_index.xml