User-agent: Mail.Ru Crawl-delay: 10 User-agent: PetalBot Disallow: / User-agent: * Disallow: /engine/go.php Disallow: /user/ Disallow: /newposts/ Disallow: /statistics.html Disallow: /*subaction=userinfo Disallow: /*subaction=newposts Disallow: /*do=lastcomments Disallow: /*do=feedback Disallow: /*do=register Disallow: /*do=lostpassword Disallow: /*do=addnews Disallow: /*do=stats Disallow: /*do=pm Disallow: /*do=search Disallow: /*do=download Disallow: /*do=go Disallow: /favorites/ Disallow: /lastnews/ Disallow: /2020/ Sitemap: https://shounen.ru/sitemap.xml Host: https://shounen.ru/