eco-nomos.ru/robots.txt:
User-agent: *
Disallow: /user/
Disallow: /backup/
Disallow: /engine/
Disallow: /language/
Disallow: /upgrade/
Disallow: /autobackup.php
Disallow: /admin.php
Disallow: /newposts/
Disallow: /lastnews/
Disallow: /engine/go.php
Disallow: /engine/download.php
Disallow: /statistics.html
Disallow: /*subaction=userinfo
Disallow: /*subaction=newposts
Disallow: /*do=lastcomments
Disallow: /*do=feedback
Disallow: /*do=register
Disallow: /*do=lostpassword
Disallow: /*do=addnews
Disallow: /*do=stats
Disallow: /*do=pm
Disallow: /xfsearch/
Disallow: /?do=actors
Disallow: /?do=actor
Disallow: /statistics.html
Disallow: /out/
Disallow: /blocks/
Disallow: *.php*
Disallow: */page/*
Disallow: /page*
Disallow: /index.php?do=orderdesc*
Disallow: /playlists/*
Disallow: /?*
Sitemap: /sitemap.xml
Sitemap: /2sitemap.xml
User-agent: AhrefsBot/5.1
Disallow: /
User-agent: AhrefsBot
Disallow: /
User-agent: SemrushBot
Disallow: /
User-agent: SemrushBot/7~bl
Disallow: /
User-agent: SemrushBot-SA
Disallow: /
User-agent: Yandex
Allow: /$
Disallow: /
User-agent: YandexBot
Allow: /$
Disallow: /
User-agent: Amazonbot
Disallow: /
User-agent: Bytespider
Allow: /$
Disallow: /
User-Agent: trendictionbot
Allow: /$
Disallow: /
User-agent: Amazonbot/0.1
Disallow: /
в яндексе
Прочее:
Ping/Trace,
История в Веб-архиве,
История владельцев,
Валидность HTML,
Валидность CSS,
Проверка на вирусы.
Запрашиваемая страница недоступна!
|