novozybkov.ru/robots.txt:
User-agent: Mediapartners-Google*
Disallow:
User-agent: *
Disallow: */largemap.php
Disallow: /map/largemap*
Disallow: /blog/cgi-bin
Disallow: /blog/wp-admin
Disallow: /news/wp-admin*
Disallow: /blog/wp-includes
Disallow: /blog/wp-content/plugins
Disallow: /blog/wp-content/cache
Disallow: /blog/wp-content/themes
Disallow: /blog/wp-trackback
Disallow: /blog/wp-feed
Disallow: /blog/wp-comments
Disallow: */trackback
Disallow: */feed
Disallow: */comments*
Disallow: *comment-page*
Disallow: /blog/*?*
Disallow: /votes/*
Disallow: *popuplink*
Disallow: /files/*
Disallow: /news/comment-subscriptions*
Disallow: *compage*
Disallow: /sab/*
Disallow: /afisha/*
Clean-param: obj&x&y&street /map/
Clean-param: obj /architecture/map/
Host: novozybkov.ru
в яндексе
Прочее:
Ping/Trace,
История в Веб-архиве,
История владельцев,
Валидность HTML,
Валидность CSS,
Проверка на вирусы.
Запрашиваемая страница недоступна!
|