www.novolab.ru/robots.txt:
User-agent: *
Disallow: /admin/
Disallow: /editor/
Disallow: /ckfinder/
Disallow: /code.gif/
Disallow: /json/
Disallow: /i/
Disallow: *?print
Disallow: *&print
Disallow: /*?page
Disallow: /index.php$
Disallow: /*?order=
Disallow: /*pdf
Disallow: /*bin
Disallow: /votes
Disallow: /*search
Disallow: /*compare
User-agent: Yandex
Disallow: /admin/
Disallow: /editor/
Disallow: /ckfinder/
Disallow: /code.gif/
Disallow: /json/
Disallow: /i/
Disallow: *?print
Disallow: *&print
Disallow: /*?page
Disallow: /index.php$
Disallow: /*?order=
Disallow: /*pdf
Disallow: /*bin
Disallow: /votes
Disallow: /*search
Disallow: /*compare
Host: https://www.novolab.ru/
User-agent: Googlebot
Disallow: /admin/
Disallow: /editor/
Disallow: /ckfinder/
Disallow: /code.gif/
Disallow: /json/
Disallow: /i/
Disallow: *?print
Disallow: *&print
Disallow: /*?page
Disallow: /index.php$
Disallow: /*?order=
Disallow: /*pdf
Disallow: /*bin
Disallow: /votes
Disallow: /*search
Disallow: /*compare
Sitemap: https://www.novolab.ru/sitemap.xml
в яндексе
Прочее:
Ping/Trace,
История в Веб-архиве,
История владельцев,
Валидность HTML,
Валидность CSS,
Проверка на вирусы.
Запрашиваемая страница недоступна!
|