irorb.ru/robots.txt:
User-Agent: *
Allow: /
Disallow: /?*
Disallow: /search/
Disallow: /cgi-bin/
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /wp-content/
Allow: /wp-includes/js/
Allow: /wp-content/themes/theme-ttweb/
Allow: /wp-content/uploads/
Crawl-delay: 10
Host: https://irorb.ru
User-Agent: Yandex
Allow: /
Disallow: /?*
Disallow: /search/
Disallow: /cgi-bin/
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /wp-content/
Allow: /wp-includes/js/
Allow: /wp-content/themes/theme-ttweb/
Allow: /wp-content/uploads/
Crawl-delay: 2
Host: https://irorb.ru
в яндексе
Прочее:
Ping/Trace,
История в Веб-архиве,
История владельцев,
Валидность HTML,
Валидность CSS,
Проверка на вирусы.
Запрашиваемая страница недоступна!
|