ukrlove.ru/robots.txt:
User-agent: Yandex
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-login.php
Disallow: /wp-register.php
Disallow: /xmlrpc.php
Disallow: */amp$
Disallow: */trackback/
Disallow: /wp-json/
Disallow: */comments/
Disallow: */comment/
Disallow: */attachment/*
Disallow: /author/
Disallow: /wp-content/uploads/*.php
Disallow: */print/
Disallow: *?print=*
Disallow: /wp-snapshots/
Clean-param: nowprocket&epik
Clean-param: __cf_chl_tk
User-agent: Googlebot
Disallow: /wp-content/uploads/*.php
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-login.php
Disallow: /wp-register.php
Disallow: /xmlrpc.php
Disallow: */trackback/
Disallow: /wp-json/
Disallow: */comments/
Disallow: */comment/
Disallow: */attachment/*
Disallow: /author/
Disallow: */print/
Disallow: *?print=*
Disallow: /wp-snapshots/
User-agent: Mail.Ru
Disallow: /wp-content/uploads/*.php
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-login.php
Disallow: /wp-register.php
Disallow: /xmlrpc.php
Disallow: */trackback/
Disallow: /wp-json/
Disallow: */comments/
Disallow: */comment/
Disallow: */attachment/*
Disallow: /author/
Disallow: */print/
Disallow: *?print=*
Disallow: */amp$
Disallow: /wp-snapshots/
User-agent: *
Disallow: /wp-content/uploads/*.php
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-login.php
Disallow: /wp-register.php
Disallow: /xmlrpc.php
Disallow: */trackback/
Disallow: /wp-json/
Disallow: */comments/
Disallow: */feed
Disallow: */comment/
Disallow: */attachment/*
Disallow: /author/
Disallow: */print/
Disallow: *?print=*
Disallow: */amp$
Disallow: /wp-snapshots/
User-agent: Mediapartners-Google
Disallow:
User-Agent: YaDirectBot
Disallow:
User-agent: AhrefsBot/5.1
Disallow: /
User-agent: AhrefsBot
Disallow: /
User-agent: SemrushBot
Disallow: /
User-agent: SemrushBot/1.1~bl
Disallow: /
в яндексе
Прочее:
Ping/Trace,
История в Веб-архиве,
История владельцев,
Валидность HTML,
Валидность CSS,
Проверка на вирусы.
Запрашиваемая страница недоступна!
|