seotech.com.ua/robots.txt:
User-agent: *
Disallow: /wp-admin/
Disallow: /wp-login/
Disallow: /author/
Disallow: */page/
Disallow: */?swcfpc=1
Disallow: /customer-story/
Disallow: /*mas_static_content*
Disallow: /mas_static_content_cat
Disallow: /?s*
Disallow: /cgi-bin
Disallow: /?
Disallow: /articles/
Disallow: /wp-
Disallow: /wp/
Disallow: *?s=
Disallow: *&s=
Disallow: /search/
Disallow: /users/
Disallow: */trackback
Disallow: */feed
Disallow: */rss
Disallow: */embed
Disallow: */wlwmanifest.xml
Disallow: /xmlrpc.php
Disallow: *utm*=
Disallow: *openstat=
Disallow: /quiz/
Allow: /wp-admin/admin-ajax.php
Allow: */uploads
Allow: /*/*.js
Allow: /*/*.css
Allow: /wp-*.png
Allow: /wp-*.jpg
Allow: /wp-*.jpeg
Allow: /wp-*.gif
Host: https://seotech.com.ua
Sitemap: https://seotech.com.ua/sitemap_index.xml
User-agent: MJ12bot
Disallow: /
User-agent: Mediapartners-Google
Disallow: /
User-agent: AhrefsBot
Disallow: /
User-agent: Baiduspider
Disallow: /
User-agent: baidu
Disallow:/
User-agent: Baidu ( catchall )
Disallow: /
User-agent: Baiduspider/2.0
Disallow: /
User-agent: Bingbot/2.0
Disallow: /
User-agent: MegaIndex
Disallow: /
User-agent: megaIndex.ru
Disallow: /
User-agent: megaindex
Disallow: /
User-agent: MegaIndex.ru/2.0
Disallow: /
User-agent: LinkpadBot
Disallow: /
User-agent: PetalBot
Disallow: /
User-agent: dotbot
Disallow: /
в яндексе
Прочее:
Ping/Trace,
История в Веб-архиве,
История владельцев,
Валидность HTML,
Валидность CSS,
Проверка на вирусы.
Запрашиваемая страница недоступна!
|