kaztrade.ru/robots.txt:
User-agent: Yandex
Disallow: /bitrix/
Disallow: *bitrix*
Disallow: *PAGEN*
Disallow: *ELEMENT_ID*
Disallow: *SHOWALL*
Disallow: /backend
Disallow: /cart
Disallow: /order
Disallow: /catalog
Disallow: /favorite
Disallow: /yupe/backend*
Disallow: /*/default*
Disallow: /index.php*
Disallow: /user/account/login
Disallow: /user/account/logout
Disallow: /user/account/recovery
Disallow: /login
Disallow: /logout
Disallow: /assets/
Disallow: */feed
Disallow: /search*
Disallow: /flowers*
Disallow: /callback
Disallow: /kazakhstan_republic*
Disallow: /russian_federation*
Disallow: *index.php*
Disallow: *rk.php*
User-agent: *
Disallow: /bitrix/
Disallow: *bitrix*
Disallow: *PAGEN*
Disallow: *ELEMENT_ID*
Disallow: *SHOWALL*
Disallow: /backend
Disallow: /cart
Disallow: /order
Disallow: /catalog
Disallow: /favorite
Disallow: /yupe/backend*
Disallow: /*/default*
Disallow: /index.php*
Disallow: /user/account/login
Disallow: /user/account/logout
Disallow: /user/account/recovery
Disallow: /login
Disallow: /logout
Disallow: /assets/
Disallow: */feed
Disallow: /search*
Disallow: /flowers*
Disallow: /callback
Disallow: /kazakhstan_republic*
Disallow: /russian_federation*
Disallow: *index.php*
Disallow: *rk.php*
Host: https://kaztrade.ru
Sitemap: https://kaztrade.ru/sitemap.xml
User-agent: Googlebot-Image
Allow: /images/
Allow: /uploads/
в яндексе
Прочее:
Ping/Trace,
История в Веб-архиве,
История владельцев,
Валидность HTML,
Валидность CSS,
Проверка на вирусы.
Запрашиваемая страница недоступна!
|