www.freedish.in/robots.txt:
User-agent: googlebot
User-agent: Googlebot-News
User-agent: Googlebot-Image
User-agent: Googlebot-Video
User-agent: Googlebot-Mobile
User-agent: mediapartners-google
User-agent: adsbot-google
User-agent: AdsBot-Google-Mobile-Apps
User-agent: GoogleOther
User-agent: Google-InspectionTool
User-agent: bingbot
User-agent: bingpreview
User-agent: msnbot
User-agent: MSNBot-Media
User-agent: AdIdxBot
User-agent: Slurp
User-agent: DuckDuckBot
User-agent: duckduckgo
User-agent: Baiduspider
User-agent: YandexBot
User-agent: YandexMobileBot
User-agent: YandexBlogs
User-agent: YandexNews
User-agent: yandex
User-agent: Teoma
User-agent: AOL
User-agent: Exabot
User-agent: facebot
User-agent: Applebot
User-agent: Lycos
User-agent: aolbuild
Disallow: /search?q=
User-agent: *
Disallow: /
#sitemap
Sitemap: https://www.freedish.in/sitemap.xml
Sitemap: https://www.freedish.in/sitemap-pages.xml
Sitemap: https://www.freedish.in/feeds/posts/default?orderby=UPDATED
в яндексе
Прочее:
Ping/Trace,
История в Веб-архиве,
История владельцев,
Валидность HTML,
Валидность CSS,
Проверка на вирусы.
Запрашиваемая страница недоступна!
|