J
J
Justin Bieber2017-04-25 07:58:59
Google
Justin Bieber, 2017-04-25 07:58:59

How to completely close the site from indexing and remove it from search engines?

You need to quickly remove the site from Google, Yandex and Mail search engines and so that the site can no longer be indexed by bots, what should I do in this case?

Answer the question

In order to leave comments, you need to log in

1 answer(s)
Y
Yuri, 2017-04-26
@JustinBieber

Add to .htaccess file:

SetEnvIfNoCase User-Agent "^Yandex" search_bot
SetEnvIfNoCase User-Agent "^Yahoo" search_bot
SetEnvIfNoCase User-Agent "^Googlebot" search_bot
SetEnvIfNoCase User-Agent "^Aport" search_bot
SetEnvIfNoCase User-Agent "^msnbot" search_bot
SetEnvIfNoCase User-Agent "^spider" search_bot
SetEnvIfNoCase User-Agent "^Robot" search_bot
SetEnvIfNoCase User-Agent "^php" search_bot
SetEnvIfNoCase User-Agent "^Mail" search_bot
SetEnvIfNoCase User-Agent "^bot" search_bot 
SetEnvIfNoCase User-Agent "bot" search_bot 
SetEnvIfNoCase User-Agent "^igdeSpyder" search_bot
SetEnvIfNoCase User-Agent "^Snapbot" search_bot
SetEnvIfNoCase User-Agent "^WordPress" search_bot
SetEnvIfNoCase User-Agent "^BlogPulseLive" search_bot
SetEnvIfNoCase User-Agent "^Parser" search_bot
SetEnvIfNoCase User-Agent "^Googlebot-Image" search_bot
SetEnvIfNoCase User-Agent "^StackRambler" search_bot
SetEnvIfNoCase User-Agent "^Adsbot-Google" search_bot
SetEnvIfNoCase User-Agent "^WebAlta" search_bot
SetEnvIfNoCase User-Agent "^Googlebot-Mobile" search_bot
SetEnvIfNoCase User-Agent "^YandexImages" search_bot
SetEnvIfNoCase User-Agent "http://www.google.com/bot.html" search_bot
 
<FilesMatch "^.*$">
Order Allow,Deny
Allow from all
Deny from env=search_bot
</FilesMatch>

And the .htaccess file with this code can be placed in any folder on the server that you want to prevent from indexing.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question