How to generate a 404 error for all search engines?

A

A

aPilot2016-03-15 12:18:59

Search Engine Optimization

aPilot, 2016-03-15 12:18:59

How to generate a 404 error for all search engines?

How to issue a 404 error for all search engines on a certain file, but not for users?
How is it technically implemented?

Reply

Answer the question

Answer the question

In order to leave comments, you need to log in

2 answer(s)

D

Dimonchik, 2016-03-15
@dimonchik2013

1) check useragent
2) return 404
list of agents:
www.useragentstring.com/pages/Crawlerlist
see googlebot, bingbot, yandex, baidu, Mail.Ru Bot

M

Maronus, 2016-03-15
@Maronus

You need robots.txt . Settings may vary for different search engines, so go ahead and read the documentation for the ones you need.

Similar questions

E

Evgeny Kalibrov2015-12-15 11:10:47

Is it possible to get the ID of the user who clicked on the banner through the facebook advertising API? 0Reply

A

AlexPack2015-12-15 13:34:41

301 redirect with or without slash? 0Reply

V

Vlek2012-10-30 10:49:48

Two in one. What is the best way to translate Locating in the context of RTLS and how to increase the request rate? 0Reply

S

Serge9991112021-08-12 12:47:23

Will there be an effect of the SEO text on the main page, despite the fact that it comes after the blocks of endless content loading? 2Reply

G

god_we_trust2018-04-30 18:41:03

404 page response, code 200 (Joomla) how to solve this problem? 0Reply

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question