U
U
Urukhayy2015-02-11 11:44:38
Google
Urukhayy, 2015-02-11 11:44:38

Will the site be indexed if robots.tx is not created?

Will the site be indexed if not creating robots.tx?

Answer the question

In order to leave comments, you need to log in

5 answer(s)
N
naXa!, 2015-02-11
@Urukhayy

Yes.
serverfault.com/questions/154820/what-happens-if-a...

A
Alexey Lebedev, 2015-02-11
@swanrnd

Will. However, there may be something superfluous indexed.

E
Evgeny Zon, 2015-02-12
@zonevgeniy

robots.txt is a recommendation for the PS. They can even index disallow. Usually there close doubles and snot. Better to do, work for an hour. site:domain.ru you type in a jar and look at all the rubbish in the search results.

S
Sergey Shilov, 2015-02-11
@Olivoin

Of course. This file sets the indexing rules, but does not prohibit it by default in any way if it is missing.

P
papamama, 2015-02-18
@papamama

Well, somehow sites on html were indexed when no one knew about this file, if you create a file, then it is easier for the search engine to work with you, and with whom it is easy to love

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question