Why are pages that are not included in the Google index (/mobile/, /m/, with www and without www)?

L

Legioner9112015-05-28 11:41:36

Google

Legioner911, 2015-05-28 11:41:36

Hello everyone.
Actually a subject.
Has anyone had a similar problem and why might it appear?
Is it really necessary to always add these links to the exception in robots when creating a site?
Thanks in advance for your reply.

Reply

Answer the question

In order to leave comments, you need to log in

2 answer(s)

M

Mark, 2015-05-28
@printf

There are (were) links to them, internal or external.

A

Agnislav, 2015-05-28
@agnislav

I will assume that Google when indexing asks for the most common subdomains and paths, even if there are no links to them. And if the web server returns something meaningful-content (for example, "page not found", but with a code of 200), puts the response in the index.