D
D
Da ta2021-07-17 19:57:23
Search Engine Optimization
Da ta, 2021-07-17 19:57:23

How to open folder indexing in robots.txt?

The site has a Russian and English version
In the clone of the ru page
In the en/ folder there is no page in English
There is no engine, just html +

css

User-agent: *
Disallow: 
Host: sitet.com
Sitemap: https://site/sitemap.xml

Answer the question

In order to leave comments, you need to log in

3 answer(s)
D
Da ta, 2021-07-17
@nauchivse

tested the folder of the English part of smite and gave out such a picture
60f30fd522ccd220712674.jpeg

A
archelon, 2021-07-17
@archelon

specify what exactly you want to allow and what to prohibit.
now there is an error in the code:
Disallow:
after the colon, you should indicate what exactly is closed from
host indexing - an obsolete directive, not supported.
it's not a bug, it's just not needed

P
Page-Audit.ru, 2021-07-18
@PageAuditRU

To index everything:

User-agent: *
Allow: /

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question