Hide rubric from indexing?

A

agromov912020-04-06 02:28:42

robots.txt

agromov91, 2020-04-06 02:28:42

There is a site. News are located on the main page.
In order to avoid duplicates, you need to hide the /news/ page from indexing.

How to do this correctly? Whatever the rubric is not indexed, the entries located in it are indexed.

Reply

Answer the question

In order to leave comments, you need to log in

0 answer(s)

Similar questions

R

RuWproSha2021-08-08 15:56:31

Why does Google swear at robots.txt? 2Reply

Z

zencd2013-01-25 13:18:33

How to teach search engines not to give results with index.html, but still take it into account when crawling? 3Reply

G

gsdgdfgf2021-08-26 22:08:47

How to make the correct robots.txt for a news site? 2Reply

A

Alexey2016-01-31 03:12:34

How to remove bad URLs? 1Reply

D

Dmitry2016-02-19 13:48:30

Should this be set to allow in robots.txt? 1Reply

Didn't find what you were looking for?

Ask your question