A
A
akula222018-02-13 19:18:40
Search Engine Optimization
akula22, 2018-02-13 19:18:40

Does it make sense to prohibit the Yandex robot from links such as /news?

It makes sense to prohibit the Yandex robot from links such as /news /news/page-2 and so on. displaying lists of news (title, preview text) if I use a sitemap that gives the robot direct links to news (internal) ?
and the second question about categories, in principle, the same news is duplicated there as in news, but only by category, you need to close them through robots.txt&

Answer the question

In order to leave comments, you need to log in

3 answer(s)
P
Puma Thailand, 2018-02-13
@opium

No, this is more idiotic.

D
Dmitry, 2018-02-13
@mytmid

No need to ban anything, search engines don't like bans.
Use rel=”canonical"
Links:
https://yandex.ru/support/webmaster/controlling-ro...
https://yandex.ru/blog/webmaster/10371

P
Pavel Myshkin, 2018-02-15
@Pazys

1. No need to ban, use rel=”canonical" in pagination
2. If there is nothing unique there, you can ban it, if there are at least 200 characters of unique text, for example, a category description, then you don’t need to ban it.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question