L
L
Lev K2017-06-02 12:51:31
robots.txt
Lev K, 2017-06-02 12:51:31

How to write robots.txt correctly?

Hello.
I'm writing robots and ran into a problem.
It is necessary to prohibit all pagination pages for indexing, but leave 1, I do this:

user-agent: *
Disallow: */*page=
Allow: */*page=1

Will this solve my problem? Or */*page=1 will also fall under Disallow

Answer the question

In order to leave comments, you need to log in

3 answer(s)
N
Natan, 2017-06-12
@Leffken

Лев К вторая звездочка не нужна. Справка по настройке в Яндекс: https://yandex.ru/support/webmaster/controlling-ro...

User-agent: *
Allow: /*page=1
Disallow: /*page=

J
Janea Morari, 2017-06-02
@gabalugi90

user-agent: *
disallow: /
allow: /page=1

A
amaduha, 2017-07-02
@amaduha

Почитайте вот здесь, хорошо и доступна раскрыта тема robots.txt

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question