T
T
Tarik22032016-12-24 17:09:01
Search Engine Optimization
Tarik2203, 2016-12-24 17:09:01

How to close any address from a specific page from indexing?

Situation...
There is a page maxpart.com.ua/product-category/bloki/bloki-dlya-n... How to close everything after /bloki-sony/ from indexing??? (for example: maxpart.com.ua/product-category/bloki/bloki-dlya-n...
The second situation and question
For the same page I enter site: maxpart.com.ua/product-category/bloki/bloki-dlya- noutbukov/bloki-sony/
I get 2 extra pages instead of one:
maxpart.com.ua/product-category/bloki/bloki-dlya-n...
maxpart.com.ua/product-category/bloki/bloki- dlya-n...
It turns out that these are selected filters.Question: are these duplicates of the main page?After all, the title and description are identical.How could these pages get into the index?
Thanks in advance for your help!

Answer the question

In order to leave comments, you need to log in

5 answer(s)
A
amorphine, 2016-12-24
@amorphine

<noindex></noindex>?

A
Alexander, 2016-12-24
@NeiroNx

robots.txt file specifies robotstxt.org.ru/robotsexclusion/spec
file should be http://site.rf/robots.txt
Disallow: /product-category/bloki/bloki-dlya-noutbukov/bloki-sony/?filter

X
xmoonlight, 2016-12-25
@xmoonlight

robots.txt:
Disallow: /bloki-sony/

T
Tarik2203, 2016-12-27
@Tarik2203

It seems like I found the answer to the question. Added 2 lines to robots:
Disallow: */page/*
Disallow: *?*
The first operator closes all pages that contain "page" from indexing. The second - all pages with "?". "page" appears in the url only if you go to the second page of products in any category, and "?" only if some product filter is selected. Both that and another (on idea) - doubles.
Checked in Yandex webmaster. Everything seems to be ok.
b28999b56d2a4b39861bc1d4ebfc5e87.png

S
Sergey Davlyatov, 2017-02-15
@sdavlyatov

Everything is correct with "?"
But you will have to work hard with paging:
If you close the pagination page from the index, then how will the robot know what you have on the second page (the product will also not be included in the index) and how many products are in this category, and this is a ranking factor - how many products you offer 10 or 150.
Do it wisely:
1. For Yandex - write the rel="canonical" attribute on all pages pagination to the first page, except for the first one, and also set up a redirect from the first page to the category itself (to avoid duplicates)
2. For Google, the rel="canonical" attribute is suitable if you have a page with all the goods of this category and put it there, then you need to close it from the index through robotic pagination. RECOMMEND - Ideal for Google (combines with Yandex if you follow step 1). Register secondary attributes (read here https://support.google.com/webmasters/answer/16637... - This option will allow you to form the general essence of the entire chain of pages as one array, which will give all the weight to the first page, and increase the position of the site by category.
A couple of updates and pagination pages will fly out of the search for I and G, but the product is not. In 1-1.5 months, Google will form an entity and the position in the category will grow.
Good luck with SEO

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question