R
R
Ruslan Makarov2019-07-03 23:01:23
Search Engine Optimization
Ruslan Makarov, 2019-07-03 23:01:23

How to hide from indexing in robots.xtx?

Good!
There is a page with a list of products, let's say: /podarok/ - it should be in the index.
And there is a filter by product parameters, applying which we get pages like:
/podarok/?fwp_price=2000&fwp_interesi=uyut-doma
/podarok/?fwp_price=5000&fwp_interesi=hozyajke
What line should be added to robots.txt so that the /podarok/ page is allowed for an index, and all of its filter options are disabled.
Thanks in advance!

Answer the question

In order to leave comments, you need to log in

2 answer(s)
B
bkosun, 2019-07-03
@facepook

More or less like this:

User-agent: *
Disallow: /podarok/*?

By the way, you can just specify canonical links:
You can also use special rules so that robots simply ignore unwanted links, thus reducing the load on the server:
https://yandex.ru/support/webmaster/robot-workings...
https://www.google.com/ webmasters/tools/crawl-url-...

P
Puma Thailand, 2019-07-04
@opium

Kaeonical seems to me much more appropriate here

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question