S
S
stainer2020-02-04 14:46:06
Google
stainer, 2020-02-04 14:46:06

How to set up robots.txt for merchants?

Good afternoon.
Help solve the problem that some products do not want to be shown in merchants (google ads) due to an error in robots.txt ( robots.txt itself ). Writes that robots.txt is blocking page crawling.
Screenshots from merchants and the "url checker" tool:
5e39594264588626788407.png
5e39594c8d8a7994974448.png
Thanks in advance!

Answer the question

In order to leave comments, you need to log in

1 answer(s)
A
Andrey Kurtuchkin, 2020-02-06
@AndreyKurtuchkin

There is a link on the first screen "view examples". By looking at them you can determine which directive blocks those URLs that should not be blocked.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question