Answer the question
In order to leave comments, you need to log in
How to set up robots.txt for merchants?
Good afternoon.
Help solve the problem that some products do not want to be shown in merchants (google ads) due to an error in robots.txt ( robots.txt itself ). Writes that robots.txt is blocking page crawling.
Screenshots from merchants and the "url checker" tool:
Thanks in advance!
Answer the question
In order to leave comments, you need to log in
There is a link on the first screen "view examples". By looking at them you can determine which directive blocks those URLs that should not be blocked.
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question