Answer the question
In order to leave comments, you need to log in
Will my site get value from external links that I put in robots.txt?
Hello people.
I am working on eliminating duplicate pages on the site, I added a line to robots.txt: Disallow: /*?a=*
When viewing external links, I noticed that a lot of sites link to these pages.
Will my site get value from external links that I put in robots.txt?
Answer the question
In order to leave comments, you need to log in
Theoretically, they are already indexed and will not disappear immediately, and apparently you will lose the reference mass as the search engine throws them out.
I think it's better not to remove it, but to prescribe a canonical url for them, because it was created for these cases
https://support.google.com/webmasters/answer/13906...
Then they will simply leave the search results, giving weight to the canonical page
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question