I
I
ivgenij72015-12-31 11:41:04
robots.txt
ivgenij7, 2015-12-31 11:41:04

How to forbid the robot to follow the url with two //?

it is very necessary to forbid the robot to follow the url with two // how to do it?
a url of this type site.ru/category1/sub-category1/sub-category2/page1
on the site cant with re-linking and duplicates are obtained site.ru/category1/sub-category1/sub-category2 // page1

Answer the question

In order to leave comments, you need to log in

1 answer(s)
A
Andrey Andrievsky, 2015-12-31
@andrievski88

Disallow: *//

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question