How to forbid the robot to follow the url with two //?

I

ivgenij72015-12-31 11:41:04

robots.txt

ivgenij7, 2015-12-31 11:41:04

it is very necessary to forbid the robot to follow the url with two // how to do it?
a url of this type site.ru/category1/sub-category1/sub-category2/page1
on the site cant with re-linking and duplicates are obtained site.ru/category1/sub-category1/sub-category2 // page1

Reply

Answer the question

In order to leave comments, you need to log in

1 answer(s)

A

Andrey Andrievsky, 2015-12-31
@andrievski88

Disallow: *//

Similar questions

K

Kee_real2018-10-22 07:44:53

How to allow search robots to access the site when htaccess is set to prohibit access from foreign countries? 3Reply

S