O
O
Owl19812019-03-05 08:55:42
robots.txt
Owl1981, 2019-03-05 08:55:42

How to disable capital letters in robots txt?

Hello!
Faced the problem of duplicate URLs with uppercase letters URLs with uppercase letters. For example, "niviuk_ Slovo " duplicates "niviuk_ Slovo ". It is necessary that only the URL with a small letter remains. Rummaged the entire Internet. But I did not find how to prohibit the indexing of a range of URLs starting with capital letters AZ. Found it with numbers.
Disallow: /id_0*
But it doesn't work with letters.
Can you please tell me if it's possible to disable URLs starting with capital letters AZ after "niviuk_" on one line after "Disallow:" instead of writing each capital letter on a separate line (e.g., Disallow: /*niviuk_A; Disallow: /*niviuk_B etc.)?
Sincerely, Alexander.

Answer the question

In order to leave comments, you need to log in

2 answer(s)
B
BigSmoke, 2019-03-05
@BigSmoke

You rather need to write the correct urls in rel="canonical". True, I could not find information about whether search engines are case-sensitive in rel="canonical", but in theory they should.

O
Owl1981, 2019-03-05
@Owl1981

I am working in Joomla 2.5. In order to register canonical pages in it, you need to install a plugin and then configure it. It would be much easier if it would be possible to register a ban in robots. If it doesn’t work out in one line, I’ll make a ban for each URL, but I don’t want to clutter up the robots with scribbling.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question