D
D
DeSharky2015-03-02 01:46:16
Google
DeSharky, 2015-03-02 01:46:16

Why is robots.txt not recognized by Google?

In general, I decided to start optimizing the site, went to google webmaster tools, showed errors in robots.txt. Site on WordPress, the file is generated on the fly. Hovering over the red dot shows "/ufeff". I understand google wants robots.txt to be utf-8 encoded w/o BOM. Website on a dedicated server under CentOS. Creating a robots.txt file with "handles" is an extreme measure, I want everything to work "normally". Who has any ideas?
12d714c4054944709f0966b35ea67887.png

Answer the question

In order to leave comments, you need to log in

3 answer(s)
V
Vyacheslav Barsukov, 2015-03-02
@slavabars

Well, you fix the script generator.

C
Chvalov, 2015-03-02
@Chvalov

And what does it say on the " More Info" button ?

J
Jacob, 2015-03-03
@Logrise

And what is there in front of the User-agent, I don’t see ...?

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question