Answer the question
In order to leave comments, you need to log in
Why is robots.txt not recognized by Google?
In general, I decided to start optimizing the site, went to google webmaster tools, showed errors in robots.txt. Site on WordPress, the file is generated on the fly. Hovering over the red dot shows "/ufeff". I understand google wants robots.txt to be utf-8 encoded w/o BOM. Website on a dedicated server under CentOS. Creating a robots.txt file with "handles" is an extreme measure, I want everything to work "normally". Who has any ideas?
Answer the question
In order to leave comments, you need to log in
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question