Answer the question
In order to leave comments, you need to log in
Why can't the robots.txt file be displayed on the WordPress site?
Good afternoon! Created a robots.txt file
User-agent: Yandex
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: */trackback
Disallow: */*/feed/*/
Disallow: */feed
Disallow: /*?*
Disallow: /tag
Disallow: /wp-login.php
Disallow: /wp-register.php
Disallow: /comments
Disallow: *?s=
Disallow:/comment-page-*
Disallow: /page/*
Disallow: *?all_comments
User-agent: *
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content/cache
Disallow: */trackback
Disallow: */*/feed/*/
Disallow: */feed
Disallow: /*?*
Disallow: /tag
Disallow: /wp-login.php
Disallow: /wp-register.php
Disallow: /comments
Disallow: *?s=
Disallow:/comment-page-*
Disallow: /page/*
Disallow: *?all_comments
Host: сайт.ру
User-agent: *
Disallow: /wp-admin/
Answer the question
In order to leave comments, you need to log in
Wordpress generates its own virtual robots.txt. You can turn it off with hooks: wordpress.stackexchange.com/questions/77969/how-to...
But I didn't use this filter, so I don't know how exactly it works.
Here is some more beautiful on wp-kama.ru
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question