Do I need to create a robots.txt file in WordPress?

Question

robots.txt

Hello,
I switched to https, I read that it is necessary to make changes in the robots.txt file, it does not physically exist at the root , but it opens at the address,
how then to make changes to robots.txt? how to glue addresses and redirect to do? do I need to create this file and write down what is needed, or should I immediately install some plugin with an eye on seo-optimization in the future through it?

Answer 1

Hello, need.

User-agent: *
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /trackback
Disallow: */trackback
Disallow: */*/trackback
Disallow: */*/feed/*/
Disallow: */feed
Disallow: /*?*
Disallow: /tag
 
User-agent: Yandex
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /trackback
Disallow: */trackback
Disallow: */*/trackback
Disallow: */*/feed/*/
Disallow: */feed
Disallow: /*?*
Disallow: /tag
Host: ваш_сайт.ru
 
Sitemap: http://ваш_сайт.ru /sitemap.xml.gz
Sitemap: http://ваш_сайт.ru /sitemap.xml

Answer 2

how then to make changes to robots.txt?

You can create it manually. It is possible with help of SEO plugins.
Just do not pull any rubbish with the HS into it.
Redirect is not needed. Generally.

Answer 3

Yes, you do, if you respect your blog. Here you can read how

Answer 4

Here you can see robots.txt, which is now working fine https://wptuts.ru/robots-txt-dlja-wordpress/ . I usually set up with Yoast SEO

Answer 5

Here in this article https://dampi.ru/pravilnyiy-robots-txt-dlya-sayta-... I just described in detail everything that needs to be done. For those who like to shove anything into robots: if you open uploads for all bots, then uploaded PDF and other text files appear in the index. And in Yandex webmaster, in the "Excluded pages" report, error messages appear when indexing pictures, saying that the content is not supported. Before writing and giving advice, did you try to analyze the messages of GSC and YaWebmaster?