SEO setup, how to correctly set the index in the X-Robots-Tag HTTP header?

Question

Google

Hello. there are a lot of non-indexed pages in google and yandex web master. writes that Page indexing is prohibited by the noindex tag, but there are no such restrictions. He also writes that there is no noindex directive in the X-Robots-Tag HTTP header. I am new to SEO. Please help! Thanks in advance!
link example - https://bona23.ru/product-category/bona/feed/

Answer 1

Page indexing is prohibited using the X-Robots-Tag HTTP header:

[[email protected]~]# curl -X HEAD -i https://bona23.ru/product-category/bona/feed/
HTTP/1.1 200 OK
Server: nginx-reuseport/1.13.4
Date: Wed, 17 Jul 2019 20:36:28 GMT
Content-Type: application/rss+xml; charset=UTF-8
Connection: keep-alive
Keep-Alive: timeout=30
X-Powered-By: PHP/7.1.21
Vary: Accept-Encoding,Cookie
ETag: "5b78413f0bbe0ff67eb22b8ffa203550"
X-Robots-Tag: noindex, follow
Link: <https://bona23.ru/wp-json/>; rel="https://api.w.org/"

Remove X-Robots-Tag or set the following value:
Alternative syntax:
https://developers.google.com/search/reference/rob...
https://yandex.ru/support/webmaster/controlling-ro...