W
W
webfactory2019-12-03 17:50:21
robots.txt
webfactory, 2019-12-03 17:50:21

Why are the language versions of the site not indexed?

Good afternoon. Faced a problem: Landing site on Wordpress, two language versions Russian (site.ru) and English (site.ru/en) implemented using the Polylang plugin. I didn’t write hreflang html tags manually, since the Polylang version is paid and it seems like everything is configured there on its own. The site.ru/sitemap.xml sitemap was created using the Yoast SEO plugin and the robots.txt file contains Sitemap: site.ru/sitemap.xml and Sitemap: site.ru/sitemap.xml.gz. The English page is not prohibited from indexing and it is in the sitemap. But Google Search Console and Yandex Metrika write that it is not indexed and it is not in the search. What could be the problem? Perhaps you need to make a separate map for the English version? If yes, how to do it? Maybe something else needs to be added to robots.txt? Even though he looks like this
User-agent: * # general rules for robots, except for Yandex and Google
Disallow: /cgi-bin
Disallow: /?
Disallow: /wp-
Disallow: /wp/
Disallow: *?s=
Disallow: *&s=
Disallow: /search/
Disallow: /author/
Disallow: /users/
Disallow: */trackback
Disallow: */feed
Disallow: */ rss
Disallow: */embed
Disallow: */wlwmanifest.xml
Disallow: /xmlrpc.php
Disallow: *utm*=
Disallow: *openstat=
Allow: */uploads
User-agent: GoogleBot # rules for Google
Disallow: /cgi-bin
Disallow: /?
Disallow: /wp-
Disallow: /wp/
Disallow: *?s=
Disallow: *&s=
Disallow: /search/
Disallow: /author/
Disallow: /users/
Disallow: */trackback
Disallow: */feed
Disallow: */ rss
Disallow: */embed
Disallow: */wlwmanifest.xml
Disallow: /xmlrpc.php
Disallow: *utm*=
Disallow: *openstat=
Allow: */uploads
Allow: /*/*.js
Allow: /*/*. css
Allow: /wp-*.png
Allow: /wp-*.jpg
Allow: /wp-*.jpeg
Allow: /wp-*.gif
Allow: /wp-admin/admin-ajax.php
User-agent: Yandex # rules for Yandex
Disallow: /cgi-bin
Disallow: /?
Disallow: /wp-
Disallow: /wp/
Disallow: *?s=
Disallow: *&s=
Disallow: /search/
Disallow: /author/
Disallow: /users/
Disallow: */trackback
Disallow: */feed
Disallow: */ rss
Disallow: */embed
Disallow: */wlwmanifest.xml
Disallow: /xmlrpc.php
Allow: */uploads
Allow: /*/*.js
Allow: /*/*.css
Allow: /wp-*.png
Allow: /wp-*.jpg
Allow: /wp-*.jpeg
Allow: /wp-*.gif
Allow: /wp-admin/admin-ajax.php
Sitemap: https://site.ru/sitemap.xml
Sitemap: https://site.ru/sitemap.xml.gz

Answer the question

In order to leave comments, you need to log in

1 answer(s)
S
Syomka Gavrilenko, 2019-12-03
@cema93

Check pages for other languages. maybe they have a canonical link

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question