The search robot has a Moscow ip and indexes only the Moscow page of the site, how to remove geo-dependence only from it?

Question

Search Engine Optimization

Good afternoon.
The site takes the user's region by ip and redirects the page to the desired region. The problem is that the search robot also has a Moscow ip, and therefore it stopped reaching the rest of the site.
Is it possible using .htaccess or robot.txt (or other means) to force it to bypass the region binding and go to the main page first?

Answer 1

Firstly, if different pages are given on your site using the same URL for different clients (by ip address), this is a gross mistake and search engines can even ban you for this. This also creates a lot of problems for users: a granddaughter from Moscow will not be able to give her grandmother in Saratov a link to a dress that she is currently considering. Therefore, you need to fix it first.
If the URLs are already configured correctly, for example: example.com/spb/index , example.com/msk/index then I don't see any problems:
1. You can use sitemap https://yandex.ru/support/webmaster/indexing-optio ... to tell the robot what to index.
2. You can place a link in the footer "we are in other regions", which leads to a page with links to all regional pages.
The most important thing here is to check the ip address only if the region is not yet specified in the URL, but if the region is already specified, then the engine should not automatically redirect it to another region, it can only offer it.
For example, I live in Moscow:
1. when I go to example.com, I am automatically redirected to example.com/msk
2. when I go to example.com/spb, they do not automatically throw me anywhere, but they show the link "want to switch to the version for Moscow ?"
Then everything will be fine with the robots.

Answer 2

Can filter by User-agent? (as an option)
All possible Yandex user agents are here https://yandex.ru/support/webmaster/robot-workings...