Answer the question
In order to leave comments, you need to log in
What to issue to search robots when indexing pages that have not yet been transferred to a new engine?
There are a lot of articles on the site, a forum, announcements, etc., I will change the engine. But if I endure everything at once, it will take a long time. Plus, when transferring, everything will need to be checked and published gradually.
I would like to launch it in a modular way ... I made a module, uploaded the data, launched it, opened the content as it was checked. What to do with search robots who know that these links are already in the search?
Answer the question
In order to leave comments, you need to log in
1- as an option, set up a temporary 302 redirect to the page of the articles section
2- another option is to leave the old version of the site on a test subdomain, for example, and make 302 redirects there
3- first transfer all the articles, then upload a completely finished site to the combat one (the most preferred option)
You need to create a robots.txt file in the root of the site with the following content:
User-agent: *
Disallow: /
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question