Answer the question
In order to leave comments, you need to log in
Will sitemap.xml be indexed if robots.txt contains disallow for the folder it is in?
Good evening. There is a main site, and a lot of dealer sites working on its base but from their own domains, in the interface of each dealer there are a number of settings for seo - they upload their sitemap.xml file there, but since the domain/sitemap.xml page is common for everyone, there hangs a script that generates xml with a link to the dealer file /upload/folder/folder/sitemap.xml . and everything would be fine, however, in robots.txt there is a disallow: /upload/ instruction, since the folder contains many other service files. Recently, the question arose whether search robots index the sitemap, the link to which is explicitly registered, provided that the file itself is located in a non-indexed directory?
PS. what can be changed is understandable, but at the moment the task is to understand the validity of the current implementation.
Answer the question
In order to leave comments, you need to log in
try adding the following line to the robots after disallow: /upload/:
and you can check if it is indexed through webmaster.yandex.ru
sitemap is not indexed.
You directly upload it to the search engine via a direct link to the file.
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question