V
V
VicTHOR2020-07-10 12:08:49
Web development
VicTHOR, 2020-07-10 12:08:49

Is any server response closed from indexing?

If I want to create an empty subdomain and proxy its directories to different projects like /munin, /cockpit, /nagios (by the way, is this a good idea?), is it possible to somehow close the subdomain from robots without proxying it to the folder with robots. txt?
I just don’t want it to be in the lists on sites in the results of "all subdomains of the site"

Answer the question

In order to leave comments, you need to log in

1 answer(s)
S
Stalker_RED, 2020-07-10
@VicTHOR

You will have authorization there, right? That is, the robots will not go beyond the authorization page.
If there are no external links to this subdomain, then they will never find it.

without proxying it to a folder with robots.txt
why proxy? Let this subdomain have its own robots.txt with content
User-agent: *
Disallow: /

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question