How to properly set up robots?

Question

Search Engine Optimization

Guys, how to set up robots.txt correctly?
I would like the robots to be able to only go to the trace of the link and that's it, but not pay attention to others:
https://test.ru/
/help
/catalog/1 - and so on
/product/1 - and so on
And so that in
/main /user/administration/login
/main/user/administration/settings
/main/user/administration/logout etc
Did not have access

Answer 1

You can disable everything by default, and then allow whatever you want. Or vice versa.
One:
Allow: /help
Allow: /catalog/
Allow: /product/ #allowed
allowed
Disallow: / #disabled the rest
Two:
Allow: / #allowed everything
Disallow: /main/user/administration/ #disabled forbidden
Sharing of directives

Answer 2

for Google, these options are advisory in nature, if something got into the index at these addresses, or there is an external link, these addresses will be crawled anyway.
In order to close from the robot in the body of the page, a prohibition must be written in the meta tag, either an HTTP header with a prohibition, or a 401 response is a password request, or 403/404/410