Answer the question
In order to leave comments, you need to log in
Can robots.txt and robots meta tag be used together?
Good afternoon!
There is a site in php, the pages of which are generated in the form site.ru/?view=razdel&id=1
I inserted robots meta tags on each page, somewhere I allowed indexing, somewhere I prohibited it. And I also created a robots.txt file, its contents are:
User-agent: *
Disallow: /images
Disallow: /js
Disallow: /lib
Disallow: /source
Disallow: /styles
Disallow: /tmpl
Disallow: /activate.php
Disallow: /login .php
Disallow: /settings.php
Host: site.ru
Do you need a robots.txt file at all?
I want to hide JavaScript in the js folder, classes in the lib folder, style files in the css folder, etc. index.php did not hide, or is it superfluous if there are meta tags?
Answer the question
In order to leave comments, you need to log in
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question