Should this be set to allow in robots.txt?

D

Dmitry2016-02-19 13:48:30

Search Engine Optimization

Dmitry, 2016-02-19 13:48:30

Good day!
When creating a site (Bitrix), the developer wrote in robots.txt:
Allow: /bitrix/components/
Allow: /bitrix/cache/
Allow: /bitrix/js/
Allow: /bitrix/templates/
Allow: /bitrix/panel
/ I need to remove it. Am I correct?

Reply

Answer the question

In order to leave comments, you need to log in

1 answer(s)

O

Oleg Borzov, 2016-03-09
@iLeg0

Not really.
Google recommends opening js and css files for indexing.
The rest - close.

Similar questions

N

n__i__k_i__t_a2017-01-06 18:58:06

Seo optimization. how to change categories on the site without harm to seo, so as not to lose positions? 1Reply

J

Jony13372017-01-08 12:11:29

How does google index sites with similar content? 3Reply

D

DoubleWish2015-01-12 12:32:13

Updating the site and all CNCs on the old domain, but with saving the data, how to save the positions? 3Reply

D

Dmitry Volodarsky2017-01-10 23:50:11

When creating a site, what affects the further evaluation of the site by search engines and growth in search results? 3Reply

D

Dmitry2019-06-04 13:46:38

What information is better to place in the online store in the categories of the 1st and 2nd levels, product cards or cards with sections of the next category? 1Reply

Didn't find what you were looking for?

Ask your question