I
I
Ibishka2020-05-09 18:02:39
robots.txt
Ibishka, 2020-05-09 18:02:39

Did I fill in robots.txt correctly?

User-agent: *
Disallow: /ajax/
Disallow: /assets/
Disallow: /includes/
Disallow: /404.php
Disallow: /db.php

Host: https://global-shop-9aff5.web.app

The fact is that in the assets folder there are only audio video pictures. Do I need to add assets to robots.txt?

Answer the question

In order to leave comments, you need to log in

1 answer(s)
D
Dimonchik, 2020-05-09
@dimonchik2013

if you do not want to be available - you need

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question