A
What files to exclude in robots.txt on a landing page?
Artyom, 2022-02-28 20:17:08
1 Reply
A
Artyom
2022-02-28 20:17:08
S
Shlyapa_1
2022-02-19 10:18:12
S
Shlyapa_1
2022-02-18 19:03:26
A
In the file robots.txt Disallow: // this will not lead to the closure of the entire site from indexing?
Albertic072, 2022-01-11 11:07:02
2 Reply
B
How to close such pages from the index?
bossigorxxx, 2021-09-29 14:17:01
1 Reply
B
bossigorxxx
2021-09-29 14:17:01
N
How to remove links with GET parameters from the output using Robots.txt?
Naked, 2021-09-14 12:15:05
1 Reply
G
How to make the correct robots.txt for a news site?
gsdgdfgf, 2021-08-26 22:08:47
2 Reply
G
gsdgdfgf
2021-08-26 22:08:47
D
How to disable indexing of all pages with a specific get-parameter in robots.txt?
damarkuzz, 2021-07-28 08:24:06
1 Reply
S
How to close duplicate pages with Bitrix GET parameters from indexing?
Sergey Nesterovsky, 2021-06-22 12:18:07
2 Reply
P
Did I close the page from indexing correctly?
Pavel Sidorov, 2021-06-14 22:12:36
9 Reply
P
Pavel Sidorov
2021-06-14 22:12:36
P
Is such a rule suitable for excluding the necessary pages from indexing?
photosho, 2021-05-07 16:04:03
0 Reply
D
How to close the path to /admin and all its files and subfolders in robots.txt for search robots?
dienerie, 2021-02-20 17:07:54
1 Reply
P
private13
2021-01-15 14:53:22
L
LisaElisa
2021-01-05 09:58:37
N
Do I need to specify the Sitemap index file in robots.txt in the sitemap directive?
Nikita, 2020-12-27 21:21:18
1 Reply
M
mihailmosienko
2020-12-01 16:28:18
D
How to disable all parameters in robots.txt except for certain ones?
dmkaruev, 2020-11-17 13:21:07
1 Reply
D
dmkaruev
2020-11-17 13:21:07
S
Host settings when starting mirrors, robots, what to do?
Sam Blade, 2020-09-05 20:09:12
0 Reply
S
Sam Blade
2020-09-05 20:09:12
K
Kamil
2020-09-04 12:40:53
D
If I have a sitemap without the .xml extension and like this www.site/ua/rus/sitemap/?
duykoff, 2020-09-01 14:58:47
1 Reply
D
How to make search robots access only what they need in robots.txt?
DocTypeMaster, 2020-08-28 16:11:04
1 Reply
V
Varoke
2020-07-11 13:32:39
G
How to close in robots # - sharp in URL?
Greg Plitt, 2020-05-30 12:15:52
1 Reply
G
Greg Plitt
2020-05-30 12:15:52
I
Ibishka
2020-05-09 18:02:39
I
Do I need to create robots.txt for a portfolio project?
Ibishka, 2020-05-08 00:41:38
1 Reply
I
Ibishka
2020-05-08 00:41:38
N
neo_centrist
2020-04-18 22:04:58
A
agromov91
2020-04-06 02:28:42
S
sHARek
2020-02-12 11:41:23
P
How to prevent certain text from being indexed via robots.txt?
peindigo, 2020-01-15 14:35:17
1 Reply
P
peindigo
2020-01-15 14:35:17
D
Dextor23
2020-01-14 14:06:59
D
Indexed despite being blocked in robots.txt?
Denis, 2019-12-19 09:39:33
1 Reply
D
Denis
2019-12-19 09:39:33
W
Why are the language versions of the site not indexed?
webfactory, 2019-12-03 17:50:21
1 Reply
W
webfactory
2019-12-03 17:50:21
B
How to exclude such links from robots.txt?
bossigorxxx, 2019-10-13 08:55:36
1 Reply
B
bossigorxxx
2019-10-13 08:55:36
A
Why don't google and yandex see the site?
Anton Myasnov, 2019-09-28 12:24:28
1 Reply
A
Anton Myasnov
2019-09-28 12:24:28
U
unlik
2019-05-23 16:23:23
A
How to close pagination pages in robots.txt?
Alexander Nameless08, 2019-04-30 16:53:59
1 Reply
A
Alexander Nameless08
2019-04-30 16:53:59
O
How to disable capital letters in robots txt?
Owl1981, 2019-03-05 08:55:42
2 Reply
O
Owl1981
2019-03-05 08:55:42
A
How to disable indexing of only a group of pages in robots.txt?
Alex-Broudy, 2019-02-18 13:11:12
2 Reply
A
Alex-Broudy
2019-02-18 13:11:12
O
How to block part of url from indexing in robots?
Owl1981, 2019-02-12 23:31:14
3 Reply
O
Owl1981
2019-02-12 23:31:14
M
How to close a subsection in robots.txt from the index?
MazHaz, 2019-02-12 13:03:35
2 Reply
M
MazHaz
2019-02-12 13:03:35
R
Is it possible to first close all pages from indexing and then enable only some?
Ruslan Yanborisov, 2018-12-10 12:40:14
1 Reply
V
Yandex WebMaster: Uploaded/Searching 153/1. How to clean "Downloaded" from garbage?
Vladimir Vladimirovich, 2018-11-11 11:30:49
1 Reply
R
How to set up sitemap.xml and robots.txt files in wordpress multisite?
Roman Govorov, 2018-09-11 10:44:51
1 Reply
E
How to close subcategories in Robots.txt?
Evgeny Korolev, 2018-09-01 17:04:18
0 Reply
E
Evgeny Korolev
2018-09-01 17:04:18
A
adam_carraway
2018-08-07 22:03:07
D
davc
2018-06-29 02:59:22
N
Which folders to close in robots.txt in laravel?
Nikita Rubinkovskiy, 2018-06-19 20:40:11
2 Reply
N
Nikita Rubinkovskiy
2018-06-19 20:40:11
S
How to remove the possibility of walking sites on the server via https when they do not have a certificate installed?
supermegacatdog, 2018-04-16 05:41:38
0 Reply
B
How to close indexing for filters in robots?
Barbie Killer, 2018-03-26 16:02:47
0 Reply
B
Barbie Killer
2018-03-26 16:02:47
A
How to open Zen access to indexing in robots.tx?
Airat Kadyrmaev, 2018-03-20 12:30:19
1 Reply
A
Airat Kadyrmaev
2018-03-20 12:30:19