How to exclude links by regexp mask from scanning in XENU program?

Y

Y

Yuriy2019-04-24 11:14:19

Search Engine Optimization

Yuriy, 2019-04-24 11:14:19

How to exclude links by regexp mask from scanning in XENU program?

Hello everyone, is it possible to somehow exclude links by mask from scanning in the XENU program, for example, do not scan
links like
(.*)/?blalla
(.*)/*.(jpg|gif|svg|png)

Reply

Answer the question

Answer the question

In order to leave comments, you need to log in

1 answer(s)

A

Alexander Denisov, 2019-04-24
@Grinvind

Try removing the brackets. At least that's how it works in Screaming Frog. .*/ ?
blalla
.*jpg
.*gif
.*svg
.*png
crawlers do not scan pages through one / two, etc.

Similar questions

S

Sergey Burduzha2020-01-10 14:38:39

How to run 2 sites locally in nginx? 2Reply

I

IvanIvvanovv2021-04-13 18:19:10

In Yandex Webmaster, in Indexing - Check the status of the URL, I see "The page is crawled by a robot, but is not in the search." why can this be? 1Reply

M

Maxim2015-05-21 15:04:43

Why does a site with one domain appear in Google search results 2 or more times? 1Reply

E

Elbakidze2019-10-09 21:27:29

How to quickly make TK for a copywriter? 2Reply

M

Multigame2019-10-10 22:54:08

How to organize comments on the site for free? 5Reply

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question