I
I
iakdrugyelena2020-08-16 11:06:55
Parsing
iakdrugyelena, 2020-08-16 11:06:55

How to weed out dead sites automatically when parsing?

Hello!
Firstly, a huge respect for this service and all the people here, especially those who do not pass by the questions of beginners!

The question is this:
There is a huge database of sites, you need to weed out the dead, abandoned, with an expired security certificate ...
How to do it automatically? What is the logic?
Where to look?

Answer the question

In order to leave comments, you need to log in

1 answer(s)
D
Dimonchik, 2020-08-16
@dimonchik2013

from the machine
, at first, DNS in general - quickly and efficiently,
then redirects the muzzle to advertising,
then timeouts
, or simply without certificates, but there are few of them in practice

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question