M
M
My joy2016-08-06 21:34:38
PHP
My joy, 2016-08-06 21:34:38

How to crawl 1000 sites as quickly as possible and get the response code from the main page?

Good evening comrades.
There is a need to go around 1000 (well, about that) sites, and get the response code of the main page, i.e. code 200 for example (if everything is ok). By what means can this be done as quickly as possible? (dedicated server).

Answer the question

In order to leave comments, you need to log in

1 answer(s)
A
Alexey Yarkov, 2016-08-06
@t-alexashka

$ wget --server-response -O /dev/null -i urls.txt

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question