How to bulk check the list of sites for the presence of a page?

Question

css

Hello. There is a task to check the list (100,000 URLs) for codes 200 and 404.
Like the httpstatus.io web service, only for desktop and multi-threaded.

Answer 1

You can make two sections: in one of them there is a large block, in the other a small one. By clicking on the button, swap them.
Animations to "leave", this is already jQuery or handles.

Answer 2

JS

Answer 3

xargs -n1 -P 10 curl -o /dev/null --silent --head --write-out '%{url_effective};%{http_code};%{time_total};%{time_namelookup};%{time_connect};%{size_download};%{speed_download}\n' < url.lst | tee results.csv