Is it possible to scrape a website consistently with Jsoup?

Question

Java

I am writing a website parser using Jsoup. Sometimes everything works fine, sometimes a ConnectException Connection refused exception is thrown. As I understand it, there are many reasons for this. As well as from the client side (I doubt that there is something on my side, there is no firewall), and from the server side. Is it possible to fix this?

Answer 1

I doubt there is anything on my end.

Try WebView, if the problem persists, then definitely not.

Answer 2

jsoup is an ingenious HTML parser,
but as an http client it's not the best choice. get better apache http or google http client