How to parse a web page using Jsoup?

Question

Java

public void methodAddDataTop3(TableView table) throws IOException {
        TableViewController tvController = new TableViewController();
        tvController.methodTableItemsClear(table);
        Document doc = Jsoup.connect("http://www.stoloto.ru/keno2/archive/").get();
        Elements newsHeadlines = doc.select("div.ashjf-0.dkbhVc");
            System.out.println(newsHeadlines.get(1).text());
    }

Hello!
How to parse this page? Other pages on this site are parsing fine, but this is the problem...
Ideally, you need to extract 20 digits of the circulation.

The error is this, the error hints that I specified the wrong doc.select, if I specify on other pages, let's say the page with the top 3 lottery, Rapido, etc., then everything is parsed normally.

Caused by: java.lang.IndexOutOfBoundsException: Index 0 out of bounds for length 0

Answer 1

Good afternoon.
As noted by colleague Sergey Gornostaev , the content of this page is formed dynamically. Accordingly, jsoup will not work.
You need to make a GET request to the REST service URL and get json, which will then need to be parsed.
Open your browser console and go to the "Network" tab. Select XHR in the filters and examine the requests.
You will see this url:

https://www.stoloto.ru/p/api/mobile/api/v34/service/draws/archive?count=10&game=keno2

And in response, json is used with the draws branch.
Using either json2pojo online service, create a pojo and use (gson, DomParser or jackson) to parse this json.
jsoup is not needed here.
You can also parse the page using selenium (controlling the browser), but in my opinion this is a bad solution.

Answer 2

Start the debugger and see what data is being processed when the error occurs. Probably, the numbers you are interested in are formed by javascript, and therefore they are not on the page for JSoup.