How to parse ajax web page?

Question

JavaScript

What are the methods and tools for parsing a page whose content is loaded via ajax when scrolling?
I suggest some options:
1) Analyze what type and address the ajax request is sent to, emulate these actions and parse the response.
2) Use browser automation tools (PhantomJS, selenium).
Suggestions, wishes, ideas?

Answer 1

If you need to parse two or three sites, then of course the first option. If there is a lot or complex logic - then a phantom, it's not so difficult.
If you do not parse for a long time and not often - a userscript / plugin for parsing. Opened the browser, pressed the button, waited, downloaded the file.

Answer 2

You described the only correct option under number 1. If you want hardcore and sex, you can implement it through a browser component and track container changes. But this is Thermorectal cryptanalysis.