How to scrape an olx website?

Question

PHP

Hello, I ran into one problem, I need to write a parser, when parsing it gives out null arrays
Link to the site
Here is an example code

$url = file_get_html('https://www.olx.ua/nedvizhimost/kharkov/?currency=USD');
 $findtest = $url->find('div.innerLayout');
echo $url;

Libraries that I tried to parse: simple dom html, phpQuery -> the result is the same


.

Answer 1

Obviously the site doesn't want to be scraped. You need to pretend to be a user, use good headers, User-Agent, ip etc...

Answer 2

They feel it's a bot and give it a stub. You have to learn to be more human)

Answer 3

puppeteer

Answer 4

CURL

Answer 5

Puppeteer. But not simple, but with a set of antideterminants

• useragent
  
• languages
  
• plugins
  
• notifications
  
• fingerprint
  
• etc
  

Puppeteer example in headless mode: false