R
R
Roman2019-04-30 19:20:25
Parsing
Roman, 2019-04-30 19:20:25

How to scrape data from the site?

You need to get the price of wildberries.
Ideally, do it using php, but I'm not really sure that this is possible)
I tried to implement it using simple html dom. Everything worked out, but after downloading, wildberries changes the price, applying another discount. Here you need to find out the price along with this discount.
Tell me with what (web programming tools) can I implement this? Thanks

Answer the question

In order to leave comments, you need to log in

1 answer(s)
M
Maxim Timofeev, 2019-04-30
@gagablik

1. Probably there the price is tied to the session and / or cookies.
2. By means of php it can be done. CURL + parser. The "simple html dom" parser is fine, but slow. If only the price, then regular expressions will be faster. In general, there are a lot of parsers for php.
3. There is such a thing as request limits. So parsing 1 price should not be difficult. But when you start parsing by the thousands, there will be problems. Will ban your ip due to frequent requests. But here at least php, at least software, at least anything - the problem will remain. It is necessary to pause, use proxies, etc.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question