A
A
Antonio Solo2018-10-04 14:58:29
Parsing
Antonio Solo, 2018-10-04 14:58:29

Which technology stack to choose for a multi-threaded parser?

It is required to implement a parser that simultaneously executes the maximum possible number of requests. The task is to get data from a remote server and enter it into your database. There is no question of data processing.
Which technology stack to choose for Linkus server?
language: PHP/PYTHON ?
concurrency model: threads/processes ?
database: MySQL/postgresql (other)?

Answer the question

In order to leave comments, you need to log in

1 answer(s)
S
sim3x, 2018-10-04
@sim3x

scrapy and put files on hdd

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question