M
M
martensit2016-11-06 23:04:07
Parsing
martensit, 2016-11-06 23:04:07

What programming language for a beginner to choose for parsing?

You need to write a lot of multi-threaded software (> 1000 threads) to work with social networks. networks, (only for themselves)
Most of the social. networks on js scripts naturally.
I realized that it’s easier to learn the language yourself.
I know how to work so far only with autoclickers (naturally, this is not suitable for a large multi-thread). I understand the principles of programming, and I love this business.
Which languages ​​to choose, the most effective ones that can deceive the js of social networks. + Will it be easy to scale up to +1000 threads?

Answer the question

In order to leave comments, you need to log in

4 answer(s)
B
BestJS, 2016-11-06
@martensit

Take a look at NodeJs
Its advantage is speed and asynchrony, which is really very cool!

T
T_y_l_e_r, 2016-11-07
@T_y_l_e_r

PHP is suitable for social networks.
Multithreading is easily achieved there . _

M
malbaron, 2017-01-06
@malbaron

The one you know best.
For cunning one-page sites - something like CasperJS (and this is JavaScript) will come in handy.
For everyone else, any developed language is suitable.
Just do not write everything yourself, but use libraries.
For example, Scrapy for Python or fetchbot and GoQuery for Go (multithreading out of the box).
But, in reality, you will have a completely different problem with multithreading.
The site will ban you for many simultaneous requests.
;)
So it should be separate spiders running on different servers but managed from the same place.

E
Evgen, 2017-11-16
@Verz1Lka

python + scrapy.org

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question