Answer the question
In order to leave comments, you need to log in
What programming language for a beginner to choose for parsing?
You need to write a lot of multi-threaded software (> 1000 threads) to work with social networks. networks, (only for themselves)
Most of the social. networks on js scripts naturally.
I realized that it’s easier to learn the language yourself.
I know how to work so far only with autoclickers (naturally, this is not suitable for a large multi-thread). I understand the principles of programming, and I love this business.
Which languages to choose, the most effective ones that can deceive the js of social networks. + Will it be easy to scale up to +1000 threads?
Answer the question
In order to leave comments, you need to log in
Take a look at NodeJs
Its advantage is speed and asynchrony, which is really very cool!
PHP is suitable for social networks.
Multithreading
is easily achieved
there . _
The one you know best.
For cunning one-page sites - something like CasperJS (and this is JavaScript) will come in handy.
For everyone else, any developed language is suitable.
Just do not write everything yourself, but use libraries.
For example, Scrapy for Python or fetchbot and GoQuery for Go (multithreading out of the box).
But, in reality, you will have a completely different problem with multithreading.
The site will ban you for many simultaneous requests.
;)
So it should be separate spiders running on different servers but managed from the same place.
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question