S
S
skomoroh2013-12-26 05:25:27
Python
skomoroh, 2013-12-26 05:25:27

Which is better to use: Eventlet or Gevent or Concurrence?

There is a task to collect a bunch of data from the network and analyze it.
Which is better to use: Eventlet or Gevent or Concurrence?
And what is better for the network under them: requests, urllib, pycurl?
And which queue is better for them: RabbitMQ(kombu?), Redis?
And why?
And how do lxml, nltk, numpy behave in greenlets?
Thanks in advance.

Answer the question

In order to leave comments, you need to log in

3 answer(s)
Z
zxmd, 2013-12-26
@zxmd

Emmm. In your case, celery on RabbitMQ + pycurl will probably be better.
Actually a counter question - why do you need greenlets?

_
_ _, 2013-12-26
@AMar4enko

Redis does not have a full-fledged queue out of the box, there is a pub-sub.
There is no distribution of queue events among handlers, and there is no confirmation of the execution of the task by the handler.

A
anatoly87, 2014-12-31
@anatoly87

https://medium.com/p/40e9b2b36148

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question