Answer the question
In order to leave comments, you need to log in
How to hook up Redis to a Python parser?
Now I am writing a parser for Amazon, sometimes errors come out that interrupt parsing and then I have to start all over again, and it can work for several hours before breaking.
So, I read somewhere that you can fasten Redis and after breaking the execution and correcting the code, you can start the parser from the moment it was interrupted. That is, he writes there all the links that he has already bypassed and does not follow them the next time he starts.
Who can tell me or throw off the link?
Thank you in advance!
Answer the question
In order to leave comments, you need to log in
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question