Answer the question
In order to leave comments, you need to log in
Scrapy. Is it possible to start spiders by condition?
The question arose: is it possible to run several spiders depending on the condition.
For example:
we launch one spider at once, it serves to authorize and receive Cookies, after which it saves them,
after its completion, a second spider is launched that works further with the page using the Cookies received from the first spider and works as long as the session cookies are valid.
After the completion of the second spider, you need to get new Cookies and start the second spider again, etc.
Tell me how to implement this
Answer the question
In order to leave comments, you need to log in
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question