J
J
jiamak2018-07-04 15:15:37
Python
jiamak, 2018-07-04 15:15:37

Scrapy. Is it possible to start spiders by condition?

The question arose: is it possible to run several spiders depending on the condition.
For example:
we launch one spider at once, it serves to authorize and receive Cookies, after which it saves them,
after its completion, a second spider is launched that works further with the page using the Cookies received from the first spider and works as long as the session cookies are valid.
After the completion of the second spider, you need to get new Cookies and start the second spider again, etc.
Tell me how to implement this

Answer the question

In order to leave comments, you need to log in

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question