Answer the question
In order to leave comments, you need to log in
Scrapy: how to generate dropdown fields?
Hello. There was a problem: you need to parse the site on Scrapy. But I ran into a problem - I don’t know how to solve the problem when there is no data in the page code yet.
Actually, the site: www.booktornado.com/.
Tried via FormRequest - to no avail. The field is not selected.
Answer the question
In order to leave comments, you need to log in
It can be seen that when changing the form fields, the page climbs to the url: www.booktornado.com/DesktopModules/BookTornado/Ser... so there is an API to which it knocks to get data.
I would do something like this:
1. Figure out what the page is sending and where to get the ISBN.
2. I made this request through scrapy and received an ISBN in response.
3. Made a request to www.booktornado.com/DesktopModules/BookTornado/Ser...
with, for example:
ISBN:9780077967963
couponApi:BT5aiKWKlJqDV2ywKZPA
apiKey
:
BT5aiKWKlJqDV2ywKZPA understand where and how the data is requested.
Didn't find what you were looking for?
Ask your questionAsk a Question
731 491 924 answers to any question