J
J
JRazor2014-03-25 20:18:38
Python
JRazor, 2014-03-25 20:18:38

Scrapy: how to generate dropdown fields?

Hello. There was a problem: you need to parse the site on Scrapy. But I ran into a problem - I don’t know how to solve the problem when there is no data in the page code yet.
Actually, the site: www.booktornado.com/.
Tried via FormRequest - to no avail. The field is not selected.

Answer the question

In order to leave comments, you need to log in

1 answer(s)
E
ehles, 2014-04-08
@JRazor

It can be seen that when changing the form fields, the page climbs to the url: www.booktornado.com/DesktopModules/BookTornado/Ser... so there is an API to which it knocks to get data.
I would do something like this:
1. Figure out what the page is sending and where to get the ISBN.
2. I made this request through scrapy and received an ISBN in response.
3. Made a request to www.booktornado.com/DesktopModules/BookTornado/Ser...
with, for example:
ISBN:9780077967963
couponApi:BT5aiKWKlJqDV2ywKZPA apiKey
: BT5aiKWKlJqDV2ywKZPA understand where and how the data is requested.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question