That page contains an iframe which loads the data table:
https://donate.aamaadmiparty.org/Report/Donation_List.aspx
The next link calls the __doPostBack js function, which you can see the
source in the html. So, basically you need to do this:
next_req = FormRequest.from_response(response,
formdata={'__EVENTTARGET': 'ctl00$MainContent$lnkNext'})
You can see more details about the FormRequest class in the docs:
http://doc.scrapy.org/en/latest/topics/request-response.html#formrequest-objects
Regards
Rolando
On Wed, Jan 1, 2014 at 11:50 AM, Tech Master <[email protected]>wrote:
> Hi,
>
> I am trying to scrape the donation list at
> http://www.aamaadmiparty.org/donation-list.
>
> The url does not change as one moves from page to page, and the Next
> buttons have a javascript function attached to them. How best can I scrape
> this data with scrapy?
>
> Thanks.
> -TM
>
> --
> You received this message because you are subscribed to the Google Groups
> "scrapy-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [email protected].
> To post to this group, send email to [email protected].
> Visit this group at http://groups.google.com/group/scrapy-users.
> For more options, visit https://groups.google.com/groups/opt_out.
>
--
You received this message because you are subscribed to the Google Groups
"scrapy-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at http://groups.google.com/group/scrapy-users.
For more options, visit https://groups.google.com/groups/opt_out.
