On Tue, Apr 12, 2011 at 7:47 AM, Jabba Laci <jabba.l...@gmail.com> wrote: > Hi, > > I want to download a web page that is updated by AJAX. The page > requires no human interaction, it is updated automatically: > http://www.ncbi.nlm.nih.gov/nuccore/CP002059.1 > > If I download it with wget, I get a file of size 97 KB. The source is > full of AJAX calls, i.e. the content of the page is not expanded. > If I open it in a browser and save it manually, the result is a file > of almost 5 MB whose content is expanded. > > (1) How to download such a page with Python? I need the post-AJAX > version of the page.
I've heard you can drive a web browser using Selenium (http://code.google.com/p/selenium/ ), have it visit the webpage and run the JavaScript on it, and then grab the final result. Cheers, Chris -- http://mail.python.org/mailman/listinfo/python-list
