On Fri, Dec 9, 2011 at 10:13, Voytek Eymont <li...@sbt.net.au> wrote: > I have userid/password to an aspx based website, > what can I use to script a login and get info or monitor for new info on a > page ? > > is wget the way to go for aspx site, or what's a good tool for that ?
A wise man once said, "You are entering a world of pain my friend, a world of pain" :) For projects like PlanningAlerts[0] we need to scrape ASPX sites quite often. They are routinely built in the most insane way and the usual wget/curl magic won't cut it. Even for a simple get requests they'll use Javascript to do a postback with incomprehensible session data. I'm not sure if coding a scraper is a solution you're considering but if you are, check out some of the PlanningAlerts scrapers we've written on ScraperWiki[1] for ideas. I like using Mechanize with Ruby but I'm sure there are similar libraries in other languages if Ruby's not your thing. If you end up going the scraping route I'll be happy to lend a hand if I can (the ScraperWiki list[2] is a pretty awesome way to get scraping help too). Cheers, Henare [0] http://www.planningalerts.org.au/ [1] https://scraperwiki.com/tags/planningalerts [2] http://groups.google.com/group/scraperwiki -- Henare Degan e » henare.de...@gmail.com t » @henaredegan w » www.henaredegan.com -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
