Re: [Rails] Re: Scrapping Content from a website

2011-12-15 Thread Santosh Kumar Mohanty
Thanks Dear for the information. On Fri, Dec 16, 2011 at 4:06 AM, Max wrote: > I don't have a lot of experience but did some scraping recently. I > used the nokogiri gem. found it to be pretty self explanatory and > much easier to implement than i had anticipated. google it and i'm > sure you

[Rails] Re: Scrapping Content from a website

2011-12-15 Thread KNowicki
I use Mechanize as user agent and Nokogiri as html/xml parser. http://mechanize.rubyforge.org/ http://nokogiri.org/ Mechanize supports both http- and application- layer auth, so that could be what You are looking for. -- You received this message because you are subscribed to the Google Groups "R

[Rails] Re: Scrapping Content from a website

2011-12-15 Thread Max
I don't have a lot of experience but did some scraping recently. I used the nokogiri gem. found it to be pretty self explanatory and much easier to implement than i had anticipated. google it and i'm sure you can figure it out... Max On Dec 14, 10:07 pm, MUMU wrote: > Hey all, >   I want to s