I did a scraper with phantomjs before, it works great but I think you should take a look at https://import.io/
On Sat, Apr 26, 2014 at 7:42 AM, Alexey Petrushin < alexey.petrus...@gmail.com> wrote: > I finished such project recently - Crawler for JavaScript Sites, with > Browser Emulator (Selenium). > > It's a private project, but I wrote some details about it and how it > works, maybe it will be interested for someone. > > http://alex-craft.com/blog/2014/crawling-javascript-sites > > On Thursday, 16 January 2014 06:09:48 UTC+4, Victor Hooi wrote: > >> Hi, >> >> I'm wondering if anybody knows of any web-scraping frameworks in Node.JS? >> >> Previously, there was node.io (https://github.com/chriso/node.io), >> however, the project was recently discontinued. >> >> Googling for Node.JS and web scraping, most of the guides online just >> talk about using requests and cheerio - it works, but you need to handle a >> whole bunch of things yourself (throttling, distributing jobs, >> configuration, managing jobs etc.). >> >> On the Python side, I know of Scrapy (https://github.com/scrapy/scrapy), >> which is using Twisted for asynchronicity >> >> On the Ruby side, Nokogiri (http://nokogiri.org/) is meant to be good, >> although I haven't dived into it much. >> >> Is there anything equivalent in the Node world? Or what approaches are >> people using to tackle this problem? >> >> Cheers, >> Victor >> > -- > -- > Job Board: http://jobs.nodejs.org/ > Posting guidelines: > https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines > You received this message because you are subscribed to the Google > Groups "nodejs" group. > To post to this group, send email to nodejs@googlegroups.com > To unsubscribe from this group, send email to > nodejs+unsubscr...@googlegroups.com > For more options, visit this group at > http://groups.google.com/group/nodejs?hl=en?hl=en > > --- > You received this message because you are subscribed to the Google Groups > "nodejs" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to nodejs+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > -- Nguyen Hai Duy Mobile : 0914 72 1900 Skype: nguyenhd2107 Yahoo: nguyenhd_lucky -- -- Job Board: http://jobs.nodejs.org/ Posting guidelines: https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines You received this message because you are subscribed to the Google Groups "nodejs" group. To post to this group, send email to nodejs@googlegroups.com To unsubscribe from this group, send email to nodejs+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/nodejs?hl=en?hl=en --- You received this message because you are subscribed to the Google Groups "nodejs" group. To unsubscribe from this group and stop receiving emails from it, send an email to nodejs+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
