Found one: http://zugravu.com/products/web-crawler-spider-scraping-javascript-regular-expression-nodejs-mongodb
On Monday, May 19, 2014 8:17:12 AM UTC+3, harish k wrote: > > Hi, > I just wrote a easy-to-use scrapper in JS as a part of my past work. > It can extract data from html pages based on predefined schema which > consists of css selectors and a data extraction function. > It is available at https://github.com/harish2704/html-scrapper > It uses cheerio for dom parsing. > > > > On Thursday, 16 January 2014 07:39:48 UTC+5:30, Victor Hooi wrote: >> >> Hi, >> >> I'm wondering if anybody knows of any web-scraping frameworks in Node.JS? >> >> Previously, there was node.io (https://github.com/chriso/node.io), >> however, the project was recently discontinued. >> >> Googling for Node.JS and web scraping, most of the guides online just >> talk about using requests and cheerio - it works, but you need to handle a >> whole bunch of things yourself (throttling, distributing jobs, >> configuration, managing jobs etc.). >> >> On the Python side, I know of Scrapy (https://github.com/scrapy/scrapy), >> which is using Twisted for asynchronicity >> >> On the Ruby side, Nokogiri (http://nokogiri.org/) is meant to be good, >> although I haven't dived into it much. >> >> Is there anything equivalent in the Node world? Or what approaches are >> people using to tackle this problem? >> >> Cheers, >> Victor >> > -- Job board: http://jobs.nodejs.org/ New group rules: https://gist.github.com/othiym23/9886289#file-moderation-policy-md Old group rules: https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines --- You received this message because you are subscribed to the Google Groups "nodejs" group. To unsubscribe from this group and stop receiving emails from it, send an email to nodejs+unsubscr...@googlegroups.com. To post to this group, send email to nodejs@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/nodejs/3cd164d1-4251-4089-8d77-30e08f309c4d%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
