Re: [nodejs] NodeJS Runtime for Chrome
Chimera looks awesome Dean. Definitely something I'd be interested in
evaluating over at tubes.io for our customers. What's the state of the
documentation? Anything I can sink my teeth into?
Dave
On 1 November 2012 10:35, Dean Mao dean...@gmail.com wrote:
I have something similar as well called node-chimera, it's a meld of
phantomjs inside of node basically. An example runtime code looks like
this:
var Chimera = require('chimera').Chimera;
var c = new Chimera();
c.perform({
url: http://mywebsite.com;,
locals: {
username: 'myuser',
password: 'mypass'
},
run: function(callback) {
jQuery('#username').val(username);
jQuery('#password').val(password);
jQuery('#login').click();
callback(null, success);
},
callback: function(err, result) {
console.log('capture screen shot');
c.capture(screenshot.png);
var cookies = c.cookies();
c.close();
console.log(Browser cookies here:);
console.log(cookies);
}
});
On Wed, Oct 31, 2012 at 7:43 AM, Roger WANG roger.w...@linux.intel.comwrote:
Arunoda Susiripala arunoda.susirip...@gmail.com writes:
Hi Guys,
Look at this amazing project: https://github.com/arunoda/chrome-node
If you're interested in calling Node from DOM, here is another project
worth to check:
https://github.com/rogerwang/node-webkit
It's based on Chromium and Node.
with the reference of running node in chrome -
http://www.youtube.com/watch?v=gkb_x9ZN0Vofeature=g-all-lsb
--
Roger WANG Intel Open Source Technology Center
--
Job Board: http://jobs.nodejs.org/
Posting guidelines:
https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
You received this message because you are subscribed to the Google
Groups nodejs group.
To post to this group, send email to nodejs@googlegroups.com
To unsubscribe from this group, send email to
nodejs+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/nodejs?hl=en?hl=en
--
Job Board: http://jobs.nodejs.org/
Posting guidelines:
https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
You received this message because you are subscribed to the Google
Groups nodejs group.
To post to this group, send email to nodejs@googlegroups.com
To unsubscribe from this group, send email to
nodejs+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/nodejs?hl=en?hl=en
--
Dave Kuhn
US: +1 415 813 9570
AU: +61 419 945 561
http://au.linkedin.com/in/davidskuhn
--
Job Board: http://jobs.nodejs.org/
Posting guidelines:
https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
You received this message because you are subscribed to the Google
Groups nodejs group.
To post to this group, send email to nodejs@googlegroups.com
To unsubscribe from this group, send email to
nodejs+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/nodejs?hl=en?hl=en
Re: [nodejs] Dynamic content scrape with Node.js
True, you can get pretty far doing that but it gets difficult when crucial bits of information are hidden inside script tags and the like. Not to mention managing cookies for ASP.NET pages amongst others is a pain in the butt. You can avoid all that hassle with a fully resolved DOM and automatic support for cookies which Phantom JS will give you. -- Dave Kuhn Sent with Sparrow (http://www.sparrowmailapp.com/?sig) On Tuesday, October 9, 2012 at 12:25 AM, greelgorke wrote: why so complicated? just find out the url of the ajax request and do it yourself with whatever lib you want... Am Montag, 8. Oktober 2012 18:53:27 UTC+2 schrieb Chad Engler: This is probably the same person who asked this question on StackOverflow: http://stackoverflow.com/questions/12630891/scrape-data-generated-by-javascript-on-server-side-from-webpages-aspx Where I have already answered his question, he just didn’t like it: http://stackoverflow.com/questions/12630891/scrape-data-generated-by-javascript-on-server-side-from-webpages-aspx#comment17032399_12630891 -Chad From: nod...@googlegroups.com [mailto:nod...@googlegroups.com] On Behalf Of Dave Kuhn Sent: Saturday, October 06, 2012 11:46 PM To: nod...@googlegroups.com Subject: Re: [nodejs] Dynamic content scrape with Node.js Good suggestions so far, though i highly recommend you check out phantomjs.org (http://phantomjs.org). Phantom is a headless version of WebKit which is the rendering engine behind Chrome Safari. It's the most comprehensive solution to handling AJAX content when scraping in my book since it's technically the same as interacting with a page loaded by your browser. -- Dave Kuhn Sent with Sparrow (http://www.sparrowmailapp.com/?sig) On Saturday, October 6, 2012 at 3:04 PM, rektide wrote: Only just picked it up last week, but it worked well enough-- node.io (http://node.io). It exposes a jQuery-esque interface for querying scraped pages. Extremely high level, just works scraping module, in my book! It also has a fairly sizable task-processing system built in, which I have not used. Good luck: https://github.com/chriso/node.io -rektide On Sat, Oct 06, 2012 at 01:34:03PM -0700, Narek Musakhanyan wrote: Hey guys . I tried to scrape a data from a website using PHP cURL lib but I failed since cURl allows you to scrape only static content . But the content I want to scrape changes via javascript(AJAX) since cURL cant hanfle that I couldnt handle scraping via cURL . So I heard the this type of things can be done via node . Basically I need to make my node app handle this js wait for some time until AJAX is done and the pass it to php .So is it possible to do via node.js ? I dont know node and I have to start from scratch so I am here you to point out the right node framework to use to get the result I explained . -- Job Board: http://jobs.nodejs.org/ Posting guidelines: https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines You received this message because you are subscribed to the Google Groups nodejs group. To post to this group, send email to nod...@googlegroups.com To unsubscribe from this group, send email to nodejs+un...@googlegroups.com For more options, visit this group at http://groups.google.com/group/nodejs?hl=en?hl=en -- Job Board: http://jobs.nodejs.org/ Posting guidelines: https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines You received this message because you are subscribed to the Google Groups nodejs group. To post to this group, send email to nod...@googlegroups.com To unsubscribe from this group, send email to nodejs+un...@googlegroups.com For more options, visit this group at http://groups.google.com/group/nodejs?hl=en?hl=en -- Job Board: http://jobs.nodejs.org/ Posting guidelines: https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines You received this message because you are subscribed to the Google Groups nodejs group. To post to this group, send email to nodejs@googlegroups.com To unsubscribe from this group, send email to nodejs+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/nodejs?hl=en?hl=en -- Job Board: http://jobs.nodejs.org/ Posting guidelines: https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines You received this message because you are subscribed to the Google Groups nodejs group. To post to this group, send email to nodejs@googlegroups.com To unsubscribe from this group, send email to nodejs+unsubscr
Re: [nodejs] Piping gzipped responses?
The request lib will automatically decompress the response for you. I think
you'd be better off using http.request or http.get directly and avoiding any
possible double handling. You can still pipe the response as you are now.
--
Dave Kuhn
Sent with Sparrow (http://www.sparrowmailapp.com/?sig)
On Thursday, September 27, 2012 at 2:05 PM, Jamison Dance wrote:
I have an Express server with a route that just proxies a request to
another server and pipes it back to the client. It looks like this:
var request = require('request');
function('/whatever', function(req, res) {
request.get({url: 'http://example.com/someGzippedThing', json:
true}).pipe(res);
});
If I hit http://example.com/someGzippedThing, the response is gzipped.
However, when I hi the /whatever route of my own server, the response
is not gzipped. How can I make sure it stays gzipped when it gets
piped back to the client?
--
Job Board: http://jobs.nodejs.org/
Posting guidelines:
https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
You received this message because you are subscribed to the Google
Groups nodejs group.
To post to this group, send email to nodejs@googlegroups.com
To unsubscribe from this group, send email to
nodejs+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/nodejs?hl=en?hl=en
--
Job Board: http://jobs.nodejs.org/
Posting guidelines:
https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
You received this message because you are subscribed to the Google
Groups nodejs group.
To post to this group, send email to nodejs@googlegroups.com
To unsubscribe from this group, send email to
nodejs+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/nodejs?hl=en?hl=en
