Re: [nodejs] Dynamic content scrape with Node.js

2012-10-06 Thread Dave Kuhn
Good suggestions so far, though i highly recommend you check out phantomjs.org. Phantom is a headless version of WebKit which is the rendering engine behind Chrome & Safari. It's the most comprehensive solution to handling AJAX content when scraping in my book since it's technically the same as

Re: [nodejs] Potential Problem with Node.js Implementation of OpenSSL with large amounts of data

2012-10-06 Thread Justin Meltzer
Looks like the _pusher method (either on the CleartextStream or EncryptedStream prototype, but I'm guessing it's the CleartextStream prototype at this point) is responsible for determining how much of the original buffer to read at one time. Maybe there's a bug originating from there? On Satur

Re: [nodejs] Potential Problem with Node.js Implementation of OpenSSL with large amounts of data

2012-10-06 Thread Justin Meltzer
Thanks Ben! Patch[1] gets rid of the "data length too long" error, and is better than the hack I did. However, it does not fix the breaking up of data. Reverting commit f210530f unfortunately does not prevent the data from being broken up either. Any other ideas? On Saturday, October 6, 2012

Re: [nodejs] Potential Problem with Node.js Implementation of OpenSSL with large amounts of data

2012-10-06 Thread Ben Noordhuis
On Sun, Oct 7, 2012 at 1:25 AM, Justin Meltzer wrote: > I'm using node.js v. 0.8 and I'm running into a problem that has proven to > be incredibly difficult to debug. Any ideas or pointers on how to debug this > would be greatly appreciated. > > For a bit of background, this involves a Flash socke

[nodejs] [ANN] GrayGelf: Fully compliant Graylog2/GELF client and server

2012-10-06 Thread wavded
https://github.com/wavded/graygelf We utilize "GELF" format pretty heavily where I work (it is pretty nice) and needed a complete implementation so we could write our own hooks and just do other crazy stuff. Includes a client/server, Node core style, streaming, chunking, proxy server stuff. W

[nodejs] Potential Problem with Node.js Implementation of OpenSSL with large amounts of data

2012-10-06 Thread Justin Meltzer
I'm using node.js v. 0.8 and I'm running into a problem that has proven to be incredibly difficult to debug. Any ideas or pointers on how to debug this would be greatly appreciated. For a bit of background, this involves a Flash socket connection over SSL in Internet Explorer 9. I'm using socke

Re: [nodejs] How to properly coordinate a sole task between multiple processes on many servers

2012-10-06 Thread Joshua Gross
Mark, maybe I missed this from earlier on, but do you have any plans to document this or open-source any related code? Sounds pretty interesting! -- Joshua Gross Christian / SpanDeX.io / BA Candidate of Computer Science, UW-Madison 2013 414-377-1041 / http://www.joshisgross.com On Oct 6, 2012, a

Re: [nodejs] Dynamic content scrape with Node.js

2012-10-06 Thread rektide
Only just picked it up last week, but it worked well enough-- node.io. It exposes a jQuery-esque interface for querying scraped pages. Extremely high level, "just works" scraping module, in my book! It also has a fairly sizable task-processing system built in, which I have not used. Good luck

Re: [nodejs] Does configure have a problem?

2012-10-06 Thread Marco Asbreuk
Yes, mine was 2.4.3. Thx. Marco. Op zaterdag 6 oktober 2012 22:08:21 UTC+2 schreef Ben Noordhuis het volgende: > > On Sat, Oct 6, 2012 at 9:17 PM, Marco Asbreuk > > > wrote: > > Using the latest build (0.8.11), I can't get node installed. > > During ./configure line 347 throws a syntax erro

Re: [nodejs] Dynamic content scrape with Node.js

2012-10-06 Thread Mark Hahn
1) You should consider using the node `request` to scrape instead of cURL. 2) Any scraping is only going to return what you request. This is only going to be the initially provided static content. You are getting this from the server, not the client. There is no way to get anything from the clien

[nodejs] Dynamic content scrape with Node.js

2012-10-06 Thread Narek Musakhanyan
Hey guys . I tried to scrape a data from a website using PHP cURL lib but I failed since cURl allows you to scrape only static content . But the content I want to scrape changes via javascript(AJAX) since cURL cant hanfle that I couldnt handle scraping via cURL . So I heard the this type of t

Re: [nodejs] Re: Cross Compile nodejs for arm

2012-10-06 Thread Jonathan Kunkee
> You mean adding NEON support to V8? Because it doesn't support it now, > only VFPv3. Point. I had assumed that the compiler could produce effective NEON code, but using SIMD effectively often does require explicit use in code. Adding it to the code would probably not be worth the cost for now.

Re: [nodejs] Does configure have a problem?

2012-10-06 Thread Ben Noordhuis
On Sat, Oct 6, 2012 at 9:17 PM, Marco Asbreuk wrote: > Using the latest build (0.8.11), I can't get node installed. > During ./configure line 347 throws a syntax error > (o['default_configuration'] = 'Debug' if options.debug else 'Release') > where the 'if' statement is marked. > > Using linux Cen

[nodejs] Does configure have a problem?

2012-10-06 Thread Marco Asbreuk
Using the latest build (0.8.11), I can't get node installed. During ./configure line 347 throws a syntax error (o['default_configuration'] = 'Debug' if options.debug else 'Release') where the 'if' statement is marked. Using linux CentOS 5.8 Any help would be appreciated. Regards, Marco Asbreuk

Re: [nodejs] How to properly coordinate a sole task between multiple processes on many servers

2012-10-06 Thread Mark Hahn
> So what server inserts the task into the database? The tasks come from user actions. Each user is only connected to one host server. So only one server creates a task.. When a task is finished its results are shared by all hosts. There is no concept of two tasks being equal and no possible r

Re: [nodejs] Re: Pure SQLite Implementation in Nodejs?

2012-10-06 Thread Pavan Kumar Sunkara
You can check out https://github.com/pksunkara/nosqlite It isn't exactly sqlite3 implementation in javascript but has the basics for it. On Sat, Oct 6, 2012 at 7:25 PM, mscdex wrote: > On Oct 6, 3:58 am, mufid wrote: >> I would want to ask, is there any pure javascript implementation of Sqlite

[nodejs] Re: Pure SQLite Implementation in Nodejs?

2012-10-06 Thread mscdex
On Oct 6, 3:58 am, mufid wrote: > I would want to ask, is there any pure javascript implementation of Sqlite > in nodejs? I need sqlite library that doesn't need compilation. I ever > triedhttps://github.com/developmentseed/node-sqlite3but it won't compile > in my computer. You'll get better perf

[nodejs] Facing a problem with Node-torrent project by Max Stewart on github (https://github.com/superafroman/node-torrent)

2012-10-06 Thread Prachi Shah
Currently my team is working on a project of Peer to Peer download under bit-torrent protocol using node.js technology. While exploring few online resources, we came across a project by Max Stewart in github ( https://github.com/superafroman/node-torrent) which seemed to be much useful for us. B

[nodejs] Pure SQLite Implementation in Nodejs?

2012-10-06 Thread mufid
Hi, I would want to ask, is there any pure javascript implementation of Sqlite in nodejs? I need sqlite library that doesn't need compilation. I ever tried https://github.com/developmentseed/node-sqlite3 but it won't compile in my computer. Thank you before. -- Job Board: http://jobs.nodejs.

Re: [nodejs] Re: Node.jar - Java port by Oracle

2012-10-06 Thread Mikeal Rogers
I think the point would be that modules written in JavaScript run in Node.jar, and that these people would write JavaScript modules, which would mean they are still compatible with the same registry without needing to fork. On Oct 5, 2012, at October 5, 201210:03 PM, Johnny Honestly wrote: