[nodejs] [ANN]: Tusker - Redis Based Distributed Task Locking

2013-02-18 Thread Arunoda Susiripala
Hi, Today I'm announcing a project that we've used internally for months. We needed a tool to coordinate following scenario. - We are transcoding ogg into mp3 realtime - And oggs are coming as chunks of (15 secs) - We have deployed several servers and routing is random stateless So we

Re: [nodejs] Re: Multi-threaded Node.js

2013-02-18 Thread Duncan Gmail
Why does this same thing get asked over and over? On 18 Feb 2013, at 07:35, Bruno Jouhier bjouh...@gmail.com wrote: https://github.com/xk/node-threads-a-gogo I wrote a blog post about it last year: http://bjouhier.wordpress.com/2012/03/11/fibers-and-threads-in-node-js-what-for/ Bruno

Re: [nodejs] Re: Multi-threaded Node.js

2013-02-18 Thread Mark Hahn
Why does this same thing get asked over and over? It's a shame google groups doesn't have FAQ support. On Mon, Feb 18, 2013 at 12:21 AM, Duncan Gmail duncananguswil...@gmail.comwrote: Why does this same thing get asked over and over? On 18 Feb 2013, at 07:35, Bruno Jouhier

Re: [nodejs] Re: Multi-threaded Node.js

2013-02-18 Thread Arunoda Susiripala
But there is a search. On Mon, Feb 18, 2013 at 2:02 PM, Mark Hahn m...@hahnca.com wrote: Why does this same thing get asked over and over? It's a shame google groups doesn't have FAQ support. On Mon, Feb 18, 2013 at 12:21 AM, Duncan Gmail duncananguswil...@gmail.com wrote: Why does

Re: [nodejs] Re: Multi-threaded Node.js

2013-02-18 Thread Arunoda Susiripala
And I think we should make a FAQ on node and make it available on the nodejs.org. Possible things to include. - Threads vs Process - CoffeeScript and other languages compiled into JS - Node Core modules vs User Land modules And so on. On Mon, Feb 18, 2013 at 2:03 PM, Arunoda

Re: [nodejs] Re: Multi-threaded Node.js

2013-02-18 Thread Floby
There use to be a FAQ on the github wiki On Monday, 18 February 2013 09:37:10 UTC+1, Arunoda Susiripala wrote: And I think we should make a FAQ on node and make it available on the nodejs.org. Possible things to include. - Threads vs Process - CoffeeScript and other languages

Re: [nodejs] Node JS with Console

2013-02-18 Thread harikrishna patadiya
I am trying to communicate with GAE (through Google Endpoints to be precise) but not through the means of a browser. Rather, through a console like cygwin. However, cygwin, or any other console does not recognize some javascript commands. To focus on a specific part of the question, I just

[nodejs] Re: Multi-threaded Node.js

2013-02-18 Thread greelgorke
threads-a-gogo for small but cpu-heavy tasks. child_process.fork for permanently running worker-like services (or use tools like mongroup) cluster for horizontal scaling on a single machine to use all CPU-cores Node is designed mainly for I/O intensive Use Cases, in fact it was born out of the

Re: [nodejs] Proxy server with authentication

2013-02-18 Thread greelgorke
now i understand the requirement. i consider a proxy-server as something transparent to the user. what you are talking about is a kind of a web-ui to your services. in this case you of course totally can use connect/express. it would be an overkill to use it for a transparent proxy. Am

[nodejs] Re: Multi-threaded Node.js

2013-02-18 Thread Andrey
Take a look at W16 project - https://github.com/sheremetyev/w16 On Monday, 18 February 2013 11:15:48 UTC+11, RF wrote: Hi, I'm CS student who is new to Node, and I have two questions: 1. Is there currently an existing mechanism (e.g. module, core functionality) that allows Node

Re: [nodejs] Node JS with Console

2013-02-18 Thread Daniel Rinehart
I don't know of a module that supports Google Cloud Endpoints but creating one should be possible. As there is a sample JavaScript client that accesses a Google Cloud Endpoint backend, you would just need to port the browser specific pieces to instead use basic node modules like http to make the

[nodejs] Emacs Setup For JavaScript Coders

2013-02-18 Thread Azer Koçulu
Hi all, I have a modularized Emacs setup that you can fork and use in a minute; https://github.com/azer/emacs.js It comes with many good tools built by Emacs community. See the README for details... Best, Azer -- -- Job Board: http://jobs.nodejs.org/ Posting guidelines:

[nodejs] Module assistance request

2013-02-18 Thread OrangeDog
If someone could give me a hand replacing the wscript on https://github.com/OrangeDog/node-gzbz2/tree/streams2 with a proper gyp build, I would be very grateful. There still don't seem to be any simple tutorials or examples for 0.6+ modules around. I look forward to your pull requests :) --

[nodejs] build from source fail

2013-02-18 Thread fancyerii
hi all I am building node-v0.8.20 from source in RedHatEnterpriseAS 4 $ ./configure { 'target_defaults': { 'cflags': [], 'default_configuration': 'Release', 'defines': [], 'include_dirs': [],

Re: [nodejs] How do node.js handle database transactions?

2013-02-18 Thread Kyaw Zaw Win
I guess, we can use store procedure for this transaction problem with node. Meaning, every transaction process must be in a store procedure altogether and node just need to execute that sp. On Friday, December 21, 2012 1:55:20 PM UTC+8, Charlie Edward wrote: Yeah, you guys are right, the

[nodejs] Writing custom session flash messages

2013-02-18 Thread someprimetime
I'm using express and I was trying to get connect-flash working, but it wouldn't work with my redirects. So I've decided to take another approach and that's just to roll my own middleware for session flashes. Has anyone had any experience on doing this? I tried to scaffold it but I'm running

[nodejs] Re: Multi-threaded Node.js

2013-02-18 Thread RF
It seems that my first question is answered (yes - threads-a-gogo - but without allowing shared mutable objects). My second question is possibly redundant, then, but whether or not this is a desirable feature would appear to be debatable. For what it's worth, I think having more choices is

Re: [nodejs] build from source fail

2013-02-18 Thread Ben Noordhuis
On Mon, Feb 18, 2013 at 10:41 AM, fancye...@gmail.com wrote: hi all I am building node-v0.8.20 from source in RedHatEnterpriseAS 4 $ ./configure { 'target_defaults': { 'cflags': [], 'default_configuration': 'Release', 'defines': [],

[nodejs] issues using node curl

2013-02-18 Thread Srividya Krishnamurthy
Hi, I'm using node-curl for making curl calls. Here is a simple server.js which just issues a curl call: var http = require('http'); var curl = require('node-curl'); var config = require('./config'); var cfgObj = new config.config(); function start(port) { function onRequest(request,

Re: [nodejs] issues using node curl

2013-02-18 Thread Arunoda Susiripala
I don't know why you use node-curl. Try to use request[0] instead. [0] - https://github.com/mikeal/request On Mon, Feb 18, 2013 at 9:58 PM, Srividya Krishnamurthy vidya.vasisht...@gmail.com wrote: Hi, I'm using node-curl for making curl calls. Here is a simple server.js which just issues

[nodejs] Wanted: federated-event/message-emitting platform?

2013-02-18 Thread MikeB_2012
Hi all. I'm an experienced data mining/machine learning algorithm developer redirecting from programming/prototyping in Matlab (past decade) to programming in js/node.js. I'm looking for guidance as to what node packages I should be considering to achieve a certain functionality. The

[nodejs] Need an offline npm-style repository - what's a good approach?

2013-02-18 Thread andy e
Apologies in advance because I've only glanced at this problem, but we work in a unique environment where we have no Internet connectivity. So, with our Java apps, we run an instance of Artifactory on our LAN and load it by running an instance that is connected, which we then export and bring into

Re: [nodejs] Need an offline npm-style repository - what's a good approach?

2013-02-18 Thread Luke Arduini
You could set up git on a server on your lan and just specify dependencies in your projects' package.json files pointing to the git address. Seems like it would be the easiest way to go for private modules not on the internet. On Mon, Feb 18, 2013 at 1:23 PM, andy e virtuala...@gmail.com wrote:

Re: [nodejs] Need an offline npm-style repository - what's a good approach?

2013-02-18 Thread Tim Caswell
If you want a mirror of the public npm repo, one option is to replicate the couch database. It's pretty big, but once replicated would give you a full mirror. I'm pretty sure you can do delta updates later on by putting the couch database back online and syncing again. On Mon, Feb 18, 2013 at

Re: [nodejs] Need an offline npm-style repository - what's a good approach?

2013-02-18 Thread Luke Arduini
Touching on what Tim said, if you create a document for replication in /_replicator (not /_replicate) on couch you can turn couch off/on and have replication resume whenever. I do it all the time for my private npm and it works well, example: https://gist.github.com/st-luke/4165831 On Mon, Feb

Re: [nodejs] Need an offline npm-style repository - what's a good approach?

2013-02-18 Thread andy e
Cool, thanks for the suggestion(s). Two quick questions: 1) Can anyone replicate w/ the npm couch repo? I take it that's a yes but maybe you need permission (then again maybe people are smart enough to not want to have to do this, unlike us...) 2) How big? 10GB? 100GB? 1TB+? Thanks, Andy On

Re: [nodejs] Need an offline npm-style repository - what's a good approach?

2013-02-18 Thread Bradley Meck
Right now without compaction you are looking at 45~ GB of data it looks like on the current npm public registry, and it can be replicated without needing any permission. On Monday, February 18, 2013 1:01:33 PM UTC-6, andy wrote: Cool, thanks for the suggestion(s). Two quick questions: 1)

Re: [nodejs] Need an offline npm-style repository - what's a good approach?

2013-02-18 Thread andy e
OK, great, thanks for the info. I'll chat it over and maybe give a shot at replicating the couch instance. Thanks for the help! Andy On Mon, Feb 18, 2013 at 12:08 PM, Bradley Meck bradley.m...@gmail.comwrote: Right now without compaction you are looking at 45~ GB of data it looks like on the

Re: [nodejs] Wanted: federated-event/message-emitting platform?

2013-02-18 Thread Michael Schoonmaker
Mike, When it comes to taking the output of sensors or other processes, what happens when a new process is added to the mesh? Should it be able to ask for the current sensor state, or simply sit idle until the next chunk of output is published to the mesh? -Schoon On Mon, Feb 18, 2013 at 10:39

[nodejs] Re: Need an offline npm-style repository - what's a good approach?

2013-02-18 Thread Tim Dickinson
You might want to read https://blog.caurea.org/2012/01/31/local-npm-registry-mirror.html On Monday, February 18, 2013 2:23:05 PM UTC-4, andy wrote: Apologies in advance because I've only glanced at this problem, but we work in a unique environment where we have no Internet connectivity. So,

Re: [nodejs] Need an offline npm-style repository - what's a good approach?

2013-02-18 Thread nwhite
I wish it was trivial to have a sparse npm server. One where I could publish my private modules to and replicate only the packages I'm interested in. Then have all npm package requests that are not found automatically forwarded to the official server. On Mon, Feb 18, 2013 at 12:14 PM, andy e

[nodejs] Re: Wanted: federated-event/message-emitting platform?

2013-02-18 Thread Alexey Petrushin
From description such architecture looks simple, but from my experience it's far from simple to built such a system. There are questions like - who will keep an eye on monitoring and restarting died agents. - where to store data? - what to do if data sent to died agent? Should it be recovered

Re: [nodejs] Module assistance request

2013-02-18 Thread Jake Verbaten
node 0.10 will having streaming zlib. On Mon, Feb 18, 2013 at 2:12 AM, OrangeDog ja...@howeswho.co.uk wrote: If someone could give me a hand replacing the wscript on https://github.com/OrangeDog/node-gzbz2/tree/streams2 with a proper gyp build, I would be very grateful. There still don't

Re: [nodejs] Need an offline npm-style repository - what's a good approach?

2013-02-18 Thread Mark Hahn
and replicate only the packages I'm interested in. It is pretty easy to filter replications in general. I don't know what the npm couch docs look like so I don't know how easy it would be in this case. And, as a bonus, the filtering is coded in JS. On Mon, Feb 18, 2013 at 12:10 PM, nwhite

Re: [nodejs] Wanted: federated-event/message-emitting platform?

2013-02-18 Thread MikeB_2012
My thinking is that it waits till the next chunk is published. That shouldn't lead to too much lag in the system but it pre-supposes that processes transmit state even in the absence of change. That isn't a stretch since many sensors publish regular updates even in the absence of change.

Re: [nodejs] Re: Wanted: federated-event/message-emitting platform?

2013-02-18 Thread Michael Schoonmaker
Mike, I'd look for the pub-sub setup that makes the most sense to you, and keep it simple. You don't need a ton of framework on top of it. Redis will meet your needs well, but if you need many thousands of messages a second (which it doesn't sound like is the case!), I would take a closer look at

Re: [nodejs] Need an offline npm-style repository - what's a good approach?

2013-02-18 Thread andy e
This would be ideal in our scenario. It's what Artifactory does for us in Java land (if a module doesn't exist in our local repo, it grabs it from maven central) and would be awesome to see in npm. If someone does an Enterprise NPM Repo Kickstarter I'll certainly kick in a few bucks to support

Re: [nodejs] Re: Node.js memory leak detection?

2013-02-18 Thread Ket
There is no memory leak at all if you write javascript effectively. Write the code that release memory when not in use. Node.js free memory (or garbage collector i'm not sure) pretty fast. No memory leak detect software needed. Save your saver space and memory. On Monday, February 18, 2013