[nodejs] Re: nodejs throughput verses custom server, scaling question to someone with experience.

2012-04-10 Thread Marco Rogers
Yeah I think you need to provide some code. It should actually be pretty difficult for you to get throughput that slow from node :) I suspect that you're not doing you async callbacks correctly and blocking the event loop more than you should be. :Marco On Tuesday, April 10, 2012 10:15:34 AM U

[nodejs] Re: nodejs throughput verses custom server, scaling question to someone with experience.

2012-04-10 Thread timp
I'll try to post some code in this box, don't know how the formatting will come through. I decided to do everything in coffee script, because, javascript is pretty ugly. using express framework: here is the "login." exports.login = (req, res) -> async.auto ({ token: async.apply(userService.g

[nodejs] Re: nodejs throughput verses custom server, scaling question to someone with experience.

2012-04-10 Thread christkv
Use the raw mongodb driver and the c++ bson parser I suggest trying native_parser set to true to avoid any gc overhead On Apr 10, 10:28 pm, timp wrote: > or BSON, sorry. > > I assume it must parse the db results, > and then it must JSON them into the result. > > > > > > > > On Tuesday, April 10,

[nodejs] Re: nodejs throughput verses custom server, scaling question to someone with experience.

2012-04-11 Thread christkv
if perf is dropping over time I suspect a possible memory leak causing the gc to have to go through longer and longer of uncollectable items. it might be worth just writing a simple test app dropping mongoskin and hitting the driver directly. On Apr 11, 12:12 am, timp wrote: > Oh well, thanks fo

[nodejs] Re: nodejs throughput verses custom server, scaling question to someone with experience.

2012-04-12 Thread timp
Hey there, I bring a few updates. Which may be more an insight into compulsive programmer behavior than anything else :-) However: So yesterday I thought, well, let's see if I just use nodeJS as the front end, and use java as the backend. So what I did, was use "gear man" to create a work que

[nodejs] Re: nodejs throughput verses custom server, scaling question to someone with experience.

2012-04-13 Thread christkv
is this a variation of a troll ? On Apr 13, 12:58 am, timp wrote: > Hmm..  This may be a valid criticism. > > However.  My gut tells me otherwise.  I made the code set for tests > incredibly small. > And all of the nodeJS/java/groovy are using the same queries in ab testing. > > (But, this being

Re: [nodejs] Re: nodejs throughput verses custom server, scaling question to someone with experience.

2012-04-12 Thread Marak Squires
Perhaps, you should take the time to decide on a single implementation and actually try to figure out what's going on. I don't really think any of the benchmarks you've posted are indicative of performance for the specific software suite they are benchmarking. On Thu, Apr 12, 2012 at 3:32 PM, t

Re: [nodejs] Re: nodejs throughput verses custom server, scaling question to someone with experience.

2012-04-12 Thread timp
Hmm.. This may be a valid criticism. However. My gut tells me otherwise. I made the code set for tests incredibly small. And all of the nodeJS/java/groovy are using the same queries in ab testing. (But, this being said, my gut is often wrong though. Maybe there is some flag or something

Re: [nodejs] Re: nodejs throughput verses custom server, scaling question to someone with experience.

2012-04-13 Thread shawn wilson
Hummm, maybe try redoing this using tomcat / rails / PHP no wait, that won't be any faster. How about a shell script and netcat / mod_perl / cobol on cogs. Ah no, that won't work either. New idea - grow smarter and stop wasting time. $$$ says gearman is the bottleneck ab is giving you stats on

Re: [nodejs] Re: nodejs throughput verses custom server, scaling question to someone with experience.

2012-04-14 Thread timp
I appreciate the colorful responses. However, I think, the numbers do speak for themselves. If you are creating basically a mongo JSON REST web service. And are having rps problems with your current framework, using dynamic languages. It may be worth your while, to remove all the frameworks, a

Re: [nodejs] Re: nodejs throughput verses custom server, scaling question to someone with experience.

2012-04-14 Thread Jann Horn
On Sat, Apr 14, 2012 at 07:41:50AM -0700, timp wrote: > I appreciate the colorful responses. > > However, I think, the numbers do speak for themselves. > > If you are creating basically a mongo JSON REST web service. And are > having rps problems with your current framework, using dynamic langu

Re: [nodejs] Re: nodejs throughput verses custom server, scaling question to someone with experience.

2012-04-14 Thread timp
Pretty much. Server authenticates, provides get/set for a user state. Provides gets for related information. Does checks for obvious cheating, obvious hacking. Apple push notifications, managing "pub sub" between players. All of the game logic is in the client on the phone. I'll use S3 to do al

Re: [nodejs] Re: nodejs throughput verses custom server, scaling question to someone with experience.

2012-04-14 Thread Tim Caswell
It may be worth your while, to remove all the frameworks, and do a vanilla js file using node. ;) On Sat, Apr 14, 2012 at 4:30 PM, timp wrote: > Pretty much. > > Server authenticates, provides get/set for a user state. > Provides gets for related information. > > Does checks for obvious cheati

Re: [nodejs] Re: nodejs throughput verses custom server, scaling question to someone with experience.

2012-04-14 Thread shawn wilson
On Apr 14, 2012 10:41 AM, "timp" wrote: > If you are creating basically a mongo JSON REST web service. And are having rps problems with your current framework, using dynamic languages. > > It may be worth your while, to remove all the frameworks, and do a jsp war deployed in tomcat with no "extr