Re: [Twisted-Python] Benchmark of Python WSGI servers

2011-03-19 Thread Glyph Lefkowitz
On Mar 19, 2011, at 8:39 AM, Michael Thompson wrote: > I agree that threads and processes is going to be the first step to > scaling but I don't think there's much advantage putting that in > twisted given that there are other solutions for this. Other solutions for what? If Twisted is going to

Re: [Twisted-Python] Benchmark of Python WSGI servers

2011-03-19 Thread Itamar Turner-Trauring
On Fri, 2011-03-18 at 20:54 -0400, Glyph Lefkowitz wrote: > My pet theory is that it has something to do with transferring data > from threads to the I/O loop via queue synchronization, and not being > as smart as it could be about buffering, and that particular technique > getting slammed really

Re: [Twisted-Python] Benchmark of Python WSGI servers

2011-03-19 Thread Michael Thompson
On 19 March 2011 08:29, Glyph Lefkowitz wrote: > On Mar 18, 2011, at 9:35 PM, exar...@twistedmatrix.com wrote: > > A multi-process WSGI container might actually be of practical use, since > it may make more cores available to your server.  If an application is > bottlenecked on CPU rather than som

Re: [Twisted-Python] Benchmark of Python WSGI servers

2011-03-19 Thread Glyph Lefkowitz
On Mar 18, 2011, at 9:35 PM, exar...@twistedmatrix.com wrote: > A multi-process WSGI container might actually be of practical use, since > it may make more cores available to your server. If an application is > bottlenecked on CPU rather than some high-latency operation (as you can > only proc

Re: [Twisted-Python] Benchmark of Python WSGI servers

2011-03-18 Thread exarkun
On 12:54 am, gl...@twistedmatrix.com wrote: >On Mar 18, 2011, at 7:44 PM, Michael Thompson wrote: >> From the guys who brought you async socket benchmark, >>http://nichol.as/asynchronous-servers-in-python, comes Python WSGI >>benchmark >>http://nichol.as/benchmark-of-python-web-servers. > >Yep, I'v

Re: [Twisted-Python] Benchmark of Python WSGI servers

2011-03-18 Thread Glyph Lefkowitz
On Mar 18, 2011, at 7:44 PM, Michael Thompson wrote: > From the guys who brought you async socket benchmark, > http://nichol.as/asynchronous-servers-in-python, comes Python WSGI > benchmark > http://nichol.as/benchmark-of-python-web-servers. Yep, I've seen that before. It's one of the better ben

[Twisted-Python] Benchmark of Python WSGI servers

2011-03-18 Thread Michael Thompson
>From the guys who brought you async socket benchmark, http://nichol.as/asynchronous-servers-in-python, comes Python WSGI benchmark http://nichol.as/benchmark-of-python-web-servers. Is twisted coming out of this so badly because they are using the default reactor, as opposed to epoll? Perhaps the