Re: [Twisted-Python] Multi-reactor architecture

2009-11-13 Thread vitaly
So if I get stick to the "vertical scalability"(Site has sessions), is it gonna be helpful for performance to run Twisted reactor on a single core machine vs multi-core machine (after all Python itself has a Global Interpreter Lock)? OR the entire "TwsitedGateway+listenSSL+Site+reactor" USAG

Re: [Twisted-Python] Multi-reactor architecture

2009-11-13 Thread Reza Lotun
> thank you for such detailed response. > I feel, finally I've succeed to express my original question correctly. > > So if I go one step forward, and lets assume that indeed there is such > limit of concurrent connections, THAN: > should it be resolved by another architecture or another usage type

Re: [Twisted-Python] Multi-reactor architecture

2009-11-13 Thread vitaly
thank you for such detailed response. I feel, finally I've succeed to express my original question correctly. So if I go one step forward, and lets assume that indeed there is such limit of concurrent connections, THAN: should it be resolved by another architecture or another usage type of Tw

Re: [Twisted-Python] Multi-reactor architecture

2009-11-13 Thread Reza Lotun
> Once there is a Site that serving many clients and > reactor.listenSSL(), for example, that actually serving many TCP > connections and all these going through TwistedGateway, my logic, > please correct me if I wrong, says at some point there will be a limit > on concurrent TCP connections, so ho

Re: [Twisted-Python] Multi-reactor architecture

2009-11-13 Thread vitaly
I've get confused enough already :-)) Once there is a Site that serving many clients and reactor.listenSSL(), for example, that actually serving many TCP connections and all these going through TwistedGateway, my logic, please correct me if I wrong, says at some point there will be a limit

Re: [Twisted-Python] Multi-reactor architecture

2009-11-13 Thread exarkun
On 03:59 pm, vit...@synapticvision.com wrote: > >Doesn't the event loop have a limit of connections it could handle? Multiple reactors isn't a realistic solution to this. The solution is to switch to an event loop that has a higher limit. "The" event loop is actually a choice of many possible

Re: [Twisted-Python] Multi-reactor architecture

2009-11-13 Thread vitaly
Doesn't the event loop have a limit of connections it could handle? Quoting "Reza Lotun" : >> hi, >> what would be the right thing to start from in order to build >> multi-reactor arch to handle thousands of concurrent connections? > > Why would you want multiple reactors? The only reason would

Re: [Twisted-Python] Multi-reactor architecture

2009-11-12 Thread Kevin Horn
On Thu, Nov 12, 2009 at 12:53 PM, wrote: > > You right, distributed systems architecture. > > Probably I need to rephrase my question more precisely: how to build > distributed system architecture with Twisted technology only ? > > As you mentioned, even reverse proxy could be a another twisted p

Re: [Twisted-Python] Multi-reactor architecture

2009-11-12 Thread vitaly
You right, distributed systems architecture. Probably I need to rephrase my question more precisely: how to build distributed system architecture with Twisted technology only ? As you mentioned, even reverse proxy could be a another twisted process. Quoting "Reza Lotun" : >> How reverse prox

Re: [Twisted-Python] Multi-reactor architecture

2009-11-12 Thread Reza Lotun
> How reverse proxy knows to balance between couple of twistd processes? > Do you have may be an example(or doc link) of such proxy that can > distributing connections to each twistd process? This is a classic distributed systems architecture. A reverse proxy can either something like haproxy, ngi

Re: [Twisted-Python] Multi-reactor architecture

2009-11-12 Thread vitaly
How reverse proxy knows to balance between couple of twistd processes? Do you have may be an example(or doc link) of such proxy that can distributing connections to each twistd process? Quoting "Reza Lotun" : >> hi, >> what would be the right thing to start from in order to build >> multi-rea

Re: [Twisted-Python] Multi-reactor architecture

2009-11-12 Thread Reza Lotun
> hi, > what would be the right thing to start from in order to build > multi-reactor arch to handle thousands of concurrent connections? Why would you want multiple reactors? The only reason would be to have one per CPU core. For that the simplest thing would be to manually start n twistd process

[Twisted-Python] Multi-reactor architecture

2009-11-12 Thread vitaly
hi, what would be the right thing to start from in order to build multi-reactor arch to handle thousands of concurrent connections? Appreciate the help. ___ Twisted-Python mailing list Twisted-Python@twistedmatrix.com http://twistedmatrix.com/cgi-bin