Re: asynchronous downloading

2012-02-25 Thread Richard Baron Penman
>> I read through the python-dev archives and found the fundamental problem is >> no one maintains asnycore / asynchat. > > Well, actually I do/did. ah OK. I had read this comment from a few years back: "IIRC, there was a threat to remove asyncore because there were no maintainers, no one was fix

Re: asynchronous downloading

2012-02-24 Thread Giampaolo RodolĂ 
Il 24 febbraio 2012 02:10, Plumo ha scritto: > that example is excellent - best use of asynchat I have seen so far. > > I read through the python-dev archives and found the fundamental problem is > no one maintains asnycore / asynchat. Well, actually I do/did. Point with asyncore/asynchat is tha

Re: asynchronous downloading

2012-02-23 Thread Fayaz Yusuf Khan
On Thursday 23 Feb 2012 5:10:25 PM Plumo wrote: > I read through the python-dev archives and found the fundamental problem is > no one maintains asnycore / asynchat. By all means, scratch your own itch. :) -- Fayaz Yusuf Khan Cloud developer and architect Dexetra SS, Bangalore, India fayaz.yusuf.

Re: asynchronous downloading

2012-02-23 Thread Plumo
that example is excellent - best use of asynchat I have seen so far. I read through the python-dev archives and found the fundamental problem is no one maintains asnycore / asynchat. -- http://mail.python.org/mailman/listinfo/python-list

Re: asynchronous downloading

2012-02-23 Thread Plumo
My current implementation works fine below a few hundred threads. But each thread takes up a lot of memory so does not scale well. I have been looking at Erlang for that reason, but found it is missing useful libraries in other areas. -- http://mail.python.org/mailman/listinfo/python-list

Re: asynchronous downloading

2012-02-23 Thread Giampaolo RodolĂ 
Il 23 febbraio 2012 07:58, Plumo ha scritto: > I want to download content asynchronously. This would be straightforward to > do threaded or across processes, but difficult asynchronously so people seem > to rely on external libraries (twisted / gevent / eventlet). > > (I would use gevent under d

Re: asynchronous downloading

2012-02-23 Thread Richard Baron Penman
>> I want to download content asynchronously. This would be >> straightforward to do threaded or across processes, but difficult >> asynchronously so people seem to rely on external libraries (twisted >> / gevent / eventlet). > > > Exactly - the fact it's difficult is why those tools compete. It i

Re: asynchronous downloading

2012-02-23 Thread Paul Rubin
Plumo writes: > What do you recommend? Threads. > And why is there poor support for asynchronous execution? The freenode #python crowd seems to hate threads and prefer twisted, which seems to have the features you want and probably handles very large #'s of connections better than POSIX thread

Re: asynchronous downloading

2012-02-23 Thread Mark Hammond
On 23/02/2012 5:58 PM, Plumo wrote: I want to download content asynchronously. This would be straightforward to do threaded or across processes, but difficult asynchronously so people seem to rely on external libraries (twisted / gevent / eventlet). Exactly - the fact it's difficult is why thos

asynchronous downloading

2012-02-22 Thread Plumo
I want to download content asynchronously. This would be straightforward to do threaded or across processes, but difficult asynchronously so people seem to rely on external libraries (twisted / gevent / eventlet). (I would use gevent under different circumstances, but currently need to stick t