managing many HTTP connections - recommendation wanted

[Torsten Foertsch]

Hi,

I have to manage many parallel HTTP/HTTPS connections. My current 
implementation starts up a number of threads (300-500). Each thread handles 
one LWP::UserAgent. Then I use a queue to shift connection requests from the 
manager thread to the workers.

Since Perl's thread implementation is rather memory consuming this is not the 
optimal solution. 500 threads is the maximum on my 1GB machine.

Is there a better solution using asynchronous IO but providing the simplicity 
of LWP::UserAgent and supporting HTTP and HTTPS?

Thanks,
Torsten

pgpbp5VyPauqX.pgp
Description: PGP signature