Word of advice, I went down the "thread" path and it became a nightmare. I'm using the Parallel LWP module from CPAN on a similar application. Two things to remember: the application of any kind of "parallel" processing becomes limited by the speed of your CPU and the amount of memory available to the app.
The application I built builds a cache of webpages (xml objects) every fifteen minutes and stores several thousand objects at a go. I quickly ran the CPU to ground and used up all the machine's memory to I called the Parallel LWP in a loop, only requesting about 100 URLs at a go (you'll have to figure out your best , number by watching the CPU/Memory load as you run your app, but start small!!!). LWP::Parallel: http://search.cpan.org/author/MARCLANG/ParallelUserAgent-2.54/lib/LWP/Parall el.pm -Zac Morris ----- Original Message ----- From: "$Bill Luebkert" <[EMAIL PROTECTED]> To: "$HeadHunter_Sid" <[EMAIL PROTECTED]> Cc: <[EMAIL PROTECTED]> Sent: Monday, August 19, 2002 6:39 PM Subject: Re: (no subject) > $HeadHunter_Sid wrote: > > Hello, > > > > One question - how can I using LWP modul, send several > > different simple requests in one moment > > > > $ua = LWP::UserAgent->new; > > $ua->agent("$0/0.1 " . $ua->agent); > > $req = HTTP::Request->new(GET => "$one_sait"); > > > > How can I in this moment I have 10 or 20 reqest, not > > one by one,but in the same moment. > > Do a PPM search for thread or parallel. That should present a few > possibilities. The only one I've used is 'ThreadPool' which seems to > work ok - used it for testing file locks with multiple accessors. > > -- > ,-/- __ _ _ $Bill Luebkert ICQ=162126130 > (_/ / ) // // DBE Collectibles Mailto:[EMAIL PROTECTED] > / ) /--< o // // http://dbecoll.tripod.com/ (Free site for Perl) > -/-' /___/_<_</_</_ Castle of Medieval Myth & Magic http://www.todbe.com/ > > _______________________________________________ > Perl-Win32-Web mailing list > [EMAIL PROTECTED] > To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs > _______________________________________________ Perl-Win32-Web mailing list [EMAIL PROTECTED] To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs
