If you don't need to login the site to catch files,I think you just
need LWP family.see perldoc lwpcook.

If the site require login for some authentication,you may need WWW::Mechanize.

I doubt there are also some modules on CPAN for this purpose.

2007/8/27, perl pra <[EMAIL PROTECTED]>:
> Hi Gurus,
>
> I need to write a perl  script for a web spider that will crawl the web
> looking for specific file(s) that I specify (such as .mp3) and store the
> URL's into a mysql database. This needs to work on a linux server. I will
> also require a skip list that will skip certain sites that I input into some
> kind of array.
>
> Can anybody give me some ideas to do the same.
>
> Thanks,
> PP
>

-- 
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
http://learn.perl.org/


Reply via email to