M (GMT+0200) Auto-Detected
Subject: perl script to crawl the web
Hi Gurus,
I need to write a perl script for a web spider that will crawl the web
looking for specific file(s) that I specify (such as .mp3) and store the
URL's into a mysql database. This needs to work on a linux server. I will
als
If you don't need to login the site to catch files,I think you just
need LWP family.see perldoc lwpcook.
If the site require login for some authentication,you may need WWW::Mechanize.
I doubt there are also some modules on CPAN for this purpose.
2007/8/27, perl pra <[EMAIL PROTECTED]>:
> Hi Guru
Hi Gurus,
I need to write a perl script for a web spider that will crawl the web
looking for specific file(s) that I specify (such as .mp3) and store the
URL's into a mysql database. This needs to work on a linux server. I will
also require a skip list that will skip certain sites that I input in
