Hi Gurus, I need to write a perl script for a web spider that will crawl the web looking for specific file(s) that I specify (such as .mp3) and store the URL's into a mysql database. This needs to work on a linux server. I will also require a skip list that will skip certain sites that I input into some kind of array.
Can anybody give me some ideas to do the same. Thanks, PP
