Surf can search or fetch the links on a website from the commandline.  As 
you can see it also creates a text file and strips the html.

http://www.hughes.net/~scheper/surf.zip

Example output...

C:\> surf -F http://packetstorm.securify.com

C:\> start .\list.txt

  SURF URL file: 'list.txt'
  employees exploit exploits freebsd headlines nessus newsnow november

  # prevents re-downloading web pages that you already have.
  * prevents downloading novel links. Delete * to SURF them.

         ----LOCAL FILES----
http://packetstorm.securify.com/
  #145 packetst.htm
  [ packet storm ] - packetstorm.securify.com
  zip tar txt november security freebsd pst newsnow syslog tgz employees
  exploit exploits headlines nessus packet saint storm versioner

         ----NOVEL LINKS----
http://208.238.102.119:8000/ss?click&sgailey&39c010fe
  *

http://209.143.242.119/cgi-bin/cbmc/forums.cgi
  *

http://209.143.242.119/cgi-bin/cbmc/forums.cgi?faq=defined
  * Newbie FAQ

http://209.143.242.119/cgi-bin/cbmc/forums.cgi?uname=anonymous&authkey=anonymous&label=Espionage.46297&vchosen=1
  * Very concerned and a talking point with all employees.

http://209.143.242.119/cgi-bin/cbmc/forums.cgi?uname=anonymous&authkey=anonymous&label=Espionage.46297&vchosen=2
  * Moderately concerned with upper management and critical employees being 
educated.

http://209.143.242.119/cgi-bin/cbmc/forums.cgi?uname=anonymous&authkey=anonymous&label=Espionage.46297&vchosen=3
  * Very little concern and is never discussed.

http://209.143.242.119/cgi-bin/cbmc/forums.cgi?uname=anonymous&authkey=anonymous&label=Espionage.46297&vchosen=4
  * None. My company does not feel that they are at risk.

http://biz.yahoo.com/fo/001102/1102malone.html
  * Hackers and Highwaymen

http://packetstorm.securify.com/advisories20.shtml
  *

http://packetstorm.securify.com/assess.html
  *

http://packetstorm.securify.com/careers.html
  *

http://packetstorm.securify.com/defense.html
  *

http://packetstorm.securify.com/exploits20.shtml
  *

http://packetstorm.securify.com/filedesc/0010-exploits.html
  * 0010-exploits.tgz...

http://packetstorm.securify.com/filedesc/FreeBSD-SA-00:62.top.html
  * FreeBSD-SA-00:62....

http://packetstorm.securify.com/filedesc/FreeBSD-SA-00:63.getnameinfo.html
  * FreeBSD-SA-00:63....

http://packetstorm.securify.com/filedesc/FreeBSD-SA-00:64.global.html
  * FreeBSD-SA-00:64....

http://packetstorm.securify.com/filedesc/FreeBSD-SA-00:65.xfce.html
  * FreeBSD-SA-00:65....

http://packetstorm.securify.com/filedesc/FreeBSD-SA-00:66.netscape.html
  * FreeBSD-SA-00:66....

http://packetstorm.securify.com/filedesc/IISHack1.5.zip.html
  * IISHack1.5.zip

http://packetstorm.securify.com/filedesc/StJudeModel.pdf.html
  * StJudeModel.pdf

http://packetstorm.securify.com/filedesc/StJude_LKM-0.04.tar.html
  * StJude_LKM-0.04.t...

http://packetstorm.securify.com/filedesc/Tfak4_5.zip.html
  * Tfak4_5.zip

http://packetstorm.securify.com/filedesc/Unverified_Fields_1.0.pdf.html
  * Unverified_Fields...

http://packetstorm.securify.com/filedesc/ads_cat.zip.html
  * ads_cat.zip

http://packetstorm.securify.com/filedesc/anomy-sanitizer-1.28.tar.html
  * anomy-sanitizer-1...

http://packetstorm.securify.com/filedesc/apache_1.3.14.tar.html
  * apache_1.3.14.tar...

http://packetstorm.securify.com/filedesc/ccla1.zip.html
  * ccla1.zip

http://packetstorm.securify.com/filedesc/ccla2.zip.html
  * ccla2.zip

http://packetstorm.securify.com/filedesc/crypto-gram-0010.txt.html
  * crypto-gram-0010....

http://packetstorm.securify.com/filedesc/devicelock.zip.html
  * devicelock.zip

http://packetstorm.securify.com/filedesc/dump.sh.html
  * dump.sh

http://packetstorm.securify.com/filedesc/eeye.iishack-1.5.txt.html
  * eeye.iishack-1.5....

http://packetstorm.securify.com/filedesc/ethereal-0.8.13.tar.html
  * ethereal-0.8.13.t...

http://packetstorm.securify.com/filedesc/exgsx.c.html
  * exgsx.c

http://packetstorm.securify.com/filedesc/exiscan-0.7.tar.html
  * exiscan-0.7.tar.g...

http://packetstorm.securify.com/filedesc/f8-103100-realsecure.txt.html
  * f8-103100-realsec...

http://packetstorm.securify.com/filedesc/firestarter-0.5.0.tar.html
  * firestarter-0.5.0...

http://packetstorm.securify.com/filedesc/formnow-exploit.pl.html
  * formnow-exploit.p...

http://packetstorm.securify.com/filedesc/fwlogwatch-0.0.25.tar.html
  * fwlogwatch-0.0.25...

http://packetstorm.securify.com/filedesc/guninski26.txt.html
  * guninski26.txt

http://packetstorm.securify.com/filedesc/hl-advisory.asc.html
  * hl-advisory.asc

http://packetstorm.securify.com/filedesc/hostexp.c.html
  * hostexp.c

http://packetstorm.securify.com/filedesc/hp2.adv.html
  * hp2.adv

http://packetstorm.securify.com/filedesc/iptables-1.1.1.tar.bz2.html
  * iptables-1.1.1.ta...

http://packetstorm.securify.com/filedesc/irpas.tar.html
  * irpas.tar.gz

http://packetstorm.securify.com/filedesc/iss.00-11-01.netmon.html
  * iss.00-11-01.netm...

http://packetstorm.securify.com/filedesc/kde-exploit.gif.html
  * kde-exploit.gif

http://packetstorm.securify.com/filedesc/kye-worm.txt.html
  * kye-worm.txt

http://packetstorm.securify.com/filedesc/labs57.txt.html
  * labs57.txt

http://packetstorm.securify.com/filedesc/libnids-1.16.tar.html
  * libnids-1.16.tar....

http://packetstorm.securify.com/filedesc/listmail-exploit.pl.html
  * listmail-exploit....

http://packetstorm.securify.com/filedesc/log_analysis-0.34.tar.html
  * log_analysis-0.34...

http://packetstorm.securify.com/filedesc/mantrap-info.html
  * mantrap-info.tgz

http://packetstorm.securify.com/filedesc/mimedefang-0.5.tar.html
  * mimedefang-0.5.ta...

http://packetstorm.securify.com/filedesc/ms00-060.html
  * ms00-060

http://packetstorm.securify.com/filedesc/ms00-082.html
  * ms00-082

http://packetstorm.securify.com/filedesc/ms00-083.html
  * ms00-083

http://packetstorm.securify.com/filedesc/ms00-084.html
  * ms00-084

http://packetstorm.securify.com/filedesc/ms00-085.html
  * ms00-085

http://packetstorm.securify.com/filedesc/ms00-086.html
  * ms00-086

http://packetstorm.securify.com/filedesc/natas.zip.html
  * natas.zip

http://packetstorm.securify.com/filedesc/nessus-1.0.6.tar.html
  * nessus-1.0.6.tar....

http://packetstorm.securify.com/filedesc/netsec36.txt.html
  * netsec36.txt

http://packetstorm.securify.com/filedesc/netsec37.txt.html
  * netsec37.txt

http://packetstorm.securify.com/filedesc/newsexp.tar.html
  * newsexp.tar.gz

http://packetstorm.securify.com/filedesc/nscache-0.4.html
  * nscache-0.4.tgz

http://packetstorm.securify.com/filedesc/ntop-w-exp.c.html
  * ntop-w-exp.c

http://packetstorm.securify.com/filedesc/openssh-2.3.0p1.tar.html
  * openssh-2.3.0p1.t...

http://packetstorm.securify.com/filedesc/patch-int-2.2.17.9.html
  * patch-int-2.2.17....

http://packetstorm.securify.com/filedesc/pollex.pl.html
  * pollex.pl

http://packetstorm.securify.com/filedesc/quakeworldex.txt.html
  * quakeworldex.txt

http://packetstorm.securify.com/filedesc/rcf-5.0.1.tar.html
  * rcf-5.0.1.tar.gz

http://packetstorm.securify.com/filedesc/rna.tar.html
  * rna.tar.gz

http://packetstorm.securify.com/filedesc/ruleset-retrieve.c.html
  * ruleset-retrieve....

http://packetstorm.securify.com/filedesc/sa_07.txt.html
  * sa_07.txt

http://packetstorm.securify.com/filedesc/safer.001103.EXP.1.9.html
  * safer.001103.EXP....

http://packetstorm.securify.com/filedesc/saint-3.1.1.beta1.tar.html
  * saint-3.1.1.beta1...

http://packetstorm.securify.com/filedesc/scx-sa-08.txt.html
  * scx-sa-08.txt

http://packetstorm.securify.com/filedesc/sendmail.8.11.1.tar.html
  * sendmail.8.11.1.t...

http://packetstorm.securify.com/filedesc/sscan2k-pre6.HWA.tar.html
  * sscan2k-pre6.HWA....

http://packetstorm.securify.com/filedesc/subscribe-me.lite.txt.html
  * subscribe-me.lite...

http://packetstorm.securify.com/filedesc/syslog-ng-1.4.8.tar.html
  * syslog-ng-1.4.8.t...

http://packetstorm.securify.com/filedesc/tcpip_lib2.zip.html
  * tcpip_lib2.zip

http://packetstorm.securify.com/filedesc/tk.html
  * tk.tgz

http://packetstorm.securify.com/filedesc/tripwire-2.3-47.bin.tar.html
  * tripwire-2.3-47.b...

http://packetstorm.securify.com/filedesc/unicodexecute2.pl.html
  * unicodexecute2.pl...

http://packetstorm.securify.com/filedesc/unrm-0.9.tar.html
  * unrm-0.9.tar.gz

http://packetstorm.securify.com/filedesc/utilmind-maillist-exploit.pl.html
  * utilmind-maillist...

http://packetstorm.securify.com/filedesc/versioner-09.zip.html
  * versioner-09.zip

http://packetstorm.securify.com/filedesc/vnx4.c.html
  * vnx4.c

http://packetstorm.securify.com/filedesc/winzapper.zip.html
  * winzapper.zip

http://packetstorm.securify.com/filedesc/xrestore.c.html
  * xrestore.c

http://packetstorm.securify.com/index.shtml
  *

http://packetstorm.securify.com/links.html
  *

http://packetstorm.securify.com/magazines.html
  *

http://packetstorm.securify.com/misc.html
  *

http://packetstorm.securify.com/miscellaneous_files20.shtml
  *

http://packetstorm.securify.com/papers.html
  *

http://packetstorm.securify.com/papers/general/kye-worm.txt
  * kye-worm.txt...

http://packetstorm.securify.com/pssabout.html
  *

http://packetstorm.securify.com/tools20.shtml
  *

http://securitygeeks.shmoo.com/
  * Security Geeks

http://securitygeeks.shmoo.com/article.php?story=20001031052646219
  * Stifling Buffer Overflows

http://www.abcnews.com/
  * ABCNews.com

http://www.abcnews.go.com/sections/tech/DailyNews/microsoft_hacked001031.html
  * Microsoft Security Experts Tried But Failed to Catch Hacker in Weeklong 
Game of Cat and Mouse

http://www.anchordesk.co.uk/
  * ZDNetUK

http://www.anchordesk.co.uk/anchordesk/commentary/columns/0,2415,7106853,00.html
  * Integrity of the FBI's NIPC Questioned

http://www.cipherwar.com/
  * CipherWar

http://www.cipherwar.com/news/00/pgp_wireless.htm
  * PGPwireless for PalmOS Announced

http://www.msnbc.com/
  * MSNBC

http://www.msnbc.com/local/PISEA/5228.asp
  * Russian Mathematician Investigated For Espionage, US Global Monopoly on 
Radar Invisibility at Risk

http://www.newsnow.co.uk/
  * http://www.newsnow.co.uk

http://www.newsnow.co.uk/cgi/NewsNow/NewsFeed.htm?Section=NewsLink&Theme=Encryption+%2F+Security
  * Encryption and Security

http://www.voila.co.uk/
  * VoilaNews

http://www.voila.co.uk/News/afp/uk/001102160211.fg9gvpa7.html
  * Employees Fear New "Big Brother" Privacy Regulations

http://www.yahoo.com/
  * Yahoo

http://www.zdnet.com/
  * ZDNet

http://www.zdnet.com/zdnn/stories/news/0,4586,2648156,00.html
  * FBI Steals Home in Yankees Hack



------------------------------------------------------------
       GIVE YOUR EMAIL A DAILY CHECKUP
  >>--->>  http://www.daytips.com <<---<<
<a href="http://www.daytips.com">CLICK IT</a>


----
post: [EMAIL PROTECTED]
url: http://theMezz.com/informant
forum: http://theMezz.com/bbs
subscribe: [EMAIL PROTECTED]
unsubscribe: [EMAIL PROTECTED]
digest: [EMAIL PROTECTED]
notDigest: [EMAIL PROTECTED]
 

___________________________________________________________
T O P I C A  http://www.topica.com/t/17
Newsletters, Tips and Discussions on Your Favorite Topics

Reply via email to