I have this line craw-urlfilter.txt

# skip file:, ftp:, & mailto: urls
-^(file|ftp|mailto):

but when in my dump links output, there are still mailto links?

mailto:[EMAIL PROTECTED]        Inlinks:
 fromUrl: http://www.cnn.com/2007/AUTOS/03/05/ford_trucks.fsb/index.html
anchor: Alex Taylor III

mailto:[EMAIL PROTECTED]        Inlinks:
 fromUrl: http://www.cnn.com/2007/AUTOS/04/09/car_colors/index.html
anchor: Feedback
 fromUrl: http://www.cnn.com/2007/AUTOS/04/11/ford_recall/index.html
anchor: Feedback

mailto:[EMAIL PROTECTED]        Inlinks:
 fromUrl: http://www.cnn.com/about/ anchor: [EMAIL PROTECTED]
 fromUrl: http://www.cnn.com/interactive_legal.html anchor:
[EMAIL PROTECTED]

mailto:[EMAIL PROTECTED]        Inlinks:
 fromUrl: 
http://www.cnn.com/exchange/ireports/topics/forms/2007/04/road.trips.html
anchor: [EMAIL PROTECTED]
 fromUrl: 
http://www.cnn.com/exchange/ireports/topics/forms/2007/04/coney.island.html
anchor: [EMAIL PROTECTED]
 fromUrl: 
http://www.cnn.com/exchange/ireports/topics/forms/2007/04/tour.duty.html
anchor: [EMAIL PROTECTED]
 fromUrl: http://www.cnn.com/exchange/ireports/toolkit/index.html
anchor: [EMAIL PROTECTED]
 fromUrl: http://www.cnn.com/exchange/ireports/topics/forms/fueling.america.html
anchor: [EMAIL PROTECTED]
 fromUrl: http://www.cnn.com/exchange/ireports/topics/forms/breaking.news.html
anchor: [EMAIL PROTECTED]
 fromUrl: http://www.cnn.com/exchange/ireports/topics/forms/2006/10/cnn.u.html
anchor: [EMAIL PROTECTED]
 fromUrl: 
http://www.cnn.com/exchange/ireports/topics/forms/2007/01/fitorfat.html
anchor: [EMAIL PROTECTED]
 fromUrl: 
http://www.cnn.com/exchange/ireports/topics/forms/2006/09/office.space.html
anchor: [EMAIL PROTECTED]
 fromUrl: http://www.cnn.com/exchange/ireports/topics/forms/2007/03/theshot.html
anchor: [EMAIL PROTECTED]

mailto:[EMAIL PROTECTED]        Inlinks:
 fromUrl: http://www.cnn.com/interactive_legal.html anchor:
[EMAIL PROTECTED]

mailto:[EMAIL PROTECTED]        Inlinks:
 fromUrl: http://www.cnn.com/CNN/Programs/american.morning/ anchor: E-mail

mailto:[EMAIL PROTECTED]        Inlinks:
 fromUrl: http://www.cnn.com/privacy.html anchor: [EMAIL PROTECTED]



Thank you.

-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
Nutch-general mailing list
[EMAIL PROTECTED]
https://lists.sourceforge.net/lists/listinfo/nutch-general

Reply via email to