Hi,
I found many pages with the same title , page contents are almost same. I would
like to index the pages with the same title only once.How can I recognize the
pages with same title during indexing process?
How do nutch remove pages with same page content and in which class/package can
I find the code?
Thanks
-Qi
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
Nutch-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-general