Shailesh Kochhar wrote:
If I understand this correctly, you can only dedup by one field. This would mean that if you were to implement and use content-based deduplication, you'd have to give up limiting the number of hits per host.

Is this correct, or did I miss something?

That's correct.  That's what's currently implemented.

Doug


-------------------------------------------------------
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=110944&bid=241720&dat=121642
_______________________________________________
Nutch-developers mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-developers

Reply via email to