What the Solr de-duplciation offers you is to calculate for each document in input an Hash ( based on a set of fields). You can then select two options : - Index everything, documents with same signature will be equals - avoid the overwriting of duplicates.
How the similarity has is calculated is something you can play with and customise if needed. Clarified that, do you think can fit in some way, or definitely you are not talking about deduce ? 2015-05-20 8:37 GMT+01:00 Bram Van Dam <bram.van...@intix.eu>: > On 19/05/15 14:47, Alessandro Benedetti wrote: > > Hi Bram, > > what do you mean with : > > " I > > would like it to provide the unique value myself, without having the > > deduplicator create a hash of field values " . > > > > This is not reduplication, but simple document filtering based on a > > constraint. > > In the case you want de-duplication ( which seemed from your very first > > part of the mail) here you can find a lot of info : > > Not sure whether de-duplication is the right word for what I'm after, I > essentially want a unique constraint on an arbitrary field. Without > overwrite semantics, because I want Solr to tell me if a duplicate is > sent to Solr. > > I was thinking that the de-duplication feature could accomplish this > somehow. > > > - Bram > -- -------------------------- Benedetti Alessandro Visiting card : http://about.me/alessandro_benedetti "Tyger, tyger burning bright In the forests of the night, What immortal hand or eye Could frame thy fearful symmetry?" William Blake - Songs of Experience -1794 England
