kaivalnp commented on PR #16030: URL: https://github.com/apache/lucene/pull/16030#issuecomment-5261121969
Sorry for getting to this PR so late, but I realized that data-blind quantization would be super helpful for another use-case too: in an attempt to support multiple HNSW graphs backed by the same vector storage (#14758), we need to be able to effectively de-duplicate vectors across fields. Lucene currently supports a centroid-centered quantization, which might cause the same raw vector to be quantized differently across different fields. If it is data-blind (i.e. centered on the zero vector), quantized bytes can be sanely de-duplicated. See #16506. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
