goankur commented on PR #13572: URL: https://github.com/apache/lucene/pull/13572#issuecomment-3648627594
Thanks Shubham for discovering `Linker.Option.critical(true)` that allows JVM to interoperate between off-heap and on-heap memory in a foreign (native) function. This eliminates extra on-heap to off-heap copying which improves the efficiency of this approach further as validated by our production environment at Amazon. As an introductory note, both Shubham and I work at Amazon in the team that designs, builds and operates Amazon's product search engine. Given the compelling performance improvements we are observing in production, especially with large (1K+ dimension) vectors, we'd love to work with the community to contribute it back so that larger Lucene community can benefit from this change. As Shubham mentioned, we are committed to supporting this alongside rest of the Lucene community. Please advise how to proceed. To reiterate, the credit for the original idea goes to this blog post from Elastic https://www.elastic.co/search-labs/blog/vector-similarity-computations-ludicrous-speed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
