[
https://issues.apache.org/jira/browse/LUCENE-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17251747#comment-17251747
]
Michael Sokolov commented on LUCENE-9625:
-----------------------------------------
Hm I used this issue number incorrectly for the attached PR; somehow I got it
in my head this issue was about implementing the HNSW diversity, but now I see
it is not, and that issue doesn't exist! So I'll open it and see if I can
transfer the PR over there, or maybe re-open it if need be
> Benchmark KNN search with ann-benchmarks
> ----------------------------------------
>
> Key: LUCENE-9625
> URL: https://issues.apache.org/jira/browse/LUCENE-9625
> Project: Lucene - Core
> Issue Type: New Feature
> Reporter: Michael Sokolov
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> In addition to benchmarking with luceneutil, it would be good to be able to
> make use of ann-benchmarks, which is publishing results from many approximate
> knn algorithms, including the hnsw implementation from its authors. We don't
> expect to challenge the performance of these native code libraries, however
> it would be good to know just how far off we are.
> I started looking into this and posted a fork of ann-benchmarks that uses
> KnnGraphTester class to run these:
> https://github.com/msokolov/ann-benchmarks. It's still a WIP; you have to
> manually copy jars and the KnnGraphTester.class to the test host machine
> rather than downloading from a distribution. KnnGraphTester needs some
> modifications in order to support this process - this issue is mostly about
> that.
> One thing I noticed is that some of the index builds with higher fanout
> (efConstruction) settings time out at 2h (on an AWS c5 instance), so this is
> concerning and I'll open a separate issue for trying to improve that.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
