jimczi commented on PR #14178:
URL: https://github.com/apache/lucene/pull/14178#issuecomment-2622455427
> Almost 10x indexing throughput improvement tells me we are doing something
silly in Lucene.
I did not test this specific integration but Faiss is multithreaded on bulk
training, adding and searching so we have to be careful when comparing the
result.
The benchmark results show a single segment but only Faiss reports time
spent in the force merge.
Does that mean that you indexed with `-numIndexThreads=1` for the Lucene
run? Since Faiss uses multithreading by default, we cannot compare with Lucene
if we don't use multi thread indexing and merging.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]