Re: [PR] Speedup concurrent multi-segment HNWS graph search 2 [lucene]

[via GitHub]

benwtrent commented on PR #12962:
URL: https://github.com/apache/lucene/pull/12962#issuecomment-1912157192

   I ran my own experiment, which showed some interesting and frustrating 
results. 
   
   I adjusted the indexing to randomly commit() on every 500 docs or so. I 
indexed the first 10M docs of cohere-wiki and used max-inner product over the 
raw float32. This showed that we have some graph building problems, will 
include those results as well.
   
   # Graph
   
   
![image](https://github.com/apache/lucene/assets/4357155/7670c364-e66a-4719-a6b5-3f068d732863)
   
   The python code & raw data used:
   
   <detail>
   
   ```python
   ```
   
   </detail>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org