Re: Lucene9.11 has longer query warm up time for vector queries compared to lucene9.7

2024-10-30 Thread Rui Wu
Sorry, the attached image didn't go through. Here is a public google doc containing the image. https://docs.google.com/document/d/1thLMJIiJhbOBrL59R8JDY6iA_rpu7cgWZnrR0Z1xI5I/edit?tab=t.0 On Wed, Oct 30, 2024 at 1:41 PM Rui Wu wrote: > Dear users, > > We recently migrated from Lucene9.7 to Luce

Lucene9.11 has longer query warm up time for vector queries compared to lucene9.7

2024-10-30 Thread Rui Wu
Dear users, We recently migrated from Lucene9.7 to Lucene9.11. During the migration, we noticed that the Lucene9.11 has a longer warm up time for vector queries. The warm up time means: when the index just finishes building, the query time is high for the first few minutes. The following figure s

Re: How to find RAM/disk usage of each vector field

2024-10-30 Thread Rui Wu
Hi Tanmay, Are you bothered by the .vec files hidden within the compound files? If yes, I have a snippet that can sum up the .vec files inside and outside compound files. https://gist.github.com/wurui90/28de20d46079108d7ae5ed181ba939d4 On Tue, Oct 29, 2024 at 12:08 PM Tanmay Goel wrote: > Hi al