Hi,
The segment size and this buffer parameter are unrelated to each other.
Lucene builds smaller segments during index, but they are merged at a
later stage anyways, so producing larger segments from the beginning and
hitting limits like you see is not required for fast search. So raising
th
My index was only vectors, plus a small string ID. That is probably the
reason why it didn't hit any issue. When I added a larger text field to the
document, I've hit this exception:
Exception in thread "Thread-0" java.lang.RuntimeException:
java.lang.ArithmeticException: integer overflow
at
com.d
Hi all,
we're building vector indexes and we'd like to achieve large segments.
There's `IndexWriterConfig.setRAMPerThreadHardLimitMB` that defaults to
1945 and can be set to up to 2048 MB. I've commented out the precondition
in the method and set the limit to 16384 and I have successfully built 6G
