Vector Search on Lucene

2023-03-02 Thread marcos rebelo
ctors. For performance reasons I would like some fast KNN for the rankers. I looked on Google and I didn't find any document with some code samples. 2 questions: * Is this a correct design pattern? * Is there a good article explaining how to do this with Lucene? Best Regards Mar

Re: Loading WFST to Memory Mapped File in Lucene

2022-12-27 Thread marcos rebelo
I have the same impression, even if I'm using the MMapDirectory. The data is on heap. For my use case, it's a huge waste of memory :( 90% of my data could be correctly organised and kept in disk. Thanks for the support Best regards Marcos Rebelo On Tue, 27 Dec 2022, 09:11 Dawid Wei

Loading WFST to Memory Mapped File in Lucene

2022-12-23 Thread marcos rebelo
wfst.load(is); System.out.println("FILE LOADED"); } Files.list(wfstPath).forEach(System.out::println); System.out.println("FILES LISTED"); assertThat(wfst.get("qwert123qwert")).isEqualTo(123); } What am I doing wrong? Thanks for the support B