Lucene 10.0 and 9.12 blockers

Hello everyone, As previously discussed , I plan on releasing 9.last and 10.0 under the following timeline: - ~September 15th: 10.0 feature freeze - main becomes 11.0 - ~September 22nd: 9.last release, - ~October 1st: 10.0 release.

Re: Lucene 10.0 and 9.12 blockers

> On 8 Aug 2024, at 17:50, Adrien Grand wrote: > > Hello everyone, > > As previously discussed, I plan on releasing 9.last and 10.0 under the > following timeline: > - ~September 15th: 10.0 feature freeze - main becomes 11.0 > - ~September 22nd: 9.last release, > - ~October 1st: 10.0 release.

Re: Lucene 10.0 and 9.12 blockers

> On 15 Aug 2024, at 10:52, Chris Hegarty > wrote: > >> ... >> >> Chris, Uwe: I also wanted to check with you if this timeline works well with >> regards to supporting Java 23 in 9.last and 10.0? > > Yes, this works for JDK 23. > > While JDK 23 is scheduled to ship on 17th Sep, there is a

Re: Lucene 10.0 and 9.12 blockers

To make sure we don't lose track of this, https://github.com/apache/lucene/issues/13671 is a blocker for 10.0. There's a quick path forward here if we get into a time-crunch situation; we can revert some recent changes to drill-sideways (specifically DrillSideways and DrillSidewaysQuery) along with

Re: Lucene 10.0 and 9.12 blockers

Hi, In 9.x there's still the backport of https://github.com/apache/lucene/pull/13570 to be done. The PR apperas in the changelog, but was not backported yet. Chris and I will do this soon. 9.last release on Sept 22 fits perfectly with the JDK 23 release (and we will have Panama Vector Suppor

Re: Lucene 10.0 and 9.12 blockers

Hi, > On 8 Aug 2024, at 17:50, Adrien Grand wrote: > > Hello everyone, > > As previously discussed, I plan on releasing 9.last and 10.0 under the > following timeline: > - ~September 15th: 10.0 feature freeze - main becomes 11.0 > - ~September 22nd: 9.last release, > - ~October 1st: 10.0 relea

Re: Lucene 10.0 and 9.12 blockers

Hi, I updated Policeman Jenkins to have JDK 23 RC and JDK 24 EA releases. Uwe P.S.: Unfortunately I have to update the macOS Hackintosh VM to have a newer operating system version: JDK 22 and later no longer run on this machine. Am 23.08.2024 um 10:41 schrieb Uwe Schindler: Hi, In 9.x th

Re: Lucene 10.0 and 9.12 blockers

I think maybe also https://github.com/apache/lucene/issues/13519 should be a blocker? It looks like 8 bit vector HNSW quantization is broken (unless I'm making a silly mistake with luceneutil tooling). I've also set its milestone to 10.0.0. Do we really not have a way to mark an issue a blocker

Re: Lucene 10.0 and 9.12 blockers

Thanks Mike. On Wed, Aug 28, 2024 at 2:16 PM Michael McCandless < luc...@mikemccandless.com> wrote: > I think maybe also https://github.com/apache/lucene/issues/13519 should > be a blocker? It looks like 8 bit vector HNSW quantization is broken > (unless I'm making a silly mistake with luceneuti

Re: Lucene 10.0 and 9.12 blockers

For Lucene 10.0, I have two topics to raise: 1. Remove the deprecated IndexSearcher#search(Query, Collector) in favour of IndexSearcher#search(Query, CollectorManager) ( https://github.com/apache/lucene/issues/12892): this involves removing the leftover usages in facet, grouping, join and test-fr

Re: Lucene 10.0 and 9.12 blockers

Hi, regarding the 10.0 release, should we also consider https://github.com/apache/lucene/pull/13328. It was planned for 10.0 ( https://github.com/apache/lucene/issues/13207) and is waiting on review, so I think it'll be good if we could consider it. Looking forward to views and seeing if there are

Re: Lucene 10.0 and 9.12 blockers

On Thu, Aug 29, 2024 at 5:15 AM Luca Cavanna wrote: > For Lucene 10.0, I have two topics to raise: > > 1. Remove the deprecated IndexSearcher#search(Query, Collector) in favour > of IndexSearcher#search(Query, CollectorManager) ( > https://github.com/apache/lucene/issues/12892): this involves re

Re: Lucene 10.0 and 9.12 blockers

On Sat, Aug 31, 2024 at 2:00 PM Shubham Chaudhary wrote: > Hi, regarding the 10.0 release, should we also consider > https://github.com/apache/lucene/pull/13328. It was planned for 10.0 ( > https://github.com/apache/lucene/issues/13207) and is waiting on review, > so I think it'll be good if we c

Re: Lucene 10.0 and 9.12 blockers

Hi Folks, For the Lucene 10.0 release, I'd like to draw attention to Lucene PR: 13572 . The PR implements vectorized dot-product computation over int8 vectors in native C code using SVE and Neon intrinsics on ARM platforms. Lucene's JMH benchmar

Re: Lucene 10.0 and 9.12 blockers

> Maybe mark it blocker so we don't lose track? Hi Mike, it's already linked to the 10.0 milestone. Is there some way to mark or track it as a blocker for 10.0? It would be great if I could get some reviews on it. The PR has been accumulating merge conflicts over time. I'm happy to address the co

Re: Lucene 10.0 and 9.12 blockers

Thanks to all who replied to this thread and worked on getting these blockers addressed. In particular I see that support for JDK 23, backporting the Arena work, and the removal of CollectorOwner are merged. I just reviewed the humongous PR that migrates more classes to records

Re: Lucene 10.0 and 9.12 blockers

The intra-segment concurrency PR has been pretty close for quite a few days already. I ran benchmarks last week, made adjustments, and just finished addressing comments from Mike's review. My plan would be to merge it tomorrow unless there are objections. Regarding the usage of the deprecated sear

Re: Lucene 10.0 and 9.12 blockers

Hi, I've been looking into Adrien's suggestion to migrate (Byte/Float)VectorValues to an unabashedly random-access API. We can easily enough support iteration on top of that (which we use extensively during indexing). I think this would represent a great simplification; preliminary implementation s

Re: Lucene 10.0 and 9.12 blockers

Thanks for driving this release process Adrien, and everyone for helping to resolve the blockers! More comments below: On Mon, Sep 9, 2024 at 1:45 PM Adrien Grand wrote: I just reviewed the humongous PR that migrates more classes to records > , it lo