Re: Lucene 9.0 release candidate

2021-11-19 Thread Adrien Grand
t; Thanks Greg, Patrick, Mike and Robert for the quick turnaround on > > getting these changes merged! I'll now resume work on the 9.0 release. > > > > On Fri, Nov 19, 2021 at 4:44 PM Greg Miller wrote: > > > > > > Heads up that both LUCENE-10122 and LUCENE-

Re: Lucene 9.0 release candidate

2021-11-19 Thread Robert Muir
Can we also push commit to branch 9x (just don't want it to get forgotten) On Fri, Nov 19, 2021 at 10:50 AM Adrien Grand wrote: > > Thanks Greg, Patrick, Mike and Robert for the quick turnaround on > getting these changes merged! I'll now resume work on the 9.0 release. >

Re: Lucene 9.0 release candidate

2021-11-19 Thread Adrien Grand
Thanks Greg, Patrick, Mike and Robert for the quick turnaround on getting these changes merged! I'll now resume work on the 9.0 release. On Fri, Nov 19, 2021 at 4:44 PM Greg Miller wrote: > > Heads up that both LUCENE-10122 and LUCENE-10062 have been merged onto > branch_9_0 now. @

Re: Lucene 9.0 release candidate

2021-11-19 Thread Greg Miller
Heads up that both LUCENE-10122 and LUCENE-10062 have been merged onto branch_9_0 now. @Adrien Grand I know you're aware already, but following up here just for completeness. Thanks! -Greg On Mon, Nov 15, 2021 at 11:17 AM Robert Muir wrote: > > On Mon, Nov 15, 2021 at 2:02 PM Michael McCandless

Re: Lucene 9.0 release candidate

2021-11-15 Thread Robert Muir
On Mon, Nov 15, 2021 at 2:02 PM Michael McCandless wrote: > > > Yeah I love that idea, but that's not what Patrick's PR explored (yet?). > > His explored switching away from custom token positions to NumericDocValues > to store the same data (ordinal -> parent mapping), but it still loaded all >

Re: Lucene 9.0 release candidate

2021-11-15 Thread Michael McCandless
On Mon, Nov 15, 2021 at 1:14 PM Robert Muir wrote: On Mon, Nov 15, 2021 at 12:57 PM Michael McCandless > wrote: > > > > I think for PR 420 (https://github.com/apache/lucene/pull/420) we are > (confusingly!) not really seeing performance benefits -- taxonomy index got > a bit bigger, and loading

Re: Lucene 9.0 release candidate

2021-11-15 Thread Robert Muir
On Mon, Nov 15, 2021 at 12:57 PM Michael McCandless wrote: > > I think for PR 420 (https://github.com/apache/lucene/pull/420) we are > (confusingly!) not really seeing performance benefits -- taxonomy index got a > bit bigger, and loading the parent arrays no faster? So Patrick closed that > o

Re: Lucene 9.0 release candidate

2021-11-15 Thread Michael McCandless
I think for PR 420 (https://github.com/apache/lucene/pull/420) we are (confusingly!) not really seeing performance benefits -- taxonomy index got a bit bigger, and loading the parent arrays no faster? So Patrick closed that one. But the other PR (https://github.com/apache/lucene/pull/264) looks l

Re: Lucene 9.0 release candidate

2021-11-15 Thread Adrien Grand
Thanks Greg! On Mon, Nov 15, 2021 at 6:09 PM Greg Miller wrote: > +1, yeah let's see if we can get these in. It would be nice to not > carry the back-compat logic into 10. I'll prioritize these > today/tomorrow; I think we should be able to turn them around pretty > quickly. I'll update on this

Re: Lucene 9.0 release candidate

2021-11-15 Thread Greg Miller
+1, yeah let's see if we can get these in. It would be nice to not carry the back-compat logic into 10. I'll prioritize these today/tomorrow; I think we should be able to turn them around pretty quickly. I'll update on this thread when PRs have been merged. Cheers, -Greg On Mon, Nov 15, 2021 at 6

Re: Lucene 9.0 release candidate

2021-11-15 Thread Adrien Grand
Thanks Dawid. @Greg Miller What do you think about getting these two PRs in for 9.0? On Sun, Nov 14, 2021 at 9:25 AM Dawid Weiss wrote: > I think we should wait for these two changes. > > I also think we should add automatic bundle names to all JARs starting > with 9.0. Even if they're not pro

Re: Lucene 9.0 release candidate

2021-11-14 Thread Dawid Weiss
I think we should wait for these two changes. I also think we should add automatic bundle names to all JARs starting with 9.0. Even if they're not proper modules yet, it'd clarify what the module names would be for all of the 9x line. I think a short name of lucene.* is sufficient (we don't need t

Lucene 9.0 release candidate

2021-11-13 Thread Adrien Grand
Hello, I plan to build a RC for Lucene 9.0 in the next few days. We don't have blockers left, but there are two faceting changes that look like we could save some backward compatibility logic in 10.x by folding them into 9.0: - LUCENE-10062 : h

Re: 8.11 and 9.0 release notes

2021-11-02 Thread Uwe Schindler
, Nov 2, 2021 at 10:18 AM Adrien Grand wrote: >> >> Hello, >> >> I started working on the 8.11 and 9.0 release notes, can you help me add >> highlights that I missed? >> >> https://cwiki.apache.org/confluence/display/LUCENE/Release+Notes+8.11 >

Re: 8.11 and 9.0 release notes

2021-11-02 Thread Michael Sokolov
re using may not have replicated the release yet. If that is the > case, please try another mirror. This also applies to Maven access. > > > On Tue, Nov 2, 2021 at 10:18 AM Adrien Grand wrote: > > > > Hello, > > > > I started working on the 8.11 and 9.0 release

Re: 8.11 and 9.0 release notes

2021-11-02 Thread Michael Sokolov
Adrien Grand wrote: > > Hello, > > I started working on the 8.11 and 9.0 release notes, can you help me add > highlights that I missed? > > https://cwiki.apache.org/confluence/display/LUCENE/Release+Notes+8.11 > https://cwiki.apache.org/confluence/display/LUCENE/Release+N

8.11 and 9.0 release notes

2021-11-02 Thread Adrien Grand
Hello, I started working on the 8.11 and 9.0 release notes, can you help me add highlights that I missed? https://cwiki.apache.org/confluence/display/LUCENE/Release+Notes+8.11 https://cwiki.apache.org/confluence/display/LUCENE/Release+Notes+9.0 -- Adrien

Re: Lucene 9.0 release

2021-11-02 Thread Adrien Grand
t; +1 Adrien. Thanks for moving things along. >>>>> > > >>>>> > > ~ David Smiley >>>>> > > Apache Lucene/Solr Search Developer >>>>> > > http://www.linkedin.com/in/davidwsmiley >>>>> > > >>>&g

Re: Lucene 9.0 release

2021-11-02 Thread Dawid Weiss
r moving things along. >>>> > > >>>> > > ~ David Smiley >>>> > > Apache Lucene/Solr Search Developer >>>> > > http://www.linkedin.com/in/davidwsmiley >>>> > > >>>> > > >>>> > >

Re: Lucene 9.0 release

2021-10-29 Thread Michael Sokolov
>>>>> > On Fri, Oct 15, 2021 at 7:04 AM David Smiley >>>>> wrote: >>>>> > > >>>>> > > +1 Adrien. Thanks for moving things along. >>>>> > > >>>>> > > ~ David Smiley >

Re: Lucene 9.0 release

2021-10-29 Thread David Smiley
ong. >>>> > > >>>> > > ~ David Smiley >>>> > > Apache Lucene/Solr Search Developer >>>> > > http://www.linkedin.com/in/davidwsmiley >>>> > > >>>> > > >>>> > > On Fri, Oct

Re: Lucene 9.0 release

2021-10-29 Thread Adrien Grand
gt; > >>> > > On Fri, Oct 15, 2021 at 3:30 AM Adrien Grand >>> wrote: >>> > >> >>> > >> For visibility, I recently opened a new issue about a case of index >>> corruption which is a blocker for 9.0. Nhat is looking into it. >

Re: Lucene 9.0 release

2021-10-29 Thread Dawid Weiss
Grand >> wrote: >> > >> >> > >> For visibility, I recently opened a new issue about a case of index >> corruption which is a blocker for 9.0. Nhat is looking into it. >> > >> >> > >> We've been discussing releasing 9.0

Re: Lucene 9.0 release

2021-10-29 Thread Anshum Gupta
or 9.0. Nhat is looking into it. > > We've been discussing releasing 9.0 for a long time now and I think that > everybody agrees with moving forward, there's even some good momentum > around making the build and release tooling ready. So I'd like to propose > the follo

Re: Lucene 9.0 release

2021-10-29 Thread Atri Sharma
Nhat is looking into it. >> > >> >> > >> We've been discussing releasing 9.0 for a long time now and I think >> > >> that everybody agrees with moving forward, there's even some good >> > >> momentum around making the build and

Re: Lucene 9.0 release

2021-10-29 Thread Adrien Grand
ly opened a new issue about a case of index > corruption which is a blocker for 9.0. Nhat is looking into it. > > >> > > >> We've been discussing releasing 9.0 for a long time now and I think > that everybody agrees with moving forward, there's even some goo

Re: Lucene 9.0 release

2021-10-17 Thread Michael Sokolov
blocker for 9.0. Nhat is looking into it. > >> > >> We've been discussing releasing 9.0 for a long time now and I think that > >> everybody agrees with moving forward, there's even some good momentum > >> around making the build and release tooling ready. So

Re: Lucene 9.0 release

2021-10-15 Thread Timothy Potter
discussing releasing 9.0 for a long time now and I think that >> everybody agrees with moving forward, there's even some good momentum around >> making the build and release tooling ready. So I'd like to propose the >> following timeline for the 9.0 release to g

Re: Lucene 9.0 release

2021-10-15 Thread David Smiley
nd release tooling ready. So I'd like to propose > the following timeline for the 9.0 release to get some feedback: > > 2021-11-01: Feature freeze: > - branch_9x gets created from main > - branch_8_11 gets created from branch_8x > This gives us ~2 weeks to do some last-minute

Re: Lucene 9.0 release

2021-10-15 Thread Adrien Grand
ing forward, there's even some good momentum around making the build and release tooling ready. So I'd like to propose the following timeline for the 9.0 release to get some feedback: 2021-11-01: Feature freeze: - branch_9x gets created from main - branch_8_11 gets created from branch_8x T

Re: Lucene 9.0 release

2021-10-02 Thread Michael Sokolov
gt; Blockers seem to be done with. So I guess we just need an RM to get the ball > rolling? :) > > I know that the Release Wizard in new Lucene repo needs some updates > https://issues.apache.org/jira/browse/LUCENE-9809 - I may help some with > that... > > Cross-ref other 9

Re: Lucene 9.0 release

2021-09-30 Thread Jan Høydahl
+1 Blockers seem to be done with. So I guess we just need an RM to get the ball rolling? :) I know that the Release Wizard in new Lucene repo needs some updates https://issues.apache.org/jira/browse/LUCENE-9809 - I may help some with that... Cross-ref other 9.0 release mail-threads: - &quo

Re: Lucene 9.0 release

2021-08-17 Thread Adrien Grand
+1 to your suggestions I just commented on LUCENE-9959 to suggest reverting since the changes are currently half baked and I don't think that they should block 9.0. There are no other blockers left to my knowledge. On Sat, Aug 14, 2021 at 6:24 P

Lucene 9.0 release

2021-08-14 Thread Michael Sokolov
It's been two years since our last release, we had lots of +1 when we raised this last December, and IMO we are close to baked at this point. I checked JIRA and found two remaining Blockers 1. https://issues.apache.org/jira/browse/LUCENE-10016 VectorReader.search needs rethought, o.a.l.search int

Re: 9.0 release

2021-07-20 Thread Michael McCandless
gt;>> >>> >> > >>> >>> >> Michael, did you get a chance to mark the issues you were > thinking of as blockers? > >>> >>> >> > >>> >>> >> Adrien, I see that the remaining open blockers look mostly l

Re: 9.0 release

2021-07-02 Thread Tomoko Uchida
gt;> > >>> >>> > >>> >>> > On Tue, Apr 13, 2021 at 10:59 PM Mike Drob wrote: >>> >>> >> >>> >>> >> Michael, did you get a chance to mark the issues you were thinking >>> >>> >> of

Re: 9.0 release

2021-06-30 Thread Mayya Sharipova
n issues. Two of them have recent activity, but LUCENE-9047 would >> need to be brought back to the lucene repo. Is this an accurate view of the >> state of things? >> >>> >> >> >>> >> Now that I'm done with 8.8.2, I would love to see how we can >

Re: 9.0 release

2021-06-29 Thread David Smiley
t;> >> Now that I'm done with 8.8.2, I would love to see how we can > continue to make headway on 9.0! > >>> >> > >>> >> > >>> >> > >>> >> On Mon, Mar 29, 2021 at 3:25 PM Michael Sokolov > wrote: > >>> >

Re: 9.0 release

2021-06-29 Thread Mike Drob
t;> >> make headway on 9.0! >>> >> >>> >> >>> >> >>> >> On Mon, Mar 29, 2021 at 3:25 PM Michael Sokolov >>> >> wrote: >>> >>> >>> >>> There has been some discussion around a few c

Re: 9.0 release

2021-04-14 Thread Julie Tibshirani
has been some discussion around a few code visibility and naming >> >>> issues related to "VectorFormat" as it is called today. I'd like to >> >>> get that sorted out before 9.0 - I'll hunt up the ticket(s) and mark >> >>> as

Re: 9.0 release

2021-04-14 Thread Adrien Grand
rs > >>> > >>> On Sun, Mar 28, 2021 at 11:02 AM Adrien Grand > wrote: > >>> > > >>> > Hello Jan, > >>> > > >>> > The list of blockers should be mostly up-to-date: > https://issues.apache.org/jira/browse/LUCENE-

Re: 9.0 release

2021-04-14 Thread Michael Sokolov
gt; as blockers >>> >>> On Sun, Mar 28, 2021 at 11:02 AM Adrien Grand wrote: >>> > >>> > Hello Jan, >>> > >>> > The list of blockers should be mostly up-to-date: >>> > https://issues.apache.org/jira/browse/LUCENE-

Re: 9.0 release

2021-04-14 Thread Adrien Grand
gt; >> > The list of blockers should be mostly up-to-date: >> https://issues.apache.org/jira/browse/LUCENE-9661?jql=project%3D%22Lucene%20-%20Core%22%20and%20priority%3DBlocker%20and%20fixVersion%3D%22main%20(9.0)%22 >> . >> > >> > On Sat, Mar 27, 2021 at 7:21

Re: 9.0 release

2021-04-14 Thread Michael Sokolov
drien Grand wrote: >> > >> > Hello Jan, >> > >> > The list of blockers should be mostly up-to-date: >> > https://issues.apache.org/jira/browse/LUCENE-9661?jql=project%3D%22Lucene%20-%20Core%22%20and%20priority%3DBlocker%20and%20fixVersion%3D%22main%20(9.0)%22. &g

Re: 9.0 release

2021-04-13 Thread Mike Drob
te: > https://issues.apache.org/jira/browse/LUCENE-9661?jql=project%3D%22Lucene%20-%20Core%22%20and%20priority%3DBlocker%20and%20fixVersion%3D%22main%20(9.0)%22 > . > > > > On Sat, Mar 27, 2021 at 7:21 PM Jan Høydahl > wrote: > >> > >> Hi, > >> >

Re: 9.0 release

2021-03-29 Thread Michael Sokolov
ote: >> >> Hi, >> >> Where are we at with the Lucene 9.0 release planning? >> >> The git split is largely done. Not sure about the build. >> Let's update the umbrella issue >> https://issues.apache.org/jira/browse/LUCENE-9375 for known remaining

Re: 9.0 release

2021-03-28 Thread Adrien Grand
are we at with the Lucene 9.0 release planning? > > The git split is largely done. Not sure about the build. > Let's update the umbrella issue > https://issues.apache.org/jira/browse/LUCENE-9375 for known remaining > cleanup tasks. > The one on that list is releaseWizard, b

Re: 9.0 release

2021-03-27 Thread Jan Høydahl
Hi, Where are we at with the Lucene 9.0 release planning? The git split is largely done. Not sure about the build. Let's update the umbrella issue https://issues.apache.org/jira/browse/LUCENE-9375 <https://issues.apache.org/jira/browse/LUCENE-9375> for known remaining cleanup tas

Re: 9.0 release

2021-01-13 Thread Adrien Grand
+1 to start planning 9.0. Since you mentioned the Gradle build, I believe that we still need to migrate some of the release tooling from Ant to Gradle, e.g. dev-tools/scripts/addBackcompatIndexes.py. These scripts are not easy to test without actually doing a release so the 9.0 RM might have some

Re: 9.0 release

2020-12-29 Thread Jan Høydahl
+1 New year and time to get this ball rolling! Jan > 28. des. 2020 kl. 19:17 skrev Michael Sokolov : > > Hi everyone, as we head into a new year full of optimism, is it time > to start discussing the next major release? We released 8.0 on Jun 18, > 2019, over 18 months ago. Since then we've swi

Re: 9.0 release

2020-12-28 Thread Noble Paul
+1 On Tue, Dec 29, 2020 at 8:43 AM Erick Erickson wrote: > > It’ll really be nice to not have to switch between gradle and ant when > verifying changes ;). > > Not to mention that we’ll be able to stop having to deal with Java 8 > .vs. Java 11. > > I don’t expect this to be a short release, so ye

Re: 9.0 release

2020-12-28 Thread Erick Erickson
It’ll really be nice to not have to switch between gradle and ant when verifying changes ;). Not to mention that we’ll be able to stop having to deal with Java 8 .vs. Java 11. I don’t expect this to be a short release, so yeah, I think it’s time to start the process. Erick > On Dec 28, 2020, a

Re: 9.0 release

2020-12-28 Thread Atri Sharma
+1 I think the division steps are pretty clearly documented-- a matter of executing them now. On Tue, 29 Dec 2020, 01:03 Dawid Weiss, wrote: > It would be great indeed if we could push to finalize dividing the > codebases (some things have been proven to be doable - snapshot > builds, splitting

Re: 9.0 release

2020-12-28 Thread Dawid Weiss
It would be great indeed if we could push to finalize dividing the codebases (some things have been proven to be doable - snapshot builds, splitting the code, build, etc.) and then follow up with proper releases of both Lucene and Solr (on their independent TLP). Dawid On Mon, Dec 28, 2020 at 7:

Re: 9.0 release

2020-12-28 Thread Nicholas Knize
+1 on starting 9.0 release planning. Nicholas Knize, Ph.D., GISP Principal Engineer - Search | Amazon Apache Lucene PMC Member and Committer nkn...@apache.org On Mon, Dec 28, 2020 at 12:34 PM Timothy Potter wrote: > Hear! Hear! Definitely agree it's time to start planning around 9

Re: 9.0 release

2020-12-28 Thread Timothy Potter
Hear! Hear! Definitely agree it's time to start planning around 9. Thanks for initiating the discussion Mike. Will follow-up after the new year with some specific thoughts around planning. Cheers, Tim On Mon, Dec 28, 2020 at 11:17 AM Michael Sokolov wrote: > Hi everyone, as we head into a new y

9.0 release

2020-12-28 Thread Michael Sokolov
Hi everyone, as we head into a new year full of optimism, is it time to start discussing the next major release? We released 8.0 on Jun 18, 2019, over 18 months ago. Since then we've switched to a gradle-based build. We have added vector-valued fields and an HNSW neighbor search algorithm for them.