Re: [DISCUSS] 9.4 release

2023-10-03 Thread Tomás Fernández Löbbe
Thanks Alex,
I've merged the changes for SOLR-16852

On Tue, Oct 3, 2023 at 10:51 AM Houston Putman  wrote:

> Yeah that was moved without fixing the script. So fixing the script is the
> way to go.
>
> - Houston
>
> On Tue, Oct 3, 2023 at 1:44 PM Alex Deparvu  wrote:
>
> > Looking for some help on creating the feature branch, I have a failure
> due
> > to the fact that SolrVersion class moved:
> >
> > Q: Shall I run 'python3 -u dev-tools/scripts/addVersion.py 9.5.0' in
> folder
> > '/Users/alexdeparvu/.solr-releases/9.4.0/solr' (y/n): y
> > .
> >   changing version to 9.5.0...
> >   File
> >
> >
> "/Users/alexdeparvu/.solr-releases/9.4.0/solr/dev-tools/scripts/scriptutil.py",
> > line 91, in update_file
> > infile = open(filename, 'r')
> >  ^^^
> > FileNotFoundError: [Errno 2] No such file or directory:
> > 'solr/core/src/java/org/apache/solr/util/SolrVersion.java'
> >
> > it looks like this class moved
> > to org.apache.solr.client.api.util.SolrVersion.
> > any thoughts?
> >
> >
> >
> > On Tue, Oct 3, 2023 at 10:16 AM Alex Deparvu 
> wrote:
> >
> > > Thank you David. Yes I got the feeling I needed to create the freeze
> > > branch, but I could not figure out the releaseWizard. I am stuck in
> some
> > > setup limbo. Will try to skip over the key setup (and jira permissions
> > and
> > > so on) and jump straight to the branch creation.
> > >
> > > Is this all documented anywhere? I get the feeling that having a script
> > to
> > > guide you helps simplify the process a lot once you have done it
> > > sufficiently enough times to trust it. having almost zero context got
> me
> > > stuck in a step where I could have done other things in parallel while
> > > waiting for others.
> > >
> > > best,
> > > alex
> > >
> > >
> > >
> > > On Tue, Oct 3, 2023 at 6:52 AM David Smiley 
> > > wrote:
> > >
> > >> Alex, *normally* as the release manager, you designate in advance the
> > >> feature freeze date & time and then at that time cut the release
> branch.
> > >> Ideally, there is then some time after that in which a RC is built
> > >> (multiple days).  This time, it's too late; it's all last-minute...
> but
> > >> just telling you and anyone else who wants to be an RM in the future.
> > >> ~ David
> > >>
> > >>
> > >> On Mon, Oct 2, 2023 at 5:02 PM Tomás Fernández Löbbe <
> > >> tomasflo...@gmail.com>
> > >> wrote:
> > >>
> > >> > I understand we still don't have a feature freeze, right? I'm
> planning
> > >> on
> > >> > merging SOLR-16852 for 9.4 unless there are any objections.
> > >> >
> > >> > On Mon, Oct 2, 2023 at 11:35 AM Eric Pugh <
> > >> ep...@opensourceconnections.com
> > >> > >
> > >> > wrote:
> > >> >
> > >> > > So, I’m thinking that SOLR-14496 probably needs more tests and
> > >> eyeballs,
> > >> > > so don’t hold up the release for it.   Hopefully it makes it!
> > >> > >
> > >> > >
> > >> > >
> > >> > > > On Oct 2, 2023, at 2:01 PM, Alex Deparvu 
> > >> wrote:
> > >> > > >
> > >> > > > Another quick update.
> > >> > > >
> > >> > > > There are 2 things pending and wanted to check on the progress
> > >> > > > - https://issues.apache.org/jira/browse/SOLR-17005 seems to be
> a
> > >> > > > regression in the start script on Windows. it looks like this
> > needs
> > >> to
> > >> > > > block the release. please correct if I misunderstood the
> priority.
> > >> > > > - https://issues.apache.org/jira/browse/SOLR-14496 - this looks
> > >> close
> > >> > to
> > >> > > > being merged and I think Eric mentioned in this thread that he
> > wants
> > >> > this
> > >> > > > in 9.4
> > >> > > >
> > >> > > > best,
> > >> > > > alex
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > > > On Sat, Sep 30, 2023 at 6:29 AM Jan Høydahl <
> > jan@cominvent.com>
> > >> > > wrote:
> > >> > > >
> > >> > > >> I added a blocker Jira for one solrbot upgrade for a CVE.
> Please
> > >> > check.
> > >> > > >> Good luck with the release, I’ll not be available for the next
> > few
> > >> > days.
> > >> > > >>
> > >> > > >> Jan Høydahl
> > >> > > >>
> > >> > > >>> 30. sep. 2023 kl. 00:02 skrev Eric Pugh <
> > >> > > ep...@opensourceconnections.com
> > >> > > >>> :
> > >> > > >>>
> > >> > > >>> If SOLR-14496, https://github.com/apache/solr/pull/1954 ends
> > up
> > >> > > >> getting reviewed with no issues, I’m hoping to get it into
> 9.4….
> > >> > >  Since we
> > >> > > >> have basic auth added to prometheus as well!
> > >> > > >>>
> > >> > > >>>
> > >> > > >>>
> > >> > >  On Sep 29, 2023, at 1:45 PM, Alex Deparvu <
> > stilla...@apache.org>
> > >> > > wrote:
> > >> > > 
> > >> > >  Hi,
> > >> > > 
> > >> > >  Just a quick status update
> > >> > >  - SOLR-16994 looks almost complete: PR was reviewed, I'm not
> > >> sure if
> > >> > > >> there
> > >> > >  is more work pending
> > >> > >  - SOLR-16644 was merged and backported
> > >> > >  - SOLR-16985 - lucene upgrade is almost complete. there are
> no
> > >> more
> > >> > >  failures (still running one single te

Re: [DISCUSS] 9.4 release

2023-10-03 Thread Houston Putman
Yeah that was moved without fixing the script. So fixing the script is the
way to go.

- Houston

On Tue, Oct 3, 2023 at 1:44 PM Alex Deparvu  wrote:

> Looking for some help on creating the feature branch, I have a failure due
> to the fact that SolrVersion class moved:
>
> Q: Shall I run 'python3 -u dev-tools/scripts/addVersion.py 9.5.0' in folder
> '/Users/alexdeparvu/.solr-releases/9.4.0/solr' (y/n): y
> .
>   changing version to 9.5.0...
>   File
>
> "/Users/alexdeparvu/.solr-releases/9.4.0/solr/dev-tools/scripts/scriptutil.py",
> line 91, in update_file
> infile = open(filename, 'r')
>  ^^^
> FileNotFoundError: [Errno 2] No such file or directory:
> 'solr/core/src/java/org/apache/solr/util/SolrVersion.java'
>
> it looks like this class moved
> to org.apache.solr.client.api.util.SolrVersion.
> any thoughts?
>
>
>
> On Tue, Oct 3, 2023 at 10:16 AM Alex Deparvu  wrote:
>
> > Thank you David. Yes I got the feeling I needed to create the freeze
> > branch, but I could not figure out the releaseWizard. I am stuck in some
> > setup limbo. Will try to skip over the key setup (and jira permissions
> and
> > so on) and jump straight to the branch creation.
> >
> > Is this all documented anywhere? I get the feeling that having a script
> to
> > guide you helps simplify the process a lot once you have done it
> > sufficiently enough times to trust it. having almost zero context got me
> > stuck in a step where I could have done other things in parallel while
> > waiting for others.
> >
> > best,
> > alex
> >
> >
> >
> > On Tue, Oct 3, 2023 at 6:52 AM David Smiley 
> > wrote:
> >
> >> Alex, *normally* as the release manager, you designate in advance the
> >> feature freeze date & time and then at that time cut the release branch.
> >> Ideally, there is then some time after that in which a RC is built
> >> (multiple days).  This time, it's too late; it's all last-minute... but
> >> just telling you and anyone else who wants to be an RM in the future.
> >> ~ David
> >>
> >>
> >> On Mon, Oct 2, 2023 at 5:02 PM Tomás Fernández Löbbe <
> >> tomasflo...@gmail.com>
> >> wrote:
> >>
> >> > I understand we still don't have a feature freeze, right? I'm planning
> >> on
> >> > merging SOLR-16852 for 9.4 unless there are any objections.
> >> >
> >> > On Mon, Oct 2, 2023 at 11:35 AM Eric Pugh <
> >> ep...@opensourceconnections.com
> >> > >
> >> > wrote:
> >> >
> >> > > So, I’m thinking that SOLR-14496 probably needs more tests and
> >> eyeballs,
> >> > > so don’t hold up the release for it.   Hopefully it makes it!
> >> > >
> >> > >
> >> > >
> >> > > > On Oct 2, 2023, at 2:01 PM, Alex Deparvu 
> >> wrote:
> >> > > >
> >> > > > Another quick update.
> >> > > >
> >> > > > There are 2 things pending and wanted to check on the progress
> >> > > > - https://issues.apache.org/jira/browse/SOLR-17005 seems to be a
> >> > > > regression in the start script on Windows. it looks like this
> needs
> >> to
> >> > > > block the release. please correct if I misunderstood the priority.
> >> > > > - https://issues.apache.org/jira/browse/SOLR-14496 - this looks
> >> close
> >> > to
> >> > > > being merged and I think Eric mentioned in this thread that he
> wants
> >> > this
> >> > > > in 9.4
> >> > > >
> >> > > > best,
> >> > > > alex
> >> > > >
> >> > > >
> >> > > >
> >> > > > On Sat, Sep 30, 2023 at 6:29 AM Jan Høydahl <
> jan@cominvent.com>
> >> > > wrote:
> >> > > >
> >> > > >> I added a blocker Jira for one solrbot upgrade for a CVE. Please
> >> > check.
> >> > > >> Good luck with the release, I’ll not be available for the next
> few
> >> > days.
> >> > > >>
> >> > > >> Jan Høydahl
> >> > > >>
> >> > > >>> 30. sep. 2023 kl. 00:02 skrev Eric Pugh <
> >> > > ep...@opensourceconnections.com
> >> > > >>> :
> >> > > >>>
> >> > > >>> If SOLR-14496, https://github.com/apache/solr/pull/1954 ends
> up
> >> > > >> getting reviewed with no issues, I’m hoping to get it into 9.4….
> >> > >  Since we
> >> > > >> have basic auth added to prometheus as well!
> >> > > >>>
> >> > > >>>
> >> > > >>>
> >> > >  On Sep 29, 2023, at 1:45 PM, Alex Deparvu <
> stilla...@apache.org>
> >> > > wrote:
> >> > > 
> >> > >  Hi,
> >> > > 
> >> > >  Just a quick status update
> >> > >  - SOLR-16994 looks almost complete: PR was reviewed, I'm not
> >> sure if
> >> > > >> there
> >> > >  is more work pending
> >> > >  - SOLR-16644 was merged and backported
> >> > >  - SOLR-16985 - lucene upgrade is almost complete. there are no
> >> more
> >> > >  failures (still running one single test a few more times just
> to
> >> > make
> >> > > >> sure
> >> > >  if there is any flakiness here I will not include the upgrade
> in
> >> the
> >> > >  release). Thank you Christine Poerschke for helping out! If
> >> anyone
> >> > > else
> >> > >  wants to review, now would be a very good time.
> >> > > 
> >> > >  Looks to me like we are in good shape for a release very soon!
> >> > >  I 

Re: [DISCUSS] 9.4 release

2023-10-03 Thread Alex Deparvu
Looking for some help on creating the feature branch, I have a failure due
to the fact that SolrVersion class moved:

Q: Shall I run 'python3 -u dev-tools/scripts/addVersion.py 9.5.0' in folder
'/Users/alexdeparvu/.solr-releases/9.4.0/solr' (y/n): y
.
  changing version to 9.5.0...
  File
"/Users/alexdeparvu/.solr-releases/9.4.0/solr/dev-tools/scripts/scriptutil.py",
line 91, in update_file
infile = open(filename, 'r')
 ^^^
FileNotFoundError: [Errno 2] No such file or directory:
'solr/core/src/java/org/apache/solr/util/SolrVersion.java'

it looks like this class moved
to org.apache.solr.client.api.util.SolrVersion.
any thoughts?



On Tue, Oct 3, 2023 at 10:16 AM Alex Deparvu  wrote:

> Thank you David. Yes I got the feeling I needed to create the freeze
> branch, but I could not figure out the releaseWizard. I am stuck in some
> setup limbo. Will try to skip over the key setup (and jira permissions and
> so on) and jump straight to the branch creation.
>
> Is this all documented anywhere? I get the feeling that having a script to
> guide you helps simplify the process a lot once you have done it
> sufficiently enough times to trust it. having almost zero context got me
> stuck in a step where I could have done other things in parallel while
> waiting for others.
>
> best,
> alex
>
>
>
> On Tue, Oct 3, 2023 at 6:52 AM David Smiley 
> wrote:
>
>> Alex, *normally* as the release manager, you designate in advance the
>> feature freeze date & time and then at that time cut the release branch.
>> Ideally, there is then some time after that in which a RC is built
>> (multiple days).  This time, it's too late; it's all last-minute... but
>> just telling you and anyone else who wants to be an RM in the future.
>> ~ David
>>
>>
>> On Mon, Oct 2, 2023 at 5:02 PM Tomás Fernández Löbbe <
>> tomasflo...@gmail.com>
>> wrote:
>>
>> > I understand we still don't have a feature freeze, right? I'm planning
>> on
>> > merging SOLR-16852 for 9.4 unless there are any objections.
>> >
>> > On Mon, Oct 2, 2023 at 11:35 AM Eric Pugh <
>> ep...@opensourceconnections.com
>> > >
>> > wrote:
>> >
>> > > So, I’m thinking that SOLR-14496 probably needs more tests and
>> eyeballs,
>> > > so don’t hold up the release for it.   Hopefully it makes it!
>> > >
>> > >
>> > >
>> > > > On Oct 2, 2023, at 2:01 PM, Alex Deparvu 
>> wrote:
>> > > >
>> > > > Another quick update.
>> > > >
>> > > > There are 2 things pending and wanted to check on the progress
>> > > > - https://issues.apache.org/jira/browse/SOLR-17005 seems to be a
>> > > > regression in the start script on Windows. it looks like this needs
>> to
>> > > > block the release. please correct if I misunderstood the priority.
>> > > > - https://issues.apache.org/jira/browse/SOLR-14496 - this looks
>> close
>> > to
>> > > > being merged and I think Eric mentioned in this thread that he wants
>> > this
>> > > > in 9.4
>> > > >
>> > > > best,
>> > > > alex
>> > > >
>> > > >
>> > > >
>> > > > On Sat, Sep 30, 2023 at 6:29 AM Jan Høydahl 
>> > > wrote:
>> > > >
>> > > >> I added a blocker Jira for one solrbot upgrade for a CVE. Please
>> > check.
>> > > >> Good luck with the release, I’ll not be available for the next few
>> > days.
>> > > >>
>> > > >> Jan Høydahl
>> > > >>
>> > > >>> 30. sep. 2023 kl. 00:02 skrev Eric Pugh <
>> > > ep...@opensourceconnections.com
>> > > >>> :
>> > > >>>
>> > > >>> If SOLR-14496, https://github.com/apache/solr/pull/1954 ends up
>> > > >> getting reviewed with no issues, I’m hoping to get it into 9.4….
>> > >  Since we
>> > > >> have basic auth added to prometheus as well!
>> > > >>>
>> > > >>>
>> > > >>>
>> > >  On Sep 29, 2023, at 1:45 PM, Alex Deparvu 
>> > > wrote:
>> > > 
>> > >  Hi,
>> > > 
>> > >  Just a quick status update
>> > >  - SOLR-16994 looks almost complete: PR was reviewed, I'm not
>> sure if
>> > > >> there
>> > >  is more work pending
>> > >  - SOLR-16644 was merged and backported
>> > >  - SOLR-16985 - lucene upgrade is almost complete. there are no
>> more
>> > >  failures (still running one single test a few more times just to
>> > make
>> > > >> sure
>> > >  if there is any flakiness here I will not include the upgrade in
>> the
>> > >  release). Thank you Christine Poerschke for helping out! If
>> anyone
>> > > else
>> > >  wants to review, now would be a very good time.
>> > > 
>> > >  Looks to me like we are in good shape for a release very soon!
>> > >  I volunteered for this one, so I will dig up the docs to see
>> what I
>> > > >> need to
>> > >  do Monday morning.
>> > > 
>> > >  best,
>> > >  alex
>> > > 
>> > > 
>> > > > On Fri, Sep 29, 2023 at 11:23 AM David Smiley <
>> > > >> david.w.smi...@gmail.com>
>> > > > wrote:
>> > > >
>> > > > There is no feature freeze yet (there is no branch_9_4), thus no
>> > > >> necessity
>> > > > to ask permission.
>> > > >
>> > > > ~ David
>> > 

Re: [DISCUSS] 9.4 release

2023-10-03 Thread Alex Deparvu
Thank you David. Yes I got the feeling I needed to create the freeze
branch, but I could not figure out the releaseWizard. I am stuck in some
setup limbo. Will try to skip over the key setup (and jira permissions and
so on) and jump straight to the branch creation.

Is this all documented anywhere? I get the feeling that having a script to
guide you helps simplify the process a lot once you have done it
sufficiently enough times to trust it. having almost zero context got me
stuck in a step where I could have done other things in parallel while
waiting for others.

best,
alex



On Tue, Oct 3, 2023 at 6:52 AM David Smiley 
wrote:

> Alex, *normally* as the release manager, you designate in advance the
> feature freeze date & time and then at that time cut the release branch.
> Ideally, there is then some time after that in which a RC is built
> (multiple days).  This time, it's too late; it's all last-minute... but
> just telling you and anyone else who wants to be an RM in the future.
> ~ David
>
>
> On Mon, Oct 2, 2023 at 5:02 PM Tomás Fernández Löbbe <
> tomasflo...@gmail.com>
> wrote:
>
> > I understand we still don't have a feature freeze, right? I'm planning on
> > merging SOLR-16852 for 9.4 unless there are any objections.
> >
> > On Mon, Oct 2, 2023 at 11:35 AM Eric Pugh <
> ep...@opensourceconnections.com
> > >
> > wrote:
> >
> > > So, I’m thinking that SOLR-14496 probably needs more tests and
> eyeballs,
> > > so don’t hold up the release for it.   Hopefully it makes it!
> > >
> > >
> > >
> > > > On Oct 2, 2023, at 2:01 PM, Alex Deparvu 
> wrote:
> > > >
> > > > Another quick update.
> > > >
> > > > There are 2 things pending and wanted to check on the progress
> > > > - https://issues.apache.org/jira/browse/SOLR-17005 seems to be a
> > > > regression in the start script on Windows. it looks like this needs
> to
> > > > block the release. please correct if I misunderstood the priority.
> > > > - https://issues.apache.org/jira/browse/SOLR-14496 - this looks
> close
> > to
> > > > being merged and I think Eric mentioned in this thread that he wants
> > this
> > > > in 9.4
> > > >
> > > > best,
> > > > alex
> > > >
> > > >
> > > >
> > > > On Sat, Sep 30, 2023 at 6:29 AM Jan Høydahl 
> > > wrote:
> > > >
> > > >> I added a blocker Jira for one solrbot upgrade for a CVE. Please
> > check.
> > > >> Good luck with the release, I’ll not be available for the next few
> > days.
> > > >>
> > > >> Jan Høydahl
> > > >>
> > > >>> 30. sep. 2023 kl. 00:02 skrev Eric Pugh <
> > > ep...@opensourceconnections.com
> > > >>> :
> > > >>>
> > > >>> If SOLR-14496, https://github.com/apache/solr/pull/1954 ends up
> > > >> getting reviewed with no issues, I’m hoping to get it into 9.4….
> > >  Since we
> > > >> have basic auth added to prometheus as well!
> > > >>>
> > > >>>
> > > >>>
> > >  On Sep 29, 2023, at 1:45 PM, Alex Deparvu 
> > > wrote:
> > > 
> > >  Hi,
> > > 
> > >  Just a quick status update
> > >  - SOLR-16994 looks almost complete: PR was reviewed, I'm not sure
> if
> > > >> there
> > >  is more work pending
> > >  - SOLR-16644 was merged and backported
> > >  - SOLR-16985 - lucene upgrade is almost complete. there are no
> more
> > >  failures (still running one single test a few more times just to
> > make
> > > >> sure
> > >  if there is any flakiness here I will not include the upgrade in
> the
> > >  release). Thank you Christine Poerschke for helping out! If anyone
> > > else
> > >  wants to review, now would be a very good time.
> > > 
> > >  Looks to me like we are in good shape for a release very soon!
> > >  I volunteered for this one, so I will dig up the docs to see what
> I
> > > >> need to
> > >  do Monday morning.
> > > 
> > >  best,
> > >  alex
> > > 
> > > 
> > > > On Fri, Sep 29, 2023 at 11:23 AM David Smiley <
> > > >> david.w.smi...@gmail.com>
> > > > wrote:
> > > >
> > > > There is no feature freeze yet (there is no branch_9_4), thus no
> > > >> necessity
> > > > to ask permission.
> > > >
> > > > ~ David
> > > >
> > > >
> > > > On Fri, Sep 29, 2023 at 10:34 AM Ishan Chattopadhyaya <
> > > > ichattopadhy...@gmail.com> wrote:
> > > >
> > > >> I'd like to merge SOLR-16644, please. I think it is low risk,
> > since
> > > it
> > > >> affects only the start script and fixes the way a low entropy
> > > warning
> > > >> is
> > > >> generated.
> > > >>
> > > >> On Fri, 29 Sept 2023 at 03:19, Alex Deparvu <
> stilla...@apache.org
> > >
> > > > wrote:
> > > >>
> > > >>> Hi,
> > > >>>
> > > >>> It would be unfortunate to get this close and miss out on the
> > > Lucene
> > > >>> release. I would want to give it one more day, if things do not
> > > work
> > > >> out, I
> > > >>> will go ahead with the release.
> > > >>>
> > > >>> best,
> > > >>> alex
> > > >>>
> > > >>>
> > > >>>
> > > 

Re: [DISCUSS] 9.4 release

2023-10-03 Thread David Smiley
Alex, *normally* as the release manager, you designate in advance the
feature freeze date & time and then at that time cut the release branch.
Ideally, there is then some time after that in which a RC is built
(multiple days).  This time, it's too late; it's all last-minute... but
just telling you and anyone else who wants to be an RM in the future.
~ David


On Mon, Oct 2, 2023 at 5:02 PM Tomás Fernández Löbbe 
wrote:

> I understand we still don't have a feature freeze, right? I'm planning on
> merging SOLR-16852 for 9.4 unless there are any objections.
>
> On Mon, Oct 2, 2023 at 11:35 AM Eric Pugh  >
> wrote:
>
> > So, I’m thinking that SOLR-14496 probably needs more tests and eyeballs,
> > so don’t hold up the release for it.   Hopefully it makes it!
> >
> >
> >
> > > On Oct 2, 2023, at 2:01 PM, Alex Deparvu  wrote:
> > >
> > > Another quick update.
> > >
> > > There are 2 things pending and wanted to check on the progress
> > > - https://issues.apache.org/jira/browse/SOLR-17005 seems to be a
> > > regression in the start script on Windows. it looks like this needs to
> > > block the release. please correct if I misunderstood the priority.
> > > - https://issues.apache.org/jira/browse/SOLR-14496 - this looks close
> to
> > > being merged and I think Eric mentioned in this thread that he wants
> this
> > > in 9.4
> > >
> > > best,
> > > alex
> > >
> > >
> > >
> > > On Sat, Sep 30, 2023 at 6:29 AM Jan Høydahl 
> > wrote:
> > >
> > >> I added a blocker Jira for one solrbot upgrade for a CVE. Please
> check.
> > >> Good luck with the release, I’ll not be available for the next few
> days.
> > >>
> > >> Jan Høydahl
> > >>
> > >>> 30. sep. 2023 kl. 00:02 skrev Eric Pugh <
> > ep...@opensourceconnections.com
> > >>> :
> > >>>
> > >>> If SOLR-14496, https://github.com/apache/solr/pull/1954 ends up
> > >> getting reviewed with no issues, I’m hoping to get it into 9.4….
> >  Since we
> > >> have basic auth added to prometheus as well!
> > >>>
> > >>>
> > >>>
> >  On Sep 29, 2023, at 1:45 PM, Alex Deparvu 
> > wrote:
> > 
> >  Hi,
> > 
> >  Just a quick status update
> >  - SOLR-16994 looks almost complete: PR was reviewed, I'm not sure if
> > >> there
> >  is more work pending
> >  - SOLR-16644 was merged and backported
> >  - SOLR-16985 - lucene upgrade is almost complete. there are no more
> >  failures (still running one single test a few more times just to
> make
> > >> sure
> >  if there is any flakiness here I will not include the upgrade in the
> >  release). Thank you Christine Poerschke for helping out! If anyone
> > else
> >  wants to review, now would be a very good time.
> > 
> >  Looks to me like we are in good shape for a release very soon!
> >  I volunteered for this one, so I will dig up the docs to see what I
> > >> need to
> >  do Monday morning.
> > 
> >  best,
> >  alex
> > 
> > 
> > > On Fri, Sep 29, 2023 at 11:23 AM David Smiley <
> > >> david.w.smi...@gmail.com>
> > > wrote:
> > >
> > > There is no feature freeze yet (there is no branch_9_4), thus no
> > >> necessity
> > > to ask permission.
> > >
> > > ~ David
> > >
> > >
> > > On Fri, Sep 29, 2023 at 10:34 AM Ishan Chattopadhyaya <
> > > ichattopadhy...@gmail.com> wrote:
> > >
> > >> I'd like to merge SOLR-16644, please. I think it is low risk,
> since
> > it
> > >> affects only the start script and fixes the way a low entropy
> > warning
> > >> is
> > >> generated.
> > >>
> > >> On Fri, 29 Sept 2023 at 03:19, Alex Deparvu  >
> > > wrote:
> > >>
> > >>> Hi,
> > >>>
> > >>> It would be unfortunate to get this close and miss out on the
> > Lucene
> > >>> release. I would want to give it one more day, if things do not
> > work
> > >> out, I
> > >>> will go ahead with the release.
> > >>>
> > >>> best,
> > >>> alex
> > >>>
> > >>>
> > >>>
> > >>> On Thu, Sep 28, 2023 at 2:25 PM Jan Høydahl <
> jan@cominvent.com
> > >
> > >> wrote:
> > >>>
> >  I see there is energy and traction into finalizing the Lucene
> 9.8
> >  integration, so that's fine as long as we believe the risk to be
> > >> low-ish.
> > 
> >  Jan
> > 
> > > 28. sep. 2023 kl. 21:53 skrev Anshum Gupta <
> > ans...@anshumgupta.net
> > >> :
> > >
> > > I don't like holding up releases, but it's nice to not have too
> > > many
> > > releases from an operational standpoint. If fixing Solr for the
> > >> Lucene
> > > upgrade will take time, I think it's worth the trade-off and
> > moving
> >  forward
> > > with the older version of Lucene.
> > >
> > > On Thu, Sep 28, 2023 at 6:05 AM Jan Høydahl <
> > jan@cominvent.com
> > >>
> >  wrote:
> > >
> > >> Can I propose we do NOT hold the 9.4 release to add the 

Re: [DISCUSS] 9.4 release

2023-10-02 Thread Tomás Fernández Löbbe
I understand we still don't have a feature freeze, right? I'm planning on
merging SOLR-16852 for 9.4 unless there are any objections.

On Mon, Oct 2, 2023 at 11:35 AM Eric Pugh 
wrote:

> So, I’m thinking that SOLR-14496 probably needs more tests and eyeballs,
> so don’t hold up the release for it.   Hopefully it makes it!
>
>
>
> > On Oct 2, 2023, at 2:01 PM, Alex Deparvu  wrote:
> >
> > Another quick update.
> >
> > There are 2 things pending and wanted to check on the progress
> > - https://issues.apache.org/jira/browse/SOLR-17005 seems to be a
> > regression in the start script on Windows. it looks like this needs to
> > block the release. please correct if I misunderstood the priority.
> > - https://issues.apache.org/jira/browse/SOLR-14496 - this looks close to
> > being merged and I think Eric mentioned in this thread that he wants this
> > in 9.4
> >
> > best,
> > alex
> >
> >
> >
> > On Sat, Sep 30, 2023 at 6:29 AM Jan Høydahl 
> wrote:
> >
> >> I added a blocker Jira for one solrbot upgrade for a CVE. Please check.
> >> Good luck with the release, I’ll not be available for the next few days.
> >>
> >> Jan Høydahl
> >>
> >>> 30. sep. 2023 kl. 00:02 skrev Eric Pugh <
> ep...@opensourceconnections.com
> >>> :
> >>>
> >>> If SOLR-14496, https://github.com/apache/solr/pull/1954 ends up
> >> getting reviewed with no issues, I’m hoping to get it into 9.4….
>  Since we
> >> have basic auth added to prometheus as well!
> >>>
> >>>
> >>>
>  On Sep 29, 2023, at 1:45 PM, Alex Deparvu 
> wrote:
> 
>  Hi,
> 
>  Just a quick status update
>  - SOLR-16994 looks almost complete: PR was reviewed, I'm not sure if
> >> there
>  is more work pending
>  - SOLR-16644 was merged and backported
>  - SOLR-16985 - lucene upgrade is almost complete. there are no more
>  failures (still running one single test a few more times just to make
> >> sure
>  if there is any flakiness here I will not include the upgrade in the
>  release). Thank you Christine Poerschke for helping out! If anyone
> else
>  wants to review, now would be a very good time.
> 
>  Looks to me like we are in good shape for a release very soon!
>  I volunteered for this one, so I will dig up the docs to see what I
> >> need to
>  do Monday morning.
> 
>  best,
>  alex
> 
> 
> > On Fri, Sep 29, 2023 at 11:23 AM David Smiley <
> >> david.w.smi...@gmail.com>
> > wrote:
> >
> > There is no feature freeze yet (there is no branch_9_4), thus no
> >> necessity
> > to ask permission.
> >
> > ~ David
> >
> >
> > On Fri, Sep 29, 2023 at 10:34 AM Ishan Chattopadhyaya <
> > ichattopadhy...@gmail.com> wrote:
> >
> >> I'd like to merge SOLR-16644, please. I think it is low risk, since
> it
> >> affects only the start script and fixes the way a low entropy
> warning
> >> is
> >> generated.
> >>
> >> On Fri, 29 Sept 2023 at 03:19, Alex Deparvu 
> > wrote:
> >>
> >>> Hi,
> >>>
> >>> It would be unfortunate to get this close and miss out on the
> Lucene
> >>> release. I would want to give it one more day, if things do not
> work
> >> out, I
> >>> will go ahead with the release.
> >>>
> >>> best,
> >>> alex
> >>>
> >>>
> >>>
> >>> On Thu, Sep 28, 2023 at 2:25 PM Jan Høydahl  >
> >> wrote:
> >>>
>  I see there is energy and traction into finalizing the Lucene 9.8
>  integration, so that's fine as long as we believe the risk to be
> >> low-ish.
> 
>  Jan
> 
> > 28. sep. 2023 kl. 21:53 skrev Anshum Gupta <
> ans...@anshumgupta.net
> >> :
> >
> > I don't like holding up releases, but it's nice to not have too
> > many
> > releases from an operational standpoint. If fixing Solr for the
> >> Lucene
> > upgrade will take time, I think it's worth the trade-off and
> moving
>  forward
> > with the older version of Lucene.
> >
> > On Thu, Sep 28, 2023 at 6:05 AM Jan Høydahl <
> jan@cominvent.com
> >>
>  wrote:
> >
> >> Can I propose we do NOT hold the 9.4 release to add the (too
> > fresh)
>  Lucene
> >> 9.8? We can do a rapid 9.5 with any benefits reaped from the new
> >>> Lucene
> >> version.
> >>
> >> Jan
> >>
> >>> 28. sep. 2023 kl. 00:36 skrev Alex Deparvu <
> stilla...@apache.org
> >> :
> >>>
> >>> Hi,
> >>>
> >>> Some updates to share on the upgrade.
> >>> I have identified a cause for most of the failures and pushed a
> >> fix.
>  this
> >>> comment has all the details if anyone is interested in taking a
> >> look
> >>>
> https://github.com/apache/solr/pull/1958#issuecomment-1736170176
> >>> I have also sent an email to lucene dev list to explain my
> 

Re: [DISCUSS] 9.4 release

2023-10-02 Thread Eric Pugh
So, I’m thinking that SOLR-14496 probably needs more tests and eyeballs, so 
don’t hold up the release for it.   Hopefully it makes it!



> On Oct 2, 2023, at 2:01 PM, Alex Deparvu  wrote:
> 
> Another quick update.
> 
> There are 2 things pending and wanted to check on the progress
> - https://issues.apache.org/jira/browse/SOLR-17005 seems to be a
> regression in the start script on Windows. it looks like this needs to
> block the release. please correct if I misunderstood the priority.
> - https://issues.apache.org/jira/browse/SOLR-14496 - this looks close to
> being merged and I think Eric mentioned in this thread that he wants this
> in 9.4
> 
> best,
> alex
> 
> 
> 
> On Sat, Sep 30, 2023 at 6:29 AM Jan Høydahl  wrote:
> 
>> I added a blocker Jira for one solrbot upgrade for a CVE. Please check.
>> Good luck with the release, I’ll not be available for the next few days.
>> 
>> Jan Høydahl
>> 
>>> 30. sep. 2023 kl. 00:02 skrev Eric Pugh >> :
>>> 
>>> If SOLR-14496, https://github.com/apache/solr/pull/1954 ends up
>> getting reviewed with no issues, I’m hoping to get it into 9.4….   Since we
>> have basic auth added to prometheus as well!
>>> 
>>> 
>>> 
 On Sep 29, 2023, at 1:45 PM, Alex Deparvu  wrote:
 
 Hi,
 
 Just a quick status update
 - SOLR-16994 looks almost complete: PR was reviewed, I'm not sure if
>> there
 is more work pending
 - SOLR-16644 was merged and backported
 - SOLR-16985 - lucene upgrade is almost complete. there are no more
 failures (still running one single test a few more times just to make
>> sure
 if there is any flakiness here I will not include the upgrade in the
 release). Thank you Christine Poerschke for helping out! If anyone else
 wants to review, now would be a very good time.
 
 Looks to me like we are in good shape for a release very soon!
 I volunteered for this one, so I will dig up the docs to see what I
>> need to
 do Monday morning.
 
 best,
 alex
 
 
> On Fri, Sep 29, 2023 at 11:23 AM David Smiley <
>> david.w.smi...@gmail.com>
> wrote:
> 
> There is no feature freeze yet (there is no branch_9_4), thus no
>> necessity
> to ask permission.
> 
> ~ David
> 
> 
> On Fri, Sep 29, 2023 at 10:34 AM Ishan Chattopadhyaya <
> ichattopadhy...@gmail.com> wrote:
> 
>> I'd like to merge SOLR-16644, please. I think it is low risk, since it
>> affects only the start script and fixes the way a low entropy warning
>> is
>> generated.
>> 
>> On Fri, 29 Sept 2023 at 03:19, Alex Deparvu 
> wrote:
>> 
>>> Hi,
>>> 
>>> It would be unfortunate to get this close and miss out on the Lucene
>>> release. I would want to give it one more day, if things do not work
>> out, I
>>> will go ahead with the release.
>>> 
>>> best,
>>> alex
>>> 
>>> 
>>> 
>>> On Thu, Sep 28, 2023 at 2:25 PM Jan Høydahl 
>> wrote:
>>> 
 I see there is energy and traction into finalizing the Lucene 9.8
 integration, so that's fine as long as we believe the risk to be
>> low-ish.
 
 Jan
 
> 28. sep. 2023 kl. 21:53 skrev Anshum Gupta > :
> 
> I don't like holding up releases, but it's nice to not have too
> many
> releases from an operational standpoint. If fixing Solr for the
>> Lucene
> upgrade will take time, I think it's worth the trade-off and moving
 forward
> with the older version of Lucene.
> 
> On Thu, Sep 28, 2023 at 6:05 AM Jan Høydahl > 
 wrote:
> 
>> Can I propose we do NOT hold the 9.4 release to add the (too
> fresh)
 Lucene
>> 9.8? We can do a rapid 9.5 with any benefits reaped from the new
>>> Lucene
>> version.
>> 
>> Jan
>> 
>>> 28. sep. 2023 kl. 00:36 skrev Alex Deparvu > :
>>> 
>>> Hi,
>>> 
>>> Some updates to share on the upgrade.
>>> I have identified a cause for most of the failures and pushed a
>> fix.
 this
>>> comment has all the details if anyone is interested in taking a
>> look
>>> https://github.com/apache/solr/pull/1958#issuecomment-1736170176
>>> I have also sent an email to lucene dev list to explain my
> findings
>>> and
>>> validate with them some of the observations I had
>>> https://lists.apache.org/thread/1gs3nsv1mcns1czdtdnqyz84f31tqm2x
>>> 
>>> There are still some tests failing all in the vector search area
> I
>>> will
>>> look at next.
>>> 
>>> best,
>>> alex
>>> 
>>> 
>>> 
>>> 
>>> On Tue, Sep 26, 2023 at 6:58 AM Alex Deparvu <
> stilla...@apache.org
>>> 
>> wrote:
>>> 
 Hi,
 
>>>

Re: [DISCUSS] 9.4 release

2023-10-02 Thread Alex Deparvu
Another quick update.

There are 2 things pending and wanted to check on the progress
 - https://issues.apache.org/jira/browse/SOLR-17005 seems to be a
regression in the start script on Windows. it looks like this needs to
block the release. please correct if I misunderstood the priority.
 - https://issues.apache.org/jira/browse/SOLR-14496 - this looks close to
being merged and I think Eric mentioned in this thread that he wants this
in 9.4

best,
alex



On Sat, Sep 30, 2023 at 6:29 AM Jan Høydahl  wrote:

> I added a blocker Jira for one solrbot upgrade for a CVE. Please check.
> Good luck with the release, I’ll not be available for the next few days.
>
> Jan Høydahl
>
> > 30. sep. 2023 kl. 00:02 skrev Eric Pugh  >:
> >
> > If SOLR-14496, https://github.com/apache/solr/pull/1954 ends up
> getting reviewed with no issues, I’m hoping to get it into 9.4….   Since we
> have basic auth added to prometheus as well!
> >
> >
> >
> >> On Sep 29, 2023, at 1:45 PM, Alex Deparvu  wrote:
> >>
> >> Hi,
> >>
> >> Just a quick status update
> >> - SOLR-16994 looks almost complete: PR was reviewed, I'm not sure if
> there
> >> is more work pending
> >> - SOLR-16644 was merged and backported
> >> - SOLR-16985 - lucene upgrade is almost complete. there are no more
> >> failures (still running one single test a few more times just to make
> sure
> >> if there is any flakiness here I will not include the upgrade in the
> >> release). Thank you Christine Poerschke for helping out! If anyone else
> >> wants to review, now would be a very good time.
> >>
> >> Looks to me like we are in good shape for a release very soon!
> >> I volunteered for this one, so I will dig up the docs to see what I
> need to
> >> do Monday morning.
> >>
> >> best,
> >> alex
> >>
> >>
> >>> On Fri, Sep 29, 2023 at 11:23 AM David Smiley <
> david.w.smi...@gmail.com>
> >>> wrote:
> >>>
> >>> There is no feature freeze yet (there is no branch_9_4), thus no
> necessity
> >>> to ask permission.
> >>>
> >>> ~ David
> >>>
> >>>
> >>> On Fri, Sep 29, 2023 at 10:34 AM Ishan Chattopadhyaya <
> >>> ichattopadhy...@gmail.com> wrote:
> >>>
>  I'd like to merge SOLR-16644, please. I think it is low risk, since it
>  affects only the start script and fixes the way a low entropy warning
> is
>  generated.
> 
>  On Fri, 29 Sept 2023 at 03:19, Alex Deparvu 
> >>> wrote:
> 
> > Hi,
> >
> > It would be unfortunate to get this close and miss out on the Lucene
> > release. I would want to give it one more day, if things do not work
>  out, I
> > will go ahead with the release.
> >
> > best,
> > alex
> >
> >
> >
> > On Thu, Sep 28, 2023 at 2:25 PM Jan Høydahl 
>  wrote:
> >
> >> I see there is energy and traction into finalizing the Lucene 9.8
> >> integration, so that's fine as long as we believe the risk to be
>  low-ish.
> >>
> >> Jan
> >>
> >>> 28. sep. 2023 kl. 21:53 skrev Anshum Gupta   :
> >>>
> >>> I don't like holding up releases, but it's nice to not have too
> >>> many
> >>> releases from an operational standpoint. If fixing Solr for the
>  Lucene
> >>> upgrade will take time, I think it's worth the trade-off and moving
> >> forward
> >>> with the older version of Lucene.
> >>>
> >>> On Thu, Sep 28, 2023 at 6:05 AM Jan Høydahl  
> >> wrote:
> >>>
>  Can I propose we do NOT hold the 9.4 release to add the (too
> >>> fresh)
> >> Lucene
>  9.8? We can do a rapid 9.5 with any benefits reaped from the new
> > Lucene
>  version.
> 
>  Jan
> 
> > 28. sep. 2023 kl. 00:36 skrev Alex Deparvu   :
> >
> > Hi,
> >
> > Some updates to share on the upgrade.
> > I have identified a cause for most of the failures and pushed a
>  fix.
> >> this
> > comment has all the details if anyone is interested in taking a
>  look
> > https://github.com/apache/solr/pull/1958#issuecomment-1736170176
> > I have also sent an email to lucene dev list to explain my
> >>> findings
> > and
> > validate with them some of the observations I had
> > https://lists.apache.org/thread/1gs3nsv1mcns1czdtdnqyz84f31tqm2x
> >
> > There are still some tests failing all in the vector search area
> >>> I
> > will
> > look at next.
> >
> > best,
> > alex
> >
> >
> >
> >
> > On Tue, Sep 26, 2023 at 6:58 AM Alex Deparvu <
> >>> stilla...@apache.org
> >
>  wrote:
> >
> >> Hi,
> >>
> >> It seems a lot of the upgrade failures are somehow related to
> >> the CollapsingQParser (
> >>
> 
> >>
> >
> 
> >>>
> https://solr.apache.org/guide/solr/latest/query-guide/collapse-and-expand-results.html
> >> ).
> >> If anyone 

Re: [DISCUSS] 9.4 release

2023-09-30 Thread Jan Høydahl
I added a blocker Jira for one solrbot upgrade for a CVE. Please check. Good 
luck with the release, I’ll not be available for the next few days.

Jan Høydahl

> 30. sep. 2023 kl. 00:02 skrev Eric Pugh :
> 
> If SOLR-14496, https://github.com/apache/solr/pull/1954 ends up getting 
> reviewed with no issues, I’m hoping to get it into 9.4….   Since we have 
> basic auth added to prometheus as well!
> 
> 
> 
>> On Sep 29, 2023, at 1:45 PM, Alex Deparvu  wrote:
>> 
>> Hi,
>> 
>> Just a quick status update
>> - SOLR-16994 looks almost complete: PR was reviewed, I'm not sure if there
>> is more work pending
>> - SOLR-16644 was merged and backported
>> - SOLR-16985 - lucene upgrade is almost complete. there are no more
>> failures (still running one single test a few more times just to make sure
>> if there is any flakiness here I will not include the upgrade in the
>> release). Thank you Christine Poerschke for helping out! If anyone else
>> wants to review, now would be a very good time.
>> 
>> Looks to me like we are in good shape for a release very soon!
>> I volunteered for this one, so I will dig up the docs to see what I need to
>> do Monday morning.
>> 
>> best,
>> alex
>> 
>> 
>>> On Fri, Sep 29, 2023 at 11:23 AM David Smiley 
>>> wrote:
>>> 
>>> There is no feature freeze yet (there is no branch_9_4), thus no necessity
>>> to ask permission.
>>> 
>>> ~ David
>>> 
>>> 
>>> On Fri, Sep 29, 2023 at 10:34 AM Ishan Chattopadhyaya <
>>> ichattopadhy...@gmail.com> wrote:
>>> 
 I'd like to merge SOLR-16644, please. I think it is low risk, since it
 affects only the start script and fixes the way a low entropy warning is
 generated.
 
 On Fri, 29 Sept 2023 at 03:19, Alex Deparvu 
>>> wrote:
 
> Hi,
> 
> It would be unfortunate to get this close and miss out on the Lucene
> release. I would want to give it one more day, if things do not work
 out, I
> will go ahead with the release.
> 
> best,
> alex
> 
> 
> 
> On Thu, Sep 28, 2023 at 2:25 PM Jan Høydahl 
 wrote:
> 
>> I see there is energy and traction into finalizing the Lucene 9.8
>> integration, so that's fine as long as we believe the risk to be
 low-ish.
>> 
>> Jan
>> 
>>> 28. sep. 2023 kl. 21:53 skrev Anshum Gupta >>> :
>>> 
>>> I don't like holding up releases, but it's nice to not have too
>>> many
>>> releases from an operational standpoint. If fixing Solr for the
 Lucene
>>> upgrade will take time, I think it's worth the trade-off and moving
>> forward
>>> with the older version of Lucene.
>>> 
>>> On Thu, Sep 28, 2023 at 6:05 AM Jan Høydahl >>> 
>> wrote:
>>> 
 Can I propose we do NOT hold the 9.4 release to add the (too
>>> fresh)
>> Lucene
 9.8? We can do a rapid 9.5 with any benefits reaped from the new
> Lucene
 version.
 
 Jan
 
> 28. sep. 2023 kl. 00:36 skrev Alex Deparvu >>> :
> 
> Hi,
> 
> Some updates to share on the upgrade.
> I have identified a cause for most of the failures and pushed a
 fix.
>> this
> comment has all the details if anyone is interested in taking a
 look
> https://github.com/apache/solr/pull/1958#issuecomment-1736170176
> I have also sent an email to lucene dev list to explain my
>>> findings
> and
> validate with them some of the observations I had
> https://lists.apache.org/thread/1gs3nsv1mcns1czdtdnqyz84f31tqm2x
> 
> There are still some tests failing all in the vector search area
>>> I
> will
> look at next.
> 
> best,
> alex
> 
> 
> 
> 
> On Tue, Sep 26, 2023 at 6:58 AM Alex Deparvu <
>>> stilla...@apache.org
> 
 wrote:
> 
>> Hi,
>> 
>> It seems a lot of the upgrade failures are somehow related to
>> the CollapsingQParser (
>> 
 
>> 
> 
 
>>> https://solr.apache.org/guide/solr/latest/query-guide/collapse-and-expand-results.html
>> ).
>> If anyone is familiar with this code, I would appreciate a look
>>> at
> the
 PR,
>> maybe something pops up.
>> 
>> best
>> alex
>> 
>> 
>> 
>> 
>> On Mon, Sep 25, 2023 at 3:18 PM Alex Deparvu <
 stilla...@apache.org>
 wrote:
>> 
>>> Hi,
>>> 
>>> To prepare for the release I opened an 'early' Lucene 9.8.0
 upgrade
>> PR
>>> for review. There is a large number of tests failing, if anyone
 has
 some
>>> time I would appreciate a hand.
>>> Tracking failures here
>>> 
>>> https://github.com/apache/solr/pull/1958#issuecomment-1734473783
>>> 
>>> 
>>> best,
>>> alex
>>> 
>>>

Re: [DISCUSS] 9.4 release

2023-09-29 Thread Eric Pugh
If SOLR-14496, https://github.com/apache/solr/pull/1954 ends up getting 
reviewed with no issues, I’m hoping to get it into 9.4….   Since we have basic 
auth added to prometheus as well!



> On Sep 29, 2023, at 1:45 PM, Alex Deparvu  wrote:
> 
> Hi,
> 
> Just a quick status update
> - SOLR-16994 looks almost complete: PR was reviewed, I'm not sure if there
> is more work pending
> - SOLR-16644 was merged and backported
> - SOLR-16985 - lucene upgrade is almost complete. there are no more
> failures (still running one single test a few more times just to make sure
> if there is any flakiness here I will not include the upgrade in the
> release). Thank you Christine Poerschke for helping out! If anyone else
> wants to review, now would be a very good time.
> 
> Looks to me like we are in good shape for a release very soon!
> I volunteered for this one, so I will dig up the docs to see what I need to
> do Monday morning.
> 
> best,
> alex
> 
> 
> On Fri, Sep 29, 2023 at 11:23 AM David Smiley 
> wrote:
> 
>> There is no feature freeze yet (there is no branch_9_4), thus no necessity
>> to ask permission.
>> 
>> ~ David
>> 
>> 
>> On Fri, Sep 29, 2023 at 10:34 AM Ishan Chattopadhyaya <
>> ichattopadhy...@gmail.com> wrote:
>> 
>>> I'd like to merge SOLR-16644, please. I think it is low risk, since it
>>> affects only the start script and fixes the way a low entropy warning is
>>> generated.
>>> 
>>> On Fri, 29 Sept 2023 at 03:19, Alex Deparvu 
>> wrote:
>>> 
 Hi,
 
 It would be unfortunate to get this close and miss out on the Lucene
 release. I would want to give it one more day, if things do not work
>>> out, I
 will go ahead with the release.
 
 best,
 alex
 
 
 
 On Thu, Sep 28, 2023 at 2:25 PM Jan Høydahl 
>>> wrote:
 
> I see there is energy and traction into finalizing the Lucene 9.8
> integration, so that's fine as long as we believe the risk to be
>>> low-ish.
> 
> Jan
> 
>> 28. sep. 2023 kl. 21:53 skrev Anshum Gupta >> :
>> 
>> I don't like holding up releases, but it's nice to not have too
>> many
>> releases from an operational standpoint. If fixing Solr for the
>>> Lucene
>> upgrade will take time, I think it's worth the trade-off and moving
> forward
>> with the older version of Lucene.
>> 
>> On Thu, Sep 28, 2023 at 6:05 AM Jan Høydahl >> 
> wrote:
>> 
>>> Can I propose we do NOT hold the 9.4 release to add the (too
>> fresh)
> Lucene
>>> 9.8? We can do a rapid 9.5 with any benefits reaped from the new
 Lucene
>>> version.
>>> 
>>> Jan
>>> 
 28. sep. 2023 kl. 00:36 skrev Alex Deparvu >> :
 
 Hi,
 
 Some updates to share on the upgrade.
 I have identified a cause for most of the failures and pushed a
>>> fix.
> this
 comment has all the details if anyone is interested in taking a
>>> look
 https://github.com/apache/solr/pull/1958#issuecomment-1736170176
 I have also sent an email to lucene dev list to explain my
>> findings
 and
 validate with them some of the observations I had
 https://lists.apache.org/thread/1gs3nsv1mcns1czdtdnqyz84f31tqm2x
 
 There are still some tests failing all in the vector search area
>> I
 will
 look at next.
 
 best,
 alex
 
 
 
 
 On Tue, Sep 26, 2023 at 6:58 AM Alex Deparvu <
>> stilla...@apache.org
 
>>> wrote:
 
> Hi,
> 
> It seems a lot of the upgrade failures are somehow related to
> the CollapsingQParser (
> 
>>> 
> 
 
>>> 
>> https://solr.apache.org/guide/solr/latest/query-guide/collapse-and-expand-results.html
> ).
> If anyone is familiar with this code, I would appreciate a look
>> at
 the
>>> PR,
> maybe something pops up.
> 
> best
> alex
> 
> 
> 
> 
> On Mon, Sep 25, 2023 at 3:18 PM Alex Deparvu <
>>> stilla...@apache.org>
>>> wrote:
> 
>> Hi,
>> 
>> To prepare for the release I opened an 'early' Lucene 9.8.0
>>> upgrade
> PR
>> for review. There is a large number of tests failing, if anyone
>>> has
>>> some
>> time I would appreciate a hand.
>> Tracking failures here
>> 
>> https://github.com/apache/solr/pull/1958#issuecomment-1734473783
>> 
>> 
>> best,
>> alex
>> 
>> 
>> 
>> 
>> 
>> 
>> On Mon, Sep 18, 2023 at 1:23 PM Alex Deparvu <
>>> stilla...@apache.org
> 
>> wrote:
>> 
>>> Good call Houston. I have created a Jira for the Lucene 9.8
 upgrade
>>> and
>>> marked it as blocker for Solr 9.4
>>> I will take a look once the Lucene release is out, if no on

Re: [DISCUSS] 9.4 release

2023-09-29 Thread Alex Deparvu
Hi,

Just a quick status update
 - SOLR-16994 looks almost complete: PR was reviewed, I'm not sure if there
is more work pending
 - SOLR-16644 was merged and backported
 - SOLR-16985 - lucene upgrade is almost complete. there are no more
failures (still running one single test a few more times just to make sure
if there is any flakiness here I will not include the upgrade in the
release). Thank you Christine Poerschke for helping out! If anyone else
wants to review, now would be a very good time.

Looks to me like we are in good shape for a release very soon!
I volunteered for this one, so I will dig up the docs to see what I need to
do Monday morning.

best,
alex


On Fri, Sep 29, 2023 at 11:23 AM David Smiley 
wrote:

> There is no feature freeze yet (there is no branch_9_4), thus no necessity
> to ask permission.
>
> ~ David
>
>
> On Fri, Sep 29, 2023 at 10:34 AM Ishan Chattopadhyaya <
> ichattopadhy...@gmail.com> wrote:
>
> > I'd like to merge SOLR-16644, please. I think it is low risk, since it
> > affects only the start script and fixes the way a low entropy warning is
> > generated.
> >
> > On Fri, 29 Sept 2023 at 03:19, Alex Deparvu 
> wrote:
> >
> > > Hi,
> > >
> > > It would be unfortunate to get this close and miss out on the Lucene
> > > release. I would want to give it one more day, if things do not work
> > out, I
> > > will go ahead with the release.
> > >
> > > best,
> > > alex
> > >
> > >
> > >
> > > On Thu, Sep 28, 2023 at 2:25 PM Jan Høydahl 
> > wrote:
> > >
> > > > I see there is energy and traction into finalizing the Lucene 9.8
> > > > integration, so that's fine as long as we believe the risk to be
> > low-ish.
> > > >
> > > > Jan
> > > >
> > > > > 28. sep. 2023 kl. 21:53 skrev Anshum Gupta  >:
> > > > >
> > > > > I don't like holding up releases, but it's nice to not have too
> many
> > > > > releases from an operational standpoint. If fixing Solr for the
> > Lucene
> > > > > upgrade will take time, I think it's worth the trade-off and moving
> > > > forward
> > > > > with the older version of Lucene.
> > > > >
> > > > > On Thu, Sep 28, 2023 at 6:05 AM Jan Høydahl  >
> > > > wrote:
> > > > >
> > > > >> Can I propose we do NOT hold the 9.4 release to add the (too
> fresh)
> > > > Lucene
> > > > >> 9.8? We can do a rapid 9.5 with any benefits reaped from the new
> > > Lucene
> > > > >> version.
> > > > >>
> > > > >> Jan
> > > > >>
> > > > >>> 28. sep. 2023 kl. 00:36 skrev Alex Deparvu  >:
> > > > >>>
> > > > >>> Hi,
> > > > >>>
> > > > >>> Some updates to share on the upgrade.
> > > > >>> I have identified a cause for most of the failures and pushed a
> > fix.
> > > > this
> > > > >>> comment has all the details if anyone is interested in taking a
> > look
> > > > >>> https://github.com/apache/solr/pull/1958#issuecomment-1736170176
> > > > >>> I have also sent an email to lucene dev list to explain my
> findings
> > > and
> > > > >>> validate with them some of the observations I had
> > > > >>> https://lists.apache.org/thread/1gs3nsv1mcns1czdtdnqyz84f31tqm2x
> > > > >>>
> > > > >>> There are still some tests failing all in the vector search area
> I
> > > will
> > > > >>> look at next.
> > > > >>>
> > > > >>> best,
> > > > >>> alex
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>> On Tue, Sep 26, 2023 at 6:58 AM Alex Deparvu <
> stilla...@apache.org
> > >
> > > > >> wrote:
> > > > >>>
> > > >  Hi,
> > > > 
> > > >  It seems a lot of the upgrade failures are somehow related to
> > > >  the CollapsingQParser (
> > > > 
> > > > >>
> > > >
> > >
> >
> https://solr.apache.org/guide/solr/latest/query-guide/collapse-and-expand-results.html
> > > >  ).
> > > >  If anyone is familiar with this code, I would appreciate a look
> at
> > > the
> > > > >> PR,
> > > >  maybe something pops up.
> > > > 
> > > >  best
> > > >  alex
> > > > 
> > > > 
> > > > 
> > > > 
> > > >  On Mon, Sep 25, 2023 at 3:18 PM Alex Deparvu <
> > stilla...@apache.org>
> > > > >> wrote:
> > > > 
> > > > > Hi,
> > > > >
> > > > > To prepare for the release I opened an 'early' Lucene 9.8.0
> > upgrade
> > > > PR
> > > > > for review. There is a large number of tests failing, if anyone
> > has
> > > > >> some
> > > > > time I would appreciate a hand.
> > > > > Tracking failures here
> > > > >
> https://github.com/apache/solr/pull/1958#issuecomment-1734473783
> > > > >
> > > > >
> > > > > best,
> > > > > alex
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > On Mon, Sep 18, 2023 at 1:23 PM Alex Deparvu <
> > stilla...@apache.org
> > > >
> > > > > wrote:
> > > > >
> > > > >> Good call Houston. I have created a Jira for the Lucene 9.8
> > > upgrade
> > > > >> and
> > > > >> marked it as blocker for Solr 9.4
> > > > >> I will take a look once the Lucene release is out, if no one
> > else
> > > > >> picks
> > > > >> it up first.
> > > > >>

Re: [DISCUSS] 9.4 release

2023-09-29 Thread David Smiley
There is no feature freeze yet (there is no branch_9_4), thus no necessity
to ask permission.

~ David


On Fri, Sep 29, 2023 at 10:34 AM Ishan Chattopadhyaya <
ichattopadhy...@gmail.com> wrote:

> I'd like to merge SOLR-16644, please. I think it is low risk, since it
> affects only the start script and fixes the way a low entropy warning is
> generated.
>
> On Fri, 29 Sept 2023 at 03:19, Alex Deparvu  wrote:
>
> > Hi,
> >
> > It would be unfortunate to get this close and miss out on the Lucene
> > release. I would want to give it one more day, if things do not work
> out, I
> > will go ahead with the release.
> >
> > best,
> > alex
> >
> >
> >
> > On Thu, Sep 28, 2023 at 2:25 PM Jan Høydahl 
> wrote:
> >
> > > I see there is energy and traction into finalizing the Lucene 9.8
> > > integration, so that's fine as long as we believe the risk to be
> low-ish.
> > >
> > > Jan
> > >
> > > > 28. sep. 2023 kl. 21:53 skrev Anshum Gupta :
> > > >
> > > > I don't like holding up releases, but it's nice to not have too many
> > > > releases from an operational standpoint. If fixing Solr for the
> Lucene
> > > > upgrade will take time, I think it's worth the trade-off and moving
> > > forward
> > > > with the older version of Lucene.
> > > >
> > > > On Thu, Sep 28, 2023 at 6:05 AM Jan Høydahl 
> > > wrote:
> > > >
> > > >> Can I propose we do NOT hold the 9.4 release to add the (too fresh)
> > > Lucene
> > > >> 9.8? We can do a rapid 9.5 with any benefits reaped from the new
> > Lucene
> > > >> version.
> > > >>
> > > >> Jan
> > > >>
> > > >>> 28. sep. 2023 kl. 00:36 skrev Alex Deparvu :
> > > >>>
> > > >>> Hi,
> > > >>>
> > > >>> Some updates to share on the upgrade.
> > > >>> I have identified a cause for most of the failures and pushed a
> fix.
> > > this
> > > >>> comment has all the details if anyone is interested in taking a
> look
> > > >>> https://github.com/apache/solr/pull/1958#issuecomment-1736170176
> > > >>> I have also sent an email to lucene dev list to explain my findings
> > and
> > > >>> validate with them some of the observations I had
> > > >>> https://lists.apache.org/thread/1gs3nsv1mcns1czdtdnqyz84f31tqm2x
> > > >>>
> > > >>> There are still some tests failing all in the vector search area I
> > will
> > > >>> look at next.
> > > >>>
> > > >>> best,
> > > >>> alex
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>> On Tue, Sep 26, 2023 at 6:58 AM Alex Deparvu  >
> > > >> wrote:
> > > >>>
> > >  Hi,
> > > 
> > >  It seems a lot of the upgrade failures are somehow related to
> > >  the CollapsingQParser (
> > > 
> > > >>
> > >
> >
> https://solr.apache.org/guide/solr/latest/query-guide/collapse-and-expand-results.html
> > >  ).
> > >  If anyone is familiar with this code, I would appreciate a look at
> > the
> > > >> PR,
> > >  maybe something pops up.
> > > 
> > >  best
> > >  alex
> > > 
> > > 
> > > 
> > > 
> > >  On Mon, Sep 25, 2023 at 3:18 PM Alex Deparvu <
> stilla...@apache.org>
> > > >> wrote:
> > > 
> > > > Hi,
> > > >
> > > > To prepare for the release I opened an 'early' Lucene 9.8.0
> upgrade
> > > PR
> > > > for review. There is a large number of tests failing, if anyone
> has
> > > >> some
> > > > time I would appreciate a hand.
> > > > Tracking failures here
> > > > https://github.com/apache/solr/pull/1958#issuecomment-1734473783
> > > >
> > > >
> > > > best,
> > > > alex
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > On Mon, Sep 18, 2023 at 1:23 PM Alex Deparvu <
> stilla...@apache.org
> > >
> > > > wrote:
> > > >
> > > >> Good call Houston. I have created a Jira for the Lucene 9.8
> > upgrade
> > > >> and
> > > >> marked it as blocker for Solr 9.4
> > > >> I will take a look once the Lucene release is out, if no one
> else
> > > >> picks
> > > >> it up first.
> > > >>
> > > >> https://issues.apache.org/jira/browse/SOLR-16985
> > > >>
> > > >> best
> > > >> alex
> > > >>
> > > >>
> > > >> On Mon, Sep 18, 2023 at 7:42 AM Houston Putman <
> > hous...@apache.org>
> > > >> wrote:
> > > >>
> > > >>> It looks like the next Lucene version might be released soon,
> so
> > we
> > > >> may
> > > >>> want to wait for that. It will come with Java 21 support for
> the
> > > >>> vector/memory map stuff.
> > > >>>
> > > >>> - Houston
> > > >>>
> > > >>> On Thu, Sep 14, 2023 at 10:53 PM Ishan Chattopadhyaya <
> > > >>> ichattopadhy...@gmail.com> wrote:
> > > >>>
> > >  Thanks Alex and Jan!
> > > 
> > >  On Fri, 15 Sept, 2023, 2:10 am Jan Høydahl, <
> > > jan@cominvent.com>
> > > >>> wrote:
> > > 
> > > > Sure, it's all yours..
> > > > You'll find what you need in the Release Wizard. Just run
> this
> > > >>> script to
> > > > get going.
> > > >
> > > 
> > > >>>
> > > >

Re: [DISCUSS] 9.4 release

2023-09-29 Thread Ishan Chattopadhyaya
I'd like to merge SOLR-16644, please. I think it is low risk, since it
affects only the start script and fixes the way a low entropy warning is
generated.

On Fri, 29 Sept 2023 at 03:19, Alex Deparvu  wrote:

> Hi,
>
> It would be unfortunate to get this close and miss out on the Lucene
> release. I would want to give it one more day, if things do not work out, I
> will go ahead with the release.
>
> best,
> alex
>
>
>
> On Thu, Sep 28, 2023 at 2:25 PM Jan Høydahl  wrote:
>
> > I see there is energy and traction into finalizing the Lucene 9.8
> > integration, so that's fine as long as we believe the risk to be low-ish.
> >
> > Jan
> >
> > > 28. sep. 2023 kl. 21:53 skrev Anshum Gupta :
> > >
> > > I don't like holding up releases, but it's nice to not have too many
> > > releases from an operational standpoint. If fixing Solr for the Lucene
> > > upgrade will take time, I think it's worth the trade-off and moving
> > forward
> > > with the older version of Lucene.
> > >
> > > On Thu, Sep 28, 2023 at 6:05 AM Jan Høydahl 
> > wrote:
> > >
> > >> Can I propose we do NOT hold the 9.4 release to add the (too fresh)
> > Lucene
> > >> 9.8? We can do a rapid 9.5 with any benefits reaped from the new
> Lucene
> > >> version.
> > >>
> > >> Jan
> > >>
> > >>> 28. sep. 2023 kl. 00:36 skrev Alex Deparvu :
> > >>>
> > >>> Hi,
> > >>>
> > >>> Some updates to share on the upgrade.
> > >>> I have identified a cause for most of the failures and pushed a fix.
> > this
> > >>> comment has all the details if anyone is interested in taking a look
> > >>> https://github.com/apache/solr/pull/1958#issuecomment-1736170176
> > >>> I have also sent an email to lucene dev list to explain my findings
> and
> > >>> validate with them some of the observations I had
> > >>> https://lists.apache.org/thread/1gs3nsv1mcns1czdtdnqyz84f31tqm2x
> > >>>
> > >>> There are still some tests failing all in the vector search area I
> will
> > >>> look at next.
> > >>>
> > >>> best,
> > >>> alex
> > >>>
> > >>>
> > >>>
> > >>>
> > >>> On Tue, Sep 26, 2023 at 6:58 AM Alex Deparvu 
> > >> wrote:
> > >>>
> >  Hi,
> > 
> >  It seems a lot of the upgrade failures are somehow related to
> >  the CollapsingQParser (
> > 
> > >>
> >
> https://solr.apache.org/guide/solr/latest/query-guide/collapse-and-expand-results.html
> >  ).
> >  If anyone is familiar with this code, I would appreciate a look at
> the
> > >> PR,
> >  maybe something pops up.
> > 
> >  best
> >  alex
> > 
> > 
> > 
> > 
> >  On Mon, Sep 25, 2023 at 3:18 PM Alex Deparvu 
> > >> wrote:
> > 
> > > Hi,
> > >
> > > To prepare for the release I opened an 'early' Lucene 9.8.0 upgrade
> > PR
> > > for review. There is a large number of tests failing, if anyone has
> > >> some
> > > time I would appreciate a hand.
> > > Tracking failures here
> > > https://github.com/apache/solr/pull/1958#issuecomment-1734473783
> > >
> > >
> > > best,
> > > alex
> > >
> > >
> > >
> > >
> > >
> > >
> > > On Mon, Sep 18, 2023 at 1:23 PM Alex Deparvu  >
> > > wrote:
> > >
> > >> Good call Houston. I have created a Jira for the Lucene 9.8
> upgrade
> > >> and
> > >> marked it as blocker for Solr 9.4
> > >> I will take a look once the Lucene release is out, if no one else
> > >> picks
> > >> it up first.
> > >>
> > >> https://issues.apache.org/jira/browse/SOLR-16985
> > >>
> > >> best
> > >> alex
> > >>
> > >>
> > >> On Mon, Sep 18, 2023 at 7:42 AM Houston Putman <
> hous...@apache.org>
> > >> wrote:
> > >>
> > >>> It looks like the next Lucene version might be released soon, so
> we
> > >> may
> > >>> want to wait for that. It will come with Java 21 support for the
> > >>> vector/memory map stuff.
> > >>>
> > >>> - Houston
> > >>>
> > >>> On Thu, Sep 14, 2023 at 10:53 PM Ishan Chattopadhyaya <
> > >>> ichattopadhy...@gmail.com> wrote:
> > >>>
> >  Thanks Alex and Jan!
> > 
> >  On Fri, 15 Sept, 2023, 2:10 am Jan Høydahl, <
> > jan@cominvent.com>
> > >>> wrote:
> > 
> > > Sure, it's all yours..
> > > You'll find what you need in the Release Wizard. Just run this
> > >>> script to
> > > get going.
> > >
> > 
> > >>>
> > >>
> >
> https://github.com/apache/solr/blob/main/dev-tools/scripts/releaseWizard.py
> > >
> > > Jan
> > >
> > >> 14. sep. 2023 kl. 21:53 skrev Alex Deparvu <
> > stilla...@apache.org
> >  :
> > >>
> > >> Hi,
> > >>
> > >> I would be happy to give this a go (if provided ample hand
> > >>> holding).
> > >>
> > >>
> > >> best,
> > >> alex
> > >>
> > >>
> > >>
> > >> On Thu, Sep 14, 2023 at 9:32 AM Jan Høydahl <
> > >>> jan@cominvent.com>
> > 

Re: [DISCUSS] 9.4 release

2023-09-28 Thread Alex Deparvu
Hi,

It would be unfortunate to get this close and miss out on the Lucene
release. I would want to give it one more day, if things do not work out, I
will go ahead with the release.

best,
alex



On Thu, Sep 28, 2023 at 2:25 PM Jan Høydahl  wrote:

> I see there is energy and traction into finalizing the Lucene 9.8
> integration, so that's fine as long as we believe the risk to be low-ish.
>
> Jan
>
> > 28. sep. 2023 kl. 21:53 skrev Anshum Gupta :
> >
> > I don't like holding up releases, but it's nice to not have too many
> > releases from an operational standpoint. If fixing Solr for the Lucene
> > upgrade will take time, I think it's worth the trade-off and moving
> forward
> > with the older version of Lucene.
> >
> > On Thu, Sep 28, 2023 at 6:05 AM Jan Høydahl 
> wrote:
> >
> >> Can I propose we do NOT hold the 9.4 release to add the (too fresh)
> Lucene
> >> 9.8? We can do a rapid 9.5 with any benefits reaped from the new Lucene
> >> version.
> >>
> >> Jan
> >>
> >>> 28. sep. 2023 kl. 00:36 skrev Alex Deparvu :
> >>>
> >>> Hi,
> >>>
> >>> Some updates to share on the upgrade.
> >>> I have identified a cause for most of the failures and pushed a fix.
> this
> >>> comment has all the details if anyone is interested in taking a look
> >>> https://github.com/apache/solr/pull/1958#issuecomment-1736170176
> >>> I have also sent an email to lucene dev list to explain my findings and
> >>> validate with them some of the observations I had
> >>> https://lists.apache.org/thread/1gs3nsv1mcns1czdtdnqyz84f31tqm2x
> >>>
> >>> There are still some tests failing all in the vector search area I will
> >>> look at next.
> >>>
> >>> best,
> >>> alex
> >>>
> >>>
> >>>
> >>>
> >>> On Tue, Sep 26, 2023 at 6:58 AM Alex Deparvu 
> >> wrote:
> >>>
>  Hi,
> 
>  It seems a lot of the upgrade failures are somehow related to
>  the CollapsingQParser (
> 
> >>
> https://solr.apache.org/guide/solr/latest/query-guide/collapse-and-expand-results.html
>  ).
>  If anyone is familiar with this code, I would appreciate a look at the
> >> PR,
>  maybe something pops up.
> 
>  best
>  alex
> 
> 
> 
> 
>  On Mon, Sep 25, 2023 at 3:18 PM Alex Deparvu 
> >> wrote:
> 
> > Hi,
> >
> > To prepare for the release I opened an 'early' Lucene 9.8.0 upgrade
> PR
> > for review. There is a large number of tests failing, if anyone has
> >> some
> > time I would appreciate a hand.
> > Tracking failures here
> > https://github.com/apache/solr/pull/1958#issuecomment-1734473783
> >
> >
> > best,
> > alex
> >
> >
> >
> >
> >
> >
> > On Mon, Sep 18, 2023 at 1:23 PM Alex Deparvu 
> > wrote:
> >
> >> Good call Houston. I have created a Jira for the Lucene 9.8 upgrade
> >> and
> >> marked it as blocker for Solr 9.4
> >> I will take a look once the Lucene release is out, if no one else
> >> picks
> >> it up first.
> >>
> >> https://issues.apache.org/jira/browse/SOLR-16985
> >>
> >> best
> >> alex
> >>
> >>
> >> On Mon, Sep 18, 2023 at 7:42 AM Houston Putman 
> >> wrote:
> >>
> >>> It looks like the next Lucene version might be released soon, so we
> >> may
> >>> want to wait for that. It will come with Java 21 support for the
> >>> vector/memory map stuff.
> >>>
> >>> - Houston
> >>>
> >>> On Thu, Sep 14, 2023 at 10:53 PM Ishan Chattopadhyaya <
> >>> ichattopadhy...@gmail.com> wrote:
> >>>
>  Thanks Alex and Jan!
> 
>  On Fri, 15 Sept, 2023, 2:10 am Jan Høydahl, <
> jan@cominvent.com>
> >>> wrote:
> 
> > Sure, it's all yours..
> > You'll find what you need in the Release Wizard. Just run this
> >>> script to
> > get going.
> >
> 
> >>>
> >>
> https://github.com/apache/solr/blob/main/dev-tools/scripts/releaseWizard.py
> >
> > Jan
> >
> >> 14. sep. 2023 kl. 21:53 skrev Alex Deparvu <
> stilla...@apache.org
>  :
> >>
> >> Hi,
> >>
> >> I would be happy to give this a go (if provided ample hand
> >>> holding).
> >>
> >>
> >> best,
> >> alex
> >>
> >>
> >>
> >> On Thu, Sep 14, 2023 at 9:32 AM Jan Høydahl <
> >>> jan@cominvent.com>
> > wrote:
> >>
> >>> Hi,
> >>>
> >>> Branch_9x has accumulated 4 features, 18 improvements, 2
>  optimizations,
> > 21
> >>> bug fixes, 7 "other", and a bunch of dependency updates. It's
> >>> been
> > almost 2
> >>> months since 9.3.
> >>>
> >>> I propose cutting the branch and preparing first RC on Tuesday
> >>> Sept
> > 26th,
> >>> twelve days from today.
> >>>
> >>> I volunteer as RM, but will yield if one of our new committers
> >>>

Re: [DISCUSS] 9.4 release

2023-09-28 Thread Jan Høydahl
I see there is energy and traction into finalizing the Lucene 9.8 integration, 
so that's fine as long as we believe the risk to be low-ish.

Jan

> 28. sep. 2023 kl. 21:53 skrev Anshum Gupta :
> 
> I don't like holding up releases, but it's nice to not have too many
> releases from an operational standpoint. If fixing Solr for the Lucene
> upgrade will take time, I think it's worth the trade-off and moving forward
> with the older version of Lucene.
> 
> On Thu, Sep 28, 2023 at 6:05 AM Jan Høydahl  wrote:
> 
>> Can I propose we do NOT hold the 9.4 release to add the (too fresh) Lucene
>> 9.8? We can do a rapid 9.5 with any benefits reaped from the new Lucene
>> version.
>> 
>> Jan
>> 
>>> 28. sep. 2023 kl. 00:36 skrev Alex Deparvu :
>>> 
>>> Hi,
>>> 
>>> Some updates to share on the upgrade.
>>> I have identified a cause for most of the failures and pushed a fix. this
>>> comment has all the details if anyone is interested in taking a look
>>> https://github.com/apache/solr/pull/1958#issuecomment-1736170176
>>> I have also sent an email to lucene dev list to explain my findings and
>>> validate with them some of the observations I had
>>> https://lists.apache.org/thread/1gs3nsv1mcns1czdtdnqyz84f31tqm2x
>>> 
>>> There are still some tests failing all in the vector search area I will
>>> look at next.
>>> 
>>> best,
>>> alex
>>> 
>>> 
>>> 
>>> 
>>> On Tue, Sep 26, 2023 at 6:58 AM Alex Deparvu 
>> wrote:
>>> 
 Hi,
 
 It seems a lot of the upgrade failures are somehow related to
 the CollapsingQParser (
 
>> https://solr.apache.org/guide/solr/latest/query-guide/collapse-and-expand-results.html
 ).
 If anyone is familiar with this code, I would appreciate a look at the
>> PR,
 maybe something pops up.
 
 best
 alex
 
 
 
 
 On Mon, Sep 25, 2023 at 3:18 PM Alex Deparvu 
>> wrote:
 
> Hi,
> 
> To prepare for the release I opened an 'early' Lucene 9.8.0 upgrade PR
> for review. There is a large number of tests failing, if anyone has
>> some
> time I would appreciate a hand.
> Tracking failures here
> https://github.com/apache/solr/pull/1958#issuecomment-1734473783
> 
> 
> best,
> alex
> 
> 
> 
> 
> 
> 
> On Mon, Sep 18, 2023 at 1:23 PM Alex Deparvu 
> wrote:
> 
>> Good call Houston. I have created a Jira for the Lucene 9.8 upgrade
>> and
>> marked it as blocker for Solr 9.4
>> I will take a look once the Lucene release is out, if no one else
>> picks
>> it up first.
>> 
>> https://issues.apache.org/jira/browse/SOLR-16985
>> 
>> best
>> alex
>> 
>> 
>> On Mon, Sep 18, 2023 at 7:42 AM Houston Putman 
>> wrote:
>> 
>>> It looks like the next Lucene version might be released soon, so we
>> may
>>> want to wait for that. It will come with Java 21 support for the
>>> vector/memory map stuff.
>>> 
>>> - Houston
>>> 
>>> On Thu, Sep 14, 2023 at 10:53 PM Ishan Chattopadhyaya <
>>> ichattopadhy...@gmail.com> wrote:
>>> 
 Thanks Alex and Jan!
 
 On Fri, 15 Sept, 2023, 2:10 am Jan Høydahl, 
>>> wrote:
 
> Sure, it's all yours..
> You'll find what you need in the Release Wizard. Just run this
>>> script to
> get going.
> 
 
>>> 
>> https://github.com/apache/solr/blob/main/dev-tools/scripts/releaseWizard.py
> 
> Jan
> 
>> 14. sep. 2023 kl. 21:53 skrev Alex Deparvu >>> :
>> 
>> Hi,
>> 
>> I would be happy to give this a go (if provided ample hand
>>> holding).
>> 
>> 
>> best,
>> alex
>> 
>> 
>> 
>> On Thu, Sep 14, 2023 at 9:32 AM Jan Høydahl <
>>> jan@cominvent.com>
> wrote:
>> 
>>> Hi,
>>> 
>>> Branch_9x has accumulated 4 features, 18 improvements, 2
 optimizations,
> 21
>>> bug fixes, 7 "other", and a bunch of dependency updates. It's
>>> been
> almost 2
>>> months since 9.3.
>>> 
>>> I propose cutting the branch and preparing first RC on Tuesday
>>> Sept
> 26th,
>>> twelve days from today.
>>> 
>>> I volunteer as RM, but will yield if one of our new committers
>>> wants
 to
>>> try the Release Manager role!
>>> 
>>> Jan
>>> 
>>> -
>>> To unsubscribe, e-mail: dev-unsubscr...@solr.apache.org
>>> For additional commands, e-mail: dev-h...@solr.apache.org
>>> 
>>> 
> 
> 
 
>>> 
>> 
>> 
>> 
>> -
>> To unsubscribe, e-mail: dev-unsubscr...@solr.apache.org
>> For additional commands, e-mail: dev-h

Re: Re: [DISCUSS] 9.4 release

2023-09-28 Thread David Smiley
By default, Solr returns all metrics, of which there are a ton of them!
That's great for looking at metrics if you are exploring them for the first
time.  But as you'll see in the ref guide, there are many filtering options
which I would consider to be mandatory if you are going to use metrics "for
real" (in production).

I know I sidestepped your question; you may have a point about indentation
defaults.  I'm somewhat surprised the Prometheus Exporter insists on JSON
(vs Solr native "javabin"); I can see the code for that and it seems it's
because it's going to do some Json specific "jq" processing.  Okay.
See org.apache.solr.prometheus.scraper.SolrScraper#request where you could
clone the params from MetricsQuery in order to set indent=false.  Or be a
little fancy and use SolrParams.wrapDefaults(params, new
MapSolrParams(Map.of("indent","false"))) or similar.  I wish there was a
convenience method for that on SolrParams.

Feel free to create a JIRA issue & PR and I'll review.

~ David


On Thu, Sep 28, 2023 at 1:38 PM Chris Schomaker
 wrote:

> I'd like to raise an issue that I'm having with Solr 9.3 that might make a
> good case for getting another release (9.3.1 or 9.4) out soon.
>
> I've had a 9.3 cluster of 180 nodes up and running for about a week. After
> the weekend, I noticed that metrics from the cluster were failing to ship.
> Upon investigation, I found that the payload coming back from
> `/solr/admin/metrics` was over a GB in size. I also saw query responses had
> ballooned in size to tens of MB and the UI was slow. I captured query
> responses in the browser, with curl and in a packet capture. In all cases,
> there were a large amount of space characters. This can be seen in the
> brower's network inspector when clicking around the UI, as well (make sure
> to disable pretty print).
>
> This all lead me to SOLR-16925. I have a fix in place for query results but
> the admin endpoints like `/solr/admin/metrics` are still experiencing the
> issue. You can simply pass `&indent=off` to the endpoints and the
> whitespace issue goes away. However, I can't figure out a way to configure
> Solr to use this default param with the CoreAdminHandler. The Solr Prom
> Exporter could be reconfigured to include this param but that's a lot of
> configuration to add. There's no way to reconfigure the UI.
>
> Here's a good illustration of the issue:
>
> ```
> ❯ curl --user 'foo:bar' "http://localhost:8983/solr/admin/metrics"; >
> /tmp/metrics_indented.json
>
> ❯ curl --user 'foo:bar' "
> http://localhost:8983/solr/admin/metrics?indent=off";
> > /tmp/metrics_not_indented.json
>
> ❯ ls -lh /tmp | grep metrics
> -rw-rw-r-- 1 foo   bar   1.4G Sep 28 08:57 metrics_indented.json
> -rw-rw-r-- 1 foo   bar   177K Sep 28 08:59 metrics_not_indented.json
>
> ❯ grep -o ' ' /tmp/metrics_indented.json | wc -l
> 1449499825
> ```
>
> In my opinion, Solr 9.3 can't be monitored and is therefore unfit to run.
>
> I'll be AFK for the next few days but am happy to lend a hand with a new
> release next week. I'd need a lot of help, though.
>
> Thanks,
> Chris
>


Re: [DISCUSS] 9.4 release

2023-09-28 Thread Anshum Gupta
I don't like holding up releases, but it's nice to not have too many
releases from an operational standpoint. If fixing Solr for the Lucene
upgrade will take time, I think it's worth the trade-off and moving forward
with the older version of Lucene.

On Thu, Sep 28, 2023 at 6:05 AM Jan Høydahl  wrote:

> Can I propose we do NOT hold the 9.4 release to add the (too fresh) Lucene
> 9.8? We can do a rapid 9.5 with any benefits reaped from the new Lucene
> version.
>
> Jan
>
> > 28. sep. 2023 kl. 00:36 skrev Alex Deparvu :
> >
> > Hi,
> >
> > Some updates to share on the upgrade.
> > I have identified a cause for most of the failures and pushed a fix. this
> > comment has all the details if anyone is interested in taking a look
> > https://github.com/apache/solr/pull/1958#issuecomment-1736170176
> > I have also sent an email to lucene dev list to explain my findings and
> > validate with them some of the observations I had
> > https://lists.apache.org/thread/1gs3nsv1mcns1czdtdnqyz84f31tqm2x
> >
> > There are still some tests failing all in the vector search area I will
> > look at next.
> >
> > best,
> > alex
> >
> >
> >
> >
> > On Tue, Sep 26, 2023 at 6:58 AM Alex Deparvu 
> wrote:
> >
> >> Hi,
> >>
> >> It seems a lot of the upgrade failures are somehow related to
> >> the CollapsingQParser (
> >>
> https://solr.apache.org/guide/solr/latest/query-guide/collapse-and-expand-results.html
> >> ).
> >> If anyone is familiar with this code, I would appreciate a look at the
> PR,
> >> maybe something pops up.
> >>
> >> best
> >> alex
> >>
> >>
> >>
> >>
> >> On Mon, Sep 25, 2023 at 3:18 PM Alex Deparvu 
> wrote:
> >>
> >>> Hi,
> >>>
> >>> To prepare for the release I opened an 'early' Lucene 9.8.0 upgrade PR
> >>> for review. There is a large number of tests failing, if anyone has
> some
> >>> time I would appreciate a hand.
> >>> Tracking failures here
> >>> https://github.com/apache/solr/pull/1958#issuecomment-1734473783
> >>>
> >>>
> >>> best,
> >>> alex
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> On Mon, Sep 18, 2023 at 1:23 PM Alex Deparvu 
> >>> wrote:
> >>>
>  Good call Houston. I have created a Jira for the Lucene 9.8 upgrade
> and
>  marked it as blocker for Solr 9.4
>  I will take a look once the Lucene release is out, if no one else
> picks
>  it up first.
> 
>  https://issues.apache.org/jira/browse/SOLR-16985
> 
>  best
>  alex
> 
> 
>  On Mon, Sep 18, 2023 at 7:42 AM Houston Putman 
>  wrote:
> 
> > It looks like the next Lucene version might be released soon, so we
> may
> > want to wait for that. It will come with Java 21 support for the
> > vector/memory map stuff.
> >
> > - Houston
> >
> > On Thu, Sep 14, 2023 at 10:53 PM Ishan Chattopadhyaya <
> > ichattopadhy...@gmail.com> wrote:
> >
> >> Thanks Alex and Jan!
> >>
> >> On Fri, 15 Sept, 2023, 2:10 am Jan Høydahl, 
> > wrote:
> >>
> >>> Sure, it's all yours..
> >>> You'll find what you need in the Release Wizard. Just run this
> > script to
> >>> get going.
> >>>
> >>
> >
> https://github.com/apache/solr/blob/main/dev-tools/scripts/releaseWizard.py
> >>>
> >>> Jan
> >>>
>  14. sep. 2023 kl. 21:53 skrev Alex Deparvu  >> :
> 
>  Hi,
> 
>  I would be happy to give this a go (if provided ample hand
> > holding).
> 
> 
>  best,
>  alex
> 
> 
> 
>  On Thu, Sep 14, 2023 at 9:32 AM Jan Høydahl <
> > jan@cominvent.com>
> >>> wrote:
> 
> > Hi,
> >
> > Branch_9x has accumulated 4 features, 18 improvements, 2
> >> optimizations,
> >>> 21
> > bug fixes, 7 "other", and a bunch of dependency updates. It's
> > been
> >>> almost 2
> > months since 9.3.
> >
> > I propose cutting the branch and preparing first RC on Tuesday
> > Sept
> >>> 26th,
> > twelve days from today.
> >
> > I volunteer as RM, but will yield if one of our new committers
> > wants
> >> to
> > try the Release Manager role!
> >
> > Jan
> >
> > -
> > To unsubscribe, e-mail: dev-unsubscr...@solr.apache.org
> > For additional commands, e-mail: dev-h...@solr.apache.org
> >
> >
> >>>
> >>>
> >>
> >
> 
>
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@solr.apache.org
> For additional commands, e-mail: dev-h...@solr.apache.org
>
>

-- 
Anshum Gupta


Re: [DISCUSS] 9.4 release

2023-09-28 Thread Christine Poerschke (BLOOMBERG/ LONDON)
Hello,

I have no strong views on Lucene 9.7 or Lucene 9.8 for Solr 9.4 but if it's not 
too late to ask, I'd love to see the (small) 
https://github.com/apache/solr/pull/1950 change for 
https://issues.apache.org/jira/browse/SOLR-16994 considered for being in the 
9.4 release.

Thanks,
Christine

From: dev@solr.apache.org At: 09/28/23 14:05:25 UTC+1:00To:  dev@solr.apache.org
Subject: Re: [DISCUSS] 9.4 release

Can I propose we do NOT hold the 9.4 release to add the (too fresh) Lucene 9.8? 
We can do a rapid 9.5 with any benefits reaped from the new Lucene version.

Jan

> 28. sep. 2023 kl. 00:36 skrev Alex Deparvu :
> 
> Hi,
> 
> Some updates to share on the upgrade.
> I have identified a cause for most of the failures and pushed a fix. this
> comment has all the details if anyone is interested in taking a look
> https://github.com/apache/solr/pull/1958#issuecomment-1736170176
> I have also sent an email to lucene dev list to explain my findings and
> validate with them some of the observations I had
> https://lists.apache.org/thread/1gs3nsv1mcns1czdtdnqyz84f31tqm2x
> 
> There are still some tests failing all in the vector search area I will
> look at next.
> 
> best,
> alex
> 
> 
> 
> 
> On Tue, Sep 26, 2023 at 6:58 AM Alex Deparvu  wrote:
> 
>> Hi,
>> 
>> It seems a lot of the upgrade failures are somehow related to
>> the CollapsingQParser (
>> 
https://solr.apache.org/guide/solr/latest/query-guide/collapse-and-expand-result
s.html
>> ).
>> If anyone is familiar with this code, I would appreciate a look at the PR,
>> maybe something pops up.
>> 
>> best
>> alex
>> 
>> 
>> 
>> 
>> On Mon, Sep 25, 2023 at 3:18 PM Alex Deparvu  wrote:
>> 
>>> Hi,
>>> 
>>> To prepare for the release I opened an 'early' Lucene 9.8.0 upgrade PR
>>> for review. There is a large number of tests failing, if anyone has some
>>> time I would appreciate a hand.
>>> Tracking failures here
>>> https://github.com/apache/solr/pull/1958#issuecomment-1734473783
>>> 
>>> 
>>> best,
>>> alex
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> On Mon, Sep 18, 2023 at 1:23 PM Alex Deparvu 
>>> wrote:
>>> 
>>>> Good call Houston. I have created a Jira for the Lucene 9.8 upgrade and
>>>> marked it as blocker for Solr 9.4
>>>> I will take a look once the Lucene release is out, if no one else picks
>>>> it up first.
>>>> 
>>>> https://issues.apache.org/jira/browse/SOLR-16985
>>>> 
>>>> best
>>>> alex
>>>> 
>>>> 
>>>> On Mon, Sep 18, 2023 at 7:42 AM Houston Putman 
>>>> wrote:
>>>> 
>>>>> It looks like the next Lucene version might be released soon, so we may
>>>>> want to wait for that. It will come with Java 21 support for the
>>>>> vector/memory map stuff.
>>>>> 
>>>>> - Houston
>>>>> 
>>>>> On Thu, Sep 14, 2023 at 10:53 PM Ishan Chattopadhyaya <
>>>>> ichattopadhy...@gmail.com> wrote:
>>>>> 
>>>>>> Thanks Alex and Jan!
>>>>>> 
>>>>>> On Fri, 15 Sept, 2023, 2:10 am Jan Høydahl, 
>>>>> wrote:
>>>>>> 
>>>>>>> Sure, it's all yours..
>>>>>>> You'll find what you need in the Release Wizard. Just run this
>>>>> script to
>>>>>>> get going.
>>>>>>> 
>>>>>> 
>>>>> 
https://github.com/apache/solr/blob/main/dev-tools/scripts/releaseWizard.py
>>>>>>> 
>>>>>>> Jan
>>>>>>> 
>>>>>>>> 14. sep. 2023 kl. 21:53 skrev Alex Deparvu >>>>> :
>>>>>>>> 
>>>>>>>> Hi,
>>>>>>>> 
>>>>>>>> I would be happy to give this a go (if provided ample hand
>>>>> holding).
>>>>>>>> 
>>>>>>>> 
>>>>>>>> best,
>>>>>>>> alex
>>>>>>>> 
>>>>>>>> 
>>>>>>>> 
>>>>>>>> On Thu, Sep 14, 2023 at 9:32 AM Jan Høydahl <
>>>>> jan@cominvent.com>
>>>>>>> wrote:
>>>>>>>> 
>>>>>>>>> Hi,
>>>>>>>>> 
>>>>>>>>> Branch_9x has accumulated 4 features, 18 improvements, 2
>>>>>> optimizations,
>>>>>>> 21
>>>>>>>>> bug fixes, 7 "other", and a bunch of dependency updates. It's
>>>>> been
>>>>>>> almost 2
>>>>>>>>> months since 9.3.
>>>>>>>>> 
>>>>>>>>> I propose cutting the branch and preparing first RC on Tuesday
>>>>> Sept
>>>>>>> 26th,
>>>>>>>>> twelve days from today.
>>>>>>>>> 
>>>>>>>>> I volunteer as RM, but will yield if one of our new committers
>>>>> wants
>>>>>> to
>>>>>>>>> try the Release Manager role!
>>>>>>>>> 
>>>>>>>>> Jan
>>>>>>>>> 
>>>>> -
>>>>>>>>> To unsubscribe, e-mail: dev-unsubscr...@solr.apache.org
>>>>>>>>> For additional commands, e-mail: dev-h...@solr.apache.org
>>>>>>>>> 
>>>>>>>>> 
>>>>>>> 
>>>>>>> 
>>>>>> 
>>>>> 
>>>> 


-
To unsubscribe, e-mail: dev-unsubscr...@solr.apache.org
For additional commands, e-mail: dev-h...@solr.apache.org




RE: Re: [DISCUSS] 9.4 release

2023-09-28 Thread Chris Schomaker
I'd like to raise an issue that I'm having with Solr 9.3 that might make a
good case for getting another release (9.3.1 or 9.4) out soon.

I've had a 9.3 cluster of 180 nodes up and running for about a week. After
the weekend, I noticed that metrics from the cluster were failing to ship.
Upon investigation, I found that the payload coming back from
`/solr/admin/metrics` was over a GB in size. I also saw query responses had
ballooned in size to tens of MB and the UI was slow. I captured query
responses in the browser, with curl and in a packet capture. In all cases,
there were a large amount of space characters. This can be seen in the
brower's network inspector when clicking around the UI, as well (make sure
to disable pretty print).

This all lead me to SOLR-16925. I have a fix in place for query results but
the admin endpoints like `/solr/admin/metrics` are still experiencing the
issue. You can simply pass `&indent=off` to the endpoints and the
whitespace issue goes away. However, I can't figure out a way to configure
Solr to use this default param with the CoreAdminHandler. The Solr Prom
Exporter could be reconfigured to include this param but that's a lot of
configuration to add. There's no way to reconfigure the UI.

Here's a good illustration of the issue:

```
❯ curl --user 'foo:bar' "http://localhost:8983/solr/admin/metrics"; >
/tmp/metrics_indented.json

❯ curl --user 'foo:bar' "http://localhost:8983/solr/admin/metrics?indent=off";
> /tmp/metrics_not_indented.json

❯ ls -lh /tmp | grep metrics
-rw-rw-r-- 1 foo   bar   1.4G Sep 28 08:57 metrics_indented.json
-rw-rw-r-- 1 foo   bar   177K Sep 28 08:59 metrics_not_indented.json

❯ grep -o ' ' /tmp/metrics_indented.json | wc -l
1449499825
```

In my opinion, Solr 9.3 can't be monitored and is therefore unfit to run.

I'll be AFK for the next few days but am happy to lend a hand with a new
release next week. I'd need a lot of help, though.

Thanks,
Chris


Re: [DISCUSS] 9.4 release

2023-09-28 Thread Jan Høydahl
Can I propose we do NOT hold the 9.4 release to add the (too fresh) Lucene 9.8? 
We can do a rapid 9.5 with any benefits reaped from the new Lucene version.

Jan

> 28. sep. 2023 kl. 00:36 skrev Alex Deparvu :
> 
> Hi,
> 
> Some updates to share on the upgrade.
> I have identified a cause for most of the failures and pushed a fix. this
> comment has all the details if anyone is interested in taking a look
> https://github.com/apache/solr/pull/1958#issuecomment-1736170176
> I have also sent an email to lucene dev list to explain my findings and
> validate with them some of the observations I had
> https://lists.apache.org/thread/1gs3nsv1mcns1czdtdnqyz84f31tqm2x
> 
> There are still some tests failing all in the vector search area I will
> look at next.
> 
> best,
> alex
> 
> 
> 
> 
> On Tue, Sep 26, 2023 at 6:58 AM Alex Deparvu  wrote:
> 
>> Hi,
>> 
>> It seems a lot of the upgrade failures are somehow related to
>> the CollapsingQParser (
>> https://solr.apache.org/guide/solr/latest/query-guide/collapse-and-expand-results.html
>> ).
>> If anyone is familiar with this code, I would appreciate a look at the PR,
>> maybe something pops up.
>> 
>> best
>> alex
>> 
>> 
>> 
>> 
>> On Mon, Sep 25, 2023 at 3:18 PM Alex Deparvu  wrote:
>> 
>>> Hi,
>>> 
>>> To prepare for the release I opened an 'early' Lucene 9.8.0 upgrade PR
>>> for review. There is a large number of tests failing, if anyone has some
>>> time I would appreciate a hand.
>>> Tracking failures here
>>> https://github.com/apache/solr/pull/1958#issuecomment-1734473783
>>> 
>>> 
>>> best,
>>> alex
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> On Mon, Sep 18, 2023 at 1:23 PM Alex Deparvu 
>>> wrote:
>>> 
 Good call Houston. I have created a Jira for the Lucene 9.8 upgrade and
 marked it as blocker for Solr 9.4
 I will take a look once the Lucene release is out, if no one else picks
 it up first.
 
 https://issues.apache.org/jira/browse/SOLR-16985
 
 best
 alex
 
 
 On Mon, Sep 18, 2023 at 7:42 AM Houston Putman 
 wrote:
 
> It looks like the next Lucene version might be released soon, so we may
> want to wait for that. It will come with Java 21 support for the
> vector/memory map stuff.
> 
> - Houston
> 
> On Thu, Sep 14, 2023 at 10:53 PM Ishan Chattopadhyaya <
> ichattopadhy...@gmail.com> wrote:
> 
>> Thanks Alex and Jan!
>> 
>> On Fri, 15 Sept, 2023, 2:10 am Jan Høydahl, 
> wrote:
>> 
>>> Sure, it's all yours..
>>> You'll find what you need in the Release Wizard. Just run this
> script to
>>> get going.
>>> 
>> 
> https://github.com/apache/solr/blob/main/dev-tools/scripts/releaseWizard.py
>>> 
>>> Jan
>>> 
 14. sep. 2023 kl. 21:53 skrev Alex Deparvu > :
 
 Hi,
 
 I would be happy to give this a go (if provided ample hand
> holding).
 
 
 best,
 alex
 
 
 
 On Thu, Sep 14, 2023 at 9:32 AM Jan Høydahl <
> jan@cominvent.com>
>>> wrote:
 
> Hi,
> 
> Branch_9x has accumulated 4 features, 18 improvements, 2
>> optimizations,
>>> 21
> bug fixes, 7 "other", and a bunch of dependency updates. It's
> been
>>> almost 2
> months since 9.3.
> 
> I propose cutting the branch and preparing first RC on Tuesday
> Sept
>>> 26th,
> twelve days from today.
> 
> I volunteer as RM, but will yield if one of our new committers
> wants
>> to
> try the Release Manager role!
> 
> Jan
> 
> -
> To unsubscribe, e-mail: dev-unsubscr...@solr.apache.org
> For additional commands, e-mail: dev-h...@solr.apache.org
> 
> 
>>> 
>>> 
>> 
> 
 


-
To unsubscribe, e-mail: dev-unsubscr...@solr.apache.org
For additional commands, e-mail: dev-h...@solr.apache.org



Re: [DISCUSS] 9.4 release

2023-09-27 Thread Alex Deparvu
Hi,

Some updates to share on the upgrade.
I have identified a cause for most of the failures and pushed a fix. this
comment has all the details if anyone is interested in taking a look
https://github.com/apache/solr/pull/1958#issuecomment-1736170176
I have also sent an email to lucene dev list to explain my findings and
validate with them some of the observations I had
https://lists.apache.org/thread/1gs3nsv1mcns1czdtdnqyz84f31tqm2x

There are still some tests failing all in the vector search area I will
look at next.

best,
alex




On Tue, Sep 26, 2023 at 6:58 AM Alex Deparvu  wrote:

> Hi,
>
> It seems a lot of the upgrade failures are somehow related to
> the CollapsingQParser (
> https://solr.apache.org/guide/solr/latest/query-guide/collapse-and-expand-results.html
> ).
> If anyone is familiar with this code, I would appreciate a look at the PR,
> maybe something pops up.
>
> best
> alex
>
>
>
>
> On Mon, Sep 25, 2023 at 3:18 PM Alex Deparvu  wrote:
>
>> Hi,
>>
>> To prepare for the release I opened an 'early' Lucene 9.8.0 upgrade PR
>> for review. There is a large number of tests failing, if anyone has some
>> time I would appreciate a hand.
>> Tracking failures here
>> https://github.com/apache/solr/pull/1958#issuecomment-1734473783
>>
>>
>> best,
>> alex
>>
>>
>>
>>
>>
>>
>> On Mon, Sep 18, 2023 at 1:23 PM Alex Deparvu 
>> wrote:
>>
>>> Good call Houston. I have created a Jira for the Lucene 9.8 upgrade and
>>> marked it as blocker for Solr 9.4
>>> I will take a look once the Lucene release is out, if no one else picks
>>> it up first.
>>>
>>> https://issues.apache.org/jira/browse/SOLR-16985
>>>
>>> best
>>> alex
>>>
>>>
>>> On Mon, Sep 18, 2023 at 7:42 AM Houston Putman 
>>> wrote:
>>>
 It looks like the next Lucene version might be released soon, so we may
 want to wait for that. It will come with Java 21 support for the
 vector/memory map stuff.

 - Houston

 On Thu, Sep 14, 2023 at 10:53 PM Ishan Chattopadhyaya <
 ichattopadhy...@gmail.com> wrote:

 > Thanks Alex and Jan!
 >
 > On Fri, 15 Sept, 2023, 2:10 am Jan Høydahl, 
 wrote:
 >
 > > Sure, it's all yours..
 > > You'll find what you need in the Release Wizard. Just run this
 script to
 > > get going.
 > >
 >
 https://github.com/apache/solr/blob/main/dev-tools/scripts/releaseWizard.py
 > >
 > > Jan
 > >
 > > > 14. sep. 2023 kl. 21:53 skrev Alex Deparvu >>> >:
 > > >
 > > > Hi,
 > > >
 > > > I would be happy to give this a go (if provided ample hand
 holding).
 > > >
 > > >
 > > > best,
 > > > alex
 > > >
 > > >
 > > >
 > > > On Thu, Sep 14, 2023 at 9:32 AM Jan Høydahl <
 jan@cominvent.com>
 > > wrote:
 > > >
 > > >> Hi,
 > > >>
 > > >> Branch_9x has accumulated 4 features, 18 improvements, 2
 > optimizations,
 > > 21
 > > >> bug fixes, 7 "other", and a bunch of dependency updates. It's
 been
 > > almost 2
 > > >> months since 9.3.
 > > >>
 > > >> I propose cutting the branch and preparing first RC on Tuesday
 Sept
 > > 26th,
 > > >> twelve days from today.
 > > >>
 > > >> I volunteer as RM, but will yield if one of our new committers
 wants
 > to
 > > >> try the Release Manager role!
 > > >>
 > > >> Jan
 > > >>
 -
 > > >> To unsubscribe, e-mail: dev-unsubscr...@solr.apache.org
 > > >> For additional commands, e-mail: dev-h...@solr.apache.org
 > > >>
 > > >>
 > >
 > >
 >

>>>


Re: [DISCUSS] 9.4 release

2023-09-26 Thread Alex Deparvu
Hi,

It seems a lot of the upgrade failures are somehow related to
the CollapsingQParser (
https://solr.apache.org/guide/solr/latest/query-guide/collapse-and-expand-results.html
).
If anyone is familiar with this code, I would appreciate a look at the PR,
maybe something pops up.

best
alex




On Mon, Sep 25, 2023 at 3:18 PM Alex Deparvu  wrote:

> Hi,
>
> To prepare for the release I opened an 'early' Lucene 9.8.0 upgrade PR for
> review. There is a large number of tests failing, if anyone has some time I
> would appreciate a hand.
> Tracking failures here
> https://github.com/apache/solr/pull/1958#issuecomment-1734473783
>
>
> best,
> alex
>
>
>
>
>
>
> On Mon, Sep 18, 2023 at 1:23 PM Alex Deparvu  wrote:
>
>> Good call Houston. I have created a Jira for the Lucene 9.8 upgrade and
>> marked it as blocker for Solr 9.4
>> I will take a look once the Lucene release is out, if no one else picks
>> it up first.
>>
>> https://issues.apache.org/jira/browse/SOLR-16985
>>
>> best
>> alex
>>
>>
>> On Mon, Sep 18, 2023 at 7:42 AM Houston Putman 
>> wrote:
>>
>>> It looks like the next Lucene version might be released soon, so we may
>>> want to wait for that. It will come with Java 21 support for the
>>> vector/memory map stuff.
>>>
>>> - Houston
>>>
>>> On Thu, Sep 14, 2023 at 10:53 PM Ishan Chattopadhyaya <
>>> ichattopadhy...@gmail.com> wrote:
>>>
>>> > Thanks Alex and Jan!
>>> >
>>> > On Fri, 15 Sept, 2023, 2:10 am Jan Høydahl, 
>>> wrote:
>>> >
>>> > > Sure, it's all yours..
>>> > > You'll find what you need in the Release Wizard. Just run this
>>> script to
>>> > > get going.
>>> > >
>>> >
>>> https://github.com/apache/solr/blob/main/dev-tools/scripts/releaseWizard.py
>>> > >
>>> > > Jan
>>> > >
>>> > > > 14. sep. 2023 kl. 21:53 skrev Alex Deparvu :
>>> > > >
>>> > > > Hi,
>>> > > >
>>> > > > I would be happy to give this a go (if provided ample hand
>>> holding).
>>> > > >
>>> > > >
>>> > > > best,
>>> > > > alex
>>> > > >
>>> > > >
>>> > > >
>>> > > > On Thu, Sep 14, 2023 at 9:32 AM Jan Høydahl >> >
>>> > > wrote:
>>> > > >
>>> > > >> Hi,
>>> > > >>
>>> > > >> Branch_9x has accumulated 4 features, 18 improvements, 2
>>> > optimizations,
>>> > > 21
>>> > > >> bug fixes, 7 "other", and a bunch of dependency updates. It's been
>>> > > almost 2
>>> > > >> months since 9.3.
>>> > > >>
>>> > > >> I propose cutting the branch and preparing first RC on Tuesday
>>> Sept
>>> > > 26th,
>>> > > >> twelve days from today.
>>> > > >>
>>> > > >> I volunteer as RM, but will yield if one of our new committers
>>> wants
>>> > to
>>> > > >> try the Release Manager role!
>>> > > >>
>>> > > >> Jan
>>> > > >>
>>> -
>>> > > >> To unsubscribe, e-mail: dev-unsubscr...@solr.apache.org
>>> > > >> For additional commands, e-mail: dev-h...@solr.apache.org
>>> > > >>
>>> > > >>
>>> > >
>>> > >
>>> >
>>>
>>


Re: [DISCUSS] 9.4 release

2023-09-25 Thread Alex Deparvu
Hi,

To prepare for the release I opened an 'early' Lucene 9.8.0 upgrade PR for
review. There is a large number of tests failing, if anyone has some time I
would appreciate a hand.
Tracking failures here
https://github.com/apache/solr/pull/1958#issuecomment-1734473783


best,
alex






On Mon, Sep 18, 2023 at 1:23 PM Alex Deparvu  wrote:

> Good call Houston. I have created a Jira for the Lucene 9.8 upgrade and
> marked it as blocker for Solr 9.4
> I will take a look once the Lucene release is out, if no one else picks it
> up first.
>
> https://issues.apache.org/jira/browse/SOLR-16985
>
> best
> alex
>
>
> On Mon, Sep 18, 2023 at 7:42 AM Houston Putman  wrote:
>
>> It looks like the next Lucene version might be released soon, so we may
>> want to wait for that. It will come with Java 21 support for the
>> vector/memory map stuff.
>>
>> - Houston
>>
>> On Thu, Sep 14, 2023 at 10:53 PM Ishan Chattopadhyaya <
>> ichattopadhy...@gmail.com> wrote:
>>
>> > Thanks Alex and Jan!
>> >
>> > On Fri, 15 Sept, 2023, 2:10 am Jan Høydahl, 
>> wrote:
>> >
>> > > Sure, it's all yours..
>> > > You'll find what you need in the Release Wizard. Just run this script
>> to
>> > > get going.
>> > >
>> >
>> https://github.com/apache/solr/blob/main/dev-tools/scripts/releaseWizard.py
>> > >
>> > > Jan
>> > >
>> > > > 14. sep. 2023 kl. 21:53 skrev Alex Deparvu :
>> > > >
>> > > > Hi,
>> > > >
>> > > > I would be happy to give this a go (if provided ample hand holding).
>> > > >
>> > > >
>> > > > best,
>> > > > alex
>> > > >
>> > > >
>> > > >
>> > > > On Thu, Sep 14, 2023 at 9:32 AM Jan Høydahl 
>> > > wrote:
>> > > >
>> > > >> Hi,
>> > > >>
>> > > >> Branch_9x has accumulated 4 features, 18 improvements, 2
>> > optimizations,
>> > > 21
>> > > >> bug fixes, 7 "other", and a bunch of dependency updates. It's been
>> > > almost 2
>> > > >> months since 9.3.
>> > > >>
>> > > >> I propose cutting the branch and preparing first RC on Tuesday Sept
>> > > 26th,
>> > > >> twelve days from today.
>> > > >>
>> > > >> I volunteer as RM, but will yield if one of our new committers
>> wants
>> > to
>> > > >> try the Release Manager role!
>> > > >>
>> > > >> Jan
>> > > >>
>> -
>> > > >> To unsubscribe, e-mail: dev-unsubscr...@solr.apache.org
>> > > >> For additional commands, e-mail: dev-h...@solr.apache.org
>> > > >>
>> > > >>
>> > >
>> > >
>> >
>>
>


Re: [DISCUSS] 9.4 release

2023-09-18 Thread Alex Deparvu
Good call Houston. I have created a Jira for the Lucene 9.8 upgrade and
marked it as blocker for Solr 9.4
I will take a look once the Lucene release is out, if no one else picks it
up first.

https://issues.apache.org/jira/browse/SOLR-16985

best
alex


On Mon, Sep 18, 2023 at 7:42 AM Houston Putman  wrote:

> It looks like the next Lucene version might be released soon, so we may
> want to wait for that. It will come with Java 21 support for the
> vector/memory map stuff.
>
> - Houston
>
> On Thu, Sep 14, 2023 at 10:53 PM Ishan Chattopadhyaya <
> ichattopadhy...@gmail.com> wrote:
>
> > Thanks Alex and Jan!
> >
> > On Fri, 15 Sept, 2023, 2:10 am Jan Høydahl, 
> wrote:
> >
> > > Sure, it's all yours..
> > > You'll find what you need in the Release Wizard. Just run this script
> to
> > > get going.
> > >
> >
> https://github.com/apache/solr/blob/main/dev-tools/scripts/releaseWizard.py
> > >
> > > Jan
> > >
> > > > 14. sep. 2023 kl. 21:53 skrev Alex Deparvu :
> > > >
> > > > Hi,
> > > >
> > > > I would be happy to give this a go (if provided ample hand holding).
> > > >
> > > >
> > > > best,
> > > > alex
> > > >
> > > >
> > > >
> > > > On Thu, Sep 14, 2023 at 9:32 AM Jan Høydahl 
> > > wrote:
> > > >
> > > >> Hi,
> > > >>
> > > >> Branch_9x has accumulated 4 features, 18 improvements, 2
> > optimizations,
> > > 21
> > > >> bug fixes, 7 "other", and a bunch of dependency updates. It's been
> > > almost 2
> > > >> months since 9.3.
> > > >>
> > > >> I propose cutting the branch and preparing first RC on Tuesday Sept
> > > 26th,
> > > >> twelve days from today.
> > > >>
> > > >> I volunteer as RM, but will yield if one of our new committers wants
> > to
> > > >> try the Release Manager role!
> > > >>
> > > >> Jan
> > > >>
> -
> > > >> To unsubscribe, e-mail: dev-unsubscr...@solr.apache.org
> > > >> For additional commands, e-mail: dev-h...@solr.apache.org
> > > >>
> > > >>
> > >
> > >
> >
>


Re: [DISCUSS] 9.4 release

2023-09-18 Thread Houston Putman
It looks like the next Lucene version might be released soon, so we may
want to wait for that. It will come with Java 21 support for the
vector/memory map stuff.

- Houston

On Thu, Sep 14, 2023 at 10:53 PM Ishan Chattopadhyaya <
ichattopadhy...@gmail.com> wrote:

> Thanks Alex and Jan!
>
> On Fri, 15 Sept, 2023, 2:10 am Jan Høydahl,  wrote:
>
> > Sure, it's all yours..
> > You'll find what you need in the Release Wizard. Just run this script to
> > get going.
> >
> https://github.com/apache/solr/blob/main/dev-tools/scripts/releaseWizard.py
> >
> > Jan
> >
> > > 14. sep. 2023 kl. 21:53 skrev Alex Deparvu :
> > >
> > > Hi,
> > >
> > > I would be happy to give this a go (if provided ample hand holding).
> > >
> > >
> > > best,
> > > alex
> > >
> > >
> > >
> > > On Thu, Sep 14, 2023 at 9:32 AM Jan Høydahl 
> > wrote:
> > >
> > >> Hi,
> > >>
> > >> Branch_9x has accumulated 4 features, 18 improvements, 2
> optimizations,
> > 21
> > >> bug fixes, 7 "other", and a bunch of dependency updates. It's been
> > almost 2
> > >> months since 9.3.
> > >>
> > >> I propose cutting the branch and preparing first RC on Tuesday Sept
> > 26th,
> > >> twelve days from today.
> > >>
> > >> I volunteer as RM, but will yield if one of our new committers wants
> to
> > >> try the Release Manager role!
> > >>
> > >> Jan
> > >> -
> > >> To unsubscribe, e-mail: dev-unsubscr...@solr.apache.org
> > >> For additional commands, e-mail: dev-h...@solr.apache.org
> > >>
> > >>
> >
> >
>


Re: [DISCUSS] 9.4 release

2023-09-14 Thread Ishan Chattopadhyaya
Thanks Alex and Jan!

On Fri, 15 Sept, 2023, 2:10 am Jan Høydahl,  wrote:

> Sure, it's all yours..
> You'll find what you need in the Release Wizard. Just run this script to
> get going.
> https://github.com/apache/solr/blob/main/dev-tools/scripts/releaseWizard.py
>
> Jan
>
> > 14. sep. 2023 kl. 21:53 skrev Alex Deparvu :
> >
> > Hi,
> >
> > I would be happy to give this a go (if provided ample hand holding).
> >
> >
> > best,
> > alex
> >
> >
> >
> > On Thu, Sep 14, 2023 at 9:32 AM Jan Høydahl 
> wrote:
> >
> >> Hi,
> >>
> >> Branch_9x has accumulated 4 features, 18 improvements, 2 optimizations,
> 21
> >> bug fixes, 7 "other", and a bunch of dependency updates. It's been
> almost 2
> >> months since 9.3.
> >>
> >> I propose cutting the branch and preparing first RC on Tuesday Sept
> 26th,
> >> twelve days from today.
> >>
> >> I volunteer as RM, but will yield if one of our new committers wants to
> >> try the Release Manager role!
> >>
> >> Jan
> >> -
> >> To unsubscribe, e-mail: dev-unsubscr...@solr.apache.org
> >> For additional commands, e-mail: dev-h...@solr.apache.org
> >>
> >>
>
>


Re: [DISCUSS] 9.4 release

2023-09-14 Thread Jan Høydahl
Sure, it's all yours..
You'll find what you need in the Release Wizard. Just run this script to get 
going.
https://github.com/apache/solr/blob/main/dev-tools/scripts/releaseWizard.py

Jan

> 14. sep. 2023 kl. 21:53 skrev Alex Deparvu :
> 
> Hi,
> 
> I would be happy to give this a go (if provided ample hand holding).
> 
> 
> best,
> alex
> 
> 
> 
> On Thu, Sep 14, 2023 at 9:32 AM Jan Høydahl  wrote:
> 
>> Hi,
>> 
>> Branch_9x has accumulated 4 features, 18 improvements, 2 optimizations, 21
>> bug fixes, 7 "other", and a bunch of dependency updates. It's been almost 2
>> months since 9.3.
>> 
>> I propose cutting the branch and preparing first RC on Tuesday Sept 26th,
>> twelve days from today.
>> 
>> I volunteer as RM, but will yield if one of our new committers wants to
>> try the Release Manager role!
>> 
>> Jan
>> -
>> To unsubscribe, e-mail: dev-unsubscr...@solr.apache.org
>> For additional commands, e-mail: dev-h...@solr.apache.org
>> 
>> 



Re: [DISCUSS] 9.4 release

2023-09-14 Thread Alex Deparvu
Hi,

I would be happy to give this a go (if provided ample hand holding).


best,
alex



On Thu, Sep 14, 2023 at 9:32 AM Jan Høydahl  wrote:

> Hi,
>
> Branch_9x has accumulated 4 features, 18 improvements, 2 optimizations, 21
> bug fixes, 7 "other", and a bunch of dependency updates. It's been almost 2
> months since 9.3.
>
> I propose cutting the branch and preparing first RC on Tuesday Sept 26th,
> twelve days from today.
>
> I volunteer as RM, but will yield if one of our new committers wants to
> try the Release Manager role!
>
> Jan
> -
> To unsubscribe, e-mail: dev-unsubscr...@solr.apache.org
> For additional commands, e-mail: dev-h...@solr.apache.org
>
>