Re: Now that 8.10 is out ... let's get rolling on 9!

2021-09-30 Thread Jan Høydahl
I don't think the wizard in lucene-solr repo is prepared to check out the new 
solr.git/main and lucene.git/main to run addVersion and backcompat stuff, so 
this likely needs to be done manually during an 8.x release?

Jan

> 30. sep. 2021 kl. 17:25 skrev Timothy Potter :
> 
> I don't know what creates that 8.10 version constant? I didn't skip
> any steps afaik except for this
> https://issues.apache.org/jira/browse/LUCENE-10131 ... could this step
> failing be the cause of the missing version 8.10?
> 
> On Thu, Sep 30, 2021 at 5:45 AM Alan Woodward  wrote:
>> 
>> +1 to start pushing for a 9.0 release.
>> 
>> There isn’t an 8.10 version constant in the 9.0 branch at the moment - are 
>> there some release tasks that have been missed?
>> 
>>> On 29 Sep 2021, at 17:58, Timothy Potter  wrote:
>>> 
>>> Hi Folks,
>>> 
>>> Having just finished up the 8.10 release, it feels like this is a good
>>> time to start pushing harder for a 9.0 release.
>>> 
>>> There are so many improvements in the 9 (main) branches and
>>> backporting features to 8x is becoming onerous. I realize Solr needs a
>>> Lucene 9 release before it can proceed. I'm seeing one open blocker on
>>> the Lucene side: https://issues.apache.org/jira/browse/LUCENE-8638
>>> 
>>> Can we at least start to nail down a more concrete timeline on a 9.0 
>>> release?
>>> 
>>> Cheers,
>>> Tim
>>> 
>>> -
>>> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
>>> For additional commands, e-mail: dev-h...@lucene.apache.org
>>> 
>> 
>> 
>> -
>> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
>> For additional commands, e-mail: dev-h...@lucene.apache.org
>> 
> 
> -
> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> For additional commands, e-mail: dev-h...@lucene.apache.org
> 


-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Now that 8.10 is out ... let's get rolling on 9!

2021-09-30 Thread Timothy Potter
Correction, the PR is https://github.com/apache/lucene/pull/343

On Thu, Sep 30, 2021 at 9:43 AM Timothy Potter  wrote:
>
> I went ahead and added the 8.10 version manually ->
> https://github.com/apache/lucene/pull/342
>
> On Thu, Sep 30, 2021 at 9:25 AM Timothy Potter  wrote:
> >
> > I don't know what creates that 8.10 version constant? I didn't skip
> > any steps afaik except for this
> > https://issues.apache.org/jira/browse/LUCENE-10131 ... could this step
> > failing be the cause of the missing version 8.10?
> >
> > On Thu, Sep 30, 2021 at 5:45 AM Alan Woodward  wrote:
> > >
> > > +1 to start pushing for a 9.0 release.
> > >
> > > There isn’t an 8.10 version constant in the 9.0 branch at the moment - 
> > > are there some release tasks that have been missed?
> > >
> > > > On 29 Sep 2021, at 17:58, Timothy Potter  wrote:
> > > >
> > > > Hi Folks,
> > > >
> > > > Having just finished up the 8.10 release, it feels like this is a good
> > > > time to start pushing harder for a 9.0 release.
> > > >
> > > > There are so many improvements in the 9 (main) branches and
> > > > backporting features to 8x is becoming onerous. I realize Solr needs a
> > > > Lucene 9 release before it can proceed. I'm seeing one open blocker on
> > > > the Lucene side: https://issues.apache.org/jira/browse/LUCENE-8638
> > > >
> > > > Can we at least start to nail down a more concrete timeline on a 9.0 
> > > > release?
> > > >
> > > > Cheers,
> > > > Tim
> > > >
> > > > -
> > > > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> > > > For additional commands, e-mail: dev-h...@lucene.apache.org
> > > >
> > >
> > >
> > > -
> > > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> > > For additional commands, e-mail: dev-h...@lucene.apache.org
> > >

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Now that 8.10 is out ... let's get rolling on 9!

2021-09-30 Thread Timothy Potter
I went ahead and added the 8.10 version manually ->
https://github.com/apache/lucene/pull/342

On Thu, Sep 30, 2021 at 9:25 AM Timothy Potter  wrote:
>
> I don't know what creates that 8.10 version constant? I didn't skip
> any steps afaik except for this
> https://issues.apache.org/jira/browse/LUCENE-10131 ... could this step
> failing be the cause of the missing version 8.10?
>
> On Thu, Sep 30, 2021 at 5:45 AM Alan Woodward  wrote:
> >
> > +1 to start pushing for a 9.0 release.
> >
> > There isn’t an 8.10 version constant in the 9.0 branch at the moment - are 
> > there some release tasks that have been missed?
> >
> > > On 29 Sep 2021, at 17:58, Timothy Potter  wrote:
> > >
> > > Hi Folks,
> > >
> > > Having just finished up the 8.10 release, it feels like this is a good
> > > time to start pushing harder for a 9.0 release.
> > >
> > > There are so many improvements in the 9 (main) branches and
> > > backporting features to 8x is becoming onerous. I realize Solr needs a
> > > Lucene 9 release before it can proceed. I'm seeing one open blocker on
> > > the Lucene side: https://issues.apache.org/jira/browse/LUCENE-8638
> > >
> > > Can we at least start to nail down a more concrete timeline on a 9.0 
> > > release?
> > >
> > > Cheers,
> > > Tim
> > >
> > > -
> > > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> > > For additional commands, e-mail: dev-h...@lucene.apache.org
> > >
> >
> >
> > -
> > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> > For additional commands, e-mail: dev-h...@lucene.apache.org
> >

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Now that 8.10 is out ... let's get rolling on 9!

2021-09-30 Thread Timothy Potter
I don't know what creates that 8.10 version constant? I didn't skip
any steps afaik except for this
https://issues.apache.org/jira/browse/LUCENE-10131 ... could this step
failing be the cause of the missing version 8.10?

On Thu, Sep 30, 2021 at 5:45 AM Alan Woodward  wrote:
>
> +1 to start pushing for a 9.0 release.
>
> There isn’t an 8.10 version constant in the 9.0 branch at the moment - are 
> there some release tasks that have been missed?
>
> > On 29 Sep 2021, at 17:58, Timothy Potter  wrote:
> >
> > Hi Folks,
> >
> > Having just finished up the 8.10 release, it feels like this is a good
> > time to start pushing harder for a 9.0 release.
> >
> > There are so many improvements in the 9 (main) branches and
> > backporting features to 8x is becoming onerous. I realize Solr needs a
> > Lucene 9 release before it can proceed. I'm seeing one open blocker on
> > the Lucene side: https://issues.apache.org/jira/browse/LUCENE-8638
> >
> > Can we at least start to nail down a more concrete timeline on a 9.0 
> > release?
> >
> > Cheers,
> > Tim
> >
> > -
> > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> > For additional commands, e-mail: dev-h...@lucene.apache.org
> >
>
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> For additional commands, e-mail: dev-h...@lucene.apache.org
>

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Lucene 9.0 release

2021-09-30 Thread Jan Høydahl
+1

Blockers seem to be done with. So I guess we just need an RM to get the ball 
rolling? :)

I know that the Release Wizard in new Lucene repo needs some updates 
https://issues.apache.org/jira/browse/LUCENE-9809 - I may help some with that...

Cross-ref other 9.0 release mail-threads: 
- "Now that 8.10 is out ... let's get rolling on 9!" 
https://lists.apache.org/thread.html/r868028d42a19ae02d5bbe2e3329da26869045002b9bb4760b8056c56%40%3Cdev.lucene.apache.org%3E
- "9.0 release": 
https://lists.apache.org/thread.html/r7bef0af668860fdbfedb4b58261efd01d9fb26dc280915284c121065%40%3Cdev.lucene.apache.org%3E

Jan

> 17. aug. 2021 kl. 11:13 skrev Adrien Grand :
> 
> +1 to your suggestions
> 
> I just commented on LUCENE-9959 
>  to suggest reverting 
> since the changes are currently half baked and I don't think that they should 
> block 9.0. There are no other blockers left to my knowledge.
> 
> On Sat, Aug 14, 2021 at 6:24 PM Michael Sokolov  > wrote:
> It's been two years since our last release, we had lots of +1 when we
> raised this last December, and IMO we are close to baked at this
> point.
> 
> I checked JIRA and found two remaining Blockers
> 
> 1. https://issues.apache.org/jira/browse/LUCENE-10016 
> 
> VectorReader.search needs rethought, o.a.l.search integration?
> 2. https://issues.apache.org/jira/browse/LUCENE-8638 
>  Remove deprecated
> code in main
> 
> The first one is very close to resolved;
> 
> On the deprecations, the issue has lingered for 1-1/2 years now, and
> some progress has been made, but more work remains. Some new
> deprecations have been added since it was opened too. Maybe we make a
> concerted effort to clean out as much as we can, and then decide if
> it's enough? Anyway this seems to be the only outstanding issue, so
> let's see if we can make progress there
> 
> Q: any other blockers?
> 
> -
> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org 
> 
> For additional commands, e-mail: dev-h...@lucene.apache.org 
> 
> 
> 
> 
> -- 
> Adrien



Re: Now that 8.10 is out ... let's get rolling on 9!

2021-09-30 Thread Alan Woodward
+1 to start pushing for a 9.0 release.

There isn’t an 8.10 version constant in the 9.0 branch at the moment - are 
there some release tasks that have been missed?

> On 29 Sep 2021, at 17:58, Timothy Potter  wrote:
> 
> Hi Folks,
> 
> Having just finished up the 8.10 release, it feels like this is a good
> time to start pushing harder for a 9.0 release.
> 
> There are so many improvements in the 9 (main) branches and
> backporting features to 8x is becoming onerous. I realize Solr needs a
> Lucene 9 release before it can proceed. I'm seeing one open blocker on
> the Lucene side: https://issues.apache.org/jira/browse/LUCENE-8638
> 
> Can we at least start to nail down a more concrete timeline on a 9.0 release?
> 
> Cheers,
> Tim
> 
> -
> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> For additional commands, e-mail: dev-h...@lucene.apache.org
> 


-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: [JENKINS] Lucene » Lucene-Coverage-main - Build # 180 - Unstable!

2021-09-30 Thread Dawid Weiss
This is a test error - allowed an empty array as input and then tried to
pick a random position from it. Corrected the test.

D.

On Wed, Sep 29, 2021 at 6:10 PM Apache Jenkins Server <
jenk...@builds.apache.org> wrote:

> Build:
> https://ci-builds.apache.org/job/Lucene/job/Lucene-Coverage-main/180/
>
> 1 tests failed.
> FAILED:
> org.apache.lucene.facet.taxonomy.directory.TestDirectoryTaxonomyReader.testCallingBulkPathReturnsCorrectResult
>
> Error Message:
> com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an
> uncaught exception in thread: Thread[id=45, name=Thread-23, state=RUNNABLE,
> group=TGRP-TestDirectoryTaxonomyReader]
>
> Stack Trace:
> com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an
> uncaught exception in thread: Thread[id=45, name=Thread-23, state=RUNNABLE,
> group=TGRP-TestDirectoryTaxonomyReader]
> Caused by: java.lang.IllegalArgumentException: bound must be positive
> at __randomizedtesting.SeedInfo.seed([5AF657A19191EA6F]:0)
> at java.base/java.util.Random.nextInt(Random.java:388)
> at
> com.carrotsearch.randomizedtesting.Xoroshiro128PlusRandom.nextInt(Xoroshiro128PlusRandom.java:73)
> at
> com.carrotsearch.randomizedtesting.AssertingRandom.nextInt(AssertingRandom.java:87)
> at
> org.apache.lucene.facet.taxonomy.directory.TestDirectoryTaxonomyReader$4.run(TestDirectoryTaxonomyReader.java:614)
>
>
>
>
> Build Log:
> [...truncated 653 lines...]
> ERROR: The following test(s) have failed:
>   -
> org.apache.lucene.facet.taxonomy.directory.TestDirectoryTaxonomyReader.testCallingBulkPathReturnsCorrectResult
> (:lucene:facet)
> Test output:
> /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Coverage-main/lucene/facet/build/test-results/test/outputs/OUTPUT-org.apache.lucene.facet.taxonomy.directory.TestDirectoryTaxonomyReader.txt
> Reproduce with: gradlew :lucene:facet:test --tests
> "org.apache.lucene.facet.taxonomy.directory.TestDirectoryTaxonomyReader.testCallingBulkPathReturnsCorrectResult"
> -Ptests.jvms=4 -Ptests.haltonfailure=false
> -Ptests.jvmargs=-XX:TieredStopAtLevel=1 -Ptests.seed=5AF657A19191EA6F
> -Ptests.multiplier=2 -Ptests.badapples=false -Ptests.file.encoding=US-ASCII
>
>
> Deprecated Gradle features were used in this build, making it incompatible
> with Gradle 8.0.
>
> You can use '--warning-mode all' to show the individual deprecation
> warnings and determine if they come from your own scripts or plugins.
>
> See
> https://docs.gradle.org/7.2/userguide/command_line_interface.html#sec:command_line_warnings
>
> BUILD SUCCESSFUL in 17m 25s
> 196 actionable tasks: 196 executed
> Build step 'Invoke Gradle script' changed build result to SUCCESS
> Archiving artifacts
> java.lang.InterruptedException: no matches found within 1
> at hudson.FilePath$ValidateAntFileMask.hasMatch(FilePath.java:3069)
> at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2948)
> at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2929)
> at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3317)
> Also:   hudson.remoting.Channel$CallSiteStackTrace: Remote call to
> lucene-solr-2
> at
> hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1800)
> at
> hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:356)
> at hudson.remoting.Channel.call(Channel.java:1001)
> at hudson.FilePath.act(FilePath.java:1159)
> at hudson.FilePath.act(FilePath.java:1148)
> at hudson.FilePath.validateAntFileMask(FilePath.java:2927)
> at
> hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:270)
> at
> hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:80)
> at
> hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
> at
> hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:803)
> at
> hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:752)
> at hudson.model.Build$BuildExecution.post2(Build.java:177)
> at
> hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:697)
> at hudson.model.Run.execute(Run.java:1931)
> at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
> at
> hudson.model.ResourceController.execute(ResourceController.java:97)
> at hudson.model.Executor.run(Executor.java:429)
> Caused: hudson.FilePath$TunneledInterruptedException
> at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3319)
> at hudson.remoting.UserRequest.perform(UserRequest.java:211)
> at hudson.remoting.UserRequest.perform(UserRequest.java:54)
> at hudson.remoting.Request$2.run(Request.java:376)
> at
> 

Re: [JENKINS] Lucene-main-Linux (64bit/jdk-11.0.6) - Build # 31440 - Still Unstable!

2021-09-30 Thread Dawid Weiss
I've cleaned up this test from the source of all leaking threads but this
failure does reproduce - I filed LUCENE-10134.

org.apache.lucene.facet.sortedset.TestSortedSetDocValuesFacets >
testCountAll FAILED
java.lang.AssertionError: Bits are only supposed to be consumed in the
thread in which they have been acquired. But
was acquired in
Thread[TEST-TestSortedSetDocValuesFacets.testCountAll-seed#[5E8A2F2BBCCBDF1B],5,TGRP-TestSortedSetDocValuesFacets]
and consumed in
Thread[TestIndexSearcher-2-thread-1,5,TGRP-TestSortedSetDocValuesFacets].
at
__randomizedtesting.SeedInfo.seed([5E8A2F2BBCCBDF1B:FFB0A39BEF474EA3]:0)
at
org.apache.lucene.index.AssertingLeafReader.assertThread(AssertingLeafReader.java:43)
at
org.apache.lucene.index.AssertingLeafReader$AssertingBits.get(AssertingLeafReader.java:1374)
at org.apache.lucene.facet.FacetUtils$1.doNext(FacetUtils.java:62)
at org.apache.lucene.facet.FacetUtils$1.nextDoc(FacetUtils.java:70)
at
org.apache.lucene.facet.sortedset.ConcurrentSortedSetDocValuesFacetCounts$CountOneSegment.call(ConcurrentSortedSetDocValuesFacetCounts.java:260)
at
org.apache.lucene.facet.sortedset.ConcurrentSortedSetDocValuesFacetCounts$CountOneSegment.call(ConcurrentSortedSetDocValuesFacetCounts.java:159)
at
java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
at java.base/java.lang.Thread.run(Thread.java:832)

Dawid

On Wed, Sep 29, 2021 at 11:37 PM Policeman Jenkins Server <
jenk...@thetaphi.de> wrote:

> Build: https://jenkins.thetaphi.de/job/Lucene-main-Linux/31440/
> Java: 64bit/jdk-11.0.6 -XX:+UseCompressedOops -XX:+UseSerialGC
>
> 3 tests failed.
> FAILED:
> org.apache.lucene.facet.sortedset.TestSortedSetDocValuesFacets.testCountAll
>
> Error Message:
> java.lang.AssertionError: Bits are only supposed to be consumed in the
> thread in which they have been acquired. But was acquired in
> Thread[TEST-TestSortedSetDocValuesFacets.testCountAll-seed#[5E8A2F2BBCCBDF1B],5,TGRP-TestSortedSetDocValuesFacets]
> and consumed in
> Thread[TestIndexSearcher-2-thread-1,5,TGRP-TestSortedSetDocValuesFacets].
>
> Stack Trace:
> java.lang.AssertionError: Bits are only supposed to be consumed in the
> thread in which they have been acquired. But was acquired in
> Thread[TEST-TestSortedSetDocValuesFacets.testCountAll-seed#[5E8A2F2BBCCBDF1B],5,TGRP-TestSortedSetDocValuesFacets]
> and consumed in
> Thread[TestIndexSearcher-2-thread-1,5,TGRP-TestSortedSetDocValuesFacets].
> at
> __randomizedtesting.SeedInfo.seed([5E8A2F2BBCCBDF1B:FFB0A39BEF474EA3]:0)
> at
> org.apache.lucene.index.AssertingLeafReader.assertThread(AssertingLeafReader.java:43)
> at
> org.apache.lucene.index.AssertingLeafReader$AssertingBits.get(AssertingLeafReader.java:1374)
> at org.apache.lucene.facet.FacetUtils$1.doNext(FacetUtils.java:62)
> at org.apache.lucene.facet.FacetUtils$1.nextDoc(FacetUtils.java:70)
> at
> org.apache.lucene.facet.sortedset.ConcurrentSortedSetDocValuesFacetCounts$CountOneSegment.call(ConcurrentSortedSetDocValuesFacetCounts.java:260)
> at
> org.apache.lucene.facet.sortedset.ConcurrentSortedSetDocValuesFacetCounts$CountOneSegment.call(ConcurrentSortedSetDocValuesFacetCounts.java:159)
> at
> java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:834)
>
>
> FAILED:
> org.apache.lucene.facet.sortedset.TestSortedSetDocValuesFacets.classMethod
>
> Error Message:
> com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from
> SUITE scope at
> org.apache.lucene.facet.sortedset.TestSortedSetDocValuesFacets:
>1) Thread[id=28, name=TestIndexSearcher-2-thread-1, state=WAITING,
> group=TGRP-TestSortedSetDocValuesFacets]
> at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
> at java.base@11.0.6
> /java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
> at java.base@11.0.6
> /java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
> at java.base@11.0.6
> /java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
> at java.base@11.0.6
> /java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
> at java.base@11.0.6
> /java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
> at java.base@11.0.6
> /java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at