Re: [JENKINS] Lucene-main-Linux (64bit/hotspot/jdk-19) - Build # 45856 - Unstable!
I'll try to get to the bottom of this Adrien, thanks for digging! I wonder if we are violating this (subtle) requirement in the Terms.intersect API: Note that the provided startTerm must be accepted by the automaton. The failures involving DirectPostingsFormat seem angry that we are indeed violating this. Mike McCandless http://blog.mikemccandless.com On Wed, Dec 20, 2023 at 6:09 AM Adrien Grand wrote: > I don't fully understandi it yet. I opened an issue: > https://github.com/apache/lucene/issues/12957. > > On Tue, Dec 19, 2023 at 6:02 PM Adrien Grand wrote: > >> This looks like a real bug with the default codec when the prefix >> compares greater than every indexed term. I'll look into it tomorrow if >> nobody beats me to it. >> >> On Tue, Dec 19, 2023 at 12:35 PM Policeman Jenkins Server < >> jenk...@thetaphi.de> wrote: >> >>> Build: https://jenkins.thetaphi.de/job/Lucene-main-Linux/45856/ >>> Java: 64bit/hotspot/jdk-19 -XX:+UseCompressedOops -XX:+UseSerialGC >>> >>> 1 tests failed. >>> FAILED: org.apache.lucene.index.TestTerms.testTermMinMaxRandom >>> >>> Error Message: >>> java.lang.AssertionError >>> >>> Stack Trace: >>> java.lang.AssertionError >>> at >>> __randomizedtesting.SeedInfo.seed([CBF65306049672F4:8785DC72680AA991]:0) >>> at >>> org.apache.lucene.codecs.lucene90.blocktree.IntersectTermsEnum.getState(IntersectTermsEnum.java:245) >>> at >>> org.apache.lucene.codecs.lucene90.blocktree.IntersectTermsEnum.seekToStartTerm(IntersectTermsEnum.java:288) >>> at >>> org.apache.lucene.codecs.lucene90.blocktree.IntersectTermsEnum.(IntersectTermsEnum.java:126) >>> at >>> org.apache.lucene.codecs.lucene90.blocktree.FieldReader.intersect(FieldReader.java:223) >>> at >>> org.apache.lucene.index.CheckIndex.checkTermsIntersect(CheckIndex.java:2374) >>> at >>> org.apache.lucene.index.CheckIndex.checkFields(CheckIndex.java:2327) >>> at >>> org.apache.lucene.index.CheckIndex.testPostings(CheckIndex.java:2529) >>> at >>> org.apache.lucene.index.CheckIndex.testSegment(CheckIndex.java:1067) >>> at >>> org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:783) >>> at >>> org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:550) >>> at >>> org.apache.lucene.tests.util.TestUtil.checkIndex(TestUtil.java:340) >>> at >>> org.apache.lucene.tests.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:909) >>> at >>> org.apache.lucene.index.TestTerms.testTermMinMaxRandom(TestTerms.java:85) >>> at >>> java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) >>> at java.base/java.lang.reflect.Method.invoke(Method.java:578) >>> at >>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758) >>> at >>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946) >>> at >>> com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982) >>> at >>> com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996) >>> at >>> org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48) >>> at >>> org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) >>> at >>> org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45) >>> at >>> org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) >>> at >>> org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) >>> at org.junit.rules.RunRules.evaluate(RunRules.java:20) >>> at >>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >>> at >>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) >>> at >>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843) >>> at >>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490) >>> at >>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955) >>> at >>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840) >>> at >>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891) >>> at >>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902) >>> at >>> org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) >>> at >>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >>>
Re: [JENKINS] Lucene-main-Linux (64bit/hotspot/jdk-19) - Build # 45856 - Unstable!
I don't fully understandi it yet. I opened an issue: https://github.com/apache/lucene/issues/12957. On Tue, Dec 19, 2023 at 6:02 PM Adrien Grand wrote: > This looks like a real bug with the default codec when the prefix compares > greater than every indexed term. I'll look into it tomorrow if nobody beats > me to it. > > On Tue, Dec 19, 2023 at 12:35 PM Policeman Jenkins Server < > jenk...@thetaphi.de> wrote: > >> Build: https://jenkins.thetaphi.de/job/Lucene-main-Linux/45856/ >> Java: 64bit/hotspot/jdk-19 -XX:+UseCompressedOops -XX:+UseSerialGC >> >> 1 tests failed. >> FAILED: org.apache.lucene.index.TestTerms.testTermMinMaxRandom >> >> Error Message: >> java.lang.AssertionError >> >> Stack Trace: >> java.lang.AssertionError >> at >> __randomizedtesting.SeedInfo.seed([CBF65306049672F4:8785DC72680AA991]:0) >> at >> org.apache.lucene.codecs.lucene90.blocktree.IntersectTermsEnum.getState(IntersectTermsEnum.java:245) >> at >> org.apache.lucene.codecs.lucene90.blocktree.IntersectTermsEnum.seekToStartTerm(IntersectTermsEnum.java:288) >> at >> org.apache.lucene.codecs.lucene90.blocktree.IntersectTermsEnum.(IntersectTermsEnum.java:126) >> at >> org.apache.lucene.codecs.lucene90.blocktree.FieldReader.intersect(FieldReader.java:223) >> at >> org.apache.lucene.index.CheckIndex.checkTermsIntersect(CheckIndex.java:2374) >> at >> org.apache.lucene.index.CheckIndex.checkFields(CheckIndex.java:2327) >> at >> org.apache.lucene.index.CheckIndex.testPostings(CheckIndex.java:2529) >> at >> org.apache.lucene.index.CheckIndex.testSegment(CheckIndex.java:1067) >> at >> org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:783) >> at >> org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:550) >> at >> org.apache.lucene.tests.util.TestUtil.checkIndex(TestUtil.java:340) >> at >> org.apache.lucene.tests.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:909) >> at >> org.apache.lucene.index.TestTerms.testTermMinMaxRandom(TestTerms.java:85) >> at >> java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) >> at java.base/java.lang.reflect.Method.invoke(Method.java:578) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996) >> at >> org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48) >> at >> org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) >> at >> org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45) >> at >> org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) >> at >> org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) >> at org.junit.rules.RunRules.evaluate(RunRules.java:20) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902) >> at >> org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) >> at >> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) >> at >> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >>
Re: [JENKINS] Lucene-main-Linux (64bit/hotspot/jdk-19) - Build # 45856 - Unstable!
This looks like a real bug with the default codec when the prefix compares greater than every indexed term. I'll look into it tomorrow if nobody beats me to it. On Tue, Dec 19, 2023 at 12:35 PM Policeman Jenkins Server < jenk...@thetaphi.de> wrote: > Build: https://jenkins.thetaphi.de/job/Lucene-main-Linux/45856/ > Java: 64bit/hotspot/jdk-19 -XX:+UseCompressedOops -XX:+UseSerialGC > > 1 tests failed. > FAILED: org.apache.lucene.index.TestTerms.testTermMinMaxRandom > > Error Message: > java.lang.AssertionError > > Stack Trace: > java.lang.AssertionError > at > __randomizedtesting.SeedInfo.seed([CBF65306049672F4:8785DC72680AA991]:0) > at > org.apache.lucene.codecs.lucene90.blocktree.IntersectTermsEnum.getState(IntersectTermsEnum.java:245) > at > org.apache.lucene.codecs.lucene90.blocktree.IntersectTermsEnum.seekToStartTerm(IntersectTermsEnum.java:288) > at > org.apache.lucene.codecs.lucene90.blocktree.IntersectTermsEnum.(IntersectTermsEnum.java:126) > at > org.apache.lucene.codecs.lucene90.blocktree.FieldReader.intersect(FieldReader.java:223) > at > org.apache.lucene.index.CheckIndex.checkTermsIntersect(CheckIndex.java:2374) > at > org.apache.lucene.index.CheckIndex.checkFields(CheckIndex.java:2327) > at > org.apache.lucene.index.CheckIndex.testPostings(CheckIndex.java:2529) > at > org.apache.lucene.index.CheckIndex.testSegment(CheckIndex.java:1067) > at > org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:783) > at > org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:550) > at > org.apache.lucene.tests.util.TestUtil.checkIndex(TestUtil.java:340) > at > org.apache.lucene.tests.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:909) > at > org.apache.lucene.index.TestTerms.testTermMinMaxRandom(TestTerms.java:85) > at > java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) > at java.base/java.lang.reflect.Method.invoke(Method.java:578) > at > com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996) > at > org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48) > at > org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) > at > org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45) > at > org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) > at > org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) > at org.junit.rules.RunRules.evaluate(RunRules.java:20) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490) > at > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902) > at > org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) > at > com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) > at > com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) > at >