This is caused by https://github.com/apache/lucene/pull/12183 , yet I don't think there is anything wrong with the PR itself.
Looking at the test and QueryUtils, we create a new searcher for each leaf reader, and each searcher gets a separate executor. That would be ok as long as the executors are shutdown promptly, but that is not the case here as they get terminated via a close listener associated with each index reader, which I believe is called only later in the AfterClass. I am thinking that we end up creating too many executors and that is why we in turn end up creating too many threads. I am looking into fixing this. On Fri, Sep 22, 2023 at 9:30 AM Dawid Weiss <dawid.we...@gmail.com> wrote: > > This failed because the thread limit has been exhausted. > > [3241.014s][warning][os,thread] Failed to start thread "Unknown thread" - > pthread_create failed (EAGAIN) for attributes: stacksize: 1024k, guardsize: > 0k, detached. > [3241.015s][warning][os,thread] Failed to start the native thread for > java.lang.Thread "LuceneTestCase-7564-thread-1 > > org.apache.lucene.search.TestSimpleExplanationsWithFillerDocs > testP7 FAILED > java.lang.OutOfMemoryError: unable to create native thread: possibly out > of memory or process/resource limits reached > at > __randomizedtesting.SeedInfo.seed([B5DBA9A0960A3ECC:1F73384DEAF58B95]:0) > at java.base/java.lang.Thread.start0(Native Method) > at java.base/java.lang.Thread.start(Thread.java:798) > at > java.base/java.util.concurrent.ThreadPoolExecutor.addWorker(ThreadPoolExecutor.java:937) > at > java.base/java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1343) > at > org.apache.lucene.search.TaskExecutor.invokeAll(TaskExecutor.java:73) > at org.apache.lucene.index.TermStates.build(TermStates.java:119) > at > org.apache.lucene.search.PhraseQuery$1.getStats(PhraseQuery.java:458) > at org.apache.lucene.search.PhraseWeight.<init>(PhraseWeight.java:44) > at org.apache.lucene.search.PhraseQuery$1.<init>(PhraseQuery.java:439) > at > org.apache.lucene.search.PhraseQuery.createWeight(PhraseQuery.java:439) > at > org.apache.lucene.search.IndexSearcher.createWeight(IndexSearcher.java:893) > at > org.apache.lucene.tests.search.AssertingIndexSearcher.createWeight(AssertingIndexSearcher.java:62) > at > org.apache.lucene.search.BooleanWeight.<init>(BooleanWeight.java:59) > at > org.apache.lucene.search.BooleanQuery.createWeight(BooleanQuery.java:245) > at > org.apache.lucene.search.IndexSearcher.createWeight(IndexSearcher.java:893) > at > org.apache.lucene.tests.search.AssertingIndexSearcher.createWeight(AssertingIndexSearcher.java:62) > at > org.apache.lucene.tests.search.QueryUtils$4.doSetNextReader(QueryUtils.java:617) > at > org.apache.lucene.search.SimpleCollector.getLeafCollector(SimpleCollector.java:31) > at > org.apache.lucene.search.FilterCollector.getLeafCollector(FilterCollector.java:38) > at > org.apache.lucene.tests.search.AssertingCollector.getLeafCollector(AssertingCollector.java:54) > at > org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:748) > at > org.apache.lucene.tests.search.AssertingIndexSearcher.search(AssertingIndexSearcher.java:79) > at > org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:547) > at > org.apache.lucene.tests.search.QueryUtils.checkFirstSkipTo(QueryUtils.java:549) > at > org.apache.lucene.tests.search.QueryUtils.check(QueryUtils.java:138) > at > org.apache.lucene.tests.search.QueryUtils.check(QueryUtils.java:131) > at > org.apache.lucene.tests.search.CheckHits.checkHitCollector(CheckHits.java:106) > at > org.apache.lucene.tests.search.BaseExplanationTestCase.qtest(BaseExplanationTestCase.java:110) > at > org.apache.lucene.search.TestSimpleExplanationsWithFillerDocs.qtest(TestSimpleExplanationsWithFillerDocs.java:116) > at > org.apache.lucene.search.TestSimpleExplanations.testP7(TestSimpleExplanations.java:87) > at > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.base/java.lang.reflect.Method.invoke(Method.java:566) > at > com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996) > at > org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48) > at > org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) > at > org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45) > at > org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) > at > org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) > at org.junit.rules.RunRules.evaluate(RunRules.java:20) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490) > at > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902) > at > org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) > at > com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) > at > com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) > at > org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) > at > org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) > at > org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) > at > org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47) > at org.junit.rules.RunRules.evaluate(RunRules.java:20) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850) > at java.base/java.lang.Thread.run(Thread.java:829) > > > On Fri, Sep 22, 2023 at 8:40 AM Apache Jenkins Server < > jenk...@builds.apache.org> wrote: > >> Build: >> https://ci-builds.apache.org/job/Lucene/job/Lucene-NightlyTests-main/1132/ >> >> 3 tests failed. >> FAILED: >> org.apache.lucene.search.TestSimpleExplanationsWithFillerDocs.testMultiFieldBQofPQ4 >> >> Error Message: >> java.lang.OutOfMemoryError: unable to create native thread: possibly out >> of memory or process/resource limits reached >> >> Stack Trace: >> java.lang.OutOfMemoryError: unable to create native thread: possibly out >> of memory or process/resource limits reached >> at >> __randomizedtesting.SeedInfo.seed([BC6B640B71B2204A:A10B8D9550CBF8A7]:0) >> at java.base/java.lang.Thread.start0(Native Method) >> at java.base/java.lang.Thread.start(Thread.java:802) >> at >> java.base/java.util.concurrent.ThreadPoolExecutor.addWorker(ThreadPoolExecutor.java:945) >> at >> java.base/java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1353) >> at >> org.apache.lucene.search.TaskExecutor.invokeAll(TaskExecutor.java:73) >> at org.apache.lucene.index.TermStates.build(TermStates.java:118) >> at >> org.apache.lucene.search.PhraseQuery$1.getStats(PhraseQuery.java:458) >> at >> org.apache.lucene.search.PhraseWeight.<init>(PhraseWeight.java:44) >> at >> org.apache.lucene.search.PhraseQuery$1.<init>(PhraseQuery.java:439) >> at >> org.apache.lucene.search.PhraseQuery.createWeight(PhraseQuery.java:439) >> at >> org.apache.lucene.search.IndexSearcher.createWeight(IndexSearcher.java:857) >> at >> org.apache.lucene.tests.search.AssertingIndexSearcher.createWeight(AssertingIndexSearcher.java:62) >> at >> org.apache.lucene.search.BooleanWeight.<init>(BooleanWeight.java:59) >> at >> org.apache.lucene.search.BooleanQuery.createWeight(BooleanQuery.java:245) >> at >> org.apache.lucene.search.IndexSearcher.createWeight(IndexSearcher.java:857) >> at >> org.apache.lucene.tests.search.AssertingIndexSearcher.createWeight(AssertingIndexSearcher.java:62) >> at >> org.apache.lucene.search.BooleanWeight.<init>(BooleanWeight.java:59) >> at >> org.apache.lucene.search.BooleanQuery.createWeight(BooleanQuery.java:245) >> at >> org.apache.lucene.search.IndexSearcher.createWeight(IndexSearcher.java:857) >> at >> org.apache.lucene.tests.search.AssertingIndexSearcher.createWeight(AssertingIndexSearcher.java:62) >> at >> org.apache.lucene.tests.search.QueryUtils$3.doSetNextReader(QueryUtils.java:464) >> at >> org.apache.lucene.search.SimpleCollector.getLeafCollector(SimpleCollector.java:31) >> at >> org.apache.lucene.search.FilterCollector.getLeafCollector(FilterCollector.java:38) >> at >> org.apache.lucene.tests.search.AssertingCollector.getLeafCollector(AssertingCollector.java:54) >> at >> org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:712) >> at >> org.apache.lucene.tests.search.AssertingIndexSearcher.search(AssertingIndexSearcher.java:79) >> at >> org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:511) >> at >> org.apache.lucene.tests.search.QueryUtils.checkSkipTo(QueryUtils.java:344) >> at >> org.apache.lucene.tests.search.QueryUtils.check(QueryUtils.java:138) >> at >> org.apache.lucene.tests.search.QueryUtils.check(QueryUtils.java:130) >> at >> org.apache.lucene.tests.search.CheckHits.checkHitCollector(CheckHits.java:106) >> at >> org.apache.lucene.tests.search.BaseExplanationTestCase.qtest(BaseExplanationTestCase.java:110) >> at >> org.apache.lucene.search.TestSimpleExplanationsWithFillerDocs.qtest(TestSimpleExplanationsWithFillerDocs.java:116) >> at >> org.apache.lucene.search.TestSimpleExplanations.testMultiFieldBQofPQ4(TestSimpleExplanations.java:702) >> at >> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native >> Method) >> at >> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) >> at >> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.base/java.lang.reflect.Method.invoke(Method.java:568) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996) >> at >> org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48) >> at >> org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) >> at >> org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45) >> at >> org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) >> at >> org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) >> at org.junit.rules.RunRules.evaluate(RunRules.java:20) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902) >> at >> org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) >> at >> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) >> at >> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) >> at >> org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) >> at >> org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) >> at >> org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) >> at >> org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47) >> at org.junit.rules.RunRules.evaluate(RunRules.java:20) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850) >> at java.base/java.lang.Thread.run(Thread.java:833) >> >> >> FAILED: >> org.apache.lucene.search.TestSimpleExplanationsWithFillerDocs.testMPQ5 >> >> Error Message: >> java.lang.OutOfMemoryError: unable to create native thread: possibly out >> of memory or process/resource limits reached >> >> Stack Trace: >> java.lang.OutOfMemoryError: unable to create native thread: possibly out >> of memory or process/resource limits reached >> at >> __randomizedtesting.SeedInfo.seed([BC6B640B71B2204A:AFB1EE69AFA27B9E]:0) >> at java.base/java.lang.Thread.start0(Native Method) >> at java.base/java.lang.Thread.start(Thread.java:802) >> at >> java.base/java.util.concurrent.ThreadPoolExecutor.addWorker(ThreadPoolExecutor.java:945) >> at >> java.base/java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1353) >> at >> org.apache.lucene.search.TaskExecutor.invokeAll(TaskExecutor.java:73) >> at org.apache.lucene.index.TermStates.build(TermStates.java:118) >> at >> org.apache.lucene.search.MultiPhraseQuery$1.getStats(MultiPhraseQuery.java:228) >> at >> org.apache.lucene.search.PhraseWeight.<init>(PhraseWeight.java:44) >> at >> org.apache.lucene.search.MultiPhraseQuery$1.<init>(MultiPhraseQuery.java:217) >> at >> org.apache.lucene.search.MultiPhraseQuery.createWeight(MultiPhraseQuery.java:217) >> at >> org.apache.lucene.search.IndexSearcher.createWeight(IndexSearcher.java:857) >> at >> org.apache.lucene.tests.search.AssertingIndexSearcher.createWeight(AssertingIndexSearcher.java:62) >> at >> org.apache.lucene.search.BooleanWeight.<init>(BooleanWeight.java:59) >> at >> org.apache.lucene.search.BooleanQuery.createWeight(BooleanQuery.java:245) >> at >> org.apache.lucene.search.IndexSearcher.createWeight(IndexSearcher.java:857) >> at >> org.apache.lucene.tests.search.AssertingIndexSearcher.createWeight(AssertingIndexSearcher.java:62) >> at >> org.apache.lucene.tests.search.QueryUtils$4.doSetNextReader(QueryUtils.java:608) >> at >> org.apache.lucene.search.SimpleCollector.getLeafCollector(SimpleCollector.java:31) >> at >> org.apache.lucene.search.FilterCollector.getLeafCollector(FilterCollector.java:38) >> at >> org.apache.lucene.tests.search.AssertingCollector.getLeafCollector(AssertingCollector.java:54) >> at >> org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:712) >> at >> org.apache.lucene.tests.search.AssertingIndexSearcher.search(AssertingIndexSearcher.java:79) >> at >> org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:511) >> at >> org.apache.lucene.tests.search.QueryUtils.checkFirstSkipTo(QueryUtils.java:540) >> at >> org.apache.lucene.tests.search.QueryUtils.check(QueryUtils.java:137) >> at >> org.apache.lucene.tests.search.QueryUtils.check(QueryUtils.java:130) >> at >> org.apache.lucene.tests.search.CheckHits.checkHitCollector(CheckHits.java:106) >> at >> org.apache.lucene.tests.search.BaseExplanationTestCase.qtest(BaseExplanationTestCase.java:110) >> at >> org.apache.lucene.search.TestSimpleExplanationsWithFillerDocs.qtest(TestSimpleExplanationsWithFillerDocs.java:116) >> at >> org.apache.lucene.search.TestSimpleExplanations.testMPQ5(TestSimpleExplanations.java:244) >> at >> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native >> Method) >> at >> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) >> at >> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.base/java.lang.reflect.Method.invoke(Method.java:568) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996) >> at >> org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48) >> at >> org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) >> at >> org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45) >> at >> org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) >> at >> org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) >> at org.junit.rules.RunRules.evaluate(RunRules.java:20) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902) >> at >> org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) >> at >> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) >> at >> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) >> at >> org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) >> at >> org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) >> at >> org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) >> at >> org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47) >> at org.junit.rules.RunRules.evaluate(RunRules.java:20) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850) >> at java.base/java.lang.Thread.run(Thread.java:833) >> >> >> FAILED: >> org.apache.lucene.search.TestSimpleExplanationsWithFillerDocs.testBQ1 >> >> Error Message: >> java.lang.OutOfMemoryError: unable to create native thread: possibly out >> of memory or process/resource limits reached >> >> Stack Trace: >> java.lang.OutOfMemoryError: unable to create native thread: possibly out >> of memory or process/resource limits reached >> at >> __randomizedtesting.SeedInfo.seed([BC6B640B71B2204A:A2B0AC682A70B830]:0) >> at java.base/java.lang.Thread.start0(Native Method) >> at java.base/java.lang.Thread.start(Thread.java:802) >> at >> java.base/java.util.concurrent.ThreadPoolExecutor.addWorker(ThreadPoolExecutor.java:945) >> at >> java.base/java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1353) >> at >> org.apache.lucene.search.TaskExecutor.invokeAll(TaskExecutor.java:73) >> at org.apache.lucene.index.TermStates.build(TermStates.java:118) >> at >> org.apache.lucene.search.TermQuery.createWeight(TermQuery.java:275) >> at >> org.apache.lucene.search.IndexSearcher.createWeight(IndexSearcher.java:857) >> at >> org.apache.lucene.tests.search.AssertingIndexSearcher.createWeight(AssertingIndexSearcher.java:62) >> at >> org.apache.lucene.search.BooleanWeight.<init>(BooleanWeight.java:59) >> at >> org.apache.lucene.search.BooleanQuery.createWeight(BooleanQuery.java:245) >> at >> org.apache.lucene.search.IndexSearcher.createWeight(IndexSearcher.java:857) >> at >> org.apache.lucene.tests.search.AssertingIndexSearcher.createWeight(AssertingIndexSearcher.java:62) >> at >> org.apache.lucene.search.BooleanWeight.<init>(BooleanWeight.java:59) >> at >> org.apache.lucene.search.BooleanQuery.createWeight(BooleanQuery.java:245) >> at >> org.apache.lucene.search.IndexSearcher.createWeight(IndexSearcher.java:857) >> at >> org.apache.lucene.tests.search.AssertingIndexSearcher.createWeight(AssertingIndexSearcher.java:62) >> at >> org.apache.lucene.search.BooleanWeight.<init>(BooleanWeight.java:59) >> at >> org.apache.lucene.search.BooleanQuery.createWeight(BooleanQuery.java:245) >> at >> org.apache.lucene.search.IndexSearcher.createWeight(IndexSearcher.java:857) >> at >> org.apache.lucene.tests.search.AssertingIndexSearcher.createWeight(AssertingIndexSearcher.java:62) >> at >> org.apache.lucene.tests.search.QueryUtils$3.doSetNextReader(QueryUtils.java:464) >> at >> org.apache.lucene.search.SimpleCollector.getLeafCollector(SimpleCollector.java:31) >> at >> org.apache.lucene.search.FilterCollector.getLeafCollector(FilterCollector.java:38) >> at >> org.apache.lucene.tests.search.AssertingCollector.getLeafCollector(AssertingCollector.java:54) >> at >> org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:712) >> at >> org.apache.lucene.tests.search.AssertingIndexSearcher.search(AssertingIndexSearcher.java:79) >> at >> org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:511) >> at >> org.apache.lucene.tests.search.QueryUtils.checkSkipTo(QueryUtils.java:344) >> at >> org.apache.lucene.tests.search.QueryUtils.check(QueryUtils.java:138) >> at >> org.apache.lucene.tests.search.QueryUtils.check(QueryUtils.java:130) >> at >> org.apache.lucene.tests.search.CheckHits.checkHitCollector(CheckHits.java:106) >> at >> org.apache.lucene.tests.search.BaseExplanationTestCase.qtest(BaseExplanationTestCase.java:110) >> at >> org.apache.lucene.search.TestSimpleExplanationsWithFillerDocs.qtest(TestSimpleExplanationsWithFillerDocs.java:116) >> at >> org.apache.lucene.search.TestSimpleExplanations.testBQ1(TestSimpleExplanations.java:261) >> at >> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native >> Method) >> at >> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) >> at >> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.base/java.lang.reflect.Method.invoke(Method.java:568) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996) >> at >> org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48) >> at >> org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) >> at >> org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45) >> at >> org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) >> at >> org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) >> at org.junit.rules.RunRules.evaluate(RunRules.java:20) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902) >> at >> org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) >> at >> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) >> at >> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) >> at >> org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) >> at >> org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) >> at >> org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) >> at >> org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47) >> at org.junit.rules.RunRules.evaluate(RunRules.java:20) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850) >> at java.base/java.lang.Thread.run(Thread.java:833) >> >> >> >> >> Build Log: >> [...truncated 1168 lines...] >> ERROR: The following test(s) have failed: >> - >> org.apache.lucene.search.TestSimpleExplanationsWithFillerDocs.testMultiFieldBQofPQ4 >> (:lucene:core) >> Test output: >> /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-NightlyTests-main/checkout/lucene/core/build/test-results/test/outputs/OUTPUT-org.apache.lucene.search.TestSimpleExplanationsWithFillerDocs.txt >> Reproduce with: gradlew :lucene:core:test --tests >> "org.apache.lucene.search.TestSimpleExplanationsWithFillerDocs.testMultiFieldBQofPQ4" >> -Ptests.jvms=4 -Ptests.jvmargs= -Ptests.seed=BC6B640B71B2204A >> -Ptests.multiplier=2 -Ptests.nightly=true -Ptests.gui=true >> -Ptests.file.encoding=US-ASCII >> -Ptests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-NightlyTests-main/test-data/enwiki.random.lines.txt >> >> - >> org.apache.lucene.search.TestSimpleExplanationsWithFillerDocs.testMPQ5 >> (:lucene:core) >> Test output: >> /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-NightlyTests-main/checkout/lucene/core/build/test-results/test/outputs/OUTPUT-org.apache.lucene.search.TestSimpleExplanationsWithFillerDocs.txt >> Reproduce with: gradlew :lucene:core:test --tests >> "org.apache.lucene.search.TestSimpleExplanationsWithFillerDocs.testMPQ5" >> -Ptests.jvms=4 -Ptests.jvmargs= -Ptests.seed=BC6B640B71B2204A >> -Ptests.multiplier=2 -Ptests.nightly=true -Ptests.gui=true >> -Ptests.file.encoding=US-ASCII >> -Ptests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-NightlyTests-main/test-data/enwiki.random.lines.txt >> >> - org.apache.lucene.search.TestSimpleExplanationsWithFillerDocs.testBQ1 >> (:lucene:core) >> Test output: >> /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-NightlyTests-main/checkout/lucene/core/build/test-results/test/outputs/OUTPUT-org.apache.lucene.search.TestSimpleExplanationsWithFillerDocs.txt >> Reproduce with: gradlew :lucene:core:test --tests >> "org.apache.lucene.search.TestSimpleExplanationsWithFillerDocs.testBQ1" >> -Ptests.jvms=4 -Ptests.jvmargs= -Ptests.seed=BC6B640B71B2204A >> -Ptests.multiplier=2 -Ptests.nightly=true -Ptests.gui=true >> -Ptests.file.encoding=US-ASCII >> -Ptests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-NightlyTests-main/test-data/enwiki.random.lines.txt >> >> >> BUILD SUCCESSFUL in 2h 12m 2s >> 243 actionable tasks: 121 executed, 122 up-to-date >> >> Publishing build scan... >> https://ge.apache.org/s/atkeq2g4eawm4 >> >> Build step 'Invoke Gradle script' changed build result to SUCCESS >> Archiving artifacts >> hudson.FilePath$ValidateAntFileMask$1Cancel >> at >> hudson.FilePath$ValidateAntFileMask$1.isCaseSensitive(FilePath.java:3300) >> at >> org.apache.tools.ant.DirectoryScanner.lambda$isIncluded$3(DirectoryScanner.java:1374) >> at >> java.base/java.util.stream.MatchOps$1MatchSink.accept(MatchOps.java:90) >> at >> java.base/java.util.Spliterators$ArraySpliterator.tryAdvance(Spliterators.java:958) >> at >> java.base/java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:127) >> at >> java.base/java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:502) >> at >> java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:488) >> at >> java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) >> at >> java.base/java.util.stream.MatchOps$MatchOp.evaluateSequential(MatchOps.java:230) >> at >> java.base/java.util.stream.MatchOps$MatchOp.evaluateSequential(MatchOps.java:196) >> at >> java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) >> at >> java.base/java.util.stream.ReferencePipeline.anyMatch(ReferencePipeline.java:528) >> at >> org.apache.tools.ant.DirectoryScanner.isIncluded(DirectoryScanner.java:1374) >> at >> org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1241) >> at >> org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267) >> at >> org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267) >> at >> org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267) >> at >> org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267) >> at >> org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267) >> at >> org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267) >> at >> org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267) >> at >> org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267) >> at >> org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267) >> at >> org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267) >> at >> org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267) >> at >> org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1267) >> at >> org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1194) >> at >> org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1156) >> at >> org.apache.tools.ant.DirectoryScanner.checkIncludePatterns(DirectoryScanner.java:954) >> at >> org.apache.tools.ant.DirectoryScanner.scan(DirectoryScanner.java:912) >> at >> hudson.FilePath$ValidateAntFileMask.hasMatch(FilePath.java:3313) >> Caused: hudson.FilePath$FileMaskNoMatchesFoundException: no matches found >> within 10000 >> at >> hudson.FilePath$ValidateAntFileMask.hasMatch(FilePath.java:3318) >> at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:3196) >> at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:3174) >> at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3578) >> Also: hudson.remoting.Channel$CallSiteStackTrace: Remote call to >> lucene-solr-1 >> at >> hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1784) >> at >> hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:356) >> at hudson.remoting.Channel.call(Channel.java:1000) >> at hudson.FilePath.act(FilePath.java:1192) >> at hudson.FilePath.act(FilePath.java:1181) >> at hudson.FilePath.validateAntFileMask(FilePath.java:3171) >> at >> hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:271) >> at >> hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:80) >> at >> hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) >> at >> hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:818) >> at >> hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:767) >> at hudson.model.Build$BuildExecution.post2(Build.java:179) >> at >> hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:711) >> at hudson.model.Run.execute(Run.java:1925) >> at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44) >> at >> hudson.model.ResourceController.execute(ResourceController.java:101) >> at hudson.model.Executor.run(Executor.java:442) >> Caused: hudson.FilePath$TunneledInterruptedException >> at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3580) >> at hudson.remoting.UserRequest.perform(UserRequest.java:211) >> at hudson.remoting.UserRequest.perform(UserRequest.java:54) >> at hudson.remoting.Request$2.run(Request.java:377) >> at >> hudson.remoting.InterceptingExecutorService.lambda$wrap$0(InterceptingExecutorService.java:78) >> at >> java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) >> at >> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) >> at >> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) >> at java.base/java.lang.Thread.run(Thread.java:829) >> Caused: java.lang.InterruptedException: >> hudson.FilePath$FileMaskNoMatchesFoundException: no matches found within >> 10000 >> at hudson.FilePath.act(FilePath.java:1194) >> at hudson.FilePath.act(FilePath.java:1181) >> at hudson.FilePath.validateAntFileMask(FilePath.java:3171) >> at >> hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:271) >> at >> hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:80) >> at >> hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) >> at >> hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:818) >> at >> hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:767) >> at hudson.model.Build$BuildExecution.post2(Build.java:179) >> at >> hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:711) >> at hudson.model.Run.execute(Run.java:1925) >> at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44) >> at >> hudson.model.ResourceController.execute(ResourceController.java:101) >> at hudson.model.Executor.run(Executor.java:442) >> No artifacts found that match the file pattern >> "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error? >> Recording test results >> [Checks API] No suitable checks publisher found. >> Build step 'Publish JUnit test result report' changed build result to >> UNSTABLE >> Email was triggered for: Unstable (Test Failures) >> Sending email for trigger: Unstable (Test Failures) >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: builds-unsubscr...@lucene.apache.org >> For additional commands, e-mail: builds-h...@lucene.apache.org > >