Its hitting a new check from mockfilesystem (limits tests to 2048 open
file handles):

https://issues.apache.org/jira/browse/LUCENE-6159

On Sat, Jan 3, 2015 at 1:18 PM, Apache Jenkins Server
<jenk...@builds.apache.org> wrote:
> Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/723/
>
> 3 tests failed.
> REGRESSION:  org.apache.lucene.search.TestSearcherManager.testSearcherManager
>
> Error Message:
> this IndexWriter is closed
>
> Stack Trace:
> org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
>         at 
> org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:705)
>         at 
> org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:719)
>         at 
> org.apache.lucene.index.IndexWriter.nrtIsCurrent(IndexWriter.java:4449)
>         at 
> org.apache.lucene.index.StandardDirectoryReader.doOpenFromWriter(StandardDirectoryReader.java:277)
>         at 
> org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:256)
>         at 
> org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:246)
>         at 
> org.apache.lucene.index.DirectoryReader.openIfChanged(DirectoryReader.java:123)
>         at 
> org.apache.lucene.search.SearcherManager.refreshIfNeeded(SearcherManager.java:137)
>         at 
> org.apache.lucene.search.SearcherManager.refreshIfNeeded(SearcherManager.java:58)
>         at 
> org.apache.lucene.search.ReferenceManager.doMaybeRefresh(ReferenceManager.java:176)
>         at 
> org.apache.lucene.search.ReferenceManager.maybeRefresh(ReferenceManager.java:225)
>         at 
> org.apache.lucene.search.TestSearcherManager.getFinalSearcher(TestSearcherManager.java:68)
>         at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase.runTest(ThreadedIndexingAndSearchingTestCase.java:541)
>         at 
> org.apache.lucene.search.TestSearcherManager.testSearcherManager(TestSearcherManager.java:60)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at 
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
>         at 
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
>         at 
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
>         at 
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
>         at 
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at 
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at 
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at 
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at 
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
>         at 
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at 
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at 
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
>         at 
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
>         at 
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
>         at 
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
>         at 
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
>         at 
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
>         at 
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
>         at 
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at 
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at 
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at 
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at 
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at 
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at 
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at 
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at 
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
>         at 
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at 
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
>         at 
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at 
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at 
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
>         at java.lang.Thread.run(Thread.java:745)
> Caused by: java.nio.file.FileSystemException: 
> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build/core/test/J3/temp/lucene.search.TestSearcherManager-D6BC19E58A39CA7-001/TestSearcherManager-001/_3i.tvd:
>  Too many open files
>         at 
> org.apache.lucene.mockfile.HandleLimitFS.onOpen(HandleLimitFS.java:49)
>         at 
> org.apache.lucene.mockfile.HandleTrackingFS.callOpenHook(HandleTrackingFS.java:84)
>         at 
> org.apache.lucene.mockfile.HandleTrackingFS.newOutputStream(HandleTrackingFS.java:157)
>         at java.nio.file.Files.newOutputStream(Files.java:172)
>         at 
> org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:265)
>         at 
> org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:214)
>         at 
> org.apache.lucene.store.FilterDirectory.createOutput(FilterDirectory.java:73)
>         at 
> org.apache.lucene.store.RateLimitedDirectoryWrapper.createOutput(RateLimitedDirectoryWrapper.java:45)
>         at 
> org.apache.lucene.store.MockDirectoryWrapper.createOutput(MockDirectoryWrapper.java:607)
>         at 
> org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
>         at 
> org.apache.lucene.codecs.compressing.CompressingTermVectorsWriter.<init>(CompressingTermVectorsWriter.java:226)
>         at 
> org.apache.lucene.codecs.compressing.CompressingTermVectorsFormat.vectorsWriter(CompressingTermVectorsFormat.java:98)
>         at 
> org.apache.lucene.codecs.asserting.AssertingTermVectorsFormat.vectorsWriter(AssertingTermVectorsFormat.java:50)
>         at 
> org.apache.lucene.index.TermVectorsConsumer.initTermVectorsWriter(TermVectorsConsumer.java:88)
>         at 
> org.apache.lucene.index.TermVectorsConsumer.finishDocument(TermVectorsConsumer.java:103)
>         at org.apache.lucene.index.TermsHash.finishDocument(TermsHash.java:93)
>         at 
> org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:316)
>         at 
> org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:270)
>         at 
> org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:410)
>         at 
> org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1231)
>         at 
> org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1192)
>         at 
> org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1177)
>         at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase.addDocuments(ThreadedIndexingAndSearchingTestCase.java:99)
>         at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase$1.run(ThreadedIndexingAndSearchingTestCase.java:218)
>
>
> FAILED:  
> junit.framework.TestSuite.org.apache.lucene.search.TestSearcherManager
>
> Error Message:
> 1 thread leaked from SUITE scope at 
> org.apache.lucene.search.TestSearcherManager:     1) Thread[id=1838, 
> name=LuceneTestCase-323-thread-1, state=WAITING, 
> group=TGRP-TestSearcherManager]         at sun.misc.Unsafe.park(Native 
> Method)         at 
> java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at 
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>          at 
> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)   
>       at 
> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) 
>         at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>          at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>          at java.lang.Thread.run(Thread.java:745)
>
> Stack Trace:
> com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from 
> SUITE scope at org.apache.lucene.search.TestSearcherManager:
>    1) Thread[id=1838, name=LuceneTestCase-323-thread-1, state=WAITING, 
> group=TGRP-TestSearcherManager]
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>         at 
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>         at 
> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>         at 
> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
>         at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>         at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:745)
>         at __randomizedtesting.SeedInfo.seed([D6BC19E58A39CA7]:0)
>
>
> FAILED:  
> junit.framework.TestSuite.org.apache.lucene.search.TestSearcherManager
>
> Error Message:
> There are still zombie threads that couldn't be terminated:    1) 
> Thread[id=1838, name=LuceneTestCase-323-thread-1, state=WAITING, 
> group=TGRP-TestSearcherManager]         at sun.misc.Unsafe.park(Native 
> Method)         at 
> java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at 
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>          at 
> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)   
>       at 
> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) 
>         at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>          at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>          at java.lang.Thread.run(Thread.java:745)
>
> Stack Trace:
> com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
> threads that couldn't be terminated:
>    1) Thread[id=1838, name=LuceneTestCase-323-thread-1, state=WAITING, 
> group=TGRP-TestSearcherManager]
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>         at 
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>         at 
> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>         at 
> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
>         at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>         at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:745)
>         at __randomizedtesting.SeedInfo.seed([D6BC19E58A39CA7]:0)
>
>
>
>
> Build Log:
> [...truncated 824 lines...]
>    [junit4] Suite: org.apache.lucene.search.TestSearcherManager
>    [junit4]   1> Thread-1587: hit exc
>    [junit4]   1> Thread-1588: hit exc
>    [junit4]   2> java.nio.file.FileSystemException: 
> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build/core/test/J3/temp/lucene.search.TestSearcherManager-D6BC19E58A39CA7-001/TestSearcherManager-001/_3i.tvd:
>  Too many open files
>    [junit4]   2>        at 
> org.apache.lucene.mockfile.HandleLimitFS.onOpen(HandleLimitFS.java:49)
>    [junit4]   2>        at 
> org.apache.lucene.mockfile.HandleTrackingFS.callOpenHook(HandleTrackingFS.java:84)
>    [junit4]   2>        at 
> org.apache.lucene.mockfile.HandleTrackingFS.newOutputStream(HandleTrackingFS.java:157)
>    [junit4]   2>        at java.nio.file.Files.newOutputStream(Files.java:172)
>    [junit4]   2>        at 
> org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:265)
>    [junit4]   2>        at 
> org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:214)
>    [junit4]   2>        at 
> org.apache.lucene.store.FilterDirectory.createOutput(FilterDirectory.java:73)
>    [junit4]   2>        at 
> org.apache.lucene.store.RateLimitedDirectoryWrapper.createOutput(RateLimitedDirectoryWrapper.java:45)
>    [junit4]   2>        at 
> org.apache.lucene.store.MockDirectoryWrapper.createOutput(MockDirectoryWrapper.java:607)
>    [junit4]   2>        at 
> org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
>    [junit4]   2>        at 
> org.apache.lucene.codecs.compressing.CompressingTermVectorsWriter.<init>(CompressingTermVectorsWriter.java:226)
>    [junit4]   2>        at 
> org.apache.lucene.codecs.compressing.CompressingTermVectorsFormat.vectorsWriter(CompressingTermVectorsFormat.java:98)
>    [junit4]   2>        at 
> org.apache.lucene.codecs.asserting.AssertingTermVectorsFormat.vectorsWriter(AssertingTermVectorsFormat.java:50)
>    [junit4]   2>        at 
> org.apache.lucene.index.TermVectorsConsumer.initTermVectorsWriter(TermVectorsConsumer.java:88)
>    [junit4]   2>        at 
> org.apache.lucene.index.TermVectorsConsumer.finishDocument(TermVectorsConsumer.java:103)
>    [junit4]   2>        at 
> org.apache.lucene.index.TermsHash.finishDocument(TermsHash.java:93)
>    [junit4]   2>        at 
> org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:316)
>    [junit4]   2>        at 
> org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:270)
>    [junit4]   2>        at 
> org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:410)
>    [junit4]   2>        at 
> org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1231)
>    [junit4]   2>        at 
> org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1192)
>    [junit4]   2>        at 
> org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1177)
>    [junit4]   2>        at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase.addDocuments(ThreadedIndexingAndSearchingTestCase.java:99)
>    [junit4]   2>        at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase$1.run(ThreadedIndexingAndSearchingTestCase.java:218)
>    [junit4]   2> java.nio.file.FileSystemException: 
> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build/core/test/J3/temp/lucene.search.TestSearcherManager-D6BC19E58A39CA7-001/TestSearcherManager-001/_3h.tvd:
>  Too many open files
>    [junit4]   2>        at 
> org.apache.lucene.mockfile.HandleLimitFS.onOpen(HandleLimitFS.java:49)
>    [junit4]   2>        at 
> org.apache.lucene.mockfile.HandleTrackingFS.callOpenHook(HandleTrackingFS.java:84)
>    [junit4]   2>        at 
> org.apache.lucene.mockfile.HandleTrackingFS.newOutputStream(HandleTrackingFS.java:157)
>    [junit4]   2>        at java.nio.file.Files.newOutputStream(Files.java:172)
>    [junit4]   2>        at 
> org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:265)
>    [junit4]   2>        at 
> org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:214)
>    [junit4]   2>        at 
> org.apache.lucene.store.FilterDirectory.createOutput(FilterDirectory.java:73)
>    [junit4]   2>        at 
> org.apache.lucene.store.RateLimitedDirectoryWrapper.createOutput(RateLimitedDirectoryWrapper.java:45)
>    [junit4]   2>        at 
> org.apache.lucene.store.MockDirectoryWrapper.createOutput(MockDirectoryWrapper.java:607)
>    [junit4]   2>        at 
> org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
>    [junit4]   2>        at 
> org.apache.lucene.codecs.compressing.CompressingTermVectorsWriter.<init>(CompressingTermVectorsWriter.java:226)
>    [junit4]   2>        at 
> org.apache.lucene.codecs.compressing.CompressingTermVectorsFormat.vectorsWriter(CompressingTermVectorsFormat.java:98)
>    [junit4]   2>        at 
> org.apache.lucene.codecs.asserting.AssertingTermVectorsFormat.vectorsWriter(AssertingTermVectorsFormat.java:50)
>    [junit4]   2>        at 
> org.apache.lucene.index.TermVectorsConsumer.initTermVectorsWriter(TermVectorsConsumer.java:88)
>    [junit4]   2>        at 
> org.apache.lucene.index.TermVectorsConsumer.finishDocument(TermVectorsConsumer.java:103)
>    [junit4]   2>        at 
> org.apache.lucene.index.TermsHash.finishDocument(TermsHash.java:93)
>    [junit4]   2>        at 
> org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:316)
>    [junit4]   2>        at 
> org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:270)
>    [junit4]   2>        at 
> org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:410)
>    [junit4]   2>        at 
> org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1231)
>    [junit4]   2>        at 
> org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1192)
>    [junit4]   2>        at 
> org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1177)
>    [junit4]   2>        at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase.addDocuments(ThreadedIndexingAndSearchingTestCase.java:99)
>    [junit4]   2>        at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase$1.run(ThreadedIndexingAndSearchingTestCase.java:218)
>    [junit4]   1> Thread-1590: hit exc
>    [junit4]   1> org.apache.lucene.store.AlreadyClosedException: this 
> IndexWriter is closed
>    [junit4]   1>        at 
> org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:705)
>    [junit4]   1>        at 
> org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:719)
>    [junit4]   1>        at 
> org.apache.lucene.index.IndexWriter.nrtIsCurrent(IndexWriter.java:4449)
>    [junit4]   1>        at 
> org.apache.lucene.index.StandardDirectoryReader.doOpenFromWriter(StandardDirectoryReader.java:277)
>    [junit4]   1>        at 
> org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:256)
>    [junit4]   1>        at 
> org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:246)
>    [junit4]   1>        at 
> org.apache.lucene.index.DirectoryReader.openIfChanged(DirectoryReader.java:123)
>    [junit4]   1>        at 
> org.apache.lucene.search.SearcherManager.refreshIfNeeded(SearcherManager.java:137)
>    [junit4]   1>        at 
> org.apache.lucene.search.SearcherManager.refreshIfNeeded(SearcherManager.java:58)
>    [junit4]   1>        at 
> org.apache.lucene.search.ReferenceManager.doMaybeRefresh(ReferenceManager.java:176)
>    [junit4]   1>        at 
> org.apache.lucene.search.ReferenceManager.maybeRefresh(ReferenceManager.java:225)
>    [junit4]   1>        at 
> org.apache.lucene.search.TestSearcherManager.getCurrentSearcher(TestSearcherManager.java:153)
>    [junit4]   1>        at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase$2.run(ThreadedIndexingAndSearchingTestCase.java:337)
>    [junit4]   1> Caused by: java.nio.file.FileSystemException: 
> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build/core/test/J3/temp/lucene.search.TestSearcherManager-D6BC19E58A39CA7-001/TestSearcherManager-001/_3i.tvd:
>  Too many open files
>    [junit4]   1>        at 
> org.apache.lucene.mockfile.HandleLimitFS.onOpen(HandleLimitFS.java:49)
>    [junit4]   1>        at 
> org.apache.lucene.mockfile.HandleTrackingFS.callOpenHook(HandleTrackingFS.java:84)
>    [junit4]   1>        at 
> org.apache.lucene.mockfile.HandleTrackingFS.newOutputStream(HandleTrackingFS.java:157)
>    [junit4]   1>        at java.nio.file.Files.newOutputStream(Files.java:172)
>    [junit4]   1>        at 
> org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:265)
>    [junit4]   1>        at 
> org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:214)
>    [junit4]   1>        at 
> org.apache.lucene.store.FilterDirectory.createOutput(FilterDirectory.java:73)
>    [junit4]   1>        at 
> org.apache.lucene.store.RateLimitedDirectoryWrapper.createOutput(RateLimitedDirectoryWrapper.java:45)
>    [junit4]   1>        at 
> org.apache.lucene.store.MockDirectoryWrapper.createOutput(MockDirectoryWrapper.java:607)
>    [junit4]   1>        at 
> org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
>    [junit4]   1>        at 
> org.apache.lucene.codecs.compressing.CompressingTermVectorsWriter.<init>(CompressingTermVectorsWriter.java:226)
>    [junit4]   1>        at 
> org.apache.lucene.codecs.compressing.CompressingTermVectorsFormat.vectorsWriter(CompressingTermVectorsFormat.java:98)
>    [junit4]   1>        at 
> org.apache.lucene.codecs.asserting.AssertingTermVectorsFormat.vectorsWriter(AssertingTermVectorsFormat.java:50)
>    [junit4]   1>        at 
> org.apache.lucene.index.TermVectorsConsumer.initTermVectorsWriter(TermVectorsConsumer.java:88)
>    [junit4]   1>        at 
> org.apache.lucene.index.TermVectorsConsumer.finishDocument(TermVectorsConsumer.java:103)
>    [junit4]   1>        at 
> org.apache.lucene.index.TermsHash.finishDocument(TermsHash.java:93)
>    [junit4]   1>        at 
> org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:316)
>    [junit4]   1>        at 
> org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:270)
>    [junit4]   1>        at 
> org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:410)
>    [junit4]   1>        at 
> org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1231)
>    [junit4]   1>        at 
> org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1192)
>    [junit4]   1>        at 
> org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1177)
>    [junit4]   1>        at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase.addDocuments(ThreadedIndexingAndSearchingTestCase.java:99)
>    [junit4]   1>        at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase$1.run(ThreadedIndexingAndSearchingTestCase.java:218)
>    [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
> 'ant get-jenkins-line-docs' in the lucene directory.
>    [junit4]   2> NOTE: reproduce with: ant test  
> -Dtestcase=TestSearcherManager -Dtests.method=testSearcherManager 
> -Dtests.seed=D6BC19E58A39CA7 -Dtests.multiplier=2 -Dtests.nightly=true 
> -Dtests.slow=true 
> -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt 
> -Dtests.locale=de_CH -Dtests.timezone=Africa/Addis_Ababa -Dtests.asserts=true 
> -Dtests.file.encoding=US-ASCII
>    [junit4] ERROR   18.4s J3 | TestSearcherManager.testSearcherManager <<<
>    [junit4]    > Throwable #1: 
> org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:705)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:719)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.nrtIsCurrent(IndexWriter.java:4449)
>    [junit4]    >        at 
> org.apache.lucene.index.StandardDirectoryReader.doOpenFromWriter(StandardDirectoryReader.java:277)
>    [junit4]    >        at 
> org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:256)
>    [junit4]    >        at 
> org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:246)
>    [junit4]    >        at 
> org.apache.lucene.index.DirectoryReader.openIfChanged(DirectoryReader.java:123)
>    [junit4]    >        at 
> org.apache.lucene.search.SearcherManager.refreshIfNeeded(SearcherManager.java:137)
>    [junit4]    >        at 
> org.apache.lucene.search.SearcherManager.refreshIfNeeded(SearcherManager.java:58)
>    [junit4]    >        at 
> org.apache.lucene.search.ReferenceManager.doMaybeRefresh(ReferenceManager.java:176)
>    [junit4]    >        at 
> org.apache.lucene.search.ReferenceManager.maybeRefresh(ReferenceManager.java:225)
>    [junit4]    >        at 
> org.apache.lucene.search.TestSearcherManager.getFinalSearcher(TestSearcherManager.java:68)
>    [junit4]    >        at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase.runTest(ThreadedIndexingAndSearchingTestCase.java:541)
>    [junit4]    >        at 
> org.apache.lucene.search.TestSearcherManager.testSearcherManager(TestSearcherManager.java:60)
>    [junit4]    >        at java.lang.Thread.run(Thread.java:745)
>    [junit4]    > Caused by: java.nio.file.FileSystemException: 
> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build/core/test/J3/temp/lucene.search.TestSearcherManager-D6BC19E58A39CA7-001/TestSearcherManager-001/_3i.tvd:
>  Too many open files
>    [junit4]    >        at 
> org.apache.lucene.mockfile.HandleLimitFS.onOpen(HandleLimitFS.java:49)
>    [junit4]    >        at 
> org.apache.lucene.mockfile.HandleTrackingFS.callOpenHook(HandleTrackingFS.java:84)
>    [junit4]    >        at 
> org.apache.lucene.mockfile.HandleTrackingFS.newOutputStream(HandleTrackingFS.java:157)
>    [junit4]    >        at java.nio.file.Files.newOutputStream(Files.java:172)
>    [junit4]    >        at 
> org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:265)
>    [junit4]    >        at 
> org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:214)
>    [junit4]    >        at 
> org.apache.lucene.store.FilterDirectory.createOutput(FilterDirectory.java:73)
>    [junit4]    >        at 
> org.apache.lucene.store.RateLimitedDirectoryWrapper.createOutput(RateLimitedDirectoryWrapper.java:45)
>    [junit4]    >        at 
> org.apache.lucene.store.MockDirectoryWrapper.createOutput(MockDirectoryWrapper.java:607)
>    [junit4]    >        at 
> org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
>    [junit4]    >        at 
> org.apache.lucene.codecs.compressing.CompressingTermVectorsWriter.<init>(CompressingTermVectorsWriter.java:226)
>    [junit4]    >        at 
> org.apache.lucene.codecs.compressing.CompressingTermVectorsFormat.vectorsWriter(CompressingTermVectorsFormat.java:98)
>    [junit4]    >        at 
> org.apache.lucene.codecs.asserting.AssertingTermVectorsFormat.vectorsWriter(AssertingTermVectorsFormat.java:50)
>    [junit4]    >        at 
> org.apache.lucene.index.TermVectorsConsumer.initTermVectorsWriter(TermVectorsConsumer.java:88)
>    [junit4]    >        at 
> org.apache.lucene.index.TermVectorsConsumer.finishDocument(TermVectorsConsumer.java:103)
>    [junit4]    >        at 
> org.apache.lucene.index.TermsHash.finishDocument(TermsHash.java:93)
>    [junit4]    >        at 
> org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:316)
>    [junit4]    >        at 
> org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:270)
>    [junit4]    >        at 
> org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:410)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1231)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1192)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1177)
>    [junit4]    >        at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase.addDocuments(ThreadedIndexingAndSearchingTestCase.java:99)
>    [junit4]    >        at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase$1.run(ThreadedIndexingAndSearchingTestCase.java:218)Throwable
>  #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an 
> uncaught exception in thread: Thread[id=1817, name=Thread-1589, 
> state=RUNNABLE, group=TGRP-TestSearcherManager]
>    [junit4]    > Caused by: java.lang.RuntimeException: 
> java.lang.IllegalStateException: this writer hit an unrecoverable error; 
> cannot commit
>    [junit4]    >        at 
> __randomizedtesting.SeedInfo.seed([D6BC19E58A39CA7]:0)
>    [junit4]    >        at 
> org.apache.lucene.search.TestSearcherManager$2.run(TestSearcherManager.java:134)
>    [junit4]    > Caused by: java.lang.IllegalStateException: this writer hit 
> an unrecoverable error; cannot commit
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2697)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2874)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2841)
>    [junit4]    >        at 
> org.apache.lucene.search.TestSearcherManager$2.run(TestSearcherManager.java:118)
>    [junit4]    > Caused by: java.nio.file.FileSystemException: 
> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build/core/test/J3/temp/lucene.search.TestSearcherManager-D6BC19E58A39CA7-001/TestSearcherManager-001/_3i.tvd:
>  Too many open files
>    [junit4]    >        at 
> org.apache.lucene.mockfile.HandleLimitFS.onOpen(HandleLimitFS.java:49)
>    [junit4]    >        at 
> org.apache.lucene.mockfile.HandleTrackingFS.callOpenHook(HandleTrackingFS.java:84)
>    [junit4]    >        at 
> org.apache.lucene.mockfile.HandleTrackingFS.newOutputStream(HandleTrackingFS.java:157)
>    [junit4]    >        at java.nio.file.Files.newOutputStream(Files.java:172)
>    [junit4]    >        at 
> org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:265)
>    [junit4]    >        at 
> org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:214)
>    [junit4]    >        at 
> org.apache.lucene.store.FilterDirectory.createOutput(FilterDirectory.java:73)
>    [junit4]    >        at 
> org.apache.lucene.store.RateLimitedDirectoryWrapper.createOutput(RateLimitedDirectoryWrapper.java:45)
>    [junit4]    >        at 
> org.apache.lucene.store.MockDirectoryWrapper.createOutput(MockDirectoryWrapper.java:607)
>    [junit4]    >        at 
> org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
>    [junit4]    >        at 
> org.apache.lucene.codecs.compressing.CompressingTermVectorsWriter.<init>(CompressingTermVectorsWriter.java:226)
>    [junit4]    >        at 
> org.apache.lucene.codecs.compressing.CompressingTermVectorsFormat.vectorsWriter(CompressingTermVectorsFormat.java:98)
>    [junit4]    >        at 
> org.apache.lucene.codecs.asserting.AssertingTermVectorsFormat.vectorsWriter(AssertingTermVectorsFormat.java:50)
>    [junit4]    >        at 
> org.apache.lucene.index.TermVectorsConsumer.initTermVectorsWriter(TermVectorsConsumer.java:88)
>    [junit4]    >        at 
> org.apache.lucene.index.TermVectorsConsumer.finishDocument(TermVectorsConsumer.java:103)
>    [junit4]    >        at 
> org.apache.lucene.index.TermsHash.finishDocument(TermsHash.java:93)
>    [junit4]    >        at 
> org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:316)
>    [junit4]    >        at 
> org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:270)
>    [junit4]    >        at 
> org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:410)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1231)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1192)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1177)
>    [junit4]    >        at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase.addDocuments(ThreadedIndexingAndSearchingTestCase.java:99)
>    [junit4]    >        at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase$1.run(ThreadedIndexingAndSearchingTestCase.java:218)Throwable
>  #3: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an 
> uncaught exception in thread: Thread[id=1841, name=Lucene Merge Thread #19, 
> state=RUNNABLE, group=TGRP-TestSearcherManager]
>    [junit4]    > Caused by: 
> org.apache.lucene.index.MergePolicy$MergeException: 
> org.apache.lucene.store.AlreadyClosedException: refusing to delete any files: 
> this IndexWriter hit an unrecoverable exception
>    [junit4]    >        at 
> __randomizedtesting.SeedInfo.seed([D6BC19E58A39CA7]:0)
>    [junit4]    >        at 
> org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:609)
>    [junit4]    >        at 
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:582)
>    [junit4]    > Caused by: org.apache.lucene.store.AlreadyClosedException: 
> refusing to delete any files: this IndexWriter hit an unrecoverable exception
>    [junit4]    >        at 
> org.apache.lucene.index.IndexFileDeleter.ensureOpen(IndexFileDeleter.java:350)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexFileDeleter.deleteFile(IndexFileDeleter.java:728)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexFileDeleter.refresh(IndexFileDeleter.java:460)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3551)
>    [junit4]    >        at 
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:469)
>    [junit4]    >        at 
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:546)
>    [junit4]    > Caused by: java.nio.file.FileSystemException: 
> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build/core/test/J3/temp/lucene.search.TestSearcherManager-D6BC19E58A39CA7-001/TestSearcherManager-001/_3i.tvd:
>  Too many open files
>    [junit4]    >        at 
> org.apache.lucene.mockfile.HandleLimitFS.onOpen(HandleLimitFS.java:49)
>    [junit4]    >        at 
> org.apache.lucene.mockfile.HandleTrackingFS.callOpenHook(HandleTrackingFS.java:84)
>    [junit4]    >        at 
> org.apache.lucene.mockfile.HandleTrackingFS.newOutputStream(HandleTrackingFS.java:157)
>    [junit4]    >        at java.nio.file.Files.newOutputStream(Files.java:172)
>    [junit4]    >        at 
> org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:265)
>    [junit4]    >        at 
> org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:214)
>    [junit4]    >        at 
> org.apache.lucene.store.FilterDirectory.createOutput(FilterDirectory.java:73)
>    [junit4]    >        at 
> org.apache.lucene.store.RateLimitedDirectoryWrapper.createOutput(RateLimitedDirectoryWrapper.java:45)
>    [junit4]    >        at 
> org.apache.lucene.store.MockDirectoryWrapper.createOutput(MockDirectoryWrapper.java:607)
>    [junit4]    >        at 
> org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
>    [junit4]    >        at 
> org.apache.lucene.codecs.compressing.CompressingTermVectorsWriter.<init>(CompressingTermVectorsWriter.java:226)
>    [junit4]    >        at 
> org.apache.lucene.codecs.compressing.CompressingTermVectorsFormat.vectorsWriter(CompressingTermVectorsFormat.java:98)
>    [junit4]    >        at 
> org.apache.lucene.codecs.asserting.AssertingTermVectorsFormat.vectorsWriter(AssertingTermVectorsFormat.java:50)
>    [junit4]    >        at 
> org.apache.lucene.index.TermVectorsConsumer.initTermVectorsWriter(TermVectorsConsumer.java:88)
>    [junit4]    >        at 
> org.apache.lucene.index.TermVectorsConsumer.finishDocument(TermVectorsConsumer.java:103)
>    [junit4]    >        at 
> org.apache.lucene.index.TermsHash.finishDocument(TermsHash.java:93)
>    [junit4]    >        at 
> org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:316)
>    [junit4]    >        at 
> org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:270)
>    [junit4]    >        at 
> org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:410)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1231)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1192)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1177)
>    [junit4]    >        at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase.addDocuments(ThreadedIndexingAndSearchingTestCase.java:99)
>    [junit4]    >        at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase$1.run(ThreadedIndexingAndSearchingTestCase.java:218)Throwable
>  #4: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an 
> uncaught exception in thread: Thread[id=1815, name=Thread-1587, 
> state=RUNNABLE, group=TGRP-TestSearcherManager]
>    [junit4]    > Caused by: java.lang.RuntimeException: 
> java.nio.file.FileSystemException: 
> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build/core/test/J3/temp/lucene.search.TestSearcherManager-D6BC19E58A39CA7-001/TestSearcherManager-001/_3i.tvd:
>  Too many open files
>    [junit4]    >        at 
> __randomizedtesting.SeedInfo.seed([D6BC19E58A39CA7]:0)
>    [junit4]    >        at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase$1.run(ThreadedIndexingAndSearchingTestCase.java:302)
>    [junit4]    > Caused by: java.nio.file.FileSystemException: 
> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build/core/test/J3/temp/lucene.search.TestSearcherManager-D6BC19E58A39CA7-001/TestSearcherManager-001/_3i.tvd:
>  Too many open files
>    [junit4]    >        at 
> org.apache.lucene.mockfile.HandleLimitFS.onOpen(HandleLimitFS.java:49)
>    [junit4]    >        at 
> org.apache.lucene.mockfile.HandleTrackingFS.callOpenHook(HandleTrackingFS.java:84)
>    [junit4]    >        at 
> org.apache.lucene.mockfile.HandleTrackingFS.newOutputStream(HandleTrackingFS.java:157)
>    [junit4]    >        at java.nio.file.Files.newOutputStream(Files.java:172)
>    [junit4]    >        at 
> org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:265)
>    [junit4]    >        at 
> org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:214)
>    [junit4]    >        at 
> org.apache.lucene.store.FilterDirectory.createOutput(FilterDirectory.java:73)
>    [junit4]    >        at 
> org.apache.lucene.store.RateLimitedDirectoryWrapper.createOutput(RateLimitedDirectoryWrapper.java:45)
>    [junit4]    >        at 
> org.apache.lucene.store.MockDirectoryWrapper.createOutput(MockDirectoryWrapper.java:607)
>    [junit4]    >        at 
> org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
>    [junit4]    >        at 
> org.apache.lucene.codecs.compressing.CompressingTermVectorsWriter.<init>(CompressingTermVectorsWriter.java:226)
>    [junit4]    >        at 
> org.apache.lucene.codecs.compressing.CompressingTermVectorsFormat.vectorsWriter(CompressingTermVectorsFormat.java:98)
>    [junit4]    >        at 
> org.apache.lucene.codecs.asserting.AssertingTermVectorsFormat.vectorsWriter(AssertingTermVectorsFormat.java:50)
>    [junit4]    >        at 
> org.apache.lucene.index.TermVectorsConsumer.initTermVectorsWriter(TermVectorsConsumer.java:88)
>    [junit4]    >        at 
> org.apache.lucene.index.TermVectorsConsumer.finishDocument(TermVectorsConsumer.java:103)
>    [junit4]    >        at 
> org.apache.lucene.index.TermsHash.finishDocument(TermsHash.java:93)
>    [junit4]    >        at 
> org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:316)
>    [junit4]    >        at 
> org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:270)
>    [junit4]    >        at 
> org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:410)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1231)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1192)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1177)
>    [junit4]    >        at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase.addDocuments(ThreadedIndexingAndSearchingTestCase.java:99)
>    [junit4]    >        at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase$1.run(ThreadedIndexingAndSearchingTestCase.java:218)Throwable
>  #5: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an 
> uncaught exception in thread: Thread[id=1816, name=Thread-1588, 
> state=RUNNABLE, group=TGRP-TestSearcherManager]
>    [junit4]    > Caused by: java.lang.RuntimeException: 
> java.nio.file.FileSystemException: 
> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build/core/test/J3/temp/lucene.search.TestSearcherManager-D6BC19E58A39CA7-001/TestSearcherManager-001/_3h.tvd:
>  Too many open files
>    [junit4]    >        at 
> __randomizedtesting.SeedInfo.seed([D6BC19E58A39CA7]:0)
>    [junit4]    >        at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase$1.run(ThreadedIndexingAndSearchingTestCase.java:302)
>    [junit4]    > Caused by: java.nio.file.FileSystemException: 
> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build/core/test/J3/temp/lucene.search.TestSearcherManager-D6BC19E58A39CA7-001/TestSearcherManager-001/_3h.tvd:
>  Too many open files
>    [junit4]    >        at 
> org.apache.lucene.mockfile.HandleLimitFS.onOpen(HandleLimitFS.java:49)
>    [junit4]    >        at 
> org.apache.lucene.mockfile.HandleTrackingFS.callOpenHook(HandleTrackingFS.java:84)
>    [junit4]    >        at 
> org.apache.lucene.mockfile.HandleTrackingFS.newOutputStream(HandleTrackingFS.java:157)
>    [junit4]    >        at java.nio.file.Files.newOutputStream(Files.java:172)
>    [junit4]    >        at 
> org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:265)
>    [junit4]    >        at 
> org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:214)
>    [junit4]    >        at 
> org.apache.lucene.store.FilterDirectory.createOutput(FilterDirectory.java:73)
>    [junit4]    >        at 
> org.apache.lucene.store.RateLimitedDirectoryWrapper.createOutput(RateLimitedDirectoryWrapper.java:45)
>    [junit4]    >        at 
> org.apache.lucene.store.MockDirectoryWrapper.createOutput(MockDirectoryWrapper.java:607)
>    [junit4]    >        at 
> org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
>    [junit4]    >        at 
> org.apache.lucene.codecs.compressing.CompressingTermVectorsWriter.<init>(CompressingTermVectorsWriter.java:226)
>    [junit4]    >        at 
> org.apache.lucene.codecs.compressing.CompressingTermVectorsFormat.vectorsWriter(CompressingTermVectorsFormat.java:98)
>    [junit4]    >        at 
> org.apache.lucene.codecs.asserting.AssertingTermVectorsFormat.vectorsWriter(AssertingTermVectorsFormat.java:50)
>    [junit4]    >        at 
> org.apache.lucene.index.TermVectorsConsumer.initTermVectorsWriter(TermVectorsConsumer.java:88)
>    [junit4]    >        at 
> org.apache.lucene.index.TermVectorsConsumer.finishDocument(TermVectorsConsumer.java:103)
>    [junit4]    >        at 
> org.apache.lucene.index.TermsHash.finishDocument(TermsHash.java:93)
>    [junit4]    >        at 
> org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:316)
>    [junit4]    >        at 
> org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:270)
>    [junit4]    >        at 
> org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:410)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1231)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1192)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1177)
>    [junit4]    >        at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase.addDocuments(ThreadedIndexingAndSearchingTestCase.java:99)
>    [junit4]    >        at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase$1.run(ThreadedIndexingAndSearchingTestCase.java:218)Throwable
>  #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an 
> uncaught exception in thread: Thread[id=1818, name=Thread-1590, 
> state=RUNNABLE, group=TGRP-TestSearcherManager]
>    [junit4]    > Caused by: java.lang.RuntimeException: 
> org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
>    [junit4]    >        at 
> __randomizedtesting.SeedInfo.seed([D6BC19E58A39CA7]:0)
>    [junit4]    >        at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase$2.run(ThreadedIndexingAndSearchingTestCase.java:397)
>    [junit4]    > Caused by: org.apache.lucene.store.AlreadyClosedException: 
> this IndexWriter is closed
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:705)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:719)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.nrtIsCurrent(IndexWriter.java:4449)
>    [junit4]    >        at 
> org.apache.lucene.index.StandardDirectoryReader.doOpenFromWriter(StandardDirectoryReader.java:277)
>    [junit4]    >        at 
> org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:256)
>    [junit4]    >        at 
> org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:246)
>    [junit4]    >        at 
> org.apache.lucene.index.DirectoryReader.openIfChanged(DirectoryReader.java:123)
>    [junit4]    >        at 
> org.apache.lucene.search.SearcherManager.refreshIfNeeded(SearcherManager.java:137)
>    [junit4]    >        at 
> org.apache.lucene.search.SearcherManager.refreshIfNeeded(SearcherManager.java:58)
>    [junit4]    >        at 
> org.apache.lucene.search.ReferenceManager.doMaybeRefresh(ReferenceManager.java:176)
>    [junit4]    >        at 
> org.apache.lucene.search.ReferenceManager.maybeRefresh(ReferenceManager.java:225)
>    [junit4]    >        at 
> org.apache.lucene.search.TestSearcherManager.getCurrentSearcher(TestSearcherManager.java:153)
>    [junit4]    >        at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase$2.run(ThreadedIndexingAndSearchingTestCase.java:337)
>    [junit4]    > Caused by: java.nio.file.FileSystemException: 
> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build/core/test/J3/temp/lucene.search.TestSearcherManager-D6BC19E58A39CA7-001/TestSearcherManager-001/_3i.tvd:
>  Too many open files
>    [junit4]    >        at 
> org.apache.lucene.mockfile.HandleLimitFS.onOpen(HandleLimitFS.java:49)
>    [junit4]    >        at 
> org.apache.lucene.mockfile.HandleTrackingFS.callOpenHook(HandleTrackingFS.java:84)
>    [junit4]    >        at 
> org.apache.lucene.mockfile.HandleTrackingFS.newOutputStream(HandleTrackingFS.java:157)
>    [junit4]    >        at java.nio.file.Files.newOutputStream(Files.java:172)
>    [junit4]    >        at 
> org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:265)
>    [junit4]    >        at 
> org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:214)
>    [junit4]    >        at 
> org.apache.lucene.store.FilterDirectory.createOutput(FilterDirectory.java:73)
>    [junit4]    >        at 
> org.apache.lucene.store.RateLimitedDirectoryWrapper.createOutput(RateLimitedDirectoryWrapper.java:45)
>    [junit4]    >        at 
> org.apache.lucene.store.MockDirectoryWrapper.createOutput(MockDirectoryWrapper.java:607)
>    [junit4]    >        at 
> org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
>    [junit4]    >        at 
> org.apache.lucene.codecs.compressing.CompressingTermVectorsWriter.<init>(CompressingTermVectorsWriter.java:226)
>    [junit4]    >        at 
> org.apache.lucene.codecs.compressing.CompressingTermVectorsFormat.vectorsWriter(CompressingTermVectorsFormat.java:98)
>    [junit4]    >        at 
> org.apache.lucene.codecs.asserting.AssertingTermVectorsFormat.vectorsWriter(AssertingTermVectorsFormat.java:50)
>    [junit4]    >        at 
> org.apache.lucene.index.TermVectorsConsumer.initTermVectorsWriter(TermVectorsConsumer.java:88)
>    [junit4]    >        at 
> org.apache.lucene.index.TermVectorsConsumer.finishDocument(TermVectorsConsumer.java:103)
>    [junit4]    >        at 
> org.apache.lucene.index.TermsHash.finishDocument(TermsHash.java:93)
>    [junit4]    >        at 
> org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:316)
>    [junit4]    >        at 
> org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:270)
>    [junit4]    >        at 
> org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:410)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1231)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1192)
>    [junit4]    >        at 
> org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1177)
>    [junit4]    >        at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase.addDocuments(ThreadedIndexingAndSearchingTestCase.java:99)
>    [junit4]    >        at 
> org.apache.lucene.index.ThreadedIndexingAndSearchingTestCase$1.run(ThreadedIndexingAndSearchingTestCase.java:218)
>    [junit4]   2> NOTE: leaving temporary files on disk at: 
> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build/core/test/J3/temp/lucene.search.TestSearcherManager-D6BC19E58A39CA7-001
>    [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): 
> {extra37=PostingsFormat(name=Asserting), 
> extra18=BlockTreeOrds(blocksize=128), extra8=PostingsFormat(name=Asserting), 
> extra27=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
>  extra35=FSTOrd50, extra28=FSTOrd50, extra2=FSTOrd50, 
> extra25=BlockTreeOrds(blocksize=128), extra19=PostingsFormat(name=Asserting), 
> docid_int=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
>  extra3=BlockTreeOrds(blocksize=128), extra36=BlockTreeOrds(blocksize=128), 
> extra9=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
>  extra29=BlockTreeOrds(blocksize=128), title=PostingsFormat(name=Asserting), 
> extra20=FSTOrd50, extra4=PostingsFormat(name=Asserting), extra39=FSTOrd50, 
> date=FSTOrd50, extra14=BlockTreeOrds(blocksize=128), 
> extra5=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
>  extra22=PostingsFormat(name=Asserting), extra6=FSTOrd50, 
> extra26=PostingsFormat(name=Asserting), extra10=BlockTreeOrds(blocksize=128), 
> extra0=PostingsFormat(name=Asserting), extra31=FSTOrd50, extra13=FSTOrd50, 
> extra23=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
>  
> extra30=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
>  
> extra16=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
>  
> extra12=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
>  extra15=PostingsFormat(name=Asserting), extra7=BlockTreeOrds(blocksize=128), 
> extra1=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
>  extra11=PostingsFormat(name=Asserting), 
> extra38=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
>  titleTokenized=BlockTreeOrds(blocksize=128), body=FSTOrd50, 
> extra34=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
>  extra33=PostingsFormat(name=Asserting), 
> docid=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
>  extra24=FSTOrd50, packID=PostingsFormat(name=Asserting), 
> extra21=BlockTreeOrds(blocksize=128), extra17=FSTOrd50, 
> extra32=BlockTreeOrds(blocksize=128)}, 
> docValues:{docid_intDV=DocValuesFormat(name=Lucene50), 
> titleDV=DocValuesFormat(name=Lucene50)}, sim=DefaultSimilarity, locale=de_CH, 
> timezone=Africa/Addis_Ababa
>    [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 
> 1.7.0_65 (64-bit)/cpus=16,threads=2,free=193111096,total=490209280
>    [junit4]   2> NOTE: All tests run in this JVM: [TestDocumentWriter, 
> TestQueryRescorer, TestSpanSearchEquivalence, TestFlex, 
> TestCachingWrapperFilter, TestStressDeletes, TestBlockPostingsFormat, 
> TestSimpleExplanations, ThrowInUncaught, 
> TestUsageTrackingFilterCachingPolicy, TestDeletionPolicy, 
> TestFrequencyTrackingRingBuffer, TestSumDocFreq, TestMatchAllDocsQuery, 
> TestSnapshotDeletionPolicy, TestLongBitSet, TestMergedIterator, 
> TestTermdocPerf, TestNoDeletionPolicy, TestMultiPhraseQuery, 
> TestIndexReaderClose, TestIndexWriterMaxDocs, 
> TestPositiveScoresOnlyCollector, TestBooleanCoord, TestFilteredQuery, 
> TestBasics, TestConjunctions, TestLookaheadTokenFilter, TestDateSort, 
> TestTwoPhaseCommitTool, TestBooleanQuery, TestBufferedIndexInput, 
> TestMultiThreadTermVectors, TestIntsRef, TestConcurrentMergeScheduler, 
> TestWildcard, TestBooleanQueryVisitSubscorers, TestFieldCacheTermsFilter, 
> TestOperations, TestIndexWriterMerging, TestAutomatonQuery, Nested1, 
> TestSizeBoundedForceMerge, TestReusableStringReader, 
> TestIndexWriterForceMerge, Test2BSortedDocValues, TestSegmentTermEnum, 
> Nested, TestBagOfPositions, TestPhrasePrefixQuery, TestIOUtils, 
> TestIndexWriterOnDiskFull, TestIndexWriter, TestIndexWriterReader, 
> TestCompressingTermVectorsFormat, TestFSTs, TestSearcherManager]
>    [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
> 'ant get-jenkins-line-docs' in the lucene directory.
>    [junit4]   2> NOTE: reproduce with: ant test  
> -Dtestcase=TestSearcherManager -Dtests.seed=D6BC19E58A39CA7 
> -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true 
> -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt 
> -Dtests.locale=de_CH -Dtests.timezone=Africa/Addis_Ababa -Dtests.asserts=true 
> -Dtests.file.encoding=US-ASCII
>    [junit4] ERROR   0.00s J3 | TestSearcherManager (suite) <<<
>    [junit4]    > Throwable #1: 
> com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from 
> SUITE scope at org.apache.lucene.search.TestSearcherManager:
>    [junit4]    >    1) Thread[id=1838, name=LuceneTestCase-323-thread-1, 
> state=WAITING, group=TGRP-TestSearcherManager]
>    [junit4]    >         at sun.misc.Unsafe.park(Native Method)
>    [junit4]    >         at 
> java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>    [junit4]    >         at 
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>    [junit4]    >         at 
> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>    [junit4]    >         at 
> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
>    [junit4]    >         at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>    [junit4]    >         at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>    [junit4]    >         at java.lang.Thread.run(Thread.java:745)
>    [junit4]    >        at 
> __randomizedtesting.SeedInfo.seed([D6BC19E58A39CA7]:0)Throwable #2: 
> com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
> threads that couldn't be terminated:
>    [junit4]    >    1) Thread[id=1838, name=LuceneTestCase-323-thread-1, 
> state=WAITING, group=TGRP-TestSearcherManager]
>    [junit4]    >         at sun.misc.Unsafe.park(Native Method)
>    [junit4]    >         at 
> java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>    [junit4]    >         at 
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>    [junit4]    >         at 
> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>    [junit4]    >         at 
> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
>    [junit4]    >         at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>    [junit4]    >         at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>    [junit4]    >         at java.lang.Thread.run(Thread.java:745)
>    [junit4]    >        at 
> __randomizedtesting.SeedInfo.seed([D6BC19E58A39CA7]:0)
>    [junit4] Completed on J3 in 41.63s, 9 tests, 3 errors <<< FAILURES!
>
> [...truncated 712 lines...]
> BUILD FAILED
> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:536:
>  The following error occurred while executing this line:
> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:477:
>  The following error occurred while executing this line:
> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61:
>  The following error occurred while executing this line:
> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39:
>  The following error occurred while executing this line:
> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build.xml:49:
>  The following error occurred while executing this line:
> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1363:
>  The following error occurred while executing this line:
> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:970:
>  There were test failures: 410 suites, 3254 tests, 2 suite-level errors, 1 
> error, 1297 ignored (18 assumptions)
>
> Total time: 27 minutes 34 seconds
> Build step 'Invoke Ant' marked build as failure
> Archiving artifacts
> Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #716
> Archived 5 artifacts
> Archive block size is 32768
> Received 0 blocks and 5163429 bytes
> Compression is 0.0%
> Took 1.5 sec
> Recording test results
> Email was triggered for: Failure
> Sending email for trigger: Failure
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> For additional commands, e-mail: dev-h...@lucene.apache.org

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to