It actually repros with java7 too, if you beast it. It's a scary failure: it seems like, after closing, the very last thing IW does in closeInternal's finally clause is to process events, and one of those events is trying to flush a segment ... weird.
Mike McCandless http://blog.mikemccandless.com On Tue, Dec 17, 2013 at 3:21 PM, Robert Muir <[email protected]> wrote: > I just want to point out this confused me a bit. the jenkins job says > java7 but it really runs java6. > > On Tue, Dec 17, 2013 at 1:43 PM, <[email protected]> wrote: >> Build: builds.flonkings.com/job/Lucene-4x-Linux-Java7-64-test-only/6907/ >> >> 1 tests failed. >> REGRESSION: >> org.apache.lucene.index.TestIndexWriterWithThreads.testRollbackAndCommitWithThreads >> >> Error Message: >> Captured an uncaught exception in thread: Thread[id=193, name=Thread-133, >> state=RUNNABLE, group=TGRP-TestIndexWriterWithThreads] >> >> Stack Trace: >> com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an >> uncaught exception in thread: Thread[id=193, name=Thread-133, >> state=RUNNABLE, group=TGRP-TestIndexWriterWithThreads] >> Caused by: java.lang.RuntimeException: >> org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed >> at __randomizedtesting.SeedInfo.seed([3FAF37E1AFFB2502]:0) >> at >> org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:619) >> Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter >> is closed >> at >> org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:645) >> at >> org.apache.lucene.index.IndexWriter.numDeletedDocs(IndexWriter.java:622) >> at >> org.apache.lucene.index.IndexWriter.segString(IndexWriter.java:4265) >> at >> org.apache.lucene.index.IndexWriter.publishFlushedSegment(IndexWriter.java:2324) >> at >> org.apache.lucene.index.DocumentsWriterFlushQueue$FlushTicket.publishFlushedSegment(DocumentsWriterFlushQueue.java:198) >> at >> org.apache.lucene.index.DocumentsWriterFlushQueue$FlushTicket.finishFlush(DocumentsWriterFlushQueue.java:213) >> at >> org.apache.lucene.index.DocumentsWriterFlushQueue$SegmentFlushTicket.publish(DocumentsWriterFlushQueue.java:249) >> at >> org.apache.lucene.index.DocumentsWriterFlushQueue.innerPurge(DocumentsWriterFlushQueue.java:116) >> at >> org.apache.lucene.index.DocumentsWriterFlushQueue.forcePurge(DocumentsWriterFlushQueue.java:138) >> at >> org.apache.lucene.index.DocumentsWriter.purgeBuffer(DocumentsWriter.java:185) >> at org.apache.lucene.index.IndexWriter.purge(IndexWriter.java:4634) >> at >> org.apache.lucene.index.DocumentsWriter$ForcedPurgeEvent.process(DocumentsWriter.java:701) >> at >> org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4665) >> at >> org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4657) >> at >> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:1067) >> at >> org.apache.lucene.index.IndexWriter.rollbackInternal(IndexWriter.java:2106) >> at >> org.apache.lucene.index.IndexWriter.rollback(IndexWriter.java:2024) >> at >> org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:575) >> >> >> >> >> Build Log: >> [...truncated 782 lines...] >> [junit4] Suite: org.apache.lucene.index.TestIndexWriterWithThreads >> [junit4] 2> 17 déc. 2013 19:41:23 >> com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler >> uncaughtException >> [junit4] 2> ATTENTION: Uncaught exception in thread: >> Thread[Thread-133,5,TGRP-TestIndexWriterWithThreads] >> [junit4] 2> java.lang.RuntimeException: >> org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed >> [junit4] 2> at >> __randomizedtesting.SeedInfo.seed([3FAF37E1AFFB2502]:0) >> [junit4] 2> at >> org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:619) >> [junit4] 2> Caused by: org.apache.lucene.store.AlreadyClosedException: >> this IndexWriter is closed >> [junit4] 2> at >> org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:645) >> [junit4] 2> at >> org.apache.lucene.index.IndexWriter.numDeletedDocs(IndexWriter.java:622) >> [junit4] 2> at >> org.apache.lucene.index.IndexWriter.segString(IndexWriter.java:4265) >> [junit4] 2> at >> org.apache.lucene.index.IndexWriter.publishFlushedSegment(IndexWriter.java:2324) >> [junit4] 2> at >> org.apache.lucene.index.DocumentsWriterFlushQueue$FlushTicket.publishFlushedSegment(DocumentsWriterFlushQueue.java:198) >> [junit4] 2> at >> org.apache.lucene.index.DocumentsWriterFlushQueue$FlushTicket.finishFlush(DocumentsWriterFlushQueue.java:213) >> [junit4] 2> at >> org.apache.lucene.index.DocumentsWriterFlushQueue$SegmentFlushTicket.publish(DocumentsWriterFlushQueue.java:249) >> [junit4] 2> at >> org.apache.lucene.index.DocumentsWriterFlushQueue.innerPurge(DocumentsWriterFlushQueue.java:116) >> [junit4] 2> at >> org.apache.lucene.index.DocumentsWriterFlushQueue.forcePurge(DocumentsWriterFlushQueue.java:138) >> [junit4] 2> at >> org.apache.lucene.index.DocumentsWriter.purgeBuffer(DocumentsWriter.java:185) >> [junit4] 2> at >> org.apache.lucene.index.IndexWriter.purge(IndexWriter.java:4634) >> [junit4] 2> at >> org.apache.lucene.index.DocumentsWriter$ForcedPurgeEvent.process(DocumentsWriter.java:701) >> [junit4] 2> at >> org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4665) >> [junit4] 2> at >> org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4657) >> [junit4] 2> at >> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:1067) >> [junit4] 2> at >> org.apache.lucene.index.IndexWriter.rollbackInternal(IndexWriter.java:2106) >> [junit4] 2> at >> org.apache.lucene.index.IndexWriter.rollback(IndexWriter.java:2024) >> [junit4] 2> at >> org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:575) >> [junit4] 2> 17 déc. 2013 19:41:23 >> com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler >> uncaughtException >> [junit4] 2> ATTENTION: Uncaught exception in thread: >> Thread[Thread-135,5,TGRP-TestIndexWriterWithThreads] >> [junit4] 2> java.lang.RuntimeException: >> org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed >> [junit4] 2> at >> __randomizedtesting.SeedInfo.seed([3FAF37E1AFFB2502]:0) >> [junit4] 2> at >> org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:619) >> [junit4] 2> Caused by: org.apache.lucene.store.AlreadyClosedException: >> this IndexWriter is closed >> [junit4] 2> at >> org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:645) >> [junit4] 2> at >> org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:659) >> [junit4] 2> at >> org.apache.lucene.index.IndexWriter.rollback(IndexWriter.java:2018) >> [junit4] 2> at >> org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:575) >> [junit4] 2> NOTE: reproduce with: ant test >> -Dtestcase=TestIndexWriterWithThreads >> -Dtests.method=testRollbackAndCommitWithThreads >> -Dtests.seed=3FAF37E1AFFB2502 -Dtests.slow=true -Dtests.locale=fr_FR >> -Dtests.timezone=Africa/Malabo -Dtests.file.encoding=UTF-8 >> [junit4] ERROR 0.27s J5 | >> TestIndexWriterWithThreads.testRollbackAndCommitWithThreads <<< >> [junit4] > Throwable #1: java.lang.AssertionError >> [junit4] > at >> org.apache.lucene.index.TestIndexWriterWithThreads.testRollbackAndCommitWithThreads(TestIndexWriterWithThreads.java:631) >> [junit4] > at java.lang.Thread.run(Thread.java:662)Throwable >> #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an >> uncaught exception in thread: Thread[id=193, name=Thread-133, >> state=RUNNABLE, group=TGRP-TestIndexWriterWithThreads] >> [junit4] > Caused by: java.lang.RuntimeException: >> org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed >> [junit4] > at >> __randomizedtesting.SeedInfo.seed([3FAF37E1AFFB2502]:0) >> [junit4] > at >> org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:619) >> [junit4] > Caused by: org.apache.lucene.store.AlreadyClosedException: >> this IndexWriter is closed >> [junit4] > at >> org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:645) >> [junit4] > at >> org.apache.lucene.index.IndexWriter.numDeletedDocs(IndexWriter.java:622) >> [junit4] > at >> org.apache.lucene.index.IndexWriter.segString(IndexWriter.java:4265) >> [junit4] > at >> org.apache.lucene.index.IndexWriter.publishFlushedSegment(IndexWriter.java:2324) >> [junit4] > at >> org.apache.lucene.index.DocumentsWriterFlushQueue$FlushTicket.publishFlushedSegment(DocumentsWriterFlushQueue.java:198) >> [junit4] > at >> org.apache.lucene.index.DocumentsWriterFlushQueue$FlushTicket.finishFlush(DocumentsWriterFlushQueue.java:213) >> [junit4] > at >> org.apache.lucene.index.DocumentsWriterFlushQueue$SegmentFlushTicket.publish(DocumentsWriterFlushQueue.java:249) >> [junit4] > at >> org.apache.lucene.index.DocumentsWriterFlushQueue.innerPurge(DocumentsWriterFlushQueue.java:116) >> [junit4] > at >> org.apache.lucene.index.DocumentsWriterFlushQueue.forcePurge(DocumentsWriterFlushQueue.java:138) >> [junit4] > at >> org.apache.lucene.index.DocumentsWriter.purgeBuffer(DocumentsWriter.java:185) >> [junit4] > at >> org.apache.lucene.index.IndexWriter.purge(IndexWriter.java:4634) >> [junit4] > at >> org.apache.lucene.index.DocumentsWriter$ForcedPurgeEvent.process(DocumentsWriter.java:701) >> [junit4] > at >> org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4665) >> [junit4] > at >> org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4657) >> [junit4] > at >> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:1067) >> [junit4] > at >> org.apache.lucene.index.IndexWriter.rollbackInternal(IndexWriter.java:2106) >> [junit4] > at >> org.apache.lucene.index.IndexWriter.rollback(IndexWriter.java:2024) >> [junit4] > at >> org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:575)Throwable >> #3: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an >> uncaught exception in thread: Thread[id=195, name=Thread-135, >> state=RUNNABLE, group=TGRP-TestIndexWriterWithThreads] >> [junit4] > Caused by: java.lang.RuntimeException: >> org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed >> [junit4] > at >> __randomizedtesting.SeedInfo.seed([3FAF37E1AFFB2502]:0) >> [junit4] > at >> org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:619) >> [junit4] > Caused by: org.apache.lucene.store.AlreadyClosedException: >> this IndexWriter is closed >> [junit4] > at >> org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:645) >> [junit4] > at >> org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:659) >> [junit4] > at >> org.apache.lucene.index.IndexWriter.rollback(IndexWriter.java:2018) >> [junit4] > at >> org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:575) >> [junit4] 2> NOTE: test params are: codec=Lucene45, >> sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {field=DFR >> I(F)L3(800.0), body=DFR I(n)B1, titleTokenized=DFR I(F)B1}, locale=fr_FR, >> timezone=Africa/Malabo >> [junit4] 2> NOTE: Linux 3.2.0-26-generic amd64/Sun Microsystems Inc. >> 1.6.0_45 (64-bit)/cpus=8,threads=1,free=78129256,total=170721280 >> [junit4] 2> NOTE: All tests run in this JVM: [Test2BTerms, >> TestCompoundFile, TestAtomicUpdate, TestByteSlices, TestWindowsMMap, >> TestEliasFanoDocIdSet, TestSnapshotDeletionPolicy, >> TestCrashCausesCorruptIndex, TestBooleanOr, TestCachingTokenFilter, >> TestDocIdSet, TestFieldInfos, TestAssertions, TestBytesStore, TestSearch, >> TestPrefixInBooleanQuery, TestDocument, TestRateLimiter, >> TestEarlyTermination, TestPositionIncrement, TestCachingCollector, >> TestSpecialOperations, TestReaderClosed, TestPerFieldDocValuesFormat, >> TestFSTs, TestIndexWriterWithThreads] >> [junit4] Completed on J5 in 6.95s, 12 tests, 1 error <<< FAILURES! >> >> [...truncated 636 lines...] >> BUILD FAILED >> /var/lib/jenkins/workspace/Lucene-4x-Linux-Java7-64-test-only/checkout/lucene/build.xml:49: >> The following error occurred while executing this line: >> /var/lib/jenkins/workspace/Lucene-4x-Linux-Java7-64-test-only/checkout/lucene/common-build.xml:1307: >> The following error occurred while executing this line: >> /var/lib/jenkins/workspace/Lucene-4x-Linux-Java7-64-test-only/checkout/lucene/common-build.xml:940: >> There were test failures: 379 suites, 2758 tests, 1 error, 81 ignored (68 >> assumptions) >> >> Total time: 5 minutes 33 seconds >> Build step 'Invoke Ant' marked build as failure >> Recording test results >> Email was triggered for: Failure >> Sending email for trigger: Failure >> >> >> >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: [email protected] >> For additional commands, e-mail: [email protected] > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
