it's not trying to flush a segment it tries to publish it. It already is flushed but still scary. I will update the job description @Robert
On Tue, Dec 17, 2013 at 9:27 PM, Michael McCandless <[email protected]> wrote: > It actually repros with java7 too, if you beast it. > > It's a scary failure: it seems like, after closing, the very last > thing IW does in closeInternal's finally clause is to process events, > and one of those events is trying to flush a segment ... weird. > > Mike McCandless > > http://blog.mikemccandless.com > > > On Tue, Dec 17, 2013 at 3:21 PM, Robert Muir <[email protected]> wrote: >> I just want to point out this confused me a bit. the jenkins job says >> java7 but it really runs java6. >> >> On Tue, Dec 17, 2013 at 1:43 PM, <[email protected]> wrote: >>> Build: builds.flonkings.com/job/Lucene-4x-Linux-Java7-64-test-only/6907/ >>> >>> 1 tests failed. >>> REGRESSION: >>> org.apache.lucene.index.TestIndexWriterWithThreads.testRollbackAndCommitWithThreads >>> >>> Error Message: >>> Captured an uncaught exception in thread: Thread[id=193, name=Thread-133, >>> state=RUNNABLE, group=TGRP-TestIndexWriterWithThreads] >>> >>> Stack Trace: >>> com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an >>> uncaught exception in thread: Thread[id=193, name=Thread-133, >>> state=RUNNABLE, group=TGRP-TestIndexWriterWithThreads] >>> Caused by: java.lang.RuntimeException: >>> org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed >>> at __randomizedtesting.SeedInfo.seed([3FAF37E1AFFB2502]:0) >>> at >>> org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:619) >>> Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter >>> is closed >>> at >>> org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:645) >>> at >>> org.apache.lucene.index.IndexWriter.numDeletedDocs(IndexWriter.java:622) >>> at >>> org.apache.lucene.index.IndexWriter.segString(IndexWriter.java:4265) >>> at >>> org.apache.lucene.index.IndexWriter.publishFlushedSegment(IndexWriter.java:2324) >>> at >>> org.apache.lucene.index.DocumentsWriterFlushQueue$FlushTicket.publishFlushedSegment(DocumentsWriterFlushQueue.java:198) >>> at >>> org.apache.lucene.index.DocumentsWriterFlushQueue$FlushTicket.finishFlush(DocumentsWriterFlushQueue.java:213) >>> at >>> org.apache.lucene.index.DocumentsWriterFlushQueue$SegmentFlushTicket.publish(DocumentsWriterFlushQueue.java:249) >>> at >>> org.apache.lucene.index.DocumentsWriterFlushQueue.innerPurge(DocumentsWriterFlushQueue.java:116) >>> at >>> org.apache.lucene.index.DocumentsWriterFlushQueue.forcePurge(DocumentsWriterFlushQueue.java:138) >>> at >>> org.apache.lucene.index.DocumentsWriter.purgeBuffer(DocumentsWriter.java:185) >>> at org.apache.lucene.index.IndexWriter.purge(IndexWriter.java:4634) >>> at >>> org.apache.lucene.index.DocumentsWriter$ForcedPurgeEvent.process(DocumentsWriter.java:701) >>> at >>> org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4665) >>> at >>> org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4657) >>> at >>> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:1067) >>> at >>> org.apache.lucene.index.IndexWriter.rollbackInternal(IndexWriter.java:2106) >>> at >>> org.apache.lucene.index.IndexWriter.rollback(IndexWriter.java:2024) >>> at >>> org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:575) >>> >>> >>> >>> >>> Build Log: >>> [...truncated 782 lines...] >>> [junit4] Suite: org.apache.lucene.index.TestIndexWriterWithThreads >>> [junit4] 2> 17 déc. 2013 19:41:23 >>> com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler >>> uncaughtException >>> [junit4] 2> ATTENTION: Uncaught exception in thread: >>> Thread[Thread-133,5,TGRP-TestIndexWriterWithThreads] >>> [junit4] 2> java.lang.RuntimeException: >>> org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed >>> [junit4] 2> at >>> __randomizedtesting.SeedInfo.seed([3FAF37E1AFFB2502]:0) >>> [junit4] 2> at >>> org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:619) >>> [junit4] 2> Caused by: org.apache.lucene.store.AlreadyClosedException: >>> this IndexWriter is closed >>> [junit4] 2> at >>> org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:645) >>> [junit4] 2> at >>> org.apache.lucene.index.IndexWriter.numDeletedDocs(IndexWriter.java:622) >>> [junit4] 2> at >>> org.apache.lucene.index.IndexWriter.segString(IndexWriter.java:4265) >>> [junit4] 2> at >>> org.apache.lucene.index.IndexWriter.publishFlushedSegment(IndexWriter.java:2324) >>> [junit4] 2> at >>> org.apache.lucene.index.DocumentsWriterFlushQueue$FlushTicket.publishFlushedSegment(DocumentsWriterFlushQueue.java:198) >>> [junit4] 2> at >>> org.apache.lucene.index.DocumentsWriterFlushQueue$FlushTicket.finishFlush(DocumentsWriterFlushQueue.java:213) >>> [junit4] 2> at >>> org.apache.lucene.index.DocumentsWriterFlushQueue$SegmentFlushTicket.publish(DocumentsWriterFlushQueue.java:249) >>> [junit4] 2> at >>> org.apache.lucene.index.DocumentsWriterFlushQueue.innerPurge(DocumentsWriterFlushQueue.java:116) >>> [junit4] 2> at >>> org.apache.lucene.index.DocumentsWriterFlushQueue.forcePurge(DocumentsWriterFlushQueue.java:138) >>> [junit4] 2> at >>> org.apache.lucene.index.DocumentsWriter.purgeBuffer(DocumentsWriter.java:185) >>> [junit4] 2> at >>> org.apache.lucene.index.IndexWriter.purge(IndexWriter.java:4634) >>> [junit4] 2> at >>> org.apache.lucene.index.DocumentsWriter$ForcedPurgeEvent.process(DocumentsWriter.java:701) >>> [junit4] 2> at >>> org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4665) >>> [junit4] 2> at >>> org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4657) >>> [junit4] 2> at >>> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:1067) >>> [junit4] 2> at >>> org.apache.lucene.index.IndexWriter.rollbackInternal(IndexWriter.java:2106) >>> [junit4] 2> at >>> org.apache.lucene.index.IndexWriter.rollback(IndexWriter.java:2024) >>> [junit4] 2> at >>> org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:575) >>> [junit4] 2> 17 déc. 2013 19:41:23 >>> com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler >>> uncaughtException >>> [junit4] 2> ATTENTION: Uncaught exception in thread: >>> Thread[Thread-135,5,TGRP-TestIndexWriterWithThreads] >>> [junit4] 2> java.lang.RuntimeException: >>> org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed >>> [junit4] 2> at >>> __randomizedtesting.SeedInfo.seed([3FAF37E1AFFB2502]:0) >>> [junit4] 2> at >>> org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:619) >>> [junit4] 2> Caused by: org.apache.lucene.store.AlreadyClosedException: >>> this IndexWriter is closed >>> [junit4] 2> at >>> org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:645) >>> [junit4] 2> at >>> org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:659) >>> [junit4] 2> at >>> org.apache.lucene.index.IndexWriter.rollback(IndexWriter.java:2018) >>> [junit4] 2> at >>> org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:575) >>> [junit4] 2> NOTE: reproduce with: ant test >>> -Dtestcase=TestIndexWriterWithThreads >>> -Dtests.method=testRollbackAndCommitWithThreads >>> -Dtests.seed=3FAF37E1AFFB2502 -Dtests.slow=true -Dtests.locale=fr_FR >>> -Dtests.timezone=Africa/Malabo -Dtests.file.encoding=UTF-8 >>> [junit4] ERROR 0.27s J5 | >>> TestIndexWriterWithThreads.testRollbackAndCommitWithThreads <<< >>> [junit4] > Throwable #1: java.lang.AssertionError >>> [junit4] > at >>> org.apache.lucene.index.TestIndexWriterWithThreads.testRollbackAndCommitWithThreads(TestIndexWriterWithThreads.java:631) >>> [junit4] > at java.lang.Thread.run(Thread.java:662)Throwable >>> #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an >>> uncaught exception in thread: Thread[id=193, name=Thread-133, >>> state=RUNNABLE, group=TGRP-TestIndexWriterWithThreads] >>> [junit4] > Caused by: java.lang.RuntimeException: >>> org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed >>> [junit4] > at >>> __randomizedtesting.SeedInfo.seed([3FAF37E1AFFB2502]:0) >>> [junit4] > at >>> org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:619) >>> [junit4] > Caused by: org.apache.lucene.store.AlreadyClosedException: >>> this IndexWriter is closed >>> [junit4] > at >>> org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:645) >>> [junit4] > at >>> org.apache.lucene.index.IndexWriter.numDeletedDocs(IndexWriter.java:622) >>> [junit4] > at >>> org.apache.lucene.index.IndexWriter.segString(IndexWriter.java:4265) >>> [junit4] > at >>> org.apache.lucene.index.IndexWriter.publishFlushedSegment(IndexWriter.java:2324) >>> [junit4] > at >>> org.apache.lucene.index.DocumentsWriterFlushQueue$FlushTicket.publishFlushedSegment(DocumentsWriterFlushQueue.java:198) >>> [junit4] > at >>> org.apache.lucene.index.DocumentsWriterFlushQueue$FlushTicket.finishFlush(DocumentsWriterFlushQueue.java:213) >>> [junit4] > at >>> org.apache.lucene.index.DocumentsWriterFlushQueue$SegmentFlushTicket.publish(DocumentsWriterFlushQueue.java:249) >>> [junit4] > at >>> org.apache.lucene.index.DocumentsWriterFlushQueue.innerPurge(DocumentsWriterFlushQueue.java:116) >>> [junit4] > at >>> org.apache.lucene.index.DocumentsWriterFlushQueue.forcePurge(DocumentsWriterFlushQueue.java:138) >>> [junit4] > at >>> org.apache.lucene.index.DocumentsWriter.purgeBuffer(DocumentsWriter.java:185) >>> [junit4] > at >>> org.apache.lucene.index.IndexWriter.purge(IndexWriter.java:4634) >>> [junit4] > at >>> org.apache.lucene.index.DocumentsWriter$ForcedPurgeEvent.process(DocumentsWriter.java:701) >>> [junit4] > at >>> org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4665) >>> [junit4] > at >>> org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4657) >>> [junit4] > at >>> org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:1067) >>> [junit4] > at >>> org.apache.lucene.index.IndexWriter.rollbackInternal(IndexWriter.java:2106) >>> [junit4] > at >>> org.apache.lucene.index.IndexWriter.rollback(IndexWriter.java:2024) >>> [junit4] > at >>> org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:575)Throwable >>> #3: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an >>> uncaught exception in thread: Thread[id=195, name=Thread-135, >>> state=RUNNABLE, group=TGRP-TestIndexWriterWithThreads] >>> [junit4] > Caused by: java.lang.RuntimeException: >>> org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed >>> [junit4] > at >>> __randomizedtesting.SeedInfo.seed([3FAF37E1AFFB2502]:0) >>> [junit4] > at >>> org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:619) >>> [junit4] > Caused by: org.apache.lucene.store.AlreadyClosedException: >>> this IndexWriter is closed >>> [junit4] > at >>> org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:645) >>> [junit4] > at >>> org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:659) >>> [junit4] > at >>> org.apache.lucene.index.IndexWriter.rollback(IndexWriter.java:2018) >>> [junit4] > at >>> org.apache.lucene.index.TestIndexWriterWithThreads$1.run(TestIndexWriterWithThreads.java:575) >>> [junit4] 2> NOTE: test params are: codec=Lucene45, >>> sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {field=DFR >>> I(F)L3(800.0), body=DFR I(n)B1, titleTokenized=DFR I(F)B1}, locale=fr_FR, >>> timezone=Africa/Malabo >>> [junit4] 2> NOTE: Linux 3.2.0-26-generic amd64/Sun Microsystems Inc. >>> 1.6.0_45 (64-bit)/cpus=8,threads=1,free=78129256,total=170721280 >>> [junit4] 2> NOTE: All tests run in this JVM: [Test2BTerms, >>> TestCompoundFile, TestAtomicUpdate, TestByteSlices, TestWindowsMMap, >>> TestEliasFanoDocIdSet, TestSnapshotDeletionPolicy, >>> TestCrashCausesCorruptIndex, TestBooleanOr, TestCachingTokenFilter, >>> TestDocIdSet, TestFieldInfos, TestAssertions, TestBytesStore, TestSearch, >>> TestPrefixInBooleanQuery, TestDocument, TestRateLimiter, >>> TestEarlyTermination, TestPositionIncrement, TestCachingCollector, >>> TestSpecialOperations, TestReaderClosed, TestPerFieldDocValuesFormat, >>> TestFSTs, TestIndexWriterWithThreads] >>> [junit4] Completed on J5 in 6.95s, 12 tests, 1 error <<< FAILURES! >>> >>> [...truncated 636 lines...] >>> BUILD FAILED >>> /var/lib/jenkins/workspace/Lucene-4x-Linux-Java7-64-test-only/checkout/lucene/build.xml:49: >>> The following error occurred while executing this line: >>> /var/lib/jenkins/workspace/Lucene-4x-Linux-Java7-64-test-only/checkout/lucene/common-build.xml:1307: >>> The following error occurred while executing this line: >>> /var/lib/jenkins/workspace/Lucene-4x-Linux-Java7-64-test-only/checkout/lucene/common-build.xml:940: >>> There were test failures: 379 suites, 2758 tests, 1 error, 81 ignored (68 >>> assumptions) >>> >>> Total time: 5 minutes 33 seconds >>> Build step 'Invoke Ant' marked build as failure >>> Recording test results >>> Email was triggered for: Failure >>> Sending email for trigger: Failure >>> >>> >>> >>> >>> --------------------------------------------------------------------- >>> To unsubscribe, e-mail: [email protected] >>> For additional commands, e-mail: [email protected] >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: [email protected] >> For additional commands, e-mail: [email protected] >> > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
