I'll dig. Mike McCandless
http://blog.mikemccandless.com On Fri, Jan 9, 2015 at 7:46 AM, Robert Muir <rcm...@gmail.com> wrote: > I think this might be related to the removal of checkAbort? How does > rollback() abort CMS merges in the new world? > > We rollback() the IW, and join on all of our own threads, then try to > close the Directory, but mockdir gets angry because merges are still > executing and writing to disk. > > On Fri, Jan 9, 2015 at 7:32 AM, Policeman Jenkins Server > <jenk...@thetaphi.de> wrote: >> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Windows/4300/ >> Java: 32bit/jdk1.8.0_25 -client -XX:+UseParallelGC >> >> 1 tests failed. >> FAILED: org.apache.lucene.index.TestAddIndexes.testAddIndexesWithRollback >> >> Error Message: >> MockDirectoryWrapper: cannot close: there are still open files: {_dx.fnm=1} >> >> Stack Trace: >> java.lang.RuntimeException: MockDirectoryWrapper: cannot close: there are >> still open files: {_dx.fnm=1} >> at >> __randomizedtesting.SeedInfo.seed([C33B410169B5ABE0:251CAEEECD1AC09E]:0) >> at >> org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:762) >> at >> org.apache.lucene.index.TestAddIndexes$RunAddIndexesThreads.closeDir(TestAddIndexes.java:727) >> at >> org.apache.lucene.index.TestAddIndexes.testAddIndexesWithRollback(TestAddIndexes.java:962) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:483) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877) >> at >> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) >> at >> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) >> at >> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) >> at >> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) >> at >> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) >> at >> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783) >> at >> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) >> at >> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) >> at >> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) >> at >> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) >> at >> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54) >> at >> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) >> at >> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) >> at >> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) >> at java.lang.Thread.run(Thread.java:745) >> Caused by: java.lang.RuntimeException: unclosed IndexOutput: _dx.fnm >> at >> org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:637) >> at >> org.apache.lucene.store.MockDirectoryWrapper.createOutput(MockDirectoryWrapper.java:609) >> at >> org.apache.lucene.index.IndexWriter$1.createOutput(IndexWriter.java:4691) >> at >> org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43) >> at >> org.apache.lucene.codecs.lucene50.Lucene50FieldInfosFormat.write(Lucene50FieldInfosFormat.java:249) >> at >> org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:136) >> at >> org.apache.lucene.index.IndexWriter.addIndexes(IndexWriter.java:2557) >> at >> org.apache.lucene.util.TestUtil.addIndexesSlowly(TestUtil.java:887) >> at >> org.apache.lucene.index.TestAddIndexes$CommitAndAddIndexes3.doBody(TestAddIndexes.java:880) >> at >> org.apache.lucene.index.TestAddIndexes$RunAddIndexesThreads$1.run(TestAddIndexes.java:697) >> >> >> >> >> Build Log: >> [...truncated 10799 lines...] >> [junit4] Suite: org.apache.lucene.index.TestAddIndexes >> [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestAddIndexes >> -Dtests.method=testAddIndexesWithRollback -Dtests.seed=C33B410169B5ABE0 >> -Dtests.slow=true -Dtests.locale=th_TH -Dtests.timezone=America/Rainy_River >> -Dtests.asserts=true -Dtests.file.encoding=Cp1252 >> [junit4] ERROR 0.50s | TestAddIndexes.testAddIndexesWithRollback <<< >> [junit4] > Throwable #1: java.lang.RuntimeException: >> MockDirectoryWrapper: cannot close: there are still open files: {_dx.fnm=1} >> [junit4] > at >> __randomizedtesting.SeedInfo.seed([C33B410169B5ABE0:251CAEEECD1AC09E]:0) >> [junit4] > at >> org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:762) >> [junit4] > at >> org.apache.lucene.index.TestAddIndexes$RunAddIndexesThreads.closeDir(TestAddIndexes.java:727) >> [junit4] > at >> org.apache.lucene.index.TestAddIndexes.testAddIndexesWithRollback(TestAddIndexes.java:962) >> [junit4] > at java.lang.Thread.run(Thread.java:745) >> [junit4] > Caused by: java.lang.RuntimeException: unclosed >> IndexOutput: _dx.fnm >> [junit4] > at >> org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:637) >> [junit4] > at >> org.apache.lucene.store.MockDirectoryWrapper.createOutput(MockDirectoryWrapper.java:609) >> [junit4] > at >> org.apache.lucene.index.IndexWriter$1.createOutput(IndexWriter.java:4691) >> [junit4] > at >> org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43) >> [junit4] > at >> org.apache.lucene.codecs.lucene50.Lucene50FieldInfosFormat.write(Lucene50FieldInfosFormat.java:249) >> [junit4] > at >> org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:136) >> [junit4] > at >> org.apache.lucene.index.IndexWriter.addIndexes(IndexWriter.java:2557) >> [junit4] > at >> org.apache.lucene.util.TestUtil.addIndexesSlowly(TestUtil.java:887) >> [junit4] > at >> org.apache.lucene.index.TestAddIndexes$CommitAndAddIndexes3.doBody(TestAddIndexes.java:880) >> [junit4] > at >> org.apache.lucene.index.TestAddIndexes$RunAddIndexesThreads$1.run(TestAddIndexes.java:697) >> [junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): >> {c=FSTOrd50, id=FSTOrd50, f1=FSTOrd50, f2=PostingsFormat(name=Memory >> doPackFST= true), content=PostingsFormat(name=LuceneVarGapFixedInterval)}, >> docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): >> {foo=DFR I(ne)Z(0.3), id=LM Jelinek-Mercer(0.100000), content=DFR >> I(F)LZ(0.3)}, locale=th_TH, timezone=America/Rainy_River >> [junit4] 2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.8.0_25 >> (32-bit)/cpus=2,threads=1,free=178171128,total=234881024 >> [junit4] 2> NOTE: All tests run in this JVM: [TestEliasFanoSequence, >> TestPagedBytes, TestFastCompressionMode, TestOrdinalMap, TestDocBoost, >> TestByteSlices, TestFilterSpans, TestSort, TestSegmentMerger, >> TestSimilarity, TestSortRandom, TestDisjunctionMaxQuery, TestBinaryDocument, >> TestFilterDirectory, TestBooleanOr, TestIsCurrent, TestIndexFileDeleter, >> TestDocumentsWriterDeleteQueue, TestFieldCacheRangeFilter, >> TestIndexWriterMerging, TestNumericRangeQuery32, TestNRTThreads, >> TestAssertingTermVectorsFormat, TestComplexExplanationsOfNonMatches, >> TestBlockPostingsFormat3, TestFieldValueFilter, Test4GBStoredFields, >> TestPersistentSnapshotDeletionPolicy, TestBytesRefArray, >> TestMultiTermQueryRewrites, TestCodecUtil, TestMergeSchedulerExternal, >> TestTopScoreDocCollector, TestBooleanMinShouldMatch, TestField, >> TestRamUsageEstimator, TestTermsEnum2, TestCharsRefBuilder, >> TestSortedSetSelector, TestOmitPositions, TestBooleanCoord, >> TestIndexWriterCommit, TestMockAnalyzer, TestDemo, TestSearchWithThreads, >> TestDirectPacked, TestDeletionPolicy, TestTieredMergePolicy, TestInfoStream, >> TestTimeLimitingCollector, TestIndexWriterOutOfMemory, TestSearcherManager, >> TestDateSort, TestNearSpansOrdered, TestLockFactory, TestFieldReuse, >> TestRegexpRandom, TestRecyclingIntBlockAllocator, TestNumericRangeQuery64, >> TestTopDocsMerge, TestBooleanQueryVisitSubscorers, TestRollingBuffer, >> TestStringHelper, TestRegExp, TestDocumentsWriterStallControl, >> TestPrefixRandom, TestDocInverterPerFieldErrorInfo, TestElevationComparator, >> TestSumDocFreq, TestCustomSearcherSort, TestTopFieldCollector, >> TestDocumentWriter, TestTermRangeQuery, TestQueryBuilder, >> FuzzyTermOnShortTermsTest, TestSpanFirstQuery, TestSimilarityProvider, >> TestBoolean2, TestDocTermOrdsRewriteMethod, TestNRTReaderWithThreads, >> TestCharFilter, TestControlledRealTimeReopenThread, TestPayloads, >> Test2BBinaryDocValues, TestMixedCodecs, TestBytesStore, TestPrefixQuery, >> TestSimpleExplanationsOfNonMatches, NestedSetupChain, NestedTeardownChain, >> TestPhrasePrefixQuery, TestIndexWriterLockRelease, TestSparseFixedBitSet, >> TestSameScoresWithThreads, TestTermsEnum, Test2BPagedBytes, TestToken, >> TestMmapDirectory, TestPayloadsOnVectors, TestLock, TestTermScorer, >> TestConcurrentMergeScheduler, TestOfflineSorter, TestIndexInput, >> TestStressAdvance, TestMockDirectoryWrapper, TestFieldType, >> TestAssertingPostingsFormat, TestFixedBitSet, TestScorerPerf, >> TestConsistentFieldNumbers, TestSegmentTermDocs, TestSimpleFSDirectory, >> TestWorstCaseTestBehavior, TestDateTools, TestNRTCachingDirectory, >> TestReaderClosed, TestFileSwitchDirectory, TestNumericDocValuesUpdates, >> TestPackedInts, TestMultiFields, Nested1, Nested2, TestLogMergePolicy, >> TestTerm, TestWindowsMMap, TestSearchAfter, TestCharsRef, >> TestSentinelIntSet, TestSmallFloat, TestLucene50NormsFormat, >> TestLucene50DocValuesFormat, TestVersion, TestBufferedChecksum, >> TestSimilarityBase, TestIndexWriterReader, TestSegmentTermEnum, >> TestPositiveScoresOnlyCollector, TestPayloadSpans, TestTransactions, >> TestVirtualMethod, TestNoMergePolicy, TestLongBitSet, Nested, >> TestFilteredQuery, TestGraphTokenizers, TestParallelReaderEmptyIndex, >> Test2BSortedDocValues, Before3, Before3, TestIndexReaderClose, >> TestAtomicUpdate, TestLucene50StoredFieldsFormat, ThrowInUncaught, >> TestMixedDocValuesUpdates, TestEliasFanoDocIdSet, TestThreadedForceMerge, >> TestSloppyPhraseQuery, TestCustomNorms, TestSpanExplanationsOfNonMatches, >> TestDateFilter, TestReusableStringReader, TestDocTermOrdsRangeFilter, >> TestBytesRefHash, TestIndexWriterOutOfFileDescriptors, TestFieldsReader, >> TestTotalHitCountCollector, TestSpanMultiTermQueryWrapper, >> TestMergedIterator, TestRollingUpdates, TestMultiLevelSkipList, Nested1, >> TestFuzzyQuery, TestLookaheadTokenFilter, TestConstantScoreQuery, >> TestScoreCachingWrappingScorer, TestNumericTokenStream, >> TestCachingWrapperFilter, TestTermVectors, TestLazyProxSkipping, >> TestTimSorter, TestGroupFiltering, TestSimpleExplanations, >> TestIndexWriterExceptions2, Test2BTerms, TestNamedSPILoader, >> TestSpansAdvanced, TestFlushByRamOrCountsPolicy, TestRAMDirectory, >> TestAssertions, TestOmitNorms, TestRegexpRandom2, TestMultiMMap, >> TestCheckIndex, TestIndexableField, TestParallelCompositeReader, TestSearch, >> TestAllFilesHaveCodecHeader, TestMockFilesystems, TestSloppyPhraseQuery2, >> TestArrayUtil, TestBitDocIdSetBuilder, TestManyFields, NonStringProperties, >> InBeforeClass, InAfterClass, InTestMethod, TestStressIndexing2, >> TestCompressingStoredFieldsFormat, TestAllFilesHaveChecksumFooter, >> TestIndexWriter, TestPerFieldDocValuesFormat, >> TestCompressingTermVectorsFormat, TestFSTs, TestIndexWriterWithThreads, >> TestAddIndexes] >> [junit4] Completed in 2.65s, 23 tests, 1 error <<< FAILURES! >> >> [...truncated 642 lines...] >> BUILD FAILED >> C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:529: The >> following error occurred while executing this line: >> C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:477: The >> following error occurred while executing this line: >> C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:61: The >> following error occurred while executing this line: >> C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\extra-targets.xml:39: >> The following error occurred while executing this line: >> C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\lucene\build.xml:49: >> The following error occurred while executing this line: >> C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\lucene\common-build.xml:1363: >> The following error occurred while executing this line: >> C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\lucene\common-build.xml:970: >> There were test failures: 409 suites, 3234 tests, 1 error, 68 ignored (58 >> assumptions) >> >> Total time: 15 minutes 9 seconds >> Build step 'Invoke Ant' marked build as failure >> [description-setter] Description set: Java: 32bit/jdk1.8.0_25 -client >> -XX:+UseParallelGC >> Archiving artifacts >> Recording test results >> Email was triggered for: Failure - Any >> Sending email for trigger: Failure - Any >> >> >> >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org >> For additional commands, e-mail: dev-h...@lucene.apache.org > > --------------------------------------------------------------------- > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org > For additional commands, e-mail: dev-h...@lucene.apache.org > --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
