Boom! Inching closer and closer... There is some "misbehavior" going on with index writer ForceMerge call when LogByteSizeMergePolicy is used. Practically any test that invokes ForceMerge and expected to have only one segment afterwards is failing. There are a lot of those, that's my next area of focus.
On Wed Jan 21 2015 at 9:21:10 AM Itamar Syn-Hershko <[email protected]> wrote: > Oh yeah, < 190 failing tests > > -- > > Itamar Syn-Hershko > http://code972.com | @synhershko <https://twitter.com/synhershko> > Freelance Developer & Consultant > Lucene.NET committer and PMC member > > On Wed, Jan 21, 2015 at 5:17 PM, <[email protected]> wrote: > > > Build Lucene.NET :: Lucene.NET Core #98 failed (Tests failed: 186 (24 > > new), passed: 2280, ignored: 112). > > Agent: JetBrains-dotnet-agent01 > > Build results: > > http://teamcity.codebetter.com/viewLog.html?buildId= > 179037&buildTypeId=LuceneNet_Core > > > > Failed Tests Summary: > > Newly failed tests (24 tests, alphabetically ordered) > > ================================================================== > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene42.TestLucene42DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetVariableLengthSin > gleValuedVsStoredFields > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene45.TestLucene45DocValuesFormat. > BaseDocValuesFormatTestCase.TestBytesTwoDocumentsMerged > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene45.TestLucene45DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetTwoDocumentsFirstMissingMerge > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene45.TestLucene45DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetTwoDocumentsLastMissingMerge > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Perfield.TestPerFieldDocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedBytesTwoDocumentsMerged > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Perfield.TestPerFieldDocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetTwoDocumentsFirstMissingMerge > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Perfield.TestPerFieldDocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetTwoDocumentsLastMissingMerge > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Perfield.TestPerFieldDocValuesFormat. > BaseIndexFileFormatTestCase.TestMergeStability > > Lucene.Net.Tests.dll: > > Lucene.Net.Index.TestDeletionPolicy.TestOpenPriorSnapshot > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestDocValuesWithThreads.Test2 > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestForceMergeForever.Test > > Lucene.Net.Tests.dll: > > Lucene.Net.Index.TestIndexWriterConfig.TestLiveChangeToCFS > > Lucene.Net.Tests.dll: > > Lucene.Net.Index.TestIndexWriterExceptions. > TestDocumentsWriterExceptionThreads > > Lucene.Net.Tests.dll: > > Lucene.Net.Index.TestIndexWriterExceptions.TestNoLostDeletesOrUpdates > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestMultiDocValues.TestBinary > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestMultiDocValues.TestSortedSet > > Lucene.Net.Tests.dll: > > Lucene.Net.Index.TestMultiDocValues.TestSortedWithLotsOfDups > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestOmitTf.TestMixedMerge > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestOmitTf.TestNoPrxFile > > Lucene.Net.Tests.dll: > > Lucene.Net.Index.TestParallelReaderEmptyIndex.TestEmptyIndexWithVectors > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestStressNRT.Test > > Lucene.Net.Tests.dll: Lucene.Net.Search.Spans.TestBasics.TestBoolean > > Lucene.Net.Tests.dll: Lucene.Net.Store.TestLockFactory.TestStressLocks > > Lucene.Net.Tests.dll: Lucene.Net.Util.TestLongBitSet.TestSmall > > > > Other failed tests (162 tests, alphabetically ordered, only first 100 > > shown) > > ================================================================== > > Lucene.Net.Tests.dll: > > Lucene.Net.Analysis.TestLookaheadTokenFilter.TestNeverCallingPeek > > Lucene.Net.Tests.dll: > > Lucene.Net.Analysis.TestMockAnalyzer.TestRandomRegexps > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene40.TestLucene40DocValuesFormat. > BaseDocValuesFormatTestCase.TestByteNumericsVsStoredFields > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene40.TestLucene40DocValuesFormat. > BaseDocValuesFormatTestCase.TestBytesTwoDocumentsMerged > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene40.TestLucene40DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedBytesTwoDocumentsMerged > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene40.TestLucene40DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedMergeAwayAllValues > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene40.TestLucene40DocValuesFormat. > BaseDocValuesFormatTestCase.TestTwoDocumentsMerged > > Lucene.Net.Tests.dll: Lucene.Net.Codecs.Lucene41. > TestBlockPostingsFormat2 > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene41.TestBlockPostingsFormat3.Test > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene42.TestLucene42DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedMergeAwayAllValues > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene42.TestLucene42DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetFixedLengthSingle > ValuedVsStoredFields > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene42.TestLucene42DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetFixedLengthVsStoredFields > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene42.TestLucene42DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetFixedLengthVsUninvertedField > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene42.TestLucene42DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetMergeAwayAllValues > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene42.TestLucene42DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetOneValue > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene42.TestLucene42DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetTermsEnum > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene42.TestLucene42DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetThreeValuesTwoDocs > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene42.TestLucene42DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetTwoDocumentsFirstMissing > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene42.TestLucene42DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetTwoDocumentsFirstMissingMerge > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene42.TestLucene42DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetTwoDocumentsLastMissing > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene42.TestLucene42DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetTwoDocumentsLastMissingMerge > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene42.TestLucene42DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetTwoDocumentsMerged > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene42.TestLucene42DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetTwoFields > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene42.TestLucene42DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetTwoValues > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene42.TestLucene42DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetTwoValuesUnordered > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene42.TestLucene42DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetVariableLengthVsStoredFields > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene42.TestLucene42DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetVariableLengthVsUninvertedField > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene42.TestLucene42DocValuesFormat. > BaseDocValuesFormatTestCase.TestTwoDocumentsMerged > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene42.TestLucene42DocValuesFormat. > BaseDocValuesFormatTestCase.TestVeryLargeButLegalSortedBytes > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene42.TestLucene42DocValuesFormat. > BaseIndexFileFormatTestCase.TestMergeStability > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene45.TestLucene45DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedMergeAwayAllValues > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene45.TestLucene45DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetFixedLengthVsUninvertedField > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene45.TestLucene45DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetMergeAwayAllValues > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene45.TestLucene45DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetThreeValuesTwoDocs > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene45.TestLucene45DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetTwoDocumentsMerged > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene45.TestLucene45DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetVariableLengthVsUninvertedField > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene45.TestLucene45DocValuesFormat. > BaseDocValuesFormatTestCase.TestThreeBytesOneMissingWithMerging > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene45.TestLucene45DocValuesFormat. > BaseDocValuesFormatTestCase.TestThreeNumbersOneMissingWithMerging > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene45.TestLucene45DocValuesFormat. > BaseDocValuesFormatTestCase.TestTwoBytesOneMissing > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene45.TestLucene45DocValuesFormat. > BaseDocValuesFormatTestCase.TestTwoBytesOneMissingWithMerging > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene45.TestLucene45DocValuesFormat. > BaseDocValuesFormatTestCase.TestTwoDocumentsMerged > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene45.TestLucene45DocValuesFormat. > BaseDocValuesFormatTestCase.TestTwoNumbersOneMissingWithMerging > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene45.TestLucene45DocValuesFormat. > BaseIndexFileFormatTestCase.TestMergeStability > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Perfield.TestPerFieldDocValuesFormat. > BaseDocValuesFormatTestCase.TestBytesTwoDocumentsMerged > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Perfield.TestPerFieldDocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedMergeAwayAllValues > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Perfield.TestPerFieldDocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetFixedLengthVsUninvertedField > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Perfield.TestPerFieldDocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetMergeAwayAllValues > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Perfield.TestPerFieldDocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetThreeValuesTwoDocs > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Perfield.TestPerFieldDocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetTwoDocumentsMerged > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Perfield.TestPerFieldDocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetVariableLengthVsUninvertedField > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Perfield.TestPerFieldDocValuesFormat. > BaseDocValuesFormatTestCase.TestThreeBytesOneMissingWithMerging > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Perfield.TestPerFieldDocValuesFormat. > BaseDocValuesFormatTestCase.TestThreeNumbersOneMissingWithMerging > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Perfield.TestPerFieldDocValuesFormat. > BaseDocValuesFormatTestCase.TestTwoBytesOneMissing > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Perfield.TestPerFieldDocValuesFormat. > BaseDocValuesFormatTestCase.TestTwoBytesOneMissingWithMerging > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Perfield.TestPerFieldDocValuesFormat. > BaseDocValuesFormatTestCase.TestTwoNumbersOneMissingWithMerging > > Lucene.Net.Tests.dll: > > Lucene.Net.Index.TestAddIndexes.TestAddIndexMissingCodec > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestAtomicUpdate. > TestAtomicUpdates > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestBagOfPositions.Test > > Lucene.Net.Tests.dll: > > Lucene.Net.Index.TestBinaryDocValuesUpdates.TestTonsOfUpdates > > Lucene.Net.Tests.dll: > > Lucene.Net.Index.TestBinaryDocValuesUpdates. > TestUpdateSegmentWithNoDocValues > > Lucene.Net.Tests.dll: > > Lucene.Net.Index.TestBinaryDocValuesUpdates.TestUpdatesAndDeletes > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestCodecHoldsOpenFiles.Test > > Lucene.Net.Tests.dll: > > Lucene.Net.Index.TestCodecHoldsOpenFiles.TestExposeUnclosedFiles > > Lucene.Net.Tests.dll: > > Lucene.Net.Index.TestConsistentFieldNumbers.TestFieldNumberGaps > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestCustomNorms.TestFloatNorms > > Lucene.Net.Tests.dll: Lucene.Net.Index.TestDirectoryReader.TestNoDir > > Lucene.Net.Tests.dll: > > Lucene.Net.Index.TestDocValuesFormat.BaseDocValuesFormatTestCase. > TestSortedMergeAwayAllValues > > Lucene.Net.Tests.dll: > > Lucene.Net.Index.TestDocValuesFormat.BaseDocValuesFormatTestCase. > TestSortedSetFixedLengthVsUninvertedField > > Lucene.Net.Tests.dll: > > Lucene.Net.Index.TestDocValuesFormat.BaseDocValuesFormatTestCase. > TestSortedSetMergeAwayAllValues > > Lucene.Net.Tests.dll: > > Lucene.Net.Index.TestDocValuesFormat.BaseDocValuesFormatTestCase. > TestSortedSetThreeValuesTwoDocs > > Lucene.Net.Tests.dll: > > Lucene.Net.Index.TestDocValuesFormat.BaseDocValuesFormatTestCase. > TestSortedSetTwoDocumentsMerged > > Lucene.Net.Tests.dll: > > Lucene.Net.Index.TestDocValuesFormat.BaseDocValuesFormatTestCase. > TestSortedSetVariableLengthVsUninvertedField > > Lucene.Net.Tests.dll: > > Lucene.Net.Index.TestDocValuesFormat.BaseDocValuesFormatTestCase. > TestThreeBytesOneMissingWithMerging > > Lucene.Net.Tests.dll: > > Lucene.Net.Index.TestDocValuesFormat.BaseDocValuesFormatTestCase. > TestThreeNumbersOneMissingWithMerging > > Lucene.Net.Tests.dll: > > Lucene.Net.Index.TestDocumentsWriterDeleteQueue.TestStressDeleteQueue > > Lucene.Net.Tests.dll: > > Lucene.Net.Index.TestDocumentsWriterStallControl.TestSimpleStall > > > > > > > > Newly failed tests details (only first 3 failures shown here) > > ================================================================== > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene42.TestLucene42DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetVariableLengthSin > gleValuedVsStoredFields > > (new) ================= > > Test(s) failed. System.NullReferenceException : Object reference not set > > to an instance of an object. > > at > > Lucene.Net.Codecs.Lucene42.Lucene42DocValuesProducer. > SortedSetDocValuesAnonymousInnerClassHelper.LookupOrd(Int64 > > ord, BytesRef result) in > > z:\Builds\work\bcdbe6b8cc677a49\src\Lucene.Net.Core\Codecs\Lucene42\ > Lucene42DocValuesProducer.cs:line > > 638 > > at > > Lucene.Net.Index.BaseDocValuesFormatTestCase. > DoTestSortedSetVsStoredFields(Int32 > > minLength, Int32 maxLength, Int32 maxValuesPerDoc) in > > z:\Builds\work\bcdbe6b8cc677a49\src\Lucene.Net.TestFramework\Index\ > BaseDocValuesFormatTestCase.cs:line > > 2384 > > at > > Lucene.Net.Index.BaseDocValuesFormatTestCase. > TestSortedSetVariableLengthSingleValuedVsStoredFields() > > in > > z:\Builds\work\bcdbe6b8cc677a49\src\Lucene.Net.TestFramework\Index\ > BaseDocValuesFormatTestCase.cs:line > > 2436 > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene45.TestLucene45DocValuesFormat. > BaseDocValuesFormatTestCase.TestBytesTwoDocumentsMerged > > (new) ================= > > Test(s) failed. System.IndexOutOfRangeException : docID must be >= 0 > and < > > maxDoc=1 (got docID=1) > > at Lucene.Net.Index.SegmentReader.CheckBounds(Int32 docID) in > > z:\Builds\work\bcdbe6b8cc677a49\src\Lucene.Net.Core\Index\SegmentReader. > cs:line > > 410 > > at Lucene.Net.Index.SegmentReader.Document(Int32 docID, > > StoredFieldVisitor visitor) in > > z:\Builds\work\bcdbe6b8cc677a49\src\Lucene.Net.Core\Index\SegmentReader. > cs:line > > 350 > > at Lucene.Net.Index.IndexReader.Document(Int32 docID) in > > z:\Builds\work\bcdbe6b8cc677a49\src\Lucene. > Net.Core\Index\IndexReader.cs:line > > 519 > > at > > Lucene.Net.Index.BaseDocValuesFormatTestCase. > TestBytesTwoDocumentsMerged() > > in > > z:\Builds\work\bcdbe6b8cc677a49\src\Lucene.Net.TestFramework\Index\ > BaseDocValuesFormatTestCase.cs:line > > 563 > > Lucene.Net.Tests.dll: > > Lucene.Net.Codecs.Lucene45.TestLucene45DocValuesFormat. > BaseDocValuesFormatTestCase.TestSortedSetTwoDocumentsFirstMissingMerge > > (new) ================= > > Test(s) failed. System.ArgumentException : > > StandardDirectoryReader(segments_2:5:nrt _0(4.8):c1 _1(4.8):c1) has 2 > > segments instead of exactly one > > at Lucene.Net.Util.LuceneTestCase.GetOnlySegmentReader( > DirectoryReader > > reader) in > > z:\Builds\work\bcdbe6b8cc677a49\src\Lucene.Net.TestFramework\Util\ > LuceneTestCase.cs:line > > 666 > > at > > Lucene.Net.Index.BaseDocValuesFormatTestCase. > TestSortedSetTwoDocumentsFirstMissingMerge() > > in > > z:\Builds\work\bcdbe6b8cc677a49\src\Lucene.Net.TestFramework\Index\ > BaseDocValuesFormatTestCase.cs:line > > 2192 > > see all newly failed tests: > > http://teamcity.codebetter.com/viewLog.html?buildId= > 179037&buildTypeId=LuceneNet_Core > > Changes included (3 changes) > > ==================================================== > > Change 547b69f5130a404918b05f6def788eda32df1c11 by itamar (0 file): > > Merge remote-tracking branch 'laimis/MissingOrdRemapper_fixes' > > > > > > Change cf5ebe106b4f2df91ccc3dcf168e9b36eeaaab6a by laimis (1 file): > > fix enumerator port to use appropriate logic > > > > > > Change 1379b3873ea90261e5a7da2c0e26602247a341e6 by itamar (2 files): > > Minor > > > > > > see more information about changed files: > > http://teamcity.codebetter.com/viewLog.html?tab=buildChangesDiv&buildId= > 179037&buildTypeId=LuceneNet_Core > > > > > > ============================================================ > ================ > > Configure email notifications: > > http://teamcity.codebetter.com/profile.html?init=1&tab=userNotifications > > >
