I committed a fix ... Mike McCandless
http://blog.mikemccandless.com On Fri, Oct 26, 2012 at 7:22 AM, Michael McCandless <[email protected]> wrote: > Yay, a heap dump! > > It looks like we need to disable the MEMORY_* index when using > CompressingStoredFields for this test... really quite silly because > the test doesn't store any fields, but our stored fields impls aren't > sparse ... so we store index entry even for docs w/ no stored fields. > > Mike McCandless > > http://blog.mikemccandless.com > > On Fri, Oct 26, 2012 at 5:45 AM, Apache Jenkins Server > <[email protected]> wrote: >> Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/73/ >> >> 1 tests failed. >> REGRESSION: org.apache.lucene.index.Test2BPostings.test >> >> Error Message: >> Java heap space >> >> Stack Trace: >> java.lang.OutOfMemoryError: Java heap space >> at >> __randomizedtesting.SeedInfo.seed([FD13C5889A91933D:7547FA52346DFEC5]:0) >> at >> org.apache.lucene.util.packed.Packed8ThreeBlocks.<init>(Packed8ThreeBlocks.java:42) >> at >> org.apache.lucene.util.packed.PackedInts.getMutable(PackedInts.java:900) >> at >> org.apache.lucene.codecs.compressing.CompressingStoredFieldsIndex$MemoryDocFieldsIndexReader.<init>(CompressingStoredFieldsIndex.java:295) >> at >> org.apache.lucene.codecs.compressing.CompressingStoredFieldsIndex$2.newReader(CompressingStoredFieldsIndex.java:75) >> at >> org.apache.lucene.codecs.compressing.CompressingStoredFieldsReader.<init>(CompressingStoredFieldsReader.java:100) >> at >> org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsReader(CompressingStoredFieldsFormat.java:111) >> at >> org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:115) >> at >> org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:57) >> at >> org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:62) >> at >> org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:668) >> at >> org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:52) >> at >> org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:65) >> at >> org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:705) >> at >> org.apache.lucene.index.Test2BPostings.test(Test2BPostings.java:82) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:616) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787) >> at >> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) >> at >> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51) >> at >> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) >> at >> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) >> at >> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) >> at >> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70) >> at >> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358) >> >> >> >> >> Build Log: >> [...truncated 1225 lines...] >> [junit4:junit4] Suite: org.apache.lucene.index.Test2BPostings >> [junit4:junit4] 2> NOTE: download the large Jenkins line-docs file by >> running 'ant get-jenkins-line-docs' in the lucene directory. >> [junit4:junit4] 2> NOTE: reproduce with: ant test >> -Dtestcase=Test2BPostings -Dtests.method=test -Dtests.seed=FD13C5889A91933D >> -Dtests.multiplier=3 -Dtests.nightly=true -Dtests.slow=true >> -Dtests.linedocsfile=/home/hudson/lucene-data/enwiki.random.lines.txt >> -Dtests.locale=es_BO -Dtests.timezone=Pacific/Marquesas >> -Dtests.file.encoding=ISO-8859-1 >> [junit4:junit4] ERROR 968s J0 | Test2BPostings.test <<< >> [junit4:junit4] > Throwable #1: java.lang.OutOfMemoryError: Java heap >> space >> [junit4:junit4] > at >> __randomizedtesting.SeedInfo.seed([FD13C5889A91933D:7547FA52346DFEC5]:0) >> [junit4:junit4] > at >> org.apache.lucene.util.packed.Packed8ThreeBlocks.<init>(Packed8ThreeBlocks.java:42) >> [junit4:junit4] > at >> org.apache.lucene.util.packed.PackedInts.getMutable(PackedInts.java:900) >> [junit4:junit4] > at >> org.apache.lucene.codecs.compressing.CompressingStoredFieldsIndex$MemoryDocFieldsIndexReader.<init>(CompressingStoredFieldsIndex.java:295) >> [junit4:junit4] > at >> org.apache.lucene.codecs.compressing.CompressingStoredFieldsIndex$2.newReader(CompressingStoredFieldsIndex.java:75) >> [junit4:junit4] > at >> org.apache.lucene.codecs.compressing.CompressingStoredFieldsReader.<init>(CompressingStoredFieldsReader.java:100) >> [junit4:junit4] > at >> org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsReader(CompressingStoredFieldsFormat.java:111) >> [junit4:junit4] > at >> org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:115) >> [junit4:junit4] > at >> org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:57) >> [junit4:junit4] > at >> org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:62) >> [junit4:junit4] > at >> org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:668) >> [junit4:junit4] > at >> org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:52) >> [junit4:junit4] > at >> org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:65) >> [junit4:junit4] > at >> org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:705) >> [junit4:junit4] > at >> org.apache.lucene.index.Test2BPostings.test(Test2BPostings.java:82) >> [junit4:junit4] > at >> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> [junit4:junit4] > at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> [junit4:junit4] > at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> [junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:616) >> [junit4:junit4] > at >> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559) >> [junit4:junit4] > at >> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79) >> [junit4:junit4] > at >> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737) >> [junit4:junit4] > at >> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773) >> [junit4:junit4] > at >> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787) >> [junit4:junit4] > at >> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) >> [junit4:junit4] > at >> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51) >> [junit4:junit4] > at >> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) >> [junit4:junit4] > at >> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) >> [junit4:junit4] > at >> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) >> [junit4:junit4] > at >> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70) >> [junit4:junit4] > at >> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) >> [junit4:junit4] > at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> [junit4:junit4] > at >> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358) >> [junit4:junit4] 2> NOTE: test params are: >> codec=Compressing(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_UNCOMPRESSION, >> chunkSize=419, storedFieldsIndex=MEMORY_DOC)), sim=DefaultSimilarity, >> locale=es_BO, timezone=Pacific/Marquesas >> [junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. >> 1.6.0_32 (64-bit)/cpus=16,threads=1,free=280472592,total=536477696 >> [junit4:junit4] 2> NOTE: All tests run in this JVM: >> [TestRamUsageEstimatorOnWildAnimals, TestGraphTokenizers, TestSumDocFreq, >> TestDeletionPolicy, TestMockCharFilter, Test2BPostingsBytes, >> TestBooleanScorer, TestVersionComparator, TestTermRangeQuery, >> TestCustomSearcherSort, Nested1, TestExplanations, TestSegmentReader, >> Before3, Before3, TestPagedBytes, TestSizeBoundedForceMerge, >> TestNGramPhraseQuery, TestPhraseQuery, Test2BTerms, ThrowInUncaught, >> TestConsistentFieldNumbers, TestDeterminism, TestSloppyPhraseQuery, >> TestBasicOperations, TestFieldValueFilter, TestFilteredQuery, TestSort, >> TestLevenshteinAutomata, TestRecyclingByteBlockAllocator, >> TestIndexWriterLockRelease, TestSearchForDuplicates, TestSpansAdvanced2, >> TestLucene40PostingsFormat, TestFilterIterator, TestNoMergeScheduler, >> TestMockDirectoryWrapper, TestTermVectors, TestMultiTermConstantScore, >> TestIndexWriterCommit, TestTopDocsCollector, TestDocIdSet, >> TestPayloadsOnVectors, TestPhrasePrefixQuery, TestIndexableField, >> TestDocument, TestDocValuesTypeCompatibility, TestBytesRef, >> TestPayloadNearQuery, TestBooleanQueryVisitSubscorers, TestCompoundFile, >> TestSpanMultiTermQueryWrapper, TestBooleanQuery, TestBagOfPostings, >> TestBackwardsCompatibility, TestVersion, TestSearchAfter, >> TestIndexWriterReader, TestAtomicUpdate, TestIndexWriterForceMerge, Nested, >> Nested, TestComplexExplanationsOfNonMatches, TestPriorityQueue, >> TestCopyBytes, TestSegmentTermEnum, TestScoreCachingWrappingScorer, >> TestIOUtils, TestWorstCaseTestBehavior, TestBytesRefHash, TestNumericUtils, >> TestAutomatonQueryUnicode, TestWeakIdentityMap, >> TestFlushByRamOrCountsPolicy, TestSpecialOperations, >> TestDirectoryReaderReopen, TestPrefixCodedTerms, >> TestSimpleSearchEquivalence, TestPrefixFilter, TestSpanFirstQuery, >> TestDocValuesScoring, TestIndexWriterWithThreads, TestPackedInts, TestFSTs, >> TestNumericRangeQuery32, TestNRTThreads, TestOpenBitSet, >> TestIndexWriterUnicode, TestArrayUtil, TestIndexWriterDelete, >> TestBufferedIndexInput, TestCollectionUtil, TestLongPostings, >> TestFixedBitSet, TestToken, TestTypePromotion, TestCustomNorms, >> TestSnapshotDeletionPolicy, TestMockAnalyzer, TestDeterminizeLexicon, >> TestIndexWriterNRTIsCurrent, TestRegexpRandom2, TestDocValuesIndexing, >> TestConcurrentMergeScheduler, TestHugeRamFile, TestSloppyPhraseQuery2, >> TestDoubleBarrelLRUCache, TestStressAdvance, >> TestMultiValuedNumericRangeQuery, TestCharTermAttributeImpl, TestOmitNorms, >> TestRollingUpdates, TestPrefixInBooleanQuery, TestThreadedForceMerge, >> TestFieldCache, TestCodecs, TestMixedCodecs, TestStressIndexing2, >> TestMaxTermFrequency, TestIndexInput, TestSpanSearchEquivalence, >> TestMultiThreadTermVectors, TestSpans, TestCrash, TestSegmentTermDocs, >> TestSimilarityBase, TestLazyProxSkipping, TestScorerPerf, TestDoc, >> TestMergeSchedulerExternal, TestTermsEnum2, TestDisjunctionMaxQuery, Nested, >> Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, >> Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, >> Nested, Nested, TestFieldMaskingSpanQuery, TestTermRangeFilter, >> TestDocumentsWriterDeleteQueue, TestPrefixRandom, TestPayloadExplanations, >> TestDocsAndPositions, TestTermVectorsWriter, TestFlex, TestUnicodeUtil, >> TestTransactionRollback, TestForTooMuchCloning, TestMultiPhraseQuery, >> TestMultiFields, TestSentinelIntSet, TestDocTermOrds, TestTermVectorsReader, >> TestSimilarity2, TestMultiLevelSkipList, Nested1, Nested2, Nested3, >> TestOmitPositions, TestPayloads, TestSimpleExplanationsOfNonMatches, >> TestFuzzyQuery, TestRollingBuffer, TestWildcard, >> TestSpanExplanationsOfNonMatches, TestCheckIndex, TestRegexpQuery, >> TestNearSpansOrdered, TestSmallFloat, TestBinaryTerms, >> TestParallelReaderEmptyIndex, TestIndexWriterConfig, TestFilteredSearch, >> TestCachingWrapperFilter, TestTermScorer, Test2BPostings] >> [junit4:junit4] Completed on J0 in 967.61s, 1 test, 1 error <<< FAILURES! >> >> [...truncated 16 lines...] >> BUILD FAILED >> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:335: >> The following error occurred while executing this line: >> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:39: >> The following error occurred while executing this line: >> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build.xml:50: >> The following error occurred while executing this line: >> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1171: >> The following error occurred while executing this line: >> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:839: >> There were test failures: 317 suites, 1819 tests, 1 error, 12 ignored (1 >> assumption) >> >> Total time: 40 minutes 35 seconds >> Build step 'Invoke Ant' marked build as failure >> Archiving artifacts >> Recording test results >> Email was triggered for: Failure >> Sending email for trigger: Failure >> >> >> >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: [email protected] >> For additional commands, e-mail: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
