This seed OOMs here too.
I added these prints:
System.out.println(RamUsageEstimator.sizeOf(fields));
System.out.println(RamUsageEstimator.sizeOf(fieldsLive));
I see:
[junit4:junit4] 1> 367701000
[junit4:junit4] 1> 222881224
(I am sure they are likely sharing some ram). But this is a massive
amount of ram for this test.
I will temporarily disable the multiplier, until the test can be made
more ram efficient. it grows linearly with the multiplier, i think
because of all the lists within lists within maps etc :)
[junit4:junit4] 1> 136660616
[junit4:junit4] 1> 89595032
On Mon, Jul 30, 2012 at 8:30 PM, Apache Jenkins Server
<jenk...@builds.apache.org> wrote:
> Build: https://builds.apache.org/job/Lucene-Solr-tests-only-4.x-java7/228/
>
> 1 tests failed.
> REGRESSION: org.apache.lucene.index.TestPostingsFormat.test
>
> Error Message:
> Java heap space
>
> Stack Trace:
> java.lang.OutOfMemoryError: Java heap space
> at
> __randomizedtesting.SeedInfo.seed([E8AAFF6FA7F41694:60FEC0B509087B6C]:0)
> at org.apache.lucene.util.BytesRef.<init>(BytesRef.java:75)
> at
> org.apache.lucene.util.fst.ByteSequenceOutputs.read(ByteSequenceOutputs.java:124)
> at
> org.apache.lucene.util.fst.ByteSequenceOutputs.read(ByteSequenceOutputs.java:33)
> at org.apache.lucene.util.fst.FST.readNextRealArc(FST.java:960)
> at org.apache.lucene.util.fst.NodeHash.hash(NodeHash.java:106)
> at org.apache.lucene.util.fst.NodeHash.add(NodeHash.java:124)
> at org.apache.lucene.util.fst.Builder.compileNode(Builder.java:195)
> at org.apache.lucene.util.fst.Builder.freezeTail(Builder.java:287)
> at org.apache.lucene.util.fst.Builder.add(Builder.java:392)
> at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finishTerm(MemoryPostingsFormat.java:257)
> at
> org.apache.lucene.index.TestPostingsFormat.buildIndex(TestPostingsFormat.java:441)
> at
> org.apache.lucene.index.TestPostingsFormat.test(TestPostingsFormat.java:896)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:601)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:818)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:877)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:891)
> at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:32)
> at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> at
> org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
> at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
> at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:825)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:671)
>
>
>
>
> Build Log:
> [...truncated 1197 lines...]
> [junit4:junit4] Suite: org.apache.lucene.index.TestPostingsFormat
> [junit4:junit4] ERROR 4.61s J0 | TestPostingsFormat.test
> [junit4:junit4] > Throwable #1: java.lang.OutOfMemoryError: Java heap space
> [junit4:junit4] > at
> __randomizedtesting.SeedInfo.seed([E8AAFF6FA7F41694:60FEC0B509087B6C]:0)
> [junit4:junit4] > at
> org.apache.lucene.util.BytesRef.<init>(BytesRef.java:75)
> [junit4:junit4] > at
> org.apache.lucene.util.fst.ByteSequenceOutputs.read(ByteSequenceOutputs.java:124)
> [junit4:junit4] > at
> org.apache.lucene.util.fst.ByteSequenceOutputs.read(ByteSequenceOutputs.java:33)
> [junit4:junit4] > at
> org.apache.lucene.util.fst.FST.readNextRealArc(FST.java:960)
> [junit4:junit4] > at
> org.apache.lucene.util.fst.NodeHash.hash(NodeHash.java:106)
> [junit4:junit4] > at
> org.apache.lucene.util.fst.NodeHash.add(NodeHash.java:124)
> [junit4:junit4] > at
> org.apache.lucene.util.fst.Builder.compileNode(Builder.java:195)
> [junit4:junit4] > at
> org.apache.lucene.util.fst.Builder.freezeTail(Builder.java:287)
> [junit4:junit4] > at
> org.apache.lucene.util.fst.Builder.add(Builder.java:392)
> [junit4:junit4] > at
> org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finishTerm(MemoryPostingsFormat.java:257)
> [junit4:junit4] > at
> org.apache.lucene.index.TestPostingsFormat.buildIndex(TestPostingsFormat.java:441)
> [junit4:junit4] > at
> org.apache.lucene.index.TestPostingsFormat.test(TestPostingsFormat.java:896)
> [junit4:junit4] > at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit4:junit4] > at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> [junit4:junit4] > at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> [junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:601)
> [junit4:junit4] > at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
> [junit4:junit4] > at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
> [junit4:junit4] > at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:818)
> [junit4:junit4] > at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:877)
> [junit4:junit4] > at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:891)
> [junit4:junit4] > at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> [junit4:junit4] > at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:32)
> [junit4:junit4] > at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> [junit4:junit4] > at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4] > at
> org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
> [junit4:junit4] > at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
> [junit4:junit4] > at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4] > at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4] > at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:825)
> [junit4:junit4] > at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132)
> [junit4:junit4] > at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:671)
> [junit4:junit4] >
> [junit4:junit4] 2> NOTE: reproduce with: ant test
> -Dtestcase=TestPostingsFormat -Dtests.method=test
> -Dtests.seed=E8AAFF6FA7F41694 -Dtests.multiplier=3 -Dtests.slow=true
> -Dtests.locale=ja -Dtests.timezone=America/Fort_Wayne
> -Dtests.file.encoding=US-ASCII
> [junit4:junit4] 2>
> [junit4:junit4] > (@AfterClass output)
> [junit4:junit4] 2> NOTE: test params are: codec=Lucene40:
> {=PostingsFormat(name=MockSep), rl=Lucene40(minBlockSize=82
> maxBlockSize=257), xgeplm=PostingsFormat(name=Memory doPackFST= false),
> kojsjftf=PostingsFormat(name=NestedPulsing)}, sim=DefaultSimilarity,
> locale=ja, timezone=America/Fort_Wayne
> [junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation
> 1.7.0_04 (64-bit)/cpus=16,threads=1,free=33223808,total=536870912
> [junit4:junit4] 2> NOTE: All tests run in this JVM: [TestSearchAfter,
> TestDocValuesIndexing, TestWeakIdentityMap,
> TestSimpleExplanationsOfNonMatches, TestFilteredQuery,
> TestFieldCacheTermsFilter, Nested, Nested, Nested, Nested, Nested, Nested,
> Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested,
> Nested, Nested, Nested, Nested, Nested, Nested, TestSpanExplanations,
> TestIndexWriterWithThreads, TestMaxTermFrequency, TestStressIndexing2,
> TestIndexableBinaryStringTools, TestCheckIndex, TestCharsRef,
> TestTermdocPerf, TestDateSort, TestSetOnce, TestMixedCodecs,
> TestSloppyPhraseQuery2, TestMultiFields, TestSnapshotDeletionPolicy,
> TestTimeLimitingCollector, TestNoDeletionPolicy, TestLazyProxSkipping,
> Test2BTerms, TestIndexWriterForceMerge, TestRollingUpdates,
> TestTermVectorsReader, TestAssertions, TestSpecialOperations,
> TestFilterAtomicReader, TestElevationComparator, TestMultiMMap,
> TestByteSlices, TestPayloadTermQuery, TestDocumentWriter,
> TestSizeBoundedForceMerge, TestFuzzyQuery, TestDeletionPolicy,
> TestShardSearching, TestNumericUtils, TestSpanSearchEquivalence,
> TestDisjunctionMaxQuery, TestByteArrayDataInput, TestMultiPhraseQuery,
> TestTopDocsCollector, TestFixedBitSet, TestSearch, TestTransactionRollback,
> TestTermVectors, TestIndexWriter, TestDirectoryReaderReopen, TestOmitTf,
> TestCopyBytes, TestRegexpQuery, TestSmallFloat, TestIndexWriterNRTIsCurrent,
> TestMockCharFilter, TestPrefixCodedTerms, TestLevenshteinAutomata, Nested,
> Nested, TestMultiTermConstantScore, TestIndexWriterReader, TestWindowsMMap,
> TestDemo, TestParallelCompositeReader, TestScoreCachingWrappingScorer,
> TestFileSwitchDirectory, TestArrayUtil, TestPagedBytes,
> TestIndexWriterLockRelease, InBeforeClass, InAfterClass, InTestMethod,
> NonStringProperties, TestBasicOperations, TestSpanExplanationsOfNonMatches,
> TestSortedVIntList, TestScorerPerf, TestPrefixInBooleanQuery,
> TestRegexpRandom, TestNorms, TestIndexWriterExceptions, TestBasics,
> TestDuelingCodecs, TestIndexWriterMergePolicy, TestNeverDelete,
> TestFlushByRamOrCountsPolicy, TestTopDocsMerge, TestCollectionUtil,
> TestCompoundFile, TestSimpleExplanations, TestCustomNorms,
> TestStressIndexing, TestDeterminizeLexicon, TestDocumentsWriterStallControl,
> TestRollingCharBuffer, TestRegexpRandom2, TestConsistentFieldNumbers,
> TestDoubleBarrelLRUCache, TestCrashCausesCorruptIndex, TestDocValues,
> TestUTF32ToUTF8, TestTransactions, TestThreadedForceMerge, TestSegmentReader,
> TestPerFieldPostingsFormat, TestFieldCache, TestPayloadNearQuery,
> TestPrefixRandom, TestDocsAndPositions, TestFlex, TestIndexableField,
> TestSimilarity2, TestAllFilesHaveCodecHeader, TestMultiLevelSkipList,
> TestExternalCodecs, Nested2, Nested3, Nested1, TestTermRangeQuery,
> TestSpansAdvanced2, TestSpanMultiTermQueryWrapper,
> TestComplexExplanationsOfNonMatches, TestSumDocFreq, TestPerSegmentDeletes,
> TestParallelReaderEmptyIndex, TestIndexFileDeleter, Before3, Before3,
> TestDocValuesScoring, TestDocIdSet, TestFieldValueFilter, TestAppendingCodec,
> TestSpansAdvanced, TestConstantScoreQuery, TestPositionIncrement, Nested,
> TestReaderClosed, TestNot, TestAutomatonQueryUnicode,
> TestIndexWriterOnJRECrash, TestBinaryDocument, TestSpanFirstQuery,
> TestPriorityQueue, TestDocBoost, TestIntBlockCodec, TestIsCurrent,
> MultiCollectorTest, TestPrefixFilter, TestVersion, TestNoMergeScheduler,
> TestCachingTokenFilter, TestIOUtils, TestCharFilter, TestPostingsFormat]
> [junit4:junit4] 2>
> [junit4:junit4] Completed on J0 in 13.67s, 1 test, 1 error <<< FAILURES!
>
> [...truncated 5 lines...]
> BUILD FAILED
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-4.x-java7/checkout/build.xml:29:
> The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-4.x-java7/checkout/lucene/build.xml:50:
> The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-4.x-java7/checkout/lucene/common-build.xml:1095:
> The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-4.x-java7/checkout/lucene/common-build.xml:790:
> There were test failures: 309 suites, 1736 tests, 1 error, 14 ignored (12
> assumptions)
>
> Total time: 6 minutes 14 seconds
> Build step 'Execute shell' marked build as failure
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure
> Sending email for trigger: Failure
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> For additional commands, e-mail: dev-h...@lucene.apache.org
--
lucidimagination.com
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
