[jira] [Created] (LUCENE-6546) Test2BPostingsBytes sometimes OOMs even with -Dtests.heapsize=30g

[Steve Rowe (JIRA)]

Steve Rowe created LUCENE-6546:
----------------------------------

             Summary: Test2BPostingsBytes sometimes OOMs even with 
-Dtests.heapsize=30g
                 Key: LUCENE-6546
                 URL: https://issues.apache.org/jira/browse/LUCENE-6546
             Project: Lucene - Core
          Issue Type: Bug
          Components: general/test
            Reporter: Steve Rowe
            Priority: Minor


Here's an example: 
[http://jenkins.sarowe.net/job/Lucene-core-nightly-monster-5.x-Java7/22/console];
 the seed still OOMs for me when {{-Dtests.heapsize=60g}}:

{noformat}
ant test  -Dtestcase=Test2BPostingsBytes -Dtests.method=test 
-Dtests.seed=F99606D852DB1420 -Dtests.nightly=true -Dtests.slow=true 
-Dtests.locale=sr_RS_#Latn -Dtests.timezone=America/Port-au-Prince 
-Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
{noformat}

(Although the repro line doesn't include all of them - [~dawid.weiss] is this 
expected? - the above-linked job runs with {{-Dtests.jvms=4 
-Dtests.nightly=true -Dtests.monster=true -Dtests.heapsize=30g}}.)

I narrowed the problem down to {{CompressingCodec}} - any of the 4 subclasses - 
with {{maxDocsPerChunk * blockSize}} less than 16.  The other variable 
randomized in {{CompressingCodec.randomInstance()}} is {{chunkSize}}, which 
doesn't seem to be implicated in the OOMs.

I guess we could suppress {{CompressingCodec}}, or just expect OOMs from time 
to time (the above condition happens fairly rarely).  But I'd rather continue 
to exercise {{CompressingCodec}} as much as possible.

Here are the OOMs I saw with {{-Dtests.heapsize=30g}} and 
{{-Dtests.codec=CompressingCodec}}:

||compressionMode||chunkSize||maxDocsPerChunk||blockSize||
|DUMMY|3|2|1|
|DUMMY|7|1|1|
|FAST_DECOMPRESSION|10|9|1|
|FAST_DECOMPRESSION|31614|3|4|
|FAST|21879|1|9|
|DUMMY|3|3|1|
|HIGH_COMPRESSION|4167|10|1|
|HIGH_COMPRESSION|12437|2|5|
|DUMMY|4|3|2|
|HIGH_COMPRESSION|3|3|2|
|FAST_DECOMPRESSION|3339|10|1|
|DUMMY|2|5|3|

Here are some that did *not* OOM:

||compressionMode||chunkSize||maxDocsPerChunk||blockSize||
|DUMMY|4|4|4|
|DUMMY|4|2|246|
|FAST|30677|907|2|
|FAST_DECOMPRESSION|15165|2|10|
|FAST_DECOMPRESSION|28633|67|1|
|DUMMY|7|3|9|
|DUMMY|2835|9|3|
|DUMMY|25785|4|7|




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org