László Bodor created HIVE-27916:
-----------------------------------

             Summary: Increase tez.am.resource.memory.mb for TestIcebergCliDrver
                 Key: HIVE-27916
                 URL: https://issues.apache.org/jira/browse/HIVE-27916
             Project: Hive
          Issue Type: Bug
          Components: Test
    Affects Versions: 4.0.0-beta-1
            Reporter: Stamatis Zampetakis
            Assignee: Stamatis Zampetakis
             Fix For: 4.0.0


Running all the tests under TestMiniTezCliDriver very frequently (but still 
intermittently) leads to OutOfMemory errors.
{noformat}
cd itests/qtest && mvn test -Dtest=TestMiniTezCliDriver
{noformat}

I set {{-XX:+HeapDumpOnOutOfMemoryError}} and the respective heapdumps are 
attached to this ticket.

The OOM is thrown from the application master and a quick inspection of the 
dumps shows that it comes mainly from the accumulation of Configuration objects 
(~1MB each) by various classes.

The max heap size for application master is pretty low (~100MB) so it is quite 
easy to reach. The heap size is explicitly very low for testing purposes but 
maybe we should re-evaluate the current configurations for the tests.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to