[ https://issues.apache.org/jira/browse/TEZ-2791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738026#comment-14738026 ]
Saikat commented on TEZ-2791: ----------------------------- [~jeagles] I believe this is the same setitngs I was taking about which had bloated the old gen heap space. Reducing this will ensure that fetched map outputs are merged-spilled early to disk by the merge manager. > Reduce tez.runtime.shuffle.fetch.buffer.percent default value to avoid corner > case OOMs > --------------------------------------------------------------------------------------- > > Key: TEZ-2791 > URL: https://issues.apache.org/jira/browse/TEZ-2791 > Project: Apache Tez > Issue Type: Bug > Reporter: Rajesh Balamohan > > Default value for tez.runtime.shuffle.fetch.buffer.percent is set to 0.9. In > corner cases & based on scheduling & data sizes, it is possible that JVM > crosses old-gen threshold and ends up throwing OOM. It would be better to set > the default value to 0.6. -- This message was sent by Atlassian JIRA (v6.3.4#6332)