[ 
https://issues.apache.org/jira/browse/TEZ-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954009#comment-14954009
 ] 

Siddharth Seth commented on TEZ-2850:
-------------------------------------

[~saikatr], as [~gopalv] pointed out in the previous comment - the 4K chunks 
are not required for in-memory segments. Fixing that would be a lot simpler - 
and less error prone (races on when to trigger a spill). We should target that 
as the fix for this issue.

> Tez MergeManager OOM for small Map Outputs
> ------------------------------------------
>
>                 Key: TEZ-2850
>                 URL: https://issues.apache.org/jira/browse/TEZ-2850
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Saikat
>            Assignee: Saikat
>         Attachments: OOM_1.png, OOM_2.png, OOM_3.png, TEZ-2850.1.patch, 
> TEZ-2850.2.patch, TEZ-2850_test.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to