[
https://issues.apache.org/jira/browse/PIG-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14041801#comment-14041801
]
Daniel Dai commented on PIG-4036:
---------------------------------
[~rohini], POCombinerPackage also materialize the bag. Now in Packager, we do
materialize from PeekedBag to InternalCachedBag, PeekedBag doing streaming,
though I cannot see the value for doing that, this should not use more memory.
I believe the problem is we pass the wrong bagCount to InternalCachedBag, so
InternalCachedBag is using unlimited memory. I attach a draft patch, can you
give a try.
> Fix e2e failures - JobManagement_3, CmdErrors_3 and BigData_4
> -------------------------------------------------------------
>
> Key: PIG-4036
> URL: https://issues.apache.org/jira/browse/PIG-4036
> Project: Pig
> Issue Type: Bug
> Reporter: Rohini Palaniswamy
> Assignee: Daniel Dai
> Fix For: 0.13.0
>
>
--
This message was sent by Atlassian JIRA
(v6.2#6252)
