[
https://issues.apache.org/jira/browse/PIG-1209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12829415#action_12829415
]
Ashutosh Chauhan commented on PIG-1209:
---------------------------------------
Did manual testing on this. With large enough dataset some reducers fail with
"Error: GC overhead limit exceeded". After applying this patch, those failures
didn't happen. This patch is ready for review.
> Port POJoinPackage to proactively spill
> ---------------------------------------
>
> Key: PIG-1209
> URL: https://issues.apache.org/jira/browse/PIG-1209
> Project: Pig
> Issue Type: Bug
> Reporter: Sriranjan Manjunath
> Assignee: Ashutosh Chauhan
> Fix For: 0.7.0
>
> Attachments: pig-1209.patch
>
>
> POPackage proactively spills the bag whereas POJoinPackage still uses the
> SpillableMemoryManager. We should port this to use InternalCacheBag which
> proactively spills.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
