[ 
https://issues.apache.org/jira/browse/PIG-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14041423#comment-14041423
 ] 

Mark Wagner commented on PIG-4036:
----------------------------------

That's the goal of using readOnce. The idea was that the POPackage could be 
optimistic/lazy about what bags actually need to be in memory (assume that they 
don't need to be), and the classes extending Packager can bring into memory 
what it needs. The JoinPackager does not hold the bag in memory and just 
iterates over it.

Looking through the other code, it looks like this may be a bug in LitePackager 
as well.

> Fix e2e failures - JobManagement_3, CmdErrors_3 and BigData_4
> -------------------------------------------------------------
>
>                 Key: PIG-4036
>                 URL: https://issues.apache.org/jira/browse/PIG-4036
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Rohini Palaniswamy
>            Assignee: Daniel Dai
>             Fix For: 0.13.0
>
>




--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to