[
https://issues.apache.org/jira/browse/PIG-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14041402#comment-14041402
]
Mark Wagner commented on PIG-4036:
----------------------------------
The readOnce flag is the method by which POPackage communicates which bags the
Packager can assume are already persisted in memory and which are ephemeral and
must be copied into memory. This enables the streaming optimization on the last
bag in classic-MR and all inputs for Tez. The Packager base class requires all
bags to actually be persisted, so it copies into memory. The CombinerPackager
can have it's one and only input streamed so it should overwrite attachInput()
to reflect that (which it doesn't right now).
I'll work on verifying that fix.
> Fix e2e failures - JobManagement_3, CmdErrors_3 and BigData_4
> -------------------------------------------------------------
>
> Key: PIG-4036
> URL: https://issues.apache.org/jira/browse/PIG-4036
> Project: Pig
> Issue Type: Bug
> Reporter: Rohini Palaniswamy
> Assignee: Daniel Dai
> Fix For: 0.13.0
>
>
--
This message was sent by Atlassian JIRA
(v6.2#6252)
