[
https://issues.apache.org/jira/browse/PIG-480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12799373#action_12799373
]
Alan Gates commented on PIG-480:
--------------------------------
So this code definitely wins in some instances and looses in others. I propose
that we do include the functionality, but that we define a property that will
turn it off (something like -Dpig.exec.noidentitymap or something) and clearly
document the case where users would want to turn it off.
Thoughts?
> PERFORMANCE: Use identity mapper in a chain of M-R jobs
> -------------------------------------------------------
>
> Key: PIG-480
> URL: https://issues.apache.org/jira/browse/PIG-480
> Project: Pig
> Issue Type: Improvement
> Affects Versions: 0.2.0
> Reporter: Olga Natkovich
> Assignee: Ying He
> Attachments: PIG_480.patch, PIG_480.patch, PIG_480.patch
>
>
> For jobs with two or more MR jobs, use identity mapper wherever possible in
> second and subsequent MR jobs. Identity mapper is about 50% than pig empty
> map job because it doesn't parse the data.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
