Optimize content of mapPlan/reducePlan to be serialized into JobConf
--------------------------------------------------------------------
Key: PIG-1336
URL: https://issues.apache.org/jira/browse/PIG-1336
Project: Pig
Issue Type: Improvement
Components: impl
Affects Versions: 0.7.0
Reporter: Daniel Dai
Assignee: Daniel Dai
Attachments: PIG-1336-1.patch
Currently, if a pig script job contains multiple map-reduce jobs, each job will
serialize all map-reduce job plan into JobConf. The reason is
PhysicalOperator.inputs is built in Physical plan and in fact it chains all the
jobs without regard to map-reduce boundary. Further, when we only want to
serialize POStore, we serialize this whole plan again due to POStore.inputs.
This should be fixed.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
