Rohini Palaniswamy created PIG-5363:
---------------------------------------
Summary: Use 1-1 edge vertex group in union
Key: PIG-5363
URL: https://issues.apache.org/jira/browse/PIG-5363
Project: Pig
Issue Type: Improvement
Reporter: Rohini Palaniswamy
TEZ-3983 fixes vertex groups to work properly with 1-1 edges. So we should
switch to that instead of using unordered partitioned shuffle edge in
[https://github.com/apache/pig/blob/5b0a0bfaefad0d57c6c9fbbc09d709d13ea9af93/src/org/apache/pig/backend/hadoop/executionengine/tez/plan/optimizer/UnionOptimizer.java#L635-L642).]
The current logic of partitioning based on hashcode of values is slightly
expensive. For backward compatibility with older Tez versions, have to support
both modes possibly via configuration setting or Tez version check.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
