Rohini Palaniswamy created PIG-4685:
---------------------------------------
Summary: SecondaryKeyOptimizerTez does not optimize cogroup
Key: PIG-4685
URL: https://issues.apache.org/jira/browse/PIG-4685
Project: Pig
Issue Type: Improvement
Reporter: Rohini Palaniswamy
In PIG-4683, [~daijy] pointed out that SecondaryKeyOptimizerTez does not
optimize cogroup.
{code}
// Current code does not handle more than one predecessors
// even though it is possible. The problem is when we
// process the first predecessor, we remove the foreach inner
// operators from the reduce side, and the second predecessor
// cannot see them
if (predecessors.size()>1) {
return;
}
{code}
It is a tricky case and we need to see how to fix it.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
