Eyal Allweil created DATAFU-116:
-----------------------------------
Summary: Make SetIntersect and SetDifference implement Accumulator
Key: DATAFU-116
URL: https://issues.apache.org/jira/browse/DATAFU-116
Project: DataFu
Issue Type: Improvement
Affects Versions: 1.3.0
Reporter: Eyal Allweil
SetIntersect and SetDifference accept only sorted bags, and the output is
always smaller than the inputs. Therefore an accumulator implementation should
be possible and it will improve memory usage (somewhat) and allow Pig to
optimize loops with these operations better.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)