Eyal Allweil created DATAFU-116:
-----------------------------------

             Summary: Make SetIntersect and SetDifference implement Accumulator
                 Key: DATAFU-116
                 URL: https://issues.apache.org/jira/browse/DATAFU-116
             Project: DataFu
          Issue Type: Improvement
    Affects Versions: 1.3.0
            Reporter: Eyal Allweil


SetIntersect and SetDifference accept only sorted bags, and the output is 
always smaller than the inputs. Therefore an accumulator implementation should 
be possible and it will improve memory usage (somewhat) and allow Pig to 
optimize loops with these operations better.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to