[ https://issues.apache.org/jira/browse/DATAFU-116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eyal Allweil closed DATAFU-116. ------------------------------- Resolution: Won't Fix Since it seems like Pig doesn't use the Accumulator interface when there are multiple bags in the input, this improvement isn't relevant for these UDF's. > Make SetIntersect and SetDifference implement Accumulator > --------------------------------------------------------- > > Key: DATAFU-116 > URL: https://issues.apache.org/jira/browse/DATAFU-116 > Project: DataFu > Issue Type: Improvement > Affects Versions: 1.3.0 > Reporter: Eyal Allweil > > SetIntersect and SetDifference accept only sorted bags, and the output is > always smaller than the inputs. Therefore an accumulator implementation > should be possible and it will improve memory usage (somewhat) and allow Pig > to optimize loops with these operations better. -- This message was sent by Atlassian JIRA (v6.4.14#64029)