[ https://issues.apache.org/jira/browse/PIG-2234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13127289#comment-13127289 ]
Thejas M Nair commented on PIG-2234: ------------------------------------ I think supporting bags of primitive types (instead of just bags of tuples) in pig would be the cleanest way to do it! (I probably had some other idea in mind when I created it, but when I think of it now - none of the alternatives look clean enough). That change has a larger scope than this jira. > Alebraic udf Init and Intermediate functions should be able to return non > tuple data types > ------------------------------------------------------------------------------------------ > > Key: PIG-2234 > URL: https://issues.apache.org/jira/browse/PIG-2234 > Project: Pig > Issue Type: Improvement > Affects Versions: 0.8.0, 0.9.0 > Reporter: Thejas M Nair > > The exec() call to Algebraic UDF initial and intermediate classes are > required to return a Tuple. This has been done because the output is > collected in a DataBag and passed to Intermediate.exec() and Final.exec() > calls, and DataBag in pig needs to contain a Tuple. But this results in > additional Tuple objects getting created and also adds additional > (de)serialization costs. Functions such as COUNT, SUM are also having to wrap > the initial and intermediate results in Tuples. > The Algebraic interface needs to change to reduce the costs for udfs that > don't need an intermediate tuple . -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira