You can extend load func to make it add a field with split id. Pass this field to UDF with other fields 18.04.2014 12:28 пользователь "Abhishek Agarwal" <abhishc...@gmail.com> написал:
> I need this information in the UDF which is a EvalFunc and not LoadFunc. > May be I can communicate the pig split information from LoadFunc to > EvalFunc through UDFContext. suggestions? > > > On Fri, Apr 18, 2014 at 12:49 AM, Prashant Kommireddi > <prash1...@gmail.com>wrote: > > > You should be able to get that info in your LoadFunc. > > > > Take a look at PigStorage.prepareToRead(RecordReader reader, PigSplit > > split) implementation. > > > > > > On Sat, Apr 12, 2014 at 12:23 PM, Abhishek Agarwal <abhishc...@gmail.com > > >wrote: > > > > > How can I get the current file being processed by mapper in EvalFunc? > In > > > typical MR Job, this is achieved through ((FileSplit) > > > context.getInputSplit).getPath() > > > > > > -- > > > Regards, > > > Abhishek Agarwal > > > > > > > > > -- > Regards, > Abhishek Agarwal >
