Re: Loading arbitrary objects

2011-04-08 Thread Mridul Muralidharan
If the arbitrary objects you refer to fit nicely into pig's notion of tuples/bags/maps/primitives, then you can directly use that. Otherwise, due to limited support for complex/arbitrary objects in pig schema (no support for something like Writable for example), you will most probably need t

Re: Loading arbitrary objects

2011-04-07 Thread Daniel Dai
You need a LoadFunc. Check http://pig.apache.org/docs/r0.8.0/udf.html#Load+Functions about how to write a LoadFunc. Daniel On 04/06/2011 06:30 PM, Mark wrote: If I wanted to load arbitrary objects into some tuples what classes should I be looking at? Would I need some of storage class? For e

Loading arbitrary objects

2011-04-06 Thread Mark
If I wanted to load arbitrary objects into some tuples what classes should I be looking at? Would I need some of storage class? For example I have data file with out that contains org.apache.mahout.fpm.pfpgrowth.convertors.string.TopKStringPatterns. I would like to iterate over them using pig