Re: Is automatic type conversion only kicked in when your loadFunc doesn't implement LoadMetadata?

2010-12-03 Thread Daniel Dai
When you write a custom LoadFunc, you have two ways to determine the schema returned by LoadFunc: 1. Implemneting LoadMetadata, tell Pig the right schema your LoadFunc will produce. You need to convert LoadFunc output to match the schema you tell Pig 2. Not implementing LoadMetadata, Pig wil

Is automatic type conversion only kicked in when your loadFunc doesn't implement LoadMetadata?

2010-12-03 Thread Jae Lee
Hi, I'm finding my custom loader fails to deal with SUM() for fields returned as DataByteArray (as in PigStorage) when its LoadMetadata indicates the field type being float. I've also changed all the field type to chararray which then doesn't find SUM function for chararray. So is it true tha