Re: issue with IsEmpty UDF

2013-06-15 Thread Cheolsoo Park
Hi Pankaj, Which version of Pig are you using? It works fine for me. I get the following output as expected: ((2,22),{(2,22,222,)},{(2,22,bb,bbb)}) I tested Pig 0.9, 0.10, 0.11, and trunk. All worked for me. Thanks, Cheolsoo On Fri, Jun 14, 2013 at 5:25 AM, Ojha, Pankaj wrote: > Hi Tea

pig union with avro

2013-06-15 Thread abhishek dodda
hello, I am doing this DEFINE AVRO_LOAD org.apache.pig.piggybank.strorage.avro.AvroStorage(); A = load '/user/abhi/a.txt' using AVRO_LOAD; B = load '/user/abhi/b.txt' using AVRO_LOAD; C = UNION A , B; here script is failing with the following error ERROR org.apache.pig.tools.grunt.Grunt - ER

Re: pig union with avro

2013-06-15 Thread abhishek dodda
hello, I am doing this DEFINE AVRO_LOAD org.apache.pig.piggybank.strorage.avro.AvroStorage(); A = load '/user/abhi/a.txt' using AVRO_LOAD; B = load '/user/abhi/b.txt' using AVRO_LOAD; C = UNION A , B; here script is failing with the following error *ERROR org.apache.pig.tools.grunt.Grunt - E

Re: pig union with avro

2013-06-15 Thread Cheolsoo Park
What's the output of describe A and B? If the schema of A and B are not identical, union will type-cast fields to merge them: http://pig.apache.org/docs/r0.11.1/basic.html#union I would try to find which fields Pig tries to cast to bytearray while merging them. Casting anything to bytearray is i

Re: pig union with avro

2013-06-15 Thread abhishek
Thanks for reply Cheolsoo What's the output of describe A and B? Output of A and B are not identical. If the schema of A and B are not identical, union will type-cast fields to merge them http://pig.apache.org/docs/r0.11.1/basic.html#union > I would try to find which fields pig tries to cas

Re: pig union with avro

2013-06-15 Thread abhishek
Cheolsoo, Thank you very much , I found the in compatible types in the union. Now it is working fine. Regards Abhishek Sent from my iPhone On Jun 15, 2013, at 11:52 PM, Cheolsoo Park wrote: > What's the output of describe A and B? > > If the schema of A and B are not identical, union will