hi all,

Running pig with avro storage and facing the below issue

pig 0.10 and avro 1.7
*
*
*org.apache.avro.file.DataFileWriter$AppenderWriteException :
java.lang.RuntimeException : Dataum 23.0 is not in union ["null" , "int"]*
*
*
my pig script does the following

a = load '/user/abhi/abc.txt' using
org.apache.pig.piggybank.storage.avro.AvroStorage();

b = load '/user/abhi/def.txt' using
org.apache.pig.piggybank.storage.avro.AvroStorage();

joined = join a  by $0 left outer , b by $0;

final = foreach joined generate
{
...
...
};

store final into '/user/abhi/output' using
org.apache.pig.piggybank.storage.avro.AvroStorage();

Thanks
abhishek

Reply via email to