Question related to org.apache.avro.io.DirectBinaryDecoder

2016-01-23 Thread Yong Zhang
Hi, Avro Developers: Is anyone familiar the code logic related to org.apache.avro.io.DirectBinaryDecoder? I am asking this question related to AVRO-1786, which I believe I am facing a bug related to this class. A valid Avro record sent from Mapper to the Reducer, but Reducer cannot read it du

Re: Question related to org.apache.avro.io.DirectBinaryDecoder

2016-01-25 Thread Scott Carey
Looking at the ticket (sorry, can¹t update in JIRA at the moment): The value 101 in the raw data is the integer -51. Therefore the cause is either: * Corrupt data * Improper schema used to read (was written with a different schema than the reader is configured to use for its Œwriter¹ schema) Yo

RE: Question related to org.apache.avro.io.DirectBinaryDecoder

2016-01-26 Thread Yong Zhang
catch (RuntimeException re){ System.out.println("key = " + key); throw re }So right now, I am stuck to simplify the data, any idea how should I debug this issue? Thanks > Date: Mon, 25 Jan 2016 12:08:44 -0800 > Subject: Re: Question related to org.apache.avro.io.DirectBinaryDecod