I did some more investigation. I found weird behavior in the readString()
method of BinaryDecoder.java in Avro source code if we have the statement
record.put("rowkey", key) in the reduce() method. Does this mean that there is
a bug in BinaryDecoder.java ? Thanks.
Ey-Chih Chow
From: eyc...
On 03/01/2011 09:05 PM, felix gao wrote:
> I am running some comparison tests on a data set that I converted to
> avro with deflator set to level 6. The original logs consists of 2880
> uncompressed http access logs with a total size of 1.4TB. The Compressed
> avro log is about 2/3 of the size. Ho
What follows are fragments of trace logs of our MR jobs corresponding
respectively to with and without the statement 'record.put("rowkey", key)'
mentioned in the previous messages. From the last line, logged at the entry of
the reduce() method, of each of these two logs you can see the differe
