A little more on this.
So, I've narrowed down the problem to using Lzop compression
(com.hadoop.compression.lzo.LzopCodec)
for mapred.map.output.compression.codec.
mapred.map.output.compression.codec
com.hadoop.compression.lzo.LzopCodec
If I do the above, I will get the Shuffle Error.
Hi, No problems. Thanks so much for your time. Greatly appreciated.
I agree that it must be a configuration problem and so today I was able
to start from scratch and did a fresh install of 0.20.2 on the 5 node cluster.
I've now noticed that the error occurs when compression is enabled.
I've run t
