What version of Hadoop are you using?
On 11/5/11 11:09 AM, "Steve Lewis" <lordjoe2...@gmail.com> wrote: My job is dying during a map task write. This happened in enough task to kill the job although most tasks succeeded - Any ideas as to where to start diagnosing the problem Caused by: java.lang.NullPointerException at org.apache.hadoop.io.compress.BZip2Codec$BZip2CompressionOutputStream.write(BZip2Codec.java:200) at org.apache.hadoop.fs.FSDataOutputStream$PositionCache.write(FSDataOutputStream.java:41) at java.io.DataOutputStream.writeByte(DataOutputStream.java:136) at org.apache.hadoop.io.WritableUtils.writeVLong(WritableUtils.java:263) at org.apache.hadoop.io.WritableUtils.writeVInt(WritableUtils.java:243) at org.apache.hadoop.mapred.IFile$Writer.close(IFile.java:126) at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1242) at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.access$1800(MapTask.java:648) at org.apache.hadoop.mapred.MapTask$MapOutputBuffer$SpillThread.run(MapTask.java:1135)
