IFile should check for null compressor
--------------------------------------
Key: MAPREDUCE-1784
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1784
Project: Hadoop Map/Reduce
Issue Type: Bug
Affects Versions: 0.22.0
Reporter: Eli Collins
Assignee: Eli Collins
Priority: Minor
Fix For: 0.22.0
IFile assumes that when it has a codec it can always get a compressor. This
fails when mapred.compress.map.output is true but the native libraries are not
installed, resulting in an NPE:
{code}
java.lang.NullPointerException
at org.apache.hadoop.mapred.IFile$Writer.<init>(IFile.java:102)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1198)
at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1091)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:359)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
{code}
Let's make IFile handle this case by logging and using non-compressed streams.l
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
