[ https://issues.apache.org/jira/browse/MAPREDUCE-1784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eli Collins resolved MAPREDUCE-1784. ------------------------------------ Resolution: Fixed Fix Version/s: 0.20.3 Hadoop Flags: [Reviewed] I merged HDFS-727 from trunk into branch-0.20, ran the libhdfs test and committed. > IFile should check for null compressor > -------------------------------------- > > Key: MAPREDUCE-1784 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1784 > Project: Hadoop Map/Reduce > Issue Type: Bug > Affects Versions: 0.22.0 > Reporter: Eli Collins > Assignee: Eli Collins > Priority: Minor > Fix For: 0.20.3, 0.22.0 > > Attachments: mapred-1784-1.patch > > > IFile assumes that when it has a codec it can always get a compressor. This > fails when mapred.compress.map.output is true but the native libraries are > not installed, resulting in an NPE: > {code} > java.lang.NullPointerException > at org.apache.hadoop.mapred.IFile$Writer.<init>(IFile.java:102) > at > org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1198) > at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1091) > at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:359) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307) > at org.apache.hadoop.mapred.Child.main(Child.java:170) > {code} > Let's make IFile handle this case by logging and using non-compressed > streams.l -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.