[
https://issues.apache.org/jira/browse/MAPREDUCE-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14065570#comment-14065570
]
Todd Lipcon commented on MAPREDUCE-5978:
----------------------------------------
I see the following in the logs:
load nativetask lib failed, Native-Task Delegation is disabled
org.apache.hadoop.mapred.InvalidJobConfException: Native output collector don't
support compression codec org.apache.hadoop.io.compress.BZip2Codec, We support
Gzip, Lz4, snappy
at
org.apache.hadoop.mapred.nativetask.NativeMapOutputCollectorDelegator.init(NativeMapOutputCollectorDelegator.java:94)
at
org.apache.hadoop.mapred.nativetask.testutil.EnforceNativeOutputCollectorDelegator.init(EnforceNativeOutputCollectorDelegator.java:31)
at
org.apache.hadoop.mapred.MapTask.createSortingCollector(MapTask.java:392)
at org.apache.hadoop.mapred.MapTask.access$100(MapTask.java:80)
at
org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:683)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:755)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
at
org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:244)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
create file ./compress/input.txt
org.apache.hadoop.io.Text org.apache.hadoop.io.Text
create file ./compress/input.txt
org.apache.hadoop.io.Text org.apache.hadoop.io.Text
load nativetask lib failed, Native-Task Delegation is disabled
org.apache.hadoop.mapred.InvalidJobConfException: Native output collector don't
support compression codec org.apache.hadoop.io.compress.DefaultCodec, We
support Gzip, Lz4, snappy
at
org.apache.hadoop.mapred.nativetask.NativeMapOutputCollectorDelegator.init(NativeMapOutputCollectorDelegator.java:94)
at
org.apache.hadoop.mapred.nativetask.testutil.EnforceNativeOutputCollectorDelegator.init(EnforceNativeOutputCollectorDelegator.java:31)
at
org.apache.hadoop.mapred.MapTask.createSortingCollector(MapTask.java:392)
at org.apache.hadoop.mapred.MapTask.access$100(MapTask.java:80)
at
org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:683)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:755)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
at
org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:244)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
> native-task CompressTest failure on Ubuntu
> ------------------------------------------
>
> Key: MAPREDUCE-5978
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5978
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
> Components: task
> Reporter: Todd Lipcon
>
> The MR-2841 branch fails the following unit tests on my box:
> CompressTest.testBzip2Compress:84 file compare result: if they are the same
> ,then return true expected:<true> but was:<false>
> CompressTest.testDefaultCompress:116 file compare result: if they are the
> same ,then return true expected:<true> but was:<false>
> We need to fix these before merging.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
