I am trying to use SequenceFiles with LZO compression outside the
context of a MapReduce application. However, when I try to use the LZO
codec, I get the following errors in the log:
08/09/30 11:09:56 DEBUG conf.Configuration: java.io.IOException:
config()
at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:157)
at
com
.rapleaf
.formats
.stream.TestSequenceFileStreams.setUp(TestSequenceFileStreams.java:22)
at junit.framework.TestCase.runBare(TestCase.java:125)
at junit.framework.TestResult$1.protect(TestResult.java:106)
at junit.framework.TestResult.runProtected(TestResult.java:124)
at junit.framework.TestResult.run(TestResult.java:109)
at junit.framework.TestCase.run(TestCase.java:118)
at junit.framework.TestSuite.runTest(TestSuite.java:208)
at junit.framework.TestSuite.run(TestSuite.java:203)
at
org
.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:
81)
at junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:36)
at
org
.apache
.tools
.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:
421)
at
org
.apache
.tools
.ant
.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:
912)
at
org
.apache
.tools
.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:
766)
08/09/30 11:09:56 DEBUG security.UserGroupInformation: Unix Login:
nathan,staff,_lpadmin,com.apple.sharepoint.group.
1,_appserveradm,_appserverusr,admin,com.apple.access_ssh
08/09/30 11:09:56 DEBUG util.NativeCodeLoader: Trying to load the
custom-built native-hadoop library...
08/09/30 11:09:56 DEBUG util.NativeCodeLoader: Failed to load native-
hadoop with error: java.lang.UnsatisfiedLinkError: no hadoop in
java.library.path
08/09/30 11:09:56 DEBUG util.NativeCodeLoader: java.library.path=.:/
Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java
08/09/30 11:09:56 WARN util.NativeCodeLoader: Unable to load native-
hadoop library for your platform... using builtin-java classes where
applicable
08/09/30 11:09:56 ERROR compress.LzoCodec: Cannot load native-lzo
without native-hadoop
What is the native hadoop library and how should I configure things to
use it?
Thanks,
Nathan Marz
RapLeaf
