Hi, Just in case you already have the 64 bit version, the following works for me on spark 0.9.1
SPARK_LIBRARY_PATH=/opt/hadoop/lib/native/ ./bin/spark-shell (where my libhadoop.so is present in /opt/hadoop/lib/native/) Thanks, Rahul Singhal From: Akhil Das <ak...@sigmoidanalytics.com<mailto:ak...@sigmoidanalytics.com>> Reply-To: "user@spark.apache.org<mailto:user@spark.apache.org>" <user@spark.apache.org<mailto:user@spark.apache.org>> Date: Wednesday 30 April 2014 2:06 PM To: "user@spark.apache.org<mailto:user@spark.apache.org>" <user@spark.apache.org<mailto:user@spark.apache.org>> Cc: "u...@spark.incubator.apache.org<mailto:u...@spark.incubator.apache.org>" <u...@spark.incubator.apache.org<mailto:u...@spark.incubator.apache.org>> Subject: Re: the spark configuage Hi The reason you saw that warning is the native Hadoop library $HADOOP_HOME/lib/native/libhadoop.so.1.0.0 was actually compiled on 32 bit. Anyway, it's just a warning, and won't impact Hadoop's functionalities. Here is the way if you do want to eliminate this warning, download the source code of Hadoop and recompile libhadoop.so.1.0.0 on 64bit system, then replace the 32bit one. Steps on how to recompile source code are included here for Ubuntu: http://www.ercoppa.org/Linux-Compile-Hadoop-220-fix-Unable-to-load-native-hadoop-library.htm http://www.csrdu.org/nauman/2014/01/23/geting-started-with-hadoop-2-2-0-building/ Good luck. Thanks Best Regards On Wed, Apr 30, 2014 at 1:28 PM, Sophia <sln-1...@163.com<mailto:sln-1...@163.com>> wrote: Hi， when I configue spark, run the shell instruction: ./spark-shell it told me like this: WARN:NativeCodeLoader:Uable to load native-hadoop livrary for your builtin-java classes where applicable,when it connect to ResourceManager,it stopped. What should I DO? Wish your reply -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/the-spark-configuage-tp5098.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
