Again incompatibility, locating example jars

2015-04-18 Thread Mahmood Naderan
Hi,There is another incompatibility between 1.2.0 and 2.2.6. I appreciate is someone help to figure it out.This command works on 1.2.0 time ${HADOOP_HOME}/bin/hadoop jar  ${HADOOP_HOME}/hadoop-examples-*.jar grep ${WORK_DIR}/data-MicroBenchmarks/in ${WORK_DIR}/data-MicroBenchmarks/out/grep a*xyz

Re: New to hadoop..plz help

2015-04-18 Thread Marco Shaw
Hi, We are usually here to help, but not really to do this all for you. If you need someone to write this for you, there are some freelance sites on the Internet where you can post a job or request and have people bid on it. Marco On Sat, Apr 18, 2015 at 7:13 PM, shanthi k wrote: > I need ma

Re: New to hadoop...plz help

2015-04-18 Thread Ted Yu
Droppinh hive mailing list since you mentioned mapreduce in your email. Can you give us a bit more detail on what you're trying to do ? Cheers On Sat, Apr 18, 2015 at 3:08 PM, shanthi k wrote: > I need mapreduce program in java for this input and output plz help >

New to hadoop..plz help

2015-04-18 Thread shanthi k
I need mapreduce program in java for this following input and output

New to hadoop...plz help

2015-04-18 Thread shanthi k
I need mapreduce program in java for this input and output plz help

RE: Unable to load native-hadoop library

2015-04-18 Thread Mich Talebzadeh
No I believe it was something to do with compilation. It is only a warning However, you should consider using hdfs dfs as opposed to hadoop fs I guess someone realised that “hadoop” is the name of eco system (HDFS + MapReduce) and hdfs is the actual file J which is more appropriate for a

Unable to load native-hadoop library

2015-04-18 Thread Mahmood Naderan
Hi,Regarding this warning WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable It seems that the prebuild 32-bit binary is not compatible on the host's 64-bit architecture. Just want to know does it make sense? Is there

Re: Incompatibility with Hadoop-2.6.0

2015-04-18 Thread Mahmood Naderan
OK thank you very much. I created the folder first on HDFS hadoop fs -mkdir -p /data/bigdatabench/Text_datagen/data-MicroBenchmarks/in then used '-put' option. It is now working. Regards, Mahmood On Saturday, April 18, 2015 11:16 PM, Mich Talebzadeh wrote: #yiv9514401917 #yiv9514401

RE: Incompatibility with Hadoop-2.6.0

2015-04-18 Thread Mich Talebzadeh
OK I assume HDFS has a directory called /data/bigdatabench/Text_datagen/data-MicroBenchmarks/in can you do hdfs dfs –ls /data/bigdatabench/Text_datagen/data-MicroBenchmarks/in and see the output For example there should one for hive similar to below hdfs dfs -ls /user

Re: Incompatibility with Hadoop-2.6.0

2015-04-18 Thread Mahmood Naderan
Same error again! [mahmood@tiger in]$ hdfs dfs -put ./lda_wiki1w_1 /data/bigdatabench/Text_datagen/data-MicroBenchmarks/in 15/04/18 22:58:23 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable put: `/data/bigdatabench/T

RE: Incompatibility with Hadoop-2.6.0

2015-04-18 Thread Mich Talebzadeh
Try this as it cannot see the file in the current directory hdfs dfs –put ./lda_wiki1w_1 /data/bigdatabench/Text_datagen/data-MicroBenchmarks/in/ Replace Hadoop with hdfs as well as is stated DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs

Re: Incompatibility with Hadoop-2.6.0

2015-04-18 Thread Mahmood Naderan
>Try>  hdfs dfs -put hive.log /mich Sorry but that didn't work... [mahmood@tiger in]$ ls lda_wiki1w_1  lda_wiki1w_2 [mahmood@tiger in]$ hadoop dfs -put lda_wiki1w_1 /data/bigdatabench/Text_datagen/data-MicroBenchmarks/in DEPRECATED: Use of this script to execute hdfs command is deprecated. Instea

ResourceLocalizationService: Localizer failed when running pi example

2015-04-18 Thread Fernando O.
Hey All, It's me again with another noob question: I deployed a cluster (HA mode) everything looked good but when I tried to run the pi example: bin/hadoop jar ./share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar pi 16 100 the same error occurs if I try to generate data with teragen

RE: Incompatibility with Hadoop-2.6.0

2015-04-18 Thread Mich Talebzadeh
Try hdfs dfs -put hive.log /mich hduser@rhes564::/tmp/hduser> hdfs dfs -ls /mich/hive.log -rw-r--r-- 2 hduser supergroup6344510 2015-04-18 15:39 /mich/hive.log Mich Talebzadeh http://talebzadehmich.wordpress.com Author of the books "A Practitioner’s Guide to Upgrading to Syb

Incompatibility with Hadoop-2.6.0

2015-04-18 Thread Mahmood Naderan
Hi, The following command works with Hadoop-1.2.0 hadoop fs -copyFromLocal data-MicroBenchmarks/in data-MicroBenchmarks/in However on Hadoop-2.6.0 it fails with this error: copyFromLocal: `data-MicroBenchmarks/in': No such file or directory Indeed there are two 500MB files there! and as I said,