Getting error unrecognized option -jvm on starting nodemanager

2013-12-23 Thread Sitaraman Vilayannur
Hi, When i attempt to start nodemanager i get the following error. Any help appreciated. I was able to start resource manager datanode, namenode and secondarynamenode, ./yarn-daemon.sh start nodemanager starting nodemanager, logging to

Re: Getting error unrecognized option -jvm on starting nodemanager

2013-12-23 Thread Nitin Pawar
Can you try starting the process as non root user. Give proper permissions to the user and start it as a different user. Thanks, Nitin On Mon, Dec 23, 2013 at 2:15 PM, Sitaraman Vilayannur vrsitaramanietfli...@gmail.com wrote: Hi, When i attempt to start nodemanager i get the following

Pivotal-HD Hadoop installation

2013-12-23 Thread orahad bigdata
Hi All, while installing pivotal HD we are facing issue during scan host step. Scanning Hosts... [RESULT] The following hosts do not meet GPHD prerequisites: [ hadoop3.test.net hadoop1.test.net ] Details... Host: hadoop3.test.net Status: [FAILED] [ERROR] Host is not reachable from the

Re: Pivotal-HD Hadoop installation

2013-12-23 Thread Nitin Pawar
may be you need to ask that to pivotal user group. Thanks, nitin On Mon, Dec 23, 2013 at 3:08 PM, orahad bigdata oracle...@gmail.com wrote: Hi All, while installing pivotal HD we are facing issue during scan host step. Scanning Hosts... [RESULT] The following hosts do not meet GPHD

Any method to get input splits by column?

2013-12-23 Thread sam liu
Hi, By default, MR inputformat classes break input file into splits by rows. However, we have a specilal requirement on MR app: get input splits by column. Is there any good method? Thanks!

RE: Any method to get input splits by column?

2013-12-23 Thread java8964
You need to store your data into column-based format, checking out Hive RCFile, and its InputFormat option. Yong Date: Mon, 23 Dec 2013 21:37:23 +0800 Subject: Any method to get input splits by column? From: samliuhad...@gmail.com To: user@hadoop.apache.org Hi, By default, MR inputformat

Rewriting Ab-Initio scripts using Hadoop MapReduce

2013-12-23 Thread Manoj Babu
Hi All, Can anybody share their experience on Rewriting Ab-Initio scripts using Hadoop MapReduce? Cheers! Manoj.

RE: libjar and Mahout

2013-12-23 Thread Sameer Tilak
Let me try that today. Date: Fri, 20 Dec 2013 21:55:44 -0500 From: chris.maw...@gmail.com To: user@hadoop.apache.org Subject: Re: libjar and Mahout In your hadoop command I see a space in the part ...-core-0.9-SNAPSHOT.jar /:/apps/mahout/trunk just

Re: Pivotal-HD Hadoop installation

2013-12-23 Thread Bhooshan Mogal
As Nitin suggested, this forum is for Apache Hadoop questions.  Please use  http://ask.gopivotal.com/hc/communities/public/topics/200053048-Pivotal-HD-Forum for questions about Pivotal HD. Thanks, Bhooshan. Sent via the Samsung Galaxy S™III, an ATT 4G LTE smartphone Original message

Re: Could not find the main class: org.apache.hadoop.mapreduce.v2.app.MRAppMaster

2013-12-23 Thread Vinod Kumar Vavilapalli
Seems like the hadoop common jar is missing, can you check if one of the directories listed in the CLASSPATH has the hadoop-common jar? Thanks, +Vinod On Dec 22, 2013, at 10:27 PM, Hadoop Dev hadoopeco@gmail.com wrote: Hi All, I am trying to execute first ever program (Word Count) in

subscribe

2013-12-23 Thread Marvin Miao Wang
-- Marvin Miao Wang

Re: Getting error unrecognized option -jvm on starting nodemanager

2013-12-23 Thread Sitaraman Vilayannur
Thanks Nitin, That worked, When i run the Pi example, i get the following warning at the end, what must i do about this warningthanks much for your help. Sitaraman inished in 20.82 seconds Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library

Re: Getting error unrecognized option -jvm on starting nodemanager

2013-12-23 Thread Nitin Pawar
For now you can ignore this warning, it was your first program so you can try building other things and slowly run the commands mentioned the log message to fix these small warnings. On Tue, Dec 24, 2013 at 10:07 AM, Sitaraman Vilayannur vrsitaramanietfli...@gmail.com wrote: Thanks Nitin,

Command line tools for YARN

2013-12-23 Thread Krishna Kishore Bonagiri
Hi, Are there any command line tools for things like, 1) checking how many nodes are in my cluster 2) what are the cluster resources total or available at the time of running the command 3) what are the names of nodes in my cluster etc.. Thanks, Kishore

Re: Getting error unrecognized option -jvm on starting nodemanager

2013-12-23 Thread Sitaraman Vilayannur
Hi Nitin, I moved to the release 2.2.0 on starting node manager it remains silent without errors but nodemanager dosent startwhile it does in the earlier 0.23 version ./hadoop-daemon.sh start namenode starting namenode, logging to

Re: Getting error unrecognized option -jvm on starting nodemanager

2013-12-23 Thread Nitin Pawar
Without log, very hard to guess what's happening. Can you clean up the log directory and then start over and check for the logs again. On Tue, Dec 24, 2013 at 11:44 AM, Sitaraman Vilayannur vrsitaramanietfli...@gmail.com wrote: Hi Nitin, I moved to the release 2.2.0 on starting node

Container exit status for released container

2013-12-23 Thread Krishna Kishore Bonagiri
Hi, I am seeing the exit status of released container(released through a call to releaseAssignedContainer()) to be -100. Can my code assume that -100 will always be given as exit status for a released container by YARN? Thanks, Kishore

Has anyone set up Hadoop2 GA on Windows 7?

2013-12-23 Thread Hadoop Dev
It seems there is classpath issue on Windows. getting following error while running any MR code Could not find the main class: org.apache.hadoop.mapreduce.v2.app.MRAppMaster and java.lang.NoClassDefFoundError: org/apache/hadoop/service/CompositeService hadoop classpath shows

Re: Getting error unrecognized option -jvm on starting nodemanager

2013-12-23 Thread Sitaraman Vilayannur
The line beginning with ulimit that i have appended below, i thought was the log file? /usr/local/Software/hadoop-2.2.0/logs/hadoop-sitaraman-namenode-localhost.localdomain.out Sitaraman On 12/24/13, Nitin Pawar nitinpawar...@gmail.com wrote: Without log, very hard to guess what's happening.

Re: Getting error unrecognized option -jvm on starting nodemanager

2013-12-23 Thread Sitaraman Vilayannur
Found it, I get the following error on starting namenode in 2.2 10/contrib/capacity-scheduler/*.jar:/usr/local/Software/hadoop-0.23.10/contrib/capacity-scheduler/*.jar:/usr/local/Software/hadoop-0.23.10/contrib/capacity-scheduler/*.jar STARTUP_MSG: build =