Ok , my bad , I fixed the issue it was due to bad classpaths. I was not giving complete lib dir paths.
Thanks Vinod for your time & help. Regards, Tony On Sat, Mar 22, 2014 at 11:41 PM, Vinod Kumar Vavilapalli < vino...@apache.org> wrote: > Given your earlier mail about the paths in /opt, shouldn't mapreduce > classpath also point to /opt/yarn/hadoop-2.3.0 etc? > > +Vinod > > > On Mar 22, 2014, at 11:33 AM, Tony Mullins <tonymullins...@gmail.com> > wrote: > > That I also dont know what 614... Its the exact and single line in stderr > of Jobs logs. > And regarding MapRed classpath , defaults are good as there are only two > vars $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*, > $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*. > > Is there any other place to look for detailed & meaningfull error info ? > or any huntch to how to fix it ? > > Thanks, > Tony > > > On Sat, Mar 22, 2014 at 11:11 PM, Vinod Kumar Vavilapalli < > vino...@apache.org> wrote: > >> What is "614" here? >> >> The other relevant thing to check is the MapReduce specific config >> mapreduce.application.classpath. >> >> +Vinod >> >> On Mar 22, 2014, at 9:03 AM, Tony Mullins <tonymullins...@gmail.com> >> wrote: >> >> Hi, >> >> I have setup a 2 node cluster of Hadoop 2.3.0. Its working fine and I can >> successfully run distributedshell-2.2.0.jar example. But when I try to run >> any mapreduce job I get error. I have setup MapRed.xml and other configs >> for running MapReduce job according to ( >> http://www.alexjf.net/blog/distributed-systems/hadoop-yarn-installation-definitive-guide) >> but I am getting following error : >> >> 14/03/22 20:31:17 INFO mapreduce.Job: Job job_1395502230567_0001 failed >> with state FAILED due to: Application application_1395502230567_0001 failed >> 2 times due to AM Container for appattempt_1395502230567_0001_000002 exited >> with exitCode: 1 due to: Exception from container-launch: >> org.apache.hadoop.util.Shell$ExitCodeException: >> org.apache.hadoop.util.Shell$ExitCodeException: at >> org.apache.hadoop.util.Shell.runCommand(Shell.java:505) at >> org.apache.hadoop.util.Shell.run(Shell.java:418) at >> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650) >> at >> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195) >> at >> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283) >> at >> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79) >> at java.util.concurrent.FutureTask.run(FutureTask.java:262) at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) >> at java.lang.Thread.run(Thread.java:744) >> >> Container exited with a non-zero exit code 1 >> .Failing this attempt.. Failing the application. >> 14/03/22 20:31:17 INFO mapreduce.Job: Counters: 0 >> Job ended: Sat Mar 22 20:31:17 PKT 2014 >> The job took 6 seconds. >> >> And if look at stderr (log of job) there is only one line >> >> *"Could not find or load main class 614"* >> >> Now I have googled it and usually this issues comes when you have >> different JAVA versions or in yarn-site.xml classpath is not properly set , >> my yarn-site.xml has this >> >> >> <property> >> <name>yarn.application.classpath</name> >> >> <value>/opt/yarn/hadoop-2.3.0/etc/hadoop,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*,/opt/yarn/hadoop-2.3.0/*,/opt/yarn/hadoop-2.3.0/lib/*</value> >> >> >> </property> >> >> So any other ideas what could be the issue here ? >> >> I am running my mapreduce job like this: >> >> $HADOOP_PREFIX/bin/hadoop jar >> $HADOOP_PREFIX/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar >> randomwriter out >> >> Thanks, Tony >> >> >> >> CONFIDENTIALITY NOTICE >> NOTICE: This message is intended for the use of the individual or entity >> to which it is addressed and may contain information that is confidential, >> privileged and exempt from disclosure under applicable law. If the reader >> of this message is not the intended recipient, you are hereby notified that >> any printing, copying, dissemination, distribution, disclosure or >> forwarding of this communication is strictly prohibited. If you have >> received this communication in error, please contact the sender immediately >> and delete it from your system. Thank You. > > > > > CONFIDENTIALITY NOTICE > NOTICE: This message is intended for the use of the individual or entity > to which it is addressed and may contain information that is confidential, > privileged and exempt from disclosure under applicable law. If the reader > of this message is not the intended recipient, you are hereby notified that > any printing, copying, dissemination, distribution, disclosure or > forwarding of this communication is strictly prohibited. If you have > received this communication in error, please contact the sender immediately > and delete it from your system. Thank You. >
