Re: job getting hung
thanks for the tip.. looking at the logs i found nodemanager was not able to comunicate to the server (i assume resourcemanager). On Mon, Apr 14, 2014 at 11:12 AM, Stanley Shi wrote: > do you any node manager running? > > Regards, > *Stanley Shi,* > > > > On Mon, Apr 14, 2014 at 11:37 AM, Rahul Singh > wrote: > >> Hi, >> I am trying to run wordcount example(input file contains just few >> words) but the job seems to be stuck. How do i debug what went wrong? >> >> [hduser@poc-hadoop04 sbin]$ hadoop jar >> ../share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar wordcount >> /user/hduser/input /user/hduser/output_wordcount >> >> 14/04/14 09:01:06 WARN util.NativeCodeLoader: Unable to load >> native-hadoop library for your platform... using builtin-java classes where >> applicable >> 14/04/14 09:01:07 INFO client.RMProxy: Connecting to ResourceManager at >> localhost/127.0.0.1:8032 >> 14/04/14 09:01:08 INFO input.FileInputFormat: Total input paths to >> process : 1 >> 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: number of splits:1 >> 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: Submitting tokens for job: >> job_1397446243581_0001 >> 14/04/14 09:01:09 INFO impl.YarnClientImpl: Submitted application >> application_1397446243581_0001 >> 14/04/14 09:01:09 INFO mapreduce.Job: The url to track the job: >> http://poc-hadoop04:8088/proxy/application_1397446243581_0001/ >> 14/04/14 09:01:09 INFO mapreduce.Job: Running job: job_1397446243581_0001 >> >> >> Thanks and Regards, >> Rahul Singh >> > >
Re: job getting hung
do you any node manager running? Regards, *Stanley Shi,* On Mon, Apr 14, 2014 at 11:37 AM, Rahul Singh wrote: > Hi, > I am trying to run wordcount example(input file contains just few words) > but the job seems to be stuck. How do i debug what went wrong? > > [hduser@poc-hadoop04 sbin]$ hadoop jar > ../share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar wordcount > /user/hduser/input /user/hduser/output_wordcount > > 14/04/14 09:01:06 WARN util.NativeCodeLoader: Unable to load native-hadoop > library for your platform... using builtin-java classes where applicable > 14/04/14 09:01:07 INFO client.RMProxy: Connecting to ResourceManager at > localhost/127.0.0.1:8032 > 14/04/14 09:01:08 INFO input.FileInputFormat: Total input paths to process > : 1 > 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: number of splits:1 > 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: Submitting tokens for job: > job_1397446243581_0001 > 14/04/14 09:01:09 INFO impl.YarnClientImpl: Submitted application > application_1397446243581_0001 > 14/04/14 09:01:09 INFO mapreduce.Job: The url to track the job: > http://poc-hadoop04:8088/proxy/application_1397446243581_0001/ > 14/04/14 09:01:09 INFO mapreduce.Job: Running job: job_1397446243581_0001 > > > Thanks and Regards, > Rahul Singh >
Re: job getting hung
Check resourcemamager log and nodemanager log On Mon, Apr 14, 2014 at 11:37 AM, Rahul Singh wrote: > Hi, > I am trying to run wordcount example(input file contains just few words) > but the job seems to be stuck. How do i debug what went wrong? > > [hduser@poc-hadoop04 sbin]$ hadoop jar > ../share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar wordcount > /user/hduser/input /user/hduser/output_wordcount > > 14/04/14 09:01:06 WARN util.NativeCodeLoader: Unable to load native-hadoop > library for your platform... using builtin-java classes where applicable > 14/04/14 09:01:07 INFO client.RMProxy: Connecting to ResourceManager at > localhost/127.0.0.1:8032 > 14/04/14 09:01:08 INFO input.FileInputFormat: Total input paths to process > : 1 > 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: number of splits:1 > 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: Submitting tokens for job: > job_1397446243581_0001 > 14/04/14 09:01:09 INFO impl.YarnClientImpl: Submitted application > application_1397446243581_0001 > 14/04/14 09:01:09 INFO mapreduce.Job: The url to track the job: > http://poc-hadoop04:8088/proxy/application_1397446243581_0001/ > 14/04/14 09:01:09 INFO mapreduce.Job: Running job: job_1397446243581_0001 > > > Thanks and Regards, > Rahul Singh > -- Regards Shengjun
job getting hung
Hi, I am trying to run wordcount example(input file contains just few words) but the job seems to be stuck. How do i debug what went wrong? [hduser@poc-hadoop04 sbin]$ hadoop jar ../share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar wordcount /user/hduser/input /user/hduser/output_wordcount 14/04/14 09:01:06 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 14/04/14 09:01:07 INFO client.RMProxy: Connecting to ResourceManager at localhost/127.0.0.1:8032 14/04/14 09:01:08 INFO input.FileInputFormat: Total input paths to process : 1 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: number of splits:1 14/04/14 09:01:08 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1397446243581_0001 14/04/14 09:01:09 INFO impl.YarnClientImpl: Submitted application application_1397446243581_0001 14/04/14 09:01:09 INFO mapreduce.Job: The url to track the job: http://poc-hadoop04:8088/proxy/application_1397446243581_0001/ 14/04/14 09:01:09 INFO mapreduce.Job: Running job: job_1397446243581_0001 Thanks and Regards, Rahul Singh