Re: hadoop job stuck in accepted state
Thanks. The job was stuck be On Wed, May 21, 2014 at 11:10 PM, Sebastian Gäde s116...@hft-leipzig.dewrote: Hi, I remember having a similar issue. My job was demanding for more memory then available in the cluster, that’s why it was waiting forever. Could you check the resource-/nodemanager logs? Also the „Scheduler page in the Webapp might give a hint whether the job is not starting because of unsufficient resources. Cheers Seb. Am 21.05.2014 um 16:19 schrieb Rahul Singh smart.rahul.i...@gmail.com: Hi, I am trying to run the wordcount example on single node cluster but my job is stuck in accepted state. Various details metioned below(ScreenShot attached): hadoop version Hadoop 2.3.0 Subversion http://svn.apache.org/repos/asf/hadoop/common -r 1567123 Compiled by jenkins on 2014-02-11T13:40Z Compiled with protoc 2.5.0 From source with checksum dfe46336fbc6a044bc124392ec06b85 machine details: Linux L-user-Tech 3.13.0-24-generic #47-Ubuntu SMP Fri May 2 23:30:00 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Command line: hduser@L-user-Tech:~$ hadoop jar /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar wordcount /user/hduser/input /user/hduser/output 14/05/21 19:13:34 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 14/05/21 19:13:35 INFO client.RMProxy: Connecting to ResourceManager at / 0.0.0.0:8032 14/05/21 19:13:35 INFO input.FileInputFormat: Total input paths to process : 1 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: number of splits:1 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1400678752370_0003 14/05/21 19:13:36 INFO impl.YarnClientImpl: Submitted application application_1400678752370_0003 14/05/21 19:13:36 INFO mapreduce.Job: The url to track the job: http://L-user-Tech:8088/proxy/application_1400678752370_0003/http://l-user-tech:8088/proxy/application_1400678752370_0003/ 14/05/21 19:13:36 INFO mapreduce.Job: Running job: job_1400678752370_0003 There are no logs generated. Let me know any if any resolutions available? Thanks and Regards, -Rahul Singh Screenshot from 2014-05-21 19:39:28.png
Re: hadoop job stuck in accepted state
Thanks Sebastian. The job was stuck due to memory issues. I found the below mentioned link very useful in configuring the yarn. http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.6.0/bk_installing_manually_book/content/rpm-chap1-11.html Regards, -Rahul Singh On Fri, May 23, 2014 at 9:59 AM, Rahul Singh smart.rahul.i...@gmail.comwrote: Thanks. The job was stuck be On Wed, May 21, 2014 at 11:10 PM, Sebastian Gäde s116...@hft-leipzig.dewrote: Hi, I remember having a similar issue. My job was demanding for more memory then available in the cluster, that’s why it was waiting forever. Could you check the resource-/nodemanager logs? Also the „Scheduler page in the Webapp might give a hint whether the job is not starting because of unsufficient resources. Cheers Seb. Am 21.05.2014 um 16:19 schrieb Rahul Singh smart.rahul.i...@gmail.com: Hi, I am trying to run the wordcount example on single node cluster but my job is stuck in accepted state. Various details metioned below(ScreenShot attached): hadoop version Hadoop 2.3.0 Subversion http://svn.apache.org/repos/asf/hadoop/common -r 1567123 Compiled by jenkins on 2014-02-11T13:40Z Compiled with protoc 2.5.0 From source with checksum dfe46336fbc6a044bc124392ec06b85 machine details: Linux L-user-Tech 3.13.0-24-generic #47-Ubuntu SMP Fri May 2 23:30:00 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Command line: hduser@L-user-Tech:~$ hadoop jar /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar wordcount /user/hduser/input /user/hduser/output 14/05/21 19:13:34 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 14/05/21 19:13:35 INFO client.RMProxy: Connecting to ResourceManager at / 0.0.0.0:8032 14/05/21 19:13:35 INFO input.FileInputFormat: Total input paths to process : 1 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: number of splits:1 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1400678752370_0003 14/05/21 19:13:36 INFO impl.YarnClientImpl: Submitted application application_1400678752370_0003 14/05/21 19:13:36 INFO mapreduce.Job: The url to track the job: http://L-user-Tech:8088/proxy/application_1400678752370_0003/http://l-user-tech:8088/proxy/application_1400678752370_0003/ 14/05/21 19:13:36 INFO mapreduce.Job: Running job: job_1400678752370_0003 There are no logs generated. Let me know any if any resolutions available? Thanks and Regards, -Rahul Singh Screenshot from 2014-05-21 19:39:28.png
Re: hadoop job stuck in accepted state
Hi, I remember having a similar issue. My job was demanding for more memory then available in the cluster, that’s why it was waiting forever. Could you check the resource-/nodemanager logs? Also the „Scheduler page in the Webapp might give a hint whether the job is not starting because of unsufficient resources. Cheers Seb. Am 21.05.2014 um 16:19 schrieb Rahul Singh smart.rahul.i...@gmail.com: Hi, I am trying to run the wordcount example on single node cluster but my job is stuck in accepted state. Various details metioned below(ScreenShot attached): hadoop version Hadoop 2.3.0 Subversion http://svn.apache.org/repos/asf/hadoop/common -r 1567123 Compiled by jenkins on 2014-02-11T13:40Z Compiled with protoc 2.5.0 From source with checksum dfe46336fbc6a044bc124392ec06b85 machine details: Linux L-user-Tech 3.13.0-24-generic #47-Ubuntu SMP Fri May 2 23:30:00 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Command line: hduser@L-user-Tech:~$ hadoop jar /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0.jar wordcount /user/hduser/input /user/hduser/output 14/05/21 19:13:34 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 14/05/21 19:13:35 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032 14/05/21 19:13:35 INFO input.FileInputFormat: Total input paths to process : 1 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: number of splits:1 14/05/21 19:13:35 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1400678752370_0003 14/05/21 19:13:36 INFO impl.YarnClientImpl: Submitted application application_1400678752370_0003 14/05/21 19:13:36 INFO mapreduce.Job: The url to track the job: http://L-user-Tech:8088/proxy/application_1400678752370_0003/ 14/05/21 19:13:36 INFO mapreduce.Job: Running job: job_1400678752370_0003 There are no logs generated. Let me know any if any resolutions available? Thanks and Regards, -Rahul Singh Screenshot from 2014-05-21 19:39:28.png
