Re: Not able to post a job in Hadoop 0.23.0
Moving to mapreduce-user@, bcc common-user@. Can you see any errors in the logs? Typically this happens when you have no NodeManagers. Check the 'nodes' link and then RM logs. Arun On Nov 29, 2011, at 8:36 PM, Nitin Khandelwal wrote: HI , I have successfully setup Hadoop 0.23.0 in a single m/c. When i post a job, it gets posted successfully (i can see the job in UI), but the job is never ASSIGNED and waits forever. Here are details of what i see for that Job in UI Name: random-writer State: ACCEPTED FinalStatus: UNDEFINED Started: 30-Nov-2011 10:08:55 Elapsed: 49sec Tracking URL: UNASSIGNEDhttp://192.168.0.93:8900/cluster/app/application_1322627869620_0001# Diagnostics: AM container logs: AM not yet registered with RM Cluster ID: 1322627869620 ResourceManager state: STARTED ResourceManager started on: 30-Nov-2011 10:07:49 ResourceManager version: 0.23.0 from 722cd694fc4ab6d040c0a34f9fb5b476e330ee60 by hortonmu source checksum 4975bf112aa7faa5673f604045ced798 on Thu Nov 3 09:07:31 UTC 2011 Hadoop version: 0.23.0 from d4fee83ec1462ab9824add6449320617caa7c605 by hortonmu source checksum 4e42b2d96c899a98a8ab8c7cc23f27ae on Thu Nov 3 08:59:12 UTC 2011 Can some one tell where am i going wrong?? Thanks, -- Nitin Khandelwal
Re: Not able to post a job in Hadoop 0.23.0
Hi Arun, Thanks for your reply. There is one NodeManager running ; Following is the NodeManager UI : Rack Node State Node Address Node HTTP Address Health-status Last health-update Health-report Containers Mem Used Mem Avail /default-rack RUNNING germinait93:50033 germinait93: Healthy 9-Dec-2011 13:03:33 Healthy 0 0 KB 1 GB Also, I get to see only following Logs relevant to the job posting : 2011-12-09 13:10:57,300 INFO fifo.FifoScheduler (FifoScheduler.java: addApplication(288)) - Application Submission: application_1323416004722_0002 from minal.kothari, currently active: 1 2011-12-09 13:10:57,300 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(464)) - Processing event for appattempt_1323416004722_0002_01 of type APP_ACCEPTED 2011-12-09 13:10:57,317 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(476)) - appattempt_1323416004722_0002_01 State change from SUBMITTED to SCHEDULED 2011-12-09 13:10:57,318 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(416)) - Processing event for application_1323416004722_0002 of type APP_ACCEPTED 2011-12-09 13:10:57,318 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(428)) - application_1323416004722_0002 State change from SUBMITTED to ACCEPTED 2011-12-09 13:10:57,320 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=minal.kothari IP=192.168.0.93 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1323416004722_0002 Please let me know if you need some other logs . Thanks, Nitin On 9 December 2011 12:44, Arun C Murthy a...@hortonworks.com wrote: Moving to mapreduce-user@, bcc common-user@. Can you see any errors in the logs? Typically this happens when you have no NodeManagers. Check the 'nodes' link and then RM logs. Arun On Nov 29, 2011, at 8:36 PM, Nitin Khandelwal wrote: HI , I have successfully setup Hadoop 0.23.0 in a single m/c. When i post a job, it gets posted successfully (i can see the job in UI), but the job is never ASSIGNED and waits forever. Here are details of what i see for that Job in UI Name: random-writer State: ACCEPTED FinalStatus: UNDEFINED Started: 30-Nov-2011 10:08:55 Elapsed: 49sec Tracking URL: UNASSIGNED http://192.168.0.93:8900/cluster/app/application_1322627869620_0001# Diagnostics: AM container logs: AM not yet registered with RM Cluster ID: 1322627869620 ResourceManager state: STARTED ResourceManager started on: 30-Nov-2011 10:07:49 ResourceManager version: 0.23.0 from 722cd694fc4ab6d040c0a34f9fb5b476e330ee60 by hortonmu source checksum 4975bf112aa7faa5673f604045ced798 on Thu Nov 3 09:07:31 UTC 2011 Hadoop version: 0.23.0 from d4fee83ec1462ab9824add6449320617caa7c605 by hortonmu source checksum 4e42b2d96c899a98a8ab8c7cc23f27ae on Thu Nov 3 08:59:12 UTC 2011 Can some one tell where am i going wrong?? Thanks, -- Nitin Khandelwal -- Nitin Khandelwal
Re: Not able to post a job in Hadoop 0.23.0
CC : mapreduce-user On 9 December 2011 13:14, Nitin Khandelwal nitin.khandel...@germinait.comwrote: Hi Arun, Thanks for your reply. There is one NodeManager running ; Following is the NodeManager UI : Rack Node State Node Address Node HTTP Address Health-status Last health-update Health-report Containers Mem Used Mem Avail /default-rack RUNNING germinait93:50033 germinait93: Healthy 9-Dec-2011 13:03:33 Healthy 0 0 KB 1 GB Also, I get to see only following Logs relevant to the job posting : 2011-12-09 13:10:57,300 INFO fifo.FifoScheduler (FifoScheduler.java: addApplication(288)) - Application Submission: application_1323416004722_0002 from minal.kothari, currently active: 1 2011-12-09 13:10:57,300 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(464)) - Processing event for appattempt_1323416004722_0002_01 of type APP_ACCEPTED 2011-12-09 13:10:57,317 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(476)) - appattempt_1323416004722_0002_01 State change from SUBMITTED to SCHEDULED 2011-12-09 13:10:57,318 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(416)) - Processing event for application_1323416004722_0002 of type APP_ACCEPTED 2011-12-09 13:10:57,318 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(428)) - application_1323416004722_0002 State change from SUBMITTED to ACCEPTED 2011-12-09 13:10:57,320 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=minal.kothari IP=192.168.0.93 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1323416004722_0002 Please let me know if you need some other logs . Thanks, Nitin On 9 December 2011 12:44, Arun C Murthy a...@hortonworks.com wrote: Moving to mapreduce-user@, bcc common-user@. Can you see any errors in the logs? Typically this happens when you have no NodeManagers. Check the 'nodes' link and then RM logs. Arun On Nov 29, 2011, at 8:36 PM, Nitin Khandelwal wrote: HI , I have successfully setup Hadoop 0.23.0 in a single m/c. When i post a job, it gets posted successfully (i can see the job in UI), but the job is never ASSIGNED and waits forever. Here are details of what i see for that Job in UI Name: random-writer State: ACCEPTED FinalStatus: UNDEFINED Started: 30-Nov-2011 10:08:55 Elapsed: 49sec Tracking URL: UNASSIGNED http://192.168.0.93:8900/cluster/app/application_1322627869620_0001# Diagnostics: AM container logs: AM not yet registered with RM Cluster ID: 1322627869620 ResourceManager state: STARTED ResourceManager started on: 30-Nov-2011 10:07:49 ResourceManager version: 0.23.0 from 722cd694fc4ab6d040c0a34f9fb5b476e330ee60 by hortonmu source checksum 4975bf112aa7faa5673f604045ced798 on Thu Nov 3 09:07:31 UTC 2011 Hadoop version: 0.23.0 from d4fee83ec1462ab9824add6449320617caa7c605 by hortonmu source checksum 4e42b2d96c899a98a8ab8c7cc23f27ae on Thu Nov 3 08:59:12 UTC 2011 Can some one tell where am i going wrong?? Thanks, -- Nitin Khandelwal -- Nitin Khandelwal -- Nitin Khandelwal