srikanth ayalasomayajulu created MAPREDUCE-4339:
---------------------------------------------------
Summary: pi example job hangs on when run on hadoop 0.23.0 when
capacity scheduler is included in the setting environment.
Key: MAPREDUCE-4339
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4339
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: examples, job submission, mrv2, scheduler
Affects Versions: 0.23.0
Environment: Ubuntu Server 11.04, Hadoop 0.23.0,
Reporter: srikanth ayalasomayajulu
Fix For: 0.23.0
Tried to include default capacity scheduler in hadoop and tried to run an
example pi program. The job hangs and no more output is getting displayed.
Starting Job
2012-06-12 22:10:02,524 INFO ipc.YarnRPC (YarnRPC.java:create(47)) - Creating
YarnRPC for org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC
2012-06-12 22:10:02,538 INFO mapred.ResourceMgrDelegate
(ResourceMgrDelegate.java:<init>(95)) - Connecting to ResourceManager at
localhost/127.0.0.1:8030
2012-06-12 22:10:02,539 INFO ipc.HadoopYarnRPC
(HadoopYarnProtoRPC.java:getProxy(48)) - Creating a HadoopYarnProtoRpc proxy
for protocol interface org.apache.hadoop.yarn.api.ClientRMProtocol
2012-06-12 22:10:02,665 INFO mapred.ResourceMgrDelegate
(ResourceMgrDelegate.java:<init>(99)) - Connected to ResourceManager at
localhost/127.0.0.1:8030
2012-06-12 22:10:02,727 WARN conf.Configuration
(Configuration.java:handleDeprecation(326)) - fs.default.name is deprecated.
Instead, use fs.defaultFS
2012-06-12 22:10:02,728 WARN conf.Configuration
(Configuration.java:handleDeprecation(343)) - mapred.used.genericoptionsparser
is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2012-06-12 22:10:02,831 INFO input.FileInputFormat
(FileInputFormat.java:listStatus(245)) - Total input paths to process : 10
2012-06-12 22:10:02,900 INFO mapreduce.JobSubmitter
(JobSubmitter.java:submitJobInternal(362)) - number of splits:10
2012-06-12 22:10:03,044 INFO mapred.YARNRunner
(YARNRunner.java:createApplicationSubmissionContext(279)) - AppMaster
capability = memory: 2048
2012-06-12 22:10:03,286 INFO mapred.YARNRunner
(YARNRunner.java:createApplicationSubmissionContext(355)) - Command to launch
container for ApplicationMaster is : $JAVA_HOME/bin/java
-Dlog4j.configuration=container-log4j.properties
-Dyarn.app.mapreduce.container.log.dir=<LOG_DIR>
-Dyarn.app.mapreduce.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA
-Xmx1536m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout
2><LOG_DIR>/stderr
2012-06-12 22:10:03,370 INFO mapred.ResourceMgrDelegate
(ResourceMgrDelegate.java:submitApplication(304)) - Submitted application
application_1339507608976_0002 to ResourceManager
2012-06-12 22:10:03,432 INFO mapreduce.Job (Job.java:monitorAndPrintJob(1207))
- Running job: job_1339507608976_0002
2012-06-12 22:10:04,443 INFO mapreduce.Job (Job.java:monitorAndPrintJob(1227))
- map 0% reduce 0%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
