Victor Kim created MAPREDUCE-5909:
-------------------------------------
Summary: JobStatus contains 0.0 values of mapProgress,
reduceProgress, setupProgress, cleanupProgress
Key: MAPREDUCE-5909
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5909
Project: Hadoop Map/Reduce
Issue Type: Bug
Affects Versions: 2.4.0
Reporter: Victor Kim
When I invoke getAllJobs on a JobClient object, I'm receiving an array of
JobStatuses. JobStatus object arrives with fields mapProgress, reduceProgress,
setupProgress, cleanupProgress with 0.0 values. So, I'm not able to track the
map and reduce job progress through the client.
Seems that because YARN supports variety of applications (not only MR),
ApplicationReport object doesn't contain mapProgress and ReduceProgress.
Instead it contains just progress. Apparently this led to following code during
converting from ApplicationReport to JobStatus object to do following:
{code:title=TypeConverter.java|borderStyle=solid}
public static JobStatus fromYarn(ApplicationReport application, String jobFile)
{
//... Some code here
JobStatus jobStatus =
new JobStatus(
TypeConverter.fromYarn(application.getApplicationId()),
0.0f, 0.0f, 0.0f, 0.0f,
TypeConverter.fromYarn(application.getYarnApplicationState(),
application.getFinalApplicationStatus()),
org.apache.hadoop.mapreduce.JobPriority.NORMAL,
application.getUser(), application.getName(),
application.getQueue(), jobFile, trackingUrl, false
);
//... Some code here
}
{code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
