Thanks a lot Bejoy! The Web UI does give me start and finish times, but I was wondering if there is a way to access these stats through an API, without having to grep through HTML.
The "hadoop jobs -status" API was useful, but it doesn't seem to list wall completion times. (It does give me CPU time though). Am I missing something? On 4 March 2012 17:46, <bejoy.had...@gmail.com> wrote: > ** > Hi Bharath > You could be getting detailed metrics on a per job basis from the > jobtracker web UI > > http://<NameNodeHost>:50030/jobtracker.jsp > > If you drill down you can get still further details on task levels . > Regards > Bejoy K S > > From handheld, Please excuse typos. > ------------------------------ > *From: * Bharath Ravi <bharathra...@gmail.com> > *Date: *Sun, 4 Mar 2012 17:39:01 -0500 > *To: *<mapreduce-user@hadoop.apache.org> > *ReplyTo: * mapreduce-user@hadoop.apache.org > *Subject: *Tracking Job completion times > > Hi all, > > I'd like to log and monitor average job completion times on hadoop. > (For example, wall time from the perspective of the JobTracker) > What might be the best way to do this? > > I see a lot of metrics exported through the metrics2 interface: > are job completion times part of this? Is there documentation I could read > to understand the exported jobtracker/tasktracker metrics? > > Thanks a lot! > -- > Bharath Ravi > > -- Bharath Ravi
