Re: Inconsistent times in Hadoop web interface

[yipeng]

Ahh... I don't manage my cluster but you were spot on. Now I know who to
follow up with.

Thanks!!

Yipeng

On Mon, Dec 27, 2010 at 3:55 PM, Harsh J  wrote:

> Hey,
>
> On Mon, Dec 27, 2010 at 10:44 AM, yipeng  wrote:
> > Hi guys,
> >
> > I am having some inconsistent timing in the web interface. The job finish
> > time as below is 47 secs but the Map & Reduce took significantly longer.
> I
> > don't think I did anything that could have caused this. Any ideas what
> might
> > have?
> >
>
> Are your cluster nodes' clocks synced right (via ntpd, etc.)?
>
> --
> Harsh J
> www.harshj.com
>

Re: Inconsistent times in Hadoop web interface

[Harsh J]

Hey,

On Mon, Dec 27, 2010 at 10:44 AM, yipeng  wrote:
> Hi guys,
>
> I am having some inconsistent timing in the web interface. The job finish
> time as below is 47 secs but the Map & Reduce took significantly longer. I
> don't think I did anything that could have caused this. Any ideas what might
> have?
>

Are your cluster nodes' clocks synced right (via ntpd, etc.)?

-- 
Harsh J
www.harshj.com

Inconsistent times in Hadoop web interface

[yipeng]

Hi guys,

I am having some inconsistent timing in the web interface. The job finish
time as below is 47 secs but the Map & Reduce took significantly longer. I
don't think I did anything that could have caused this. Any ideas what might
have?

Hadoop Job job_201012271216_0002 on History Viewer
User: yipeng
JobName: Identity Job
JobConf:
hdfs://compg0:54310/temp/hadoop-yipeng/mapred/system/job_201012271216_0002/job.xml
Submitted At: 27-Dec-2010 12:35:51
Launched At: 27-Dec-2010 12:35:52 (0sec)
Finished At: 27-Dec-2010 12:36:39 (*47sec*)
Status: SUCCESS
Analyse This Job
Kind Total Tasks(successful+failed+killed) Successful tasks Failed tasks Killed
tasks Start Time Finish Time
Setup 1 1 0 0 27-Dec-2010 12:34:35 27-Dec-2010 12:34:36 (1sec)
Map 18 18 0 0 27-Dec-2010 12:34:39 27-Dec-2010 12:36:32 (*1mins, 53sec*)
Reduce 18 18 0 0 27-Dec-2010 12:34:48 27-Dec-2010 12:36:52 (*2mins, 4sec*)
Cleanup 1 1 0 0 27-Dec-2010 12:36:55 27-Dec-2010 12:36:56 (1sec)

Cheers,

Yipeng