Upon further inspection of that log, it appears the problem is the startup
task just takes a very long time.
Typically it is taking at most 6 seconds, but sometimes (the cases I think
its hanging) it actually runs and finishes but takes 3-5 minutes.
Same problem with the cleanup (which is where
Hey Robert,
Any chance you can pastebin the JT logs, grepped for the bad job ID,
and send the link across? They shouldn't hang the way you describe.
On Fri, Jul 13, 2012 at 9:33 AM, Robert Dyer psyb...@gmail.com wrote:
I'm using Hadoop 1.0.3 on a small cluster (1 namenode, 1 jobtracker, 2
I'm using Hadoop 1.0.3 on a small cluster (1 namenode, 1 jobtracker, 2
compute nodes). My input size is a sequence file of around 280mb.
Generally, my jobs run just fine and all finish in 2-5 minutes. However,
quite randomly the jobs refuse to run. They submit and appear when running
'hadoop
.
Regards
Bejoy KS
Sent from handheld, please excuse typos.
-Original Message-
From: Robert Dyer psyb...@gmail.com
Date: Thu, 12 Jul 2012 23:03:02
To: mapreduce-user@hadoop.apache.org
Reply-To: mapreduce-user@hadoop.apache.org
Subject: Jobs randomly not starting
I'm using Hadoop 1.0.3