Re: Jobs randomly not starting

2012-07-17 Thread Robert Dyer
Upon further inspection of that log, it appears the problem is the startup task just takes a very long time. Typically it is taking at most 6 seconds, but sometimes (the cases I think its hanging) it actually runs and finishes but takes 3-5 minutes. Same problem with the cleanup (which is where

Re: Jobs randomly not starting

2012-07-13 Thread Harsh J
Hey Robert, Any chance you can pastebin the JT logs, grepped for the bad job ID, and send the link across? They shouldn't hang the way you describe. On Fri, Jul 13, 2012 at 9:33 AM, Robert Dyer psyb...@gmail.com wrote: I'm using Hadoop 1.0.3 on a small cluster (1 namenode, 1 jobtracker, 2

Jobs randomly not starting

2012-07-12 Thread Robert Dyer
I'm using Hadoop 1.0.3 on a small cluster (1 namenode, 1 jobtracker, 2 compute nodes). My input size is a sequence file of around 280mb. Generally, my jobs run just fine and all finish in 2-5 minutes. However, quite randomly the jobs refuse to run. They submit and appear when running 'hadoop

Re: Jobs randomly not starting

2012-07-12 Thread Bejoy KS
. Regards Bejoy KS Sent from handheld, please excuse typos. -Original Message- From: Robert Dyer psyb...@gmail.com Date: Thu, 12 Jul 2012 23:03:02 To: mapreduce-user@hadoop.apache.org Reply-To: mapreduce-user@hadoop.apache.org Subject: Jobs randomly not starting I'm using Hadoop 1.0.3