One more observation: usually this job takes 3 to 4 minutes, however when
it fails, at that particular time it takes more than 42 to 50 minutes.
-Vipul
On Fri, Mar 16, 2012 at 11:38 AM, Vipul Bharakhada <vipulr...@gmail.com>wrote:
> Hi,
> I am using the old hadoop version 0.17.2 and I am getting the following
> exception when I am trying to run a Job. But it only happens at particular
> time, as cron jobs do run those task at particular intervals but it only
> fails at one particular time in day.
>
> Mar 14 06:49:23 7 08884: java.io.IOException: The directory
> hdfs://<{IPADDRESS}>:<{PORT}>/myserver/matcher/output/_temporary doesnt
> exist
> Mar 14 06:49:23 7 08884: \09at
> org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:1439)
> Mar 14 06:49:23 7 08884: \09at
> org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:1511)
> Mar 14 06:49:23 7 08884: \09at
> org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:723)
> Mar 14 06:49:23 7 08884: \09at
> org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:716)
> Mar 14 06:49:23 7 08884: \09at
> org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1274)
> Mar 14 06:49:23 7 08884: \09at
> org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:915)
> Mar 14 06:49:23 7 08884: \09at
> org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:1310)
> Mar 14 06:49:23 7 08884: \09at
> org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:2251)
>
> What can be a problem? as this folder is created by hadoop internally and
> used internally, clean up is also done internally by hadoop. So why this
> directory is missing at some particular time?
> Any clue?
> -Vipul
>
>
