[
https://issues.apache.org/jira/browse/HADOOP-2570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12558080#action_12558080
]
Arun C Murthy commented on HADOOP-2570:
---------------------------------------
All tests fail with:
{noformat}
2008-01-11 17:35:53,433 INFO mapred.TaskTracker
(TaskTracker.java:launchTaskForJob(703)) -
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
taskTracker/jobcache/job_200801111735_0001/work in any of the configured local
directories
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:359)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:138)
at
org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:1395)
at
org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:1469)
at
org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:693)
at
org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:686)
at
org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1279)
at
org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:920)
at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:1315)
at
org.apache.hadoop.mapred.MiniMRCluster$TaskTrackerRunner.run(MiniMRCluster.java:144)
at java.lang.Thread.run(Thread.java:595)
{noformat}
The problem is that the LocalDirAllocator.getLocalPathToRead throws and
exception when the path is not found - this patch should handle that exception
and go-ahead to create the symlink...
> streaming jobs fail after HADOOP-2227
> -------------------------------------
>
> Key: HADOOP-2570
> URL: https://issues.apache.org/jira/browse/HADOOP-2570
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.15.2
> Reporter: lohit vijayarenu
> Assignee: Amareshwari Sri Ramadasu
> Priority: Blocker
> Fix For: 0.15.3
>
> Attachments: patch-2570.txt
>
>
> HADOOP-2227 changes jobCacheDir. In streaming, jobCacheDir was constructed
> like this
> {code}
> File jobCacheDir = new File(currentDir.getParentFile().getParent(), "work");
> {code}
> We should change this to get it working. Referring to the changes made in
> HADOOP-2227, I see that the APIs used in there to construct the path are not
> public. And hard coding the path in streaming does not look good. thought?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
