[ http://issues.apache.org/jira/browse/HADOOP-308?page=all ]
Sameer Paranjpye updated HADOOP-308:
------------------------------------
Component/s: mapred
Description:
In case that the local dir is not writable on a node, the tasks on the node
will fail as expected, with an exception like:
(Read-only file system) at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.(FileOutputStream.java:179)
at java.io.FileOutputStream.(FileOutputStream.java:131)
at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.(DFSClient.java:723)
at org.apache.hadoop.dfs.DFSClient.create(DFSClient.java:241)
at
org.apache.hadoop.dfs.DistributedFileSystem.createRaw(DistributedFileSystem.java:96)
at org.apache.hadoop.fs.FSDataOutputStream$Summer.(FSDataOutputStream.java:44)
at org.apache.hadoop.fs.FSDataOutputStream.(FSDataOutputStream.java:134)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:224)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:176)
....
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:265)
at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:847)
However, the task tracker will continue accept new tasks and continue to fail.
The runloop of tasktracker should detect such a problem and exits.
was:
In case that the local dir is not writable on a node, the tasks on the node
will fail as expected, with an exception like:
(Read-only file system) at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.(FileOutputStream.java:179)
at java.io.FileOutputStream.(FileOutputStream.java:131)
at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.(DFSClient.java:723)
at org.apache.hadoop.dfs.DFSClient.create(DFSClient.java:241)
at
org.apache.hadoop.dfs.DistributedFileSystem.createRaw(DistributedFileSystem.java:96)
at org.apache.hadoop.fs.FSDataOutputStream$Summer.(FSDataOutputStream.java:44)
at org.apache.hadoop.fs.FSDataOutputStream.(FSDataOutputStream.java:134)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:224)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:176)
....
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:265)
at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:847)
However, the task tracker will continue accept new tasks and continue to fail.
The runloop of tasktracker should detect such a problem and exits.
> Task Tracker does not handle the case of read only local dir case correctly
> ----------------------------------------------------------------------------
>
> Key: HADOOP-308
> URL: http://issues.apache.org/jira/browse/HADOOP-308
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.3.2
> Environment: all
> Reporter: Runping Qi
>
> In case that the local dir is not writable on a node, the tasks on the node
> will fail as expected, with an exception like:
> (Read-only file system) at java.io.FileOutputStream.open(Native Method)
> at java.io.FileOutputStream.(FileOutputStream.java:179)
> at java.io.FileOutputStream.(FileOutputStream.java:131)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.(DFSClient.java:723)
> at org.apache.hadoop.dfs.DFSClient.create(DFSClient.java:241)
> at
> org.apache.hadoop.dfs.DistributedFileSystem.createRaw(DistributedFileSystem.java:96)
>
> at
> org.apache.hadoop.fs.FSDataOutputStream$Summer.(FSDataOutputStream.java:44)
> at org.apache.hadoop.fs.FSDataOutputStream.(FSDataOutputStream.java:134)
> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:224)
> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:176)
> ....
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:265)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:847)
> However, the task tracker will continue accept new tasks and continue to fail.
> The runloop of tasktracker should detect such a problem and exits.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
