Unable to create file in dfs in code run on machine not in the cluster.
-----------------------------------------------------------------------
Key: HADOOP-457
URL: http://issues.apache.org/jira/browse/HADOOP-457
Project: Hadoop
Issue Type: Bug
Components: dfs
Affects Versions: 0.5.0
Reporter: Johan Oskarson
I've got a tiny hadoop cluster and one machine that's not in the cluster that
rsync the latest version off the namenode/jobtracker machine. The machine
that's not in the cluster is then responsible for starting a few jobs here and
there.
However, the latest trunk is unable to create files in the dfs from my code.
I'm using a simple new OutputStreamWriter(fs.create(file))); and the file
creation looks like it's going ok but then this gets thrown:
org.apache.hadoop.ipc.RemoteException: java.io.IOException: failed to create
file
/user/hadoop/submissions/1150000000/1152000000/1152440000/.1155824015.negsub.crc
on client "servernotincluster" because target-length is 0, below
MIN_REPLICATION (1)
at org.apache.hadoop.dfs.FSNamesystem.startFile(FSNamesystem.java:410)
at org.apache.hadoop.dfs.NameNode.create(NameNode.java:202)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:585)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:332)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:468)
at org.apache.hadoop.ipc.Client$Connection.run(Client.java:159)
If I add that machine to the conf/slaves it works fine. Note that it's trying
to create that file on the server that's not in the cluster.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
