Namenode does not always clean up pendingCreates
------------------------------------------------
Key: HADOOP-118
URL: http://issues.apache.org/jira/browse/HADOOP-118
Project: Hadoop
Type: Bug
Components: dfs
Versions: 0.1.0
Environment: 195 node cluster running redhat linux (2.6 kernel)
Reporter: Owen O'Malley
Priority: Critical
In some failure modes, the pending creates list is not cleaned up and prevents
that file from ever being created.
When I try to create the file after the first job was killed (hours
previously), I get:
060404 084619 Cannot start file because pendingCreates is non-null.
src=/user/oom/rand/part000118
060404 084619 Server handler 0 on 8020 call error: java.io.IOException: Cannot
create file /user/oom/rand/part000118 on client DFSClient_-1656137458
java.io.IOException: Cannot create file /user/oom/rand/part000118 on client
DFSClient_-1656137458
at org.apache.hadoop.dfs.NameNode.create(NameNode.java:147)
at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:585)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:237)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:216)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
