One should be able to renew a lease. How does one renew a lease?
Seems like adding a byte to the block should do that... This seems
very brittle as is. If you are doing something CPU intensive that
produces output, you don't want the system to timeout and potentially
throw out a lot of your work.
On Mar 27, 2006, at 1:00 PM, Konstantin Shvachko (JIRA) wrote:
[ http://issues.apache.org/jira/browse/HADOOP-107?
page=comments#action_12372024 ]
Konstantin Shvachko commented on HADOOP-107:
--------------------------------------------
It looks like your write to a file takes too long.
The client has 1 minute to complete one block write until
the lease issued for that client expires. When the lease expires the
namenode thinks the block is abandoned. If your files are small,
consisting of only 1 block, then the file will be considered abandoned
as well. So the namenode removes the file before the client reports
its completion.
Lease duration is not configurable, so you cannot control that.
But you can retry everything starting from file creation when you
receive that exception.
Is it true that your writes take longer than a minute?
Namenode errors "Failed to complete filename.crc because
dir.getFile()==null and null"
---------------------------------------------------------------------
------------------
Key: HADOOP-107
URL: http://issues.apache.org/jira/browse/HADOOP-107
Project: Hadoop
Type: Bug
Components: dfs
Environment: Linux
Reporter: Igor Bolotin
We're getting lot of these errors and here is what I see in
namenode log:
060327 002016 Removing lease [Lease. Holder:
DFSClient_1897466025, heldlocks: 0, pendingcreates: 0], leases
remaining: 1
060327 002523 Block report from member2.local:50010: 91895 blocks.
060327 003238 Block report from member1.local:50010: 91895 blocks.
060327 005830 Failed to complete /
feedback/.feedback_10.1.10.102-33877.log.crc because dir.getFile()
==null and null
060327 005830 Server handler 1 on 50000 call error:
java.io.IOException: Could not complete write to file /
feedback/.feedback_10.1.10.102-33877.log.crc by DFSClient_1897466025
java.io.IOException: Could not complete write to file /
feedback/.feedback_10.1.10.102-33877.log.crc by DFSClient_1897466025
at org.apache.hadoop.dfs.NameNode.complete(NameNode.java:205)
at sun.reflect.GeneratedMethodAccessor38.invoke(Unknown
Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:585)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:237)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:216)
I can't be 100% sure, but it looks like these errors happen with
checksum files for very small data files.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the
administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
