Re: hdfs: weird lease expiration issue

2015-08-21 Thread Bogdan Raducanu
Ravi On Friday, August 21, 2015 10:05 AM, Bogdan Raducanu lrd...@gmail.com wrote: I have an application that continuously appends to an hdfs file and keeps it open a long time. At some point the application crashed and left the file open. It was then restarted and it resumed normal

hdfs: weird lease expiration issue

2015-08-21 Thread Bogdan Raducanu
I have an application that continuously appends to an hdfs file and keeps it open a long time. At some point the application crashed and left the file open. It was then restarted and it resumed normal operation, completing some writes (appending to the file). But, an hour after the crash it

Re: Not able to place enough replicas

2014-07-15 Thread Bogdan Raducanu
can refer the ERROR log like: org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:test (auth:SIMPLE) 2014-07-15 2:07 GMT+08:00 Bogdan Raducanu lrd...@gmail.com: I'm getting this error while writing many files

Not able to place enough replicas

2014-07-14 Thread Bogdan Raducanu
I'm getting this error while writing many files. org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy: Not able to place enough replicas, still in need of 4 to reach 4 I've set logging to DEBUG but still there is no reason printed. There should've been a reason after this line but

Re: Recover HDFS lease after crash

2014-06-16 Thread Bogdan Raducanu
Thanks. I tried to call recoverLease before doing fs.append. Now I'm getting only the AlreadyBeingCreatedException (org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AlreadyBeingCreatedException): failed to create file /lease_fix for DFSClient_NONMAPREDUCE_394503315_1 for

Re: Recover HDFS lease after crash

2014-06-16 Thread Bogdan Raducanu
Thanks. I tried to call recoverLease before doing fs.append. Now I'm getting only the AlreadyBeingCreatedException (org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AlreadyBeingCreatedException): failed to create file /lease_fix for DFSClient_NONMAPREDUCE_394503315_1 for

Re: Recover HDFS lease after crash

2014-06-16 Thread Bogdan Raducanu
Ah, indeed. Thanks On Mon, Jun 16, 2014 at 7:18 PM, Harsh J ha...@cloudera.com wrote: You are likely hitting this: https://issues.apache.org/jira/browse/HDFS-3848 On Mon, Jun 16, 2014 at 10:17 PM, Bogdan Raducanu lrd...@gmail.com wrote: Thanks. I tried to call recoverLease before doing