[jira] [Commented] (HDFS-12446) FSNamesystem#internalReleaseLease throw IllegalStateException

2017-09-17 Thread Jiandan Yang (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-12446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16169546#comment-16169546
 ] 

Jiandan Yang  commented on HDFS-12446:
--

NN log exception info as description. this because LeaseManager$Monitor#run is 
in a dead loop, every run will throw IllegalStateException.
[HDFS-11817|https://issues.apache.org/jira/browse/HDFS-11817] has the same 
exception, but did not fix completely.

{code:java}
  boolean completed = false;
  try {
completed = fsnamesystem.internalReleaseLease(
leaseToCheck, p, iip, newHolder);
  } catch (IOException e) { 
 // NOTE:  did not catch IllegalStateException
LOG.warn("Cannot release the path " + p + " in the lease "
+ leaseToCheck + ". It will be retried.", e);
continue;
  }
{code}


> FSNamesystem#internalReleaseLease throw IllegalStateException
> -
>
> Key: HDFS-12446
> URL: https://issues.apache.org/jira/browse/HDFS-12446
> Project: Hadoop HDFS
>  Issue Type: Bug
>Affects Versions: 2.8.1
>Reporter: Jiandan Yang 
>
> NameNode always print following logs.
> {code:java}
> 2017-09-14 10:21:32,042 INFO 
> org.apache.hadoop.hdfs.server.namenode.LeaseManager: [Lease.  Holder: 
> DFSClient_NONMAPREDUCE_-275421369_84, pending creates: 7] has expired hard 
> limit
> 2017-09-14 10:21:32,042 INFO 
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Recovering [Lease.  
> Holder: DFSClient_NONMAPREDUCE_-275421369_84, pending creates: 7], src=/xxx
> 2017-09-14 10:21:32,042 WARN 
> org.apache.hadoop.hdfs.server.namenode.LeaseManager: Unexpected throwable:
> java.lang.IllegalStateException: Unexpected block state: 
> blk_1265519060_203004758 is COMMITTED but not COMPLETE, file=xxx (INodeFile), 
> blocks=[blk_1265519060_203004758] (i=0)
> at 
> com.google.common.base.Preconditions.checkState(Preconditions.java:172)
> at 
> org.apache.hadoop.hdfs.server.namenode.INodeFile.assertAllBlocksComplete(INodeFile.java:218)
> at 
> org.apache.hadoop.hdfs.server.namenode.INodeFile.toCompleteFile(INodeFile.java:207)
> at 
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.finalizeINodeFileUnderConstruction(FSNamesystem.java:3312)
> at 
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.internalReleaseLease(FSNamesystem.java:3184)
> at 
> org.apache.hadoop.hdfs.server.namenode.LeaseManager.checkLeases(LeaseManager.java:383)
> at 
> org.apache.hadoop.hdfs.server.namenode.LeaseManager$Monitor.run(LeaseManager.java:329)
> at java.lang.Thread.run(Thread.java:834)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-12446) FSNamesystem#internalReleaseLease throw IllegalStateException

2017-09-14 Thread Rushabh S Shah (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-12446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167012#comment-16167012
 ] 

Rushabh S Shah commented on HDFS-12446:
---

bq. NameNode always print following logs.
What do you mean by always ?
Can you attach some more logs giving more context ? Does namenode log this 
while finalizing all inodes ?

> FSNamesystem#internalReleaseLease throw IllegalStateException
> -
>
> Key: HDFS-12446
> URL: https://issues.apache.org/jira/browse/HDFS-12446
> Project: Hadoop HDFS
>  Issue Type: Bug
>Affects Versions: 2.8.1
>Reporter: Jiandan Yang 
>
> NameNode always print following logs.
> {code:java}
> 2017-09-14 10:21:32,042 INFO 
> org.apache.hadoop.hdfs.server.namenode.LeaseManager: [Lease.  Holder: 
> DFSClient_NONMAPREDUCE_-275421369_84, pending creates: 7] has expired hard 
> limit
> 2017-09-14 10:21:32,042 INFO 
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Recovering [Lease.  
> Holder: DFSClient_NONMAPREDUCE_-275421369_84, pending creates: 7], src=/xxx
> 2017-09-14 10:21:32,042 WARN 
> org.apache.hadoop.hdfs.server.namenode.LeaseManager: Unexpected throwable:
> java.lang.IllegalStateException: Unexpected block state: 
> blk_1265519060_203004758 is COMMITTED but not COMPLETE, file=xxx (INodeFile), 
> blocks=[blk_1265519060_203004758] (i=0)
> at 
> com.google.common.base.Preconditions.checkState(Preconditions.java:172)
> at 
> org.apache.hadoop.hdfs.server.namenode.INodeFile.assertAllBlocksComplete(INodeFile.java:218)
> at 
> org.apache.hadoop.hdfs.server.namenode.INodeFile.toCompleteFile(INodeFile.java:207)
> at 
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.finalizeINodeFileUnderConstruction(FSNamesystem.java:3312)
> at 
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.internalReleaseLease(FSNamesystem.java:3184)
> at 
> org.apache.hadoop.hdfs.server.namenode.LeaseManager.checkLeases(LeaseManager.java:383)
> at 
> org.apache.hadoop.hdfs.server.namenode.LeaseManager$Monitor.run(LeaseManager.java:329)
> at java.lang.Thread.run(Thread.java:834)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org