Kihwal Lee created HDFS-4075: -------------------------------- Summary: Reduce recommissioning overhead Key: HDFS-4075 URL: https://issues.apache.org/jira/browse/HDFS-4075 Project: Hadoop HDFS Issue Type: Bug Components: name-node Affects Versions: 2.0.2-alpha, 0.23.4 Reporter: Kihwal Lee Assignee: Kihwal Lee Priority: Critical
When datanodes are recommissioned, {BlockManager#processOverReplicatedBlocksOnReCommission()} is called for each rejoined node and excess blocks are added to the invalidate list. The problem is this is done while the namesystem write lock is held. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira