[ https://issues.apache.org/jira/browse/HDFS-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HDFS-2421: ----------------------------------------- Resolution: Fixed Fix Version/s: (was: 0.24.0) 2.2.0-alpha Status: Resolved (was: Patch Available) I have committed this. Thanks, Jing Zhao and Weiyan Wang! > Improve the concurrency of SerialNumberMap in NameNode > ------------------------------------------------------- > > Key: HDFS-2421 > URL: https://issues.apache.org/jira/browse/HDFS-2421 > Project: Hadoop HDFS > Issue Type: Improvement > Components: name-node > Reporter: Hairong Kuang > Assignee: Jing Zhao > Fix For: 2.2.0-alpha > > Attachments: HDFS-2421.patch, performance_100000_op.png, > performance_10000_op.png, performance_SerialNumberManager.png, > TestSerialNumberManager.java > > > After enabled permission checking in our HDFS test cluster, our benchmark > observed a significant reduced concurrency in NameNode. Investigation showed > that most threads were blocked at acquiring the lock of > org.apache.hadoop.hdfs.server.namenode.SerialNumberManager$SerialNumberMap. > We used concurrentHashMap to replace Hashmap + synchronized methods, which > greatly improved the situation. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira