hfutatzhanghb opened a new pull request, #6717:
URL: https://github.com/apache/hadoop/pull/6717

   ### Description of PR
   
   In [HDFS-16429](https://issues.apache.org/jira/browse/HDFS-16429) we make 
LightWeightResizableGSet to be thread safe, and in 
[HDFS-16511](https://issues.apache.org/jira/browse/HDFS-16511)  we change some 
methods in ReplicaMap to acquire read lock instead of acquiring write lock.
   
   This PR try to remove unnecessary Block_Pool read lock further.
   
   Recently, I performed stress tests on datanodes to measure their read/write 
operations/second.
   
   Before we removing some lock(createRbw、finalizeBlock etc.),  it can only 
achieve ~2K write ops. After optimizing, it can achieve more than 5K write ops.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

Reply via email to