[ https://issues.apache.org/jira/browse/HDFS-15994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327218#comment-17327218 ]
Qi Zhu edited comment on HDFS-15994 at 4/22/21, 9:50 AM: --------------------------------------------------------- cc [~weichiu] [~hexiaoqiao] [~sodonnell] [~ayushtkn] [~linyiqun] [~jianliang.wu] I submitted a patch for review, i think we should improve the block deletions in huge clusters. What's your opinions about this? Thanks. was (Author: zhuqi): cc [~weichiu] [~hexiaoqiao] [~sodonnell] [~ayushtkn] [~linyiqun] [~jianliang.wu] I submitted a patch for review, i think we should improve the block deletions in huge clusters.-- What's your opinions about this? Thanks. > Deletion should sleep some time, when there are too many pending deletion > blocks. > --------------------------------------------------------------------------------- > > Key: HDFS-15994 > URL: https://issues.apache.org/jira/browse/HDFS-15994 > Project: Hadoop HDFS > Issue Type: Improvement > Reporter: Qi Zhu > Assignee: Qi Zhu > Priority: Major > Attachments: HDFS-15994.001.patch > > > HDFS-13831 realize that we can control the frequency of other waiters to get > the lock chance. > But actually in our big cluster with heavy deletion: > The problem still happened, and the pending deletion blocks will be more > than ten million somtimes, and the size become more than 1 million in regular > in huge clusters. > So i think we should sleep for some time when pending too many deletion > blocks. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org