JiangHua Zhu created HDFS-16414: ----------------------------------- Summary: Improve asynchronous edit: reduce the time that edit waits to enter editPendingQ Key: HDFS-16414 URL: https://issues.apache.org/jira/browse/HDFS-16414 Project: Hadoop HDFS Issue Type: Improvement Components: fs async, namenode Affects Versions: 2.9.2 Reporter: JiangHua Zhu
When dfs.namenode.edits.asynclogging=true, FSEditLogAsync starts to work, which is very helpful for improving the speed of NameNode processing Call. But there is a strange phenomenon here. When a lot of calls enter the NameNode through RPC within a period of time, the handler will be forced to wait, in seconds: FSEditLogAsync#enqueueEdit(): if (Thread.holdsLock(this)) { int permits = overflowMutex.drainPermits(); try { do { this.wait(1000); // will be notified by next logSync. } while (!editPendingQ.offer(edit)); } finally { overflowMutex.release(permits); } } We should reduce this.wait(1000) here so that edit can be processed quickly. -- This message was sent by Atlassian Jira (v8.20.1#820001) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org