yuanboliu commented on PR #6244: URL: https://github.com/apache/hadoop/pull/6244#issuecomment-1793981740
+1. We've seen that a block is marked as missing block because of the mis-order after applying [HDFS-16016](https://issues.apache.org/jira/browse/HDFS-16016). This bug can be reproduced as below: 1. client write block to dn1 and dn2 as pipeline 2. dn1/dn2 has over 1 million blocks and fbr is reported one by one disk. 3. when fbr is being reported, client finish writing, dn1/dn2 starts to trigger ibr in different thread. 4. nn receives all the operations and because of the namesystem write lock, the operations are executed in line as dn1-ibr, dn2-ibr, dn1-fbr-disk, dn2-fbr-disk. After this, the block is marked as a missing block. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
