Hui Fei created HDFS-16105: ------------------------------ Summary: Edit log corruption due to mismatch between fileId and path Key: HDFS-16105 URL: https://issues.apache.org/jira/browse/HDFS-16105 Project: Hadoop HDFS Issue Type: Bug Components: namanode Affects Versions: 3.3.1, 3.2.2 Reporter: Hui Fei
We do stress testing in FUSE with HDFS, Standby Namenode crashes. The log is following {quote} 2021-06-25 17:13:02,953 ERROR org.apache.hadoop.hdfs.server.namenode.FSEditLogLoader: Encountered exception on operation AddBlockOp [path=/xxx/fiotest_write.354.46, penultimateBlock=xxx, lastBlock=xxx, numOfBytes=0}, RpcClientId=, RpcCallId=-2] java.io.FileNotFoundException: File /xxx/fiotest_write.354.46 does not exist. {quote} The following steps can reproduce it (Illegal writes). 1 create file A (fileId X) (1st block is being written) 2 rename file A to file B(stile fileId X) 3 continue to write file A(using above the same outputstream, 2nd block need to be written) 4 standby namenode load the above edits and would crash -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org