[ https://issues.apache.org/jira/browse/HADOOP-18242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steve Loughran resolved HADOOP-18242. ------------------------------------- Fix Version/s: 3.3.9 Resolution: Fixed > ABFS Rename Failure when tracking metadata is in incomplete state > ----------------------------------------------------------------- > > Key: HADOOP-18242 > URL: https://issues.apache.org/jira/browse/HADOOP-18242 > Project: Hadoop Common > Issue Type: Bug > Components: fs/azure > Reporter: Mehakmeet Singh > Assignee: Mehakmeet Singh > Priority: Major > Labels: pull-request-available > Fix For: 3.3.9 > > Time Spent: 6.5h > Remaining Estimate: 0h > > If a node in the datacenter crashes while processing an operation, > occasionally it can leave the Storage-internal blob tracking metadata in an > incomplete state. We expect this to happen occasionally, and so all API’s > are designed in such a way that if this incomplete state is observed on a > blob, the situation is resolved before the current operation proceeds. > However, this incident has exposed a bug specifically with the Rename API, > where the incomplete state fails to resolve, leading to this incorrect > failure. As a temporary mitigation, if any other operation is performed on > this blob – GetBlobProperties, GetBlob, GetFileProperties, SetFileProperties, > etc – it should resolve the incomplete state, and rename will no longer hit > this issue. > StackTrace: > {code:java} > 2022-03-22 17:52:19,789 DEBUG [regionserver/euwukwlss-hg50:16020.logRoller] > services.AbfsClient: HttpRequest: > 404,RenameDestinationParentPathNotFound,cid=ef5cbf0f-5d4a-4630-8a59-3d559077fc24,rid=35fef164-101f-000b-1b15-3ed818000000,sent=0,recv=212,PUT,https://euwqdaotdfdls03.dfs.core.windows.net/eykbssc/apps/hbase/data/oldWALs/euwukwlss-hg50.tdf.qa%252C16020%252C1647949929877.1647967939315?timeout=90 > {code} -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org