[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17827839#comment-17827839 ] Rushabh Shah commented on HDFS-17299: - Merged to branch-2.10 and branch-3.3 also. Tha

[jira] [Updated] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh Shah updated HDFS-17299: Fix Version/s: 2.10.3 > HDFS is not rack failure tolerant while creating a new file. >

[jira] [Updated] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh Shah updated HDFS-17299: Fix Version/s: 3.3.7 > HDFS is not rack failure tolerant while creating a new file. > -

[jira] [Updated] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh Shah updated HDFS-17299: Fix Version/s: 3.3.9 (was: 3.3.7) > HDFS is not rack failure tolerant while

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17824197#comment-17824197 ] Rushabh Shah commented on HDFS-17299: - [~slfan1989] By mistake, I cherry-picked this

[jira] [Resolved] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh Shah resolved HDFS-17299. - Fix Version/s: 3.4.1 3.5.0 Resolution: Fixed > HDFS is not rack failure

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17824194#comment-17824194 ] Rushabh Shah commented on HDFS-17299: - Thank you [~gargrite]  for the PR. The patch

[jira] [Created] (HDFS-17409) TestDFSAdmin has couple of flaky tests.

Rushabh Shah created HDFS-17409: --- Summary: TestDFSAdmin has couple of flaky tests. Key: HDFS-17409 URL: https://issues.apache.org/jira/browse/HDFS-17409 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-16064) Determine when to invalidate corrupt replicas based on number of usable replicas

[ https://issues.apache.org/jira/browse/HDFS-16064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17805723#comment-17805723 ] Rushabh Shah commented on HDFS-16064: - [~KevinWikant]  By any chance you have draft P

[jira] [Commented] (HDFS-16064) Determine when to invalidate corrupt replicas based on number of usable replicas

[ https://issues.apache.org/jira/browse/HDFS-16064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17805704#comment-17805704 ] Rushabh Shah commented on HDFS-16064: - Thank you [~KevinWikant]  for your reply. We a

[jira] [Commented] (HDFS-16064) Determine when to invalidate corrupt replicas based on number of usable replicas

[ https://issues.apache.org/jira/browse/HDFS-16064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17805302#comment-17805302 ] Rushabh Shah commented on HDFS-16064: - [~KevinWikant]  [~aajisaka]  Any reason why we

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17801889#comment-17801889 ] Rushabh Shah commented on HDFS-17299: - Thank you [~ayushtkn]  > HDFS is not rack fai

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17801867#comment-17801867 ] Rushabh Shah commented on HDFS-17299: - [~gargrite] is interested to work on this jira

[jira] [Updated] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh Shah updated HDFS-17299: Description: Recently we saw an HBase cluster outage when we mistakenly brought down 1 AZ. Our conf

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17800840#comment-17800840 ] Rushabh Shah commented on HDFS-17299: - Thank you [~ayushtkn]  [~hexiaoqiao]  [~tasanu

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17800217#comment-17800217 ] Rushabh Shah commented on HDFS-17299: - > Maybe if you would have put > dfs.client.bl

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17799891#comment-17799891 ] Rushabh Shah commented on HDFS-17299: - >From the file creation (at 2023-12-16 17:17:4

[jira] [Comment Edited] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17799871#comment-17799871 ] Rushabh Shah edited comment on HDFS-17299 at 12/22/23 4:28 PM:

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17799871#comment-17799871 ] Rushabh Shah commented on HDFS-17299: - bq.  You should find the reason why the nodes

[jira] [Updated] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh Shah updated HDFS-17299: Description: Recently we saw an HBase cluster outage when we mistakenly brought down 1 AZ. Our conf

[jira] [Updated] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh Shah updated HDFS-17299: Description: Recently we saw an HBase cluster outage when we mistakenly brought down 1 AZ. Our conf

[jira] [Updated] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh Shah updated HDFS-17299: Description: Recently we saw an HBase cluster outage when we mistakenly brought down 1 AZ. Our conf

[jira] [Updated] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh Shah updated HDFS-17299: Description: Recently we saw an HBase cluster outage when we mistakenly brought down 1 AZ. Our conf

[jira] [Updated] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh Shah updated HDFS-17299: Priority: Critical (was: Major) > HDFS is not rack failure tolerant while creating a new file. > -

[jira] [Created] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

Rushabh Shah created HDFS-17299: --- Summary: HDFS is not rack failure tolerant while creating a new file. Key: HDFS-17299 URL: https://issues.apache.org/jira/browse/HDFS-17299 Project: Hadoop HDFS

[jira] [Commented] (HDFS-16540) Data locality is lost when DataNode pod restarts in kubernetes

[ https://issues.apache.org/jira/browse/HDFS-16540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17770545#comment-17770545 ] Rushabh Shah commented on HDFS-16540: - > I'll let folks ask for the backport before d

[jira] [Updated] (HDFS-17188) Data loss in our production clusters due to missing HDFS-16540

[ https://issues.apache.org/jira/browse/HDFS-17188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh Shah updated HDFS-17188: Description: Recently we saw missing blocks in our production clusters running on dynamic environm

[jira] [Updated] (HDFS-17188) Data loss in our production clusters due to missing HDFS-16540

[ https://issues.apache.org/jira/browse/HDFS-17188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh Shah updated HDFS-17188: Description: Recently we saw missing blocks in our production clusters running on dynamic environm

[jira] [Updated] (HDFS-17188) Data loss in our production clusters due to missing HDFS-16540

[ https://issues.apache.org/jira/browse/HDFS-17188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh Shah updated HDFS-17188: Description: Recently we saw missing blocks in our production clusters running on dynamic environm

[jira] [Created] (HDFS-17188) Data loss in our production clusters due to missing HDFS-16540

Rushabh Shah created HDFS-17188: --- Summary: Data loss in our production clusters due to missing HDFS-16540 Key: HDFS-17188 URL: https://issues.apache.org/jira/browse/HDFS-17188 Project: Hadoop HDFS

[jira] [Commented] (HDFS-16829) Delay deleting blocks with older generation stamp until the block is fully replicated.

[ https://issues.apache.org/jira/browse/HDFS-16829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17629131#comment-17629131 ] Rushabh Shah commented on HDFS-16829: - >  If I catch correct if you had that patch in

[jira] [Commented] (HDFS-16829) Delay deleting blocks with older generation stamp until the block is fully replicated.

[ https://issues.apache.org/jira/browse/HDFS-16829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17629109#comment-17629109 ] Rushabh Shah commented on HDFS-16829: - > That is my point like in your case the pipel

[jira] [Comment Edited] (HDFS-16829) Delay deleting blocks with older generation stamp until the block is fully replicated.

[ https://issues.apache.org/jira/browse/HDFS-16829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17628011#comment-17628011 ] Rushabh Shah edited comment on HDFS-16829 at 11/4/22 3:48 PM: -

[jira] [Commented] (HDFS-16829) Delay deleting blocks with older generation stamp until the block is fully replicated.

[ https://issues.apache.org/jira/browse/HDFS-16829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17629057#comment-17629057 ] Rushabh Shah commented on HDFS-16829: - {quote} dfs.client.block.write.replace-datano

[jira] [Comment Edited] (HDFS-16829) Delay deleting blocks with older generation stamp until the block is fully replicated.

[ https://issues.apache.org/jira/browse/HDFS-16829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17629057#comment-17629057 ] Rushabh Shah edited comment on HDFS-16829 at 11/4/22 3:47 PM: -

[jira] [Comment Edited] (HDFS-16829) Delay deleting blocks with older generation stamp until the block is fully replicated.

[ https://issues.apache.org/jira/browse/HDFS-16829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17629057#comment-17629057 ] Rushabh Shah edited comment on HDFS-16829 at 11/4/22 3:47 PM: -

[jira] [Comment Edited] (HDFS-16829) Delay deleting blocks with older generation stamp until the block is fully replicated.

[ https://issues.apache.org/jira/browse/HDFS-16829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17628011#comment-17628011 ] Rushabh Shah edited comment on HDFS-16829 at 11/2/22 11:07 PM:

[jira] [Commented] (HDFS-16829) Delay deleting blocks with older generation stamp until the block is fully replicated.

[ https://issues.apache.org/jira/browse/HDFS-16829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17628011#comment-17628011 ] Rushabh Shah commented on HDFS-16829: - {quote}dfs.client.block.write.replace-datanode

[jira] [Commented] (HDFS-16829) Delay deleting blocks with older generation stamp until the block is fully replicated.

[ https://issues.apache.org/jira/browse/HDFS-16829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17627294#comment-17627294 ] Rushabh Shah commented on HDFS-16829: - Thank you [~ayushsaxena] for the response. >

[jira] [Updated] (HDFS-16829) Delay deleting blocks with older generation stamp until the block is fully replicated.

[ https://issues.apache.org/jira/browse/HDFS-16829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh Shah updated HDFS-16829: Priority: Critical (was: Major) > Delay deleting blocks with older generation stamp until the bloc

[jira] [Updated] (HDFS-16829) Delay deleting blocks with older generation stamp until the block is fully replicated.

[ https://issues.apache.org/jira/browse/HDFS-16829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh Shah updated HDFS-16829: Description: We encountered this data loss issue in one of our production clusters which runs hbas

[jira] [Created] (HDFS-16829) Delay deleting blocks with older generation stamp until the block is fully replicated.

Rushabh Shah created HDFS-16829: --- Summary: Delay deleting blocks with older generation stamp until the block is fully replicated. Key: HDFS-16829 URL: https://issues.apache.org/jira/browse/HDFS-16829 Pr