[jira] [Work logged] (HDFS-16326) Simplify the code for DiskBalancer

[ https://issues.apache.org/jira/browse/HDFS-16326?focusedWorklogId=681852&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681852 ] ASF GitHub Bot logged work on HDFS-16326: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17444348#comment-17444348 ] Tsz-wo Sze commented on HDFS-16322: --- bq. ... That means we should change ClientProtocol

[jira] [Comment Edited] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17444348#comment-17444348 ] Tsz-wo Sze edited comment on HDFS-16322 at 11/16/21, 8:10 AM: -

[jira] [Work logged] (HDFS-16324) fix error log in BlockManagerSafeMode

[ https://issues.apache.org/jira/browse/HDFS-16324?focusedWorklogId=681853&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681853 ] ASF GitHub Bot logged work on HDFS-16324: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17444371#comment-17444371 ] Yuanbo Liu commented on HDFS-15382: --- The design of splitting data lock by volume seems

[jira] [Work logged] (HDFS-16320) Datanode retrieve slownode information from NameNode

[ https://issues.apache.org/jira/browse/HDFS-16320?focusedWorklogId=681896&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681896 ] ASF GitHub Bot logged work on HDFS-16320: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1729#comment-1729 ] nhaorand commented on HDFS-16322: - Sorry, my focus is not whether the truncate(...) is id

[jira] [Commented] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1734#comment-1734 ] Tsz-wo Sze commented on HDFS-16322: --- Do you have any suggestion fixing it? As [~shv] m

[jira] [Comment Edited] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1734#comment-1734 ] Tsz-wo Sze edited comment on HDFS-16322 at 11/16/21, 10:21 AM:

[jira] [Work logged] (HDFS-16182) numOfReplicas is given the wrong value in BlockPlacementPolicyDefault$chooseTarget can cause DataStreamer to fail with Heterogeneous Storage

[ https://issues.apache.org/jira/browse/HDFS-16182?focusedWorklogId=681915&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681915 ] ASF GitHub Bot logged work on HDFS-16182: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16324) fix error log in BlockManagerSafeMode

[ https://issues.apache.org/jira/browse/HDFS-16324?focusedWorklogId=681922&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681922 ] ASF GitHub Bot logged work on HDFS-16324: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16314) Support to make dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigurable

[ https://issues.apache.org/jira/browse/HDFS-16314?focusedWorklogId=681947&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681947 ] ASF GitHub Bot logged work on HDFS-16314: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16314) Support to make dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigurable

[ https://issues.apache.org/jira/browse/HDFS-16314?focusedWorklogId=681948&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681948 ] ASF GitHub Bot logged work on HDFS-16314: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1796#comment-1796 ] nhaorand commented on HDFS-16322: - Thanks [~szetszwo] for your response. I suggest that

[jira] [Work logged] (HDFS-16314) Support to make dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigurable

[ https://issues.apache.org/jira/browse/HDFS-16314?focusedWorklogId=681955&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681955 ] ASF GitHub Bot logged work on HDFS-16314: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nhaorand updated HDFS-16322: Attachment: h16322_2026.patch > The NameNode implementation of ClientProtocol.truncate(...) can cause d

[jira] [Commented] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17444509#comment-17444509 ] nhaorand commented on HDFS-16322: - h16322_2026.patch has been uploaded to the attachm

[jira] [Work logged] (HDFS-16315) Add metrics related to Transfer and NativeCopy for DataNode

[ https://issues.apache.org/jira/browse/HDFS-16315?focusedWorklogId=681983&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681983 ] ASF GitHub Bot logged work on HDFS-16315: - Author: ASF GitHub Bot

[jira] [Comment Edited] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1796#comment-1796 ] nhaorand edited comment on HDFS-16322 at 11/16/21, 12:51 PM: -

[jira] [Commented] (HDFS-15714) HDFS Provided Storage Read/Write Mount Support On-the-fly

[ https://issues.apache.org/jira/browse/HDFS-15714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17444528#comment-17444528 ] Bhavik Patel commented on HDFS-15714: - [~PhiloHe] Thanks for the fix. I think now w

[jira] [Updated] (HDFS-16182) numOfReplicas is given the wrong value in BlockPlacementPolicyDefault$chooseTarget can cause DataStreamer to fail with Heterogeneous Storage

[ https://issues.apache.org/jira/browse/HDFS-16182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-16182: --- Fix Version/s: 3.4.0 3.2.3 3.3.2 Resolution: Fixe

[jira] [Work logged] (HDFS-16310) RBF: Add client port to CallerContext for Router

[ https://issues.apache.org/jira/browse/HDFS-16310?focusedWorklogId=682058&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-682058 ] ASF GitHub Bot logged work on HDFS-16310: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-16322: -- Component/s: namanode [~Nsupyq], I agree that truncate should use RetryCache. Good catch! Could you o

[jira] [Work logged] (HDFS-16310) RBF: Add client port to CallerContext for Router

[ https://issues.apache.org/jira/browse/HDFS-16310?focusedWorklogId=682061&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-682061 ] ASF GitHub Bot logged work on HDFS-16310: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17444627#comment-17444627 ] nhaorand commented on HDFS-16322: - Ok, I am lucky to contribute to the HDFS project! > T

[jira] [Work logged] (HDFS-16310) RBF: Add client port to CallerContext for Router

[ https://issues.apache.org/jira/browse/HDFS-16310?focusedWorklogId=682236&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-682236 ] ASF GitHub Bot logged work on HDFS-16310: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16303) Losing over 100 datanodes in state decommissioning results in full blockage of all datanode decommissioning

[ https://issues.apache.org/jira/browse/HDFS-16303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-16303: -- Labels: pull-request-available (was: ) > Losing over 100 datanodes in state decommissioning re

[jira] [Work logged] (HDFS-16303) Losing over 100 datanodes in state decommissioning results in full blockage of all datanode decommissioning

[ https://issues.apache.org/jira/browse/HDFS-16303?focusedWorklogId=682317&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-682317 ] ASF GitHub Bot logged work on HDFS-16303: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16310) RBF: Add client port to CallerContext for Router

[ https://issues.apache.org/jira/browse/HDFS-16310?focusedWorklogId=682362&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-682362 ] ASF GitHub Bot logged work on HDFS-16310: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16310) RBF: Add client port to CallerContext for Router

[ https://issues.apache.org/jira/browse/HDFS-16310?focusedWorklogId=682364&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-682364 ] ASF GitHub Bot logged work on HDFS-16310: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16315) Add metrics related to Transfer and NativeCopy for DataNode

[ https://issues.apache.org/jira/browse/HDFS-16315?focusedWorklogId=682368&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-682368 ] ASF GitHub Bot logged work on HDFS-16315: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16315) Add metrics related to Transfer and NativeCopy for DataNode

[ https://issues.apache.org/jira/browse/HDFS-16315?focusedWorklogId=682369&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-682369 ] ASF GitHub Bot logged work on HDFS-16315: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16315) Add metrics related to Transfer and NativeCopy for DataNode

[ https://issues.apache.org/jira/browse/HDFS-16315?focusedWorklogId=682370&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-682370 ] ASF GitHub Bot logged work on HDFS-16315: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16315) Add metrics related to Transfer and NativeCopy for DataNode

[ https://issues.apache.org/jira/browse/HDFS-16315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-16315: Fix Version/s: 3.3.3 > Add metrics related to Transfer and NativeCopy for DataNode > --

[jira] [Updated] (HDFS-16315) Add metrics related to Transfer and NativeCopy for DataNode

[ https://issues.apache.org/jira/browse/HDFS-16315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-16315: Fix Version/s: 3.2.4 > Add metrics related to Transfer and NativeCopy for DataNode > --

[jira] [Work logged] (HDFS-16315) Add metrics related to Transfer and NativeCopy for DataNode

[ https://issues.apache.org/jira/browse/HDFS-16315?focusedWorklogId=682382&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-682382 ] ASF GitHub Bot logged work on HDFS-16315: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16315) Add metrics related to Transfer and NativeCopy for DataNode

[ https://issues.apache.org/jira/browse/HDFS-16315?focusedWorklogId=682384&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-682384 ] ASF GitHub Bot logged work on HDFS-16315: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15963) Unreleased volume references cause an infinite loop

[ https://issues.apache.org/jira/browse/HDFS-15963?focusedWorklogId=682388&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-682388 ] ASF GitHub Bot logged work on HDFS-15963: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16322) The NameNode implementation of ClientProtocol.truncate(...) can cause data loss.

[ https://issues.apache.org/jira/browse/HDFS-16322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17444979#comment-17444979 ] Tsz-wo Sze commented on HDFS-16322: --- [~Nsupyq], we are lucky to have you! Please let m

[jira] [Work logged] (HDFS-16303) Losing over 100 datanodes in state decommissioning results in full blockage of all datanode decommissioning

[ https://issues.apache.org/jira/browse/HDFS-16303?focusedWorklogId=682418&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-682418 ] ASF GitHub Bot logged work on HDFS-16303: - Author: ASF GitHub Bot