[jira] [Commented] (HDFS-17295) 'hdfs dfs -put' may fail when more than half of the datanodes are unavailable

2023-12-18 Thread Xuze Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798040#comment-17798040 ] Xuze Yang commented on HDFS-17295: -- A simple solution is to increase the considerLoadFactor. For

[jira] [Commented] (HDFS-17294) Reconfigure the scheduling cycle of the slowPeerCollectorDaemon thread.

2023-12-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798205#comment-17798205 ] ASF GitHub Bot commented on HDFS-17294: --- tasanuma commented on code in PR #6366: URL:

[jira] [Commented] (HDFS-17289) Considering the size of non-lastBlocks equals to complete block size can cause append failure.

2023-12-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798189#comment-17798189 ] ASF GitHub Bot commented on HDFS-17289: --- hadoop-yetus commented on PR #6357: URL:

[jira] [Commented] (HDFS-17294) Reconfigure the scheduling cycle of the slowPeerCollectorDaemon thread.

2023-12-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798222#comment-17798222 ] ASF GitHub Bot commented on HDFS-17294: --- tasanuma commented on PR #6366: URL:

[jira] [Commented] (HDFS-17294) Reconfigure the scheduling cycle of the slowPeerCollectorDaemon thread.

2023-12-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798239#comment-17798239 ] ASF GitHub Bot commented on HDFS-17294: --- hadoop-yetus commented on PR #6366: URL:

[jira] [Commented] (HDFS-17294) Reconfigure the scheduling cycle of the slowPeerCollectorDaemon thread.

2023-12-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798210#comment-17798210 ] ASF GitHub Bot commented on HDFS-17294: --- huangzhaobo99 commented on code in PR #6366: URL:

[jira] [Commented] (HDFS-17292) Show the number of times the slowPeerCollectorDaemon thread has collected SlowNodes.

2023-12-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798355#comment-17798355 ] ASF GitHub Bot commented on HDFS-17292: --- hadoop-yetus commented on PR #6364: URL:

[jira] [Commented] (HDFS-17294) Reconfigure the scheduling cycle of the slowPeerCollectorDaemon thread.

2023-12-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798395#comment-17798395 ] ASF GitHub Bot commented on HDFS-17294: --- huangzhaobo99 commented on PR #6366: URL:

[jira] [Commented] (HDFS-17290) HDFS: add client rpc backoff metrics due to disconnection from lowest priority queue

2023-12-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798397#comment-17798397 ] ASF GitHub Bot commented on HDFS-17290: --- simbadzina commented on code in PR #6359: URL:

[jira] [Commented] (HDFS-17292) Show the number of times the slowPeerCollectorDaemon thread has collected SlowNodes.

2023-12-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798409#comment-17798409 ] ASF GitHub Bot commented on HDFS-17292: --- hadoop-yetus commented on PR #6364: URL:

[jira] [Updated] (HDFS-17290) HDFS: add client rpc backoff metrics due to disconnection from lowest priority queue

2023-12-18 Thread Lei Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei Yang updated HDFS-17290: Description: Clients are backoff when rpcs cannot be enqueued. However there are different scenarios when

[jira] [Updated] (HDFS-17290) HDFS: add client rpc backoff metrics due to disconnection from lowest priority queue

2023-12-18 Thread Lei Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei Yang updated HDFS-17290: Affects Version/s: 3.4.0 (was: 3.3.6) > HDFS: add client rpc backoff metrics

[jira] [Commented] (HDFS-17290) HDFS: add client rpc backoff metrics due to disconnection from lowest priority queue

2023-12-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798383#comment-17798383 ] ASF GitHub Bot commented on HDFS-17290: --- mccormickt12 commented on PR #6359: URL:

[jira] [Updated] (HDFS-17290) HDFS: add client rpc backoff metrics due to disconnection from lowest priority queue

2023-12-18 Thread Lei Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei Yang updated HDFS-17290: Description: Clients are backoff when rpcs cannot be enqueued. However there are different scenarios when

[jira] [Resolved] (HDFS-17294) Reconfigure the scheduling cycle of the slowPeerCollectorDaemon thread.

2023-12-18 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17294. - Resolution: Fixed > Reconfigure the scheduling cycle of the slowPeerCollectorDaemon

[jira] [Updated] (HDFS-17286) Add UDP as a transfer protocol for HDFS

2023-12-18 Thread Xing Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xing Lin updated HDFS-17286: Attachment: (was: active.png) > Add UDP as a transfer protocol for HDFS >

[jira] [Updated] (HDFS-17286) Add UDP as a transfer protocol for HDFS

2023-12-18 Thread Xing Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xing Lin updated HDFS-17286: Attachment: (was: Observer.png) > Add UDP as a transfer protocol for HDFS >

[jira] [Comment Edited] (HDFS-17290) HDFS: add client rpc backoff metrics due to disconnection from lowest priority queue

2023-12-18 Thread Lei Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798382#comment-17798382 ] Lei Yang edited comment on HDFS-17290 at 12/18/23 11:48 PM: [~goiri]  

[jira] [Commented] (HDFS-17294) Reconfigure the scheduling cycle of the slowPeerCollectorDaemon thread.

2023-12-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798392#comment-17798392 ] ASF GitHub Bot commented on HDFS-17294: --- tasanuma commented on PR #6366: URL:

[jira] [Updated] (HDFS-17294) Reconfigure the scheduling cycle of the slowPeerCollectorDaemon thread.

2023-12-18 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17294: Fix Version/s: 3.4.0 > Reconfigure the scheduling cycle of the slowPeerCollectorDaemon

[jira] [Updated] (HDFS-17286) Add UDP as a transfer protocol for HDFS

2023-12-18 Thread Xing Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xing Lin updated HDFS-17286: Attachment: active.png observer.png > Add UDP as a transfer protocol for HDFS >

[jira] [Commented] (HDFS-17294) Reconfigure the scheduling cycle of the slowPeerCollectorDaemon thread.

2023-12-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798366#comment-17798366 ] ASF GitHub Bot commented on HDFS-17294: --- hadoop-yetus commented on PR #6366: URL:

[jira] [Updated] (HDFS-17290) HDFS: add client rpc backoff metrics due to disconnection from lowest priority queue

2023-12-18 Thread Lei Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei Yang updated HDFS-17290: Summary: HDFS: add client rpc backoff metrics due to disconnection from lowest priority queue (was: HDFS:

[jira] [Commented] (HDFS-17290) HDFS: add client rpc backoff metrics due to disconnection from lowest priority queue

2023-12-18 Thread Lei Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798382#comment-17798382 ] Lei Yang commented on HDFS-17290: - [~goiri]  [~simbadzina] Can you please review this and let me know if

[jira] [Updated] (HDFS-17290) HDFS: add client rpc backoff metrics due to disconnection from lowest priority queue

2023-12-18 Thread Lei Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei Yang updated HDFS-17290: Description: Clients are backoff when rpcs cannot be enqueued. However there are different scenarios when

[jira] [Commented] (HDFS-17294) Reconfigure the scheduling cycle of the slowPeerCollectorDaemon thread.

2023-12-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798391#comment-17798391 ] ASF GitHub Bot commented on HDFS-17294: --- tasanuma merged PR #6366: URL:

[jira] [Commented] (HDFS-17275) We should determine whether the block has been deleted in the block report

2023-12-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798340#comment-17798340 ] ASF GitHub Bot commented on HDFS-17275: --- hadoop-yetus commented on PR #6335: URL:

[jira] [Created] (HDFS-17296) ACL inheritance broken for new files

2023-12-18 Thread Emil Kleszcz (Jira)
Emil Kleszcz created HDFS-17296: --- Summary: ACL inheritance broken for new files Key: HDFS-17296 URL: https://issues.apache.org/jira/browse/HDFS-17296 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-17296) ACL inheritance broken for new files

2023-12-18 Thread Emil Kleszcz (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emil Kleszcz updated HDFS-17296: Description: Looks like the inheritance of ACLs for the files is not working correctly. I have

[jira] [Updated] (HDFS-17296) ACL inheritance broken for new files

2023-12-18 Thread Emil Kleszcz (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emil Kleszcz updated HDFS-17296: Description: Looks like the inheritance of ACLs for the files is not working correctly. I have

[jira] [Updated] (HDFS-17296) ACL inheritance broken for new files

2023-12-18 Thread Emil Kleszcz (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emil Kleszcz updated HDFS-17296: Affects Version/s: 3.3.6 > ACL inheritance broken for new files >

[jira] [Updated] (HDFS-17297) The NameNode should remove block from the BlocksMap if the block is marked as deleted.

2023-12-18 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17297: -- Description: When call internalReleaseLease method: {code:java} boolean internalReleaseLease( ... int

[jira] [Commented] (HDFS-17297) The NameNode should remove block from the BlocksMap if the block is marked as deleted.

2023-12-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798456#comment-17798456 ] ASF GitHub Bot commented on HDFS-17297: --- hadoop-yetus commented on PR #6369: URL:

[jira] [Commented] (HDFS-17290) HDFS: add client rpc backoff metrics due to disconnection from lowest priority queue

2023-12-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798418#comment-17798418 ] ASF GitHub Bot commented on HDFS-17290: --- hadoop-yetus commented on PR #6359: URL:

[jira] [Commented] (HDFS-17292) Show the number of times the slowPeerCollectorDaemon thread has collected SlowNodes.

2023-12-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798449#comment-17798449 ] ASF GitHub Bot commented on HDFS-17292: --- huangzhaobo99 commented on code in PR #6364: URL:

[jira] [Commented] (HDFS-17292) Show the number of times the slowPeerCollectorDaemon thread has collected SlowNodes.

2023-12-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798439#comment-17798439 ] ASF GitHub Bot commented on HDFS-17292: --- slfan1989 commented on code in PR #6364: URL:

[jira] [Updated] (HDFS-17297) The NameNode should remove block from the BlocksMap if the block is marked as deleted.

2023-12-18 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HDFS-17297: -- Description: When call internalReleaseLease method: {code:java} boolean internalReleaseLease( ... int

[jira] [Created] (HDFS-17297) The NameNode should remove block from the BlocksMap if the block is marked as deleted.

2023-12-18 Thread Haiyang Hu (Jira)
Haiyang Hu created HDFS-17297: - Summary: The NameNode should remove block from the BlocksMap if the block is marked as deleted. Key: HDFS-17297 URL: https://issues.apache.org/jira/browse/HDFS-17297

[jira] [Commented] (HDFS-17297) The NameNode should remove block from the BlocksMap if the block is marked as deleted.

2023-12-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798420#comment-17798420 ] ASF GitHub Bot commented on HDFS-17297: --- haiyang1987 opened a new pull request, #6369: URL:

[jira] [Updated] (HDFS-17297) The NameNode should remove block from the BlocksMap if the block is marked as deleted.

2023-12-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17297: -- Labels: pull-request-available (was: ) > The NameNode should remove block from the BlocksMap

[jira] [Commented] (HDFS-17297) The NameNode should remove block from the BlocksMap if the block is marked as deleted.

2023-12-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798425#comment-17798425 ] ASF GitHub Bot commented on HDFS-17297: --- hadoop-yetus commented on PR #6369: URL: