[jira] [Updated] (HDFS-17301) Add read and write dataXceiver threads count metrics to datanode.

2023-12-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17301: -- Labels: pull-request-available (was: ) > Add read and write dataXceiver threads count metrics

[jira] [Commented] (HDFS-17301) Add read and write dataXceiver threads count metrics to datanode.

2023-12-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1788#comment-1788 ] ASF GitHub Bot commented on HDFS-17301: --- huangzhaobo99 opened a new pull request, #6377: URL:

[jira] [Created] (HDFS-17301) Add read and write dataXceiver threads count metrics to datanode.

2023-12-22 Thread huangzhaobo99 (Jira)
huangzhaobo99 created HDFS-17301: Summary: Add read and write dataXceiver threads count metrics to datanode. Key: HDFS-17301 URL: https://issues.apache.org/jira/browse/HDFS-17301 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-17301) Add read and write dataXceiver threads count metrics to datanode.

2023-12-22 Thread huangzhaobo99 (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huangzhaobo99 reassigned HDFS-17301: Assignee: huangzhaobo99 > Add read and write dataXceiver threads count metrics to

[jira] [Commented] (HDFS-17300) [SBN READ] Observer should throw ObserverRetryOnActiveException if stateid is always delayed with Active Namenode for a configured time

2023-12-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1774#comment-1774 ] ASF GitHub Bot commented on HDFS-17300: --- hadoop-yetus commented on PR #6376: URL:

[jira] [Commented] (HDFS-17300) [SBN READ] Observer should throw ObserverRetryOnActiveException if stateid is always delayed with Active Namenode for a configured time

2023-12-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17799970#comment-17799970 ] ASF GitHub Bot commented on HDFS-17300: --- LiuGuH opened a new pull request, #6376: URL:

[jira] [Commented] (HDFS-17300) [SBN READ] Observer should throw ObserverRetryOnActiveException if stateid is always delayed with Active Namenode for a configured time

2023-12-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17799969#comment-17799969 ] ASF GitHub Bot commented on HDFS-17300: --- LiuGuH closed pull request #6375: HDFS-17300. [SBN READ]

[jira] [Comment Edited] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2023-12-22 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17799897#comment-17799897 ] Ayush Saxena edited comment on HDFS-17299 at 12/22/23 6:28 PM: --- The stale

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2023-12-22 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17799897#comment-17799897 ] Ayush Saxena commented on HDFS-17299: - The stale node thing was added for a HBase use case only as

[jira] [Commented] (HDFS-17300) [SBN READ] Observer should throw ObserverRetryOnActiveException if stateid is always delayed with Active Namenode for a configured time

2023-12-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17799893#comment-17799893 ] ASF GitHub Bot commented on HDFS-17300: --- hadoop-yetus commented on PR #6375: URL:

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2023-12-22 Thread Rushabh Shah (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17799891#comment-17799891 ] Rushabh Shah commented on HDFS-17299: - >From the file creation (at 2023-12-16 17:17:43,818) to the

[jira] [Commented] (HDFS-17300) [SBN READ] Observer should throw ObserverRetryOnActiveException if stateid is always delayed with Active Namenode for a configured time

2023-12-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17799877#comment-17799877 ] ASF GitHub Bot commented on HDFS-17300: --- hadoop-yetus commented on PR #6375: URL:

[jira] [Comment Edited] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2023-12-22 Thread Rushabh Shah (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17799871#comment-17799871 ] Rushabh Shah edited comment on HDFS-17299 at 12/22/23 4:28 PM: --- bq.  You

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2023-12-22 Thread Rushabh Shah (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17799871#comment-17799871 ] Rushabh Shah commented on HDFS-17299: - bq.  You should find the reason why the nodes were chosen in 1

[jira] [Commented] (HDFS-17284) Fix int overflow in calculating numEcReplicatedTasks and numReplicationTasks during block recovery

2023-12-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17799858#comment-17799858 ] ASF GitHub Bot commented on HDFS-17284: --- hadoop-yetus commented on PR #6348: URL:

[jira] [Comment Edited] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2023-12-22 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17799702#comment-17799702 ] Ayush Saxena edited comment on HDFS-17299 at 12/22/23 1:53 PM: --- {quote}So

[jira] [Comment Edited] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2023-12-22 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17799702#comment-17799702 ] Ayush Saxena edited comment on HDFS-17299 at 12/22/23 1:52 PM: --- {quote}So

[jira] [Commented] (HDFS-17298) Fix NPE in DataNode.handleBadBlock and BlockSender

2023-12-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17799809#comment-17799809 ] ASF GitHub Bot commented on HDFS-17298: --- hadoop-yetus commented on PR #6374: URL:

[jira] [Updated] (HDFS-17300) [SBN READ] Observer should throw ObserverRetryOnActiveException if stateid is always delayed with Active Namenode for a configured time

2023-12-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17300: -- Labels: pull-request-available (was: ) > [SBN READ] Observer should throw

[jira] [Commented] (HDFS-17300) [SBN READ] Observer should throw ObserverRetryOnActiveException if stateid is always delayed with Active Namenode for a configured time

2023-12-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17799760#comment-17799760 ] ASF GitHub Bot commented on HDFS-17300: --- LiuGuH opened a new pull request, #6375: URL:

[jira] [Updated] (HDFS-17300) [SBN READ] Observer should throw ObserverRetryOnActiveException if stateid is always delayed with Active Namenode for a period of time

2023-12-22 Thread liuguanghua (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuguanghua updated HDFS-17300: --- Description:            Now when Observer NN is used,  if the stateid is delayed , the rpcServer

[jira] [Updated] (HDFS-17300) [SBN READ] Observer should throw ObserverRetryOnActiveException if stateid is always delayed with Active Namenode for a configured time

2023-12-22 Thread liuguanghua (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuguanghua updated HDFS-17300: --- Summary: [SBN READ] Observer should throw ObserverRetryOnActiveException if stateid is always

[jira] [Updated] (HDFS-17300) [SBN READ] Observer should throw ObserverRetryOnActiveException if stateid is always delayed with Active Namenode for a period of time

2023-12-22 Thread liuguanghua (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuguanghua updated HDFS-17300: --- Description: Now when Observer NN is used,  if the stateid is delayed , the rpcServer will be

[jira] [Created] (HDFS-17300) [SBN READ] Observer should throw ObserverRetryOnActiveException if stateid is always delayed with Active Namenode for a period of time

2023-12-22 Thread liuguanghua (Jira)
liuguanghua created HDFS-17300: -- Summary: [SBN READ] Observer should throw ObserverRetryOnActiveException if stateid is always delayed with Active Namenode for a period of time Key: HDFS-17300 URL:

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2023-12-22 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17799702#comment-17799702 ] Ayush Saxena commented on HDFS-17299: - {quote}So it will take 123 ms (20.5mins) to detect that