[jira] [Commented] (HDFS-17476) fix: False positive "Observer Node is too far behind" due to long overflow.

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841851#comment-17841851 ] ASF GitHub Bot commented on HDFS-17476: --- hadoop-yetus commented on PR #6747: URL:

[jira] [Assigned] (HDFS-17462) RBF: NPE in Router concat when trg is an empty file.

2024-04-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-17462: -- Assignee: NaihaoFan > RBF: NPE in Router concat when trg is an empty file. >

[jira] [Updated] (HDFS-17462) RBF: NPE in Router concat when trg is an empty file.

2024-04-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17462: --- Summary: RBF: NPE in Router concat when trg is an empty file. (was: NPE in Router concat when trg

[jira] [Commented] (HDFS-17458) Remove unnecessary BP lock in ReplicaMap

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841831#comment-17841831 ] ASF GitHub Bot commented on HDFS-17458: --- hfutatzhanghb commented on PR #6717: URL:

[jira] [Commented] (HDFS-17458) Remove unnecessary BP lock in ReplicaMap

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841829#comment-17841829 ] ASF GitHub Bot commented on HDFS-17458: --- Hexiaoqiao commented on PR #6717: URL:

[jira] [Commented] (HDFS-17458) Remove unnecessary BP lock in ReplicaMap

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841830#comment-17841830 ] ASF GitHub Bot commented on HDFS-17458: --- Hexiaoqiao closed pull request #6717: HDFS-17458. Remove

[jira] [Commented] (HDFS-17456) Fix the dfsused statistics of datanode are incorrect when appending a file.

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841828#comment-17841828 ] ASF GitHub Bot commented on HDFS-17456: --- Hexiaoqiao commented on PR #6713: URL:

[jira] [Commented] (HDFS-17367) Add PercentUsed for Different StorageTypes in JMX

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841822#comment-17841822 ] ASF GitHub Bot commented on HDFS-17367: --- zhtttylz commented on PR #6735: URL:

[jira] [Commented] (HDFS-17503) Unreleased volume references because of OOM

2024-04-28 Thread Zilong Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841815#comment-17841815 ] Zilong Zhu commented on HDFS-17503: --- [~Keepromise] It appears to occur when creating the BlockSender

[jira] [Commented] (HDFS-16993) Datanode supports configure TopN DatanodeNetworkCounts

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841812#comment-17841812 ] ASF GitHub Bot commented on HDFS-16993: --- huangzhaobo99 commented on code in PR #5597: URL:

[jira] [Commented] (HDFS-17488) DN can fail IBRs with NPE when a volume is removed

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841809#comment-17841809 ] ASF GitHub Bot commented on HDFS-17488: --- kokonguyen191 commented on code in PR #6759: URL:

[jira] [Commented] (HDFS-17488) DN can fail IBRs with NPE when a volume is removed

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841801#comment-17841801 ] ASF GitHub Bot commented on HDFS-17488: --- hfutatzhanghb commented on PR #6759: URL:

[jira] [Commented] (HDFS-17484) Introduce redundancy.considerLoad.minLoad to avoiding excluding nodes when they are not busy actually

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841798#comment-17841798 ] ASF GitHub Bot commented on HDFS-17484: --- hadoop-yetus commented on PR #6758: URL:

[jira] [Commented] (HDFS-17497) Logic for committed blocks is mixed when computing file size

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841797#comment-17841797 ] ASF GitHub Bot commented on HDFS-17497: --- ZanderXu commented on PR #6765: URL:

[jira] [Commented] (HDFS-17488) DN can fail IBRs with NPE when a volume is removed

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841794#comment-17841794 ] ASF GitHub Bot commented on HDFS-17488: --- hadoop-yetus commented on PR #6759: URL:

[jira] [Commented] (HDFS-17384) [FGL] Replace the global lock with global FS Lock and global BM lock

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841789#comment-17841789 ] ASF GitHub Bot commented on HDFS-17384: --- hadoop-yetus commented on PR #6762: URL:

[jira] [Commented] (HDFS-17496) DataNode supports more fine-grained dataset lock based on blockid

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841779#comment-17841779 ] ASF GitHub Bot commented on HDFS-17496: --- hadoop-yetus commented on PR #6764: URL:

[jira] [Commented] (HDFS-13603) Warmup NameNode EDEK thread retries continuously if there's an invalid key

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841777#comment-17841777 ] ASF GitHub Bot commented on HDFS-13603: --- hadoop-yetus commented on PR #6774: URL:

[jira] [Commented] (HDFS-17497) Logic for committed blocks is mixed when computing file size

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841767#comment-17841767 ] ASF GitHub Bot commented on HDFS-17497: --- hadoop-yetus commented on PR #6765: URL:

[jira] [Commented] (HDFS-17452) DfsRouterAdmin RefreshCallQueue fails when authorization is enabled

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841683#comment-17841683 ] ASF GitHub Bot commented on HDFS-17452: --- hadoop-yetus commented on PR #6779: URL:

[jira] [Commented] (HDFS-17452) DfsRouterAdmin RefreshCallQueue fails when authorization is enabled

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841662#comment-17841662 ] ASF GitHub Bot commented on HDFS-17452: --- AnanyaSingh2121 opened a new pull request, #6779: URL:

[jira] [Updated] (HDFS-17452) DfsRouterAdmin RefreshCallQueue fails when authorization is enabled

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17452: -- Labels: pull-request-available (was: ) > DfsRouterAdmin RefreshCallQueue fails when

[jira] [Commented] (HDFS-17501) Add a parameter "redirectByIPAddress" to WebHDFS

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841659#comment-17841659 ] ASF GitHub Bot commented on HDFS-17501: --- hadoop-yetus commented on PR #6775: URL:

[jira] [Commented] (HDFS-17502) Adjust the log format of the printStatistics() in FSEditLog.java

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841658#comment-17841658 ] ASF GitHub Bot commented on HDFS-17502: --- hadoop-yetus commented on PR #6777: URL:

[jira] [Commented] (HDFS-17488) DN can fail IBRs with NPE when a volume is removed

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841657#comment-17841657 ] ASF GitHub Bot commented on HDFS-17488: --- kokonguyen191 commented on code in PR #6759: URL:

[jira] [Commented] (HDFS-17488) DN can fail IBRs with NPE when a volume is removed

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841656#comment-17841656 ] ASF GitHub Bot commented on HDFS-17488: --- kokonguyen191 commented on PR #6759: URL:

[jira] [Commented] (HDFS-17484) Introduce redundancy.considerLoad.minLoad to avoiding excluding nodes when they are not busy actually

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841652#comment-17841652 ] ASF GitHub Bot commented on HDFS-17484: --- Hexiaoqiao commented on PR #6758: URL:

[jira] [Commented] (HDFS-17488) DN can fail IBRs with NPE when a volume is removed

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841651#comment-17841651 ] ASF GitHub Bot commented on HDFS-17488: --- Hexiaoqiao commented on PR #6759: URL:

[jira] [Commented] (HDFS-17503) Unreleased volume references because of OOM

2024-04-28 Thread Jian Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841650#comment-17841650 ] Jian Zhang commented on HDFS-17503: --- Can you describe in detail how oom came about? > Unreleased

[jira] [Commented] (HDFS-17497) Logic for committed blocks is mixed when computing file size

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841647#comment-17841647 ] ASF GitHub Bot commented on HDFS-17497: --- Hexiaoqiao commented on PR #6765: URL:

[jira] [Commented] (HDFS-17502) Adjust the log format of the printStatistics() in FSEditLog.java

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841639#comment-17841639 ] ASF GitHub Bot commented on HDFS-17502: --- Hexiaoqiao closed pull request #6777: HDFS-17502. Adjust

[jira] [Commented] (HDFS-17502) Adjust the log format of the printStatistics() in FSEditLog.java

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841640#comment-17841640 ] ASF GitHub Bot commented on HDFS-17502: --- Hexiaoqiao commented on PR #6777: URL:

[jira] [Commented] (HDFS-17464) Improve some logs output in class FsDatasetImpl

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841623#comment-17841623 ] ASF GitHub Bot commented on HDFS-17464: --- hfutatzhanghb commented on code in PR #6724: URL:

[jira] [Commented] (HDFS-17464) Improve some logs output in class FsDatasetImpl

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841613#comment-17841613 ] ASF GitHub Bot commented on HDFS-17464: --- haiyang1987 commented on code in PR #6724: URL:

[jira] [Commented] (HDFS-17464) Improve some logs output in class FsDatasetImpl

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841614#comment-17841614 ] ASF GitHub Bot commented on HDFS-17464: --- haiyang1987 commented on code in PR #6724: URL:

[jira] [Commented] (HDFS-17488) DN can fail IBRs with NPE when a volume is removed

2024-04-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841612#comment-17841612 ] ASF GitHub Bot commented on HDFS-17488: --- haiyang1987 commented on code in PR #6759: URL:

[jira] [Assigned] (HDFS-17504) DN process should exit when BPServiceActor exit

2024-04-28 Thread Zilong Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zilong Zhu reassigned HDFS-17504: - Assignee: Zilong Zhu > DN process should exit when BPServiceActor exit >

[jira] [Created] (HDFS-17504) DN process should exit when BPServiceActor exit

2024-04-28 Thread Zilong Zhu (Jira)
Zilong Zhu created HDFS-17504: - Summary: DN process should exit when BPServiceActor exit Key: HDFS-17504 URL: https://issues.apache.org/jira/browse/HDFS-17504 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-17503) Unreleased volume references because of OOM

2024-04-28 Thread Zilong Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zilong Zhu updated HDFS-17503: -- Description: When BlockSender throws an error because of OOM,the volume reference obtained by the

[jira] [Assigned] (HDFS-17503) Unreleased volume references because of OOM

2024-04-28 Thread Zilong Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zilong Zhu reassigned HDFS-17503: - Assignee: Zilong Zhu > Unreleased volume references because of OOM >

[jira] [Updated] (HDFS-17503) Unreleased volume references because of OOM

2024-04-28 Thread Zilong Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zilong Zhu updated HDFS-17503: -- Summary: Unreleased volume references because of OOM (was: Unreleased volume references because of)

[jira] [Created] (HDFS-17503) Unreleased volume references because of

2024-04-28 Thread Zilong Zhu (Jira)
Zilong Zhu created HDFS-17503: - Summary: Unreleased volume references because of Key: HDFS-17503 URL: https://issues.apache.org/jira/browse/HDFS-17503 Project: Hadoop HDFS Issue Type: Bug