[jira] [Updated] (HDFS-17552) [ARR] RPC client uses CompletableFuture to support asynchronous operations.

2024-06-13 Thread Jian Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian Zhang updated HDFS-17552: -- Attachment: HDFS-17552.patch Status: Patch Available (was: Open) > [ARR] RPC client u

[jira] [Created] (HDFS-17552) [ARR] RPC client uses CompletableFuture to support asynchronous operations.

2024-06-13 Thread Jian Zhang (Jira)
Jian Zhang created HDFS-17552: - Summary: [ARR] RPC client uses CompletableFuture to support asynchronous operations. Key: HDFS-17552 URL: https://issues.apache.org/jira/browse/HDFS-17552 Project: Hadoop

[jira] [Commented] (HDFS-16757) Add a new method copyBlockCrossNamespace to DataNode

2024-06-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854762#comment-17854762 ] ASF GitHub Bot commented on HDFS-16757: --- hadoop-yetus commented on PR #6882: URL: https

[jira] [Commented] (HDFS-17439) Improve NNThroughputBenchmark to allow non super user to use the tool

2024-06-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854720#comment-17854720 ] ASF GitHub Bot commented on HDFS-17439: --- sodonnel commented on PR #6677: URL: https://github.com

[jira] [Commented] (HDFS-16757) Add a new method copyBlockCrossNamespace to DataNode

2024-06-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854710#comment-17854710 ] ASF GitHub Bot commented on HDFS-16757: --- hadoop-yetus commented on PR #6882: URL: https

[jira] [Commented] (HDFS-16757) Add a new method copyBlockCrossNamespace to DataNode

2024-06-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854674#comment-17854674 ] ASF GitHub Bot commented on HDFS-16757: --- hadoop-yetus commented on PR #6882: URL: https

[jira] [Commented] (HDFS-17534) RBF: Support leader follower mode for multiple subclusters

2024-06-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854646#comment-17854646 ] ASF GitHub Bot commented on HDFS-17534: --- hadoop-yetus commented on PR #6861: URL: https

[jira] [Commented] (HDFS-17546) Implementing Timeout for HostFileReader when FS hangs

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854619#comment-17854619 ] ASF GitHub Bot commented on HDFS-17546: --- hadoop-yetus commented on PR #6873: URL: https

[jira] [Commented] (HDFS-16757) Add a new method copyBlockCrossNamespace to DataNode

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854618#comment-17854618 ] ASF GitHub Bot commented on HDFS-16757: --- hadoop-yetus commented on PR #6882: URL: https

[jira] [Commented] (HDFS-16757) Add a new method copyBlockCrossNamespace to DataNode

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854617#comment-17854617 ] ASF GitHub Bot commented on HDFS-16757: --- hadoop-yetus commented on PR #6882: URL: https

[jira] [Commented] (HDFS-17534) RBF: Support leader follower mode for multiple subclusters

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854608#comment-17854608 ] ASF GitHub Bot commented on HDFS-17534: --- yuanboliu commented on code in PR #6861: URL: https

[jira] [Commented] (HDFS-17534) RBF: Support leader follower mode for multiple subclusters

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854609#comment-17854609 ] ASF GitHub Bot commented on HDFS-17534: --- yuanboliu commented on PR #6861: URL: https://github.com

[jira] [Commented] (HDFS-17534) RBF: Support leader follower mode for multiple subclusters

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854607#comment-17854607 ] ASF GitHub Bot commented on HDFS-17534: --- yuanboliu commented on code in PR #6861: URL: https

[jira] [Commented] (HDFS-17537) RBF : Last block report is incorrect in federationhealth.html

2024-06-12 Thread Ananya Singh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854603#comment-17854603 ] Ananya Singh commented on HDFS-17537: - [~ayushtkn] , can you please help review https://github.com

[jira] [Commented] (HDFS-17546) Implementing Timeout for HostFileReader when FS hangs

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854576#comment-17854576 ] ASF GitHub Bot commented on HDFS-17546: --- simbadzina commented on code in PR #6873: URL: https

[jira] [Commented] (HDFS-17546) Implementing Timeout for HostFileReader when FS hangs

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854543#comment-17854543 ] ASF GitHub Bot commented on HDFS-17546: --- hadoop-yetus commented on PR #6873: URL: https

[jira] [Commented] (HDFS-17518) In the lease monitor, if a file is closed, we should sync the editslog

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854515#comment-17854515 ] ASF GitHub Bot commented on HDFS-17518: --- vinayakumarb commented on code in PR #6809: URL: https

[jira] [Commented] (HDFS-17551) Fix unit test failure caused by HDFS-17464

2024-06-12 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854489#comment-17854489 ] Ayush Saxena commented on HDFS-17551: - Committed to trunk. Thanx [~zhanghaobo] for the contribution

[jira] [Commented] (HDFS-17551) Fix unit test failure caused by HDFS-17464

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854488#comment-17854488 ] ASF GitHub Bot commented on HDFS-17551: --- ayushtkn merged PR #6883: URL: https://github.com/apache

[jira] [Resolved] (HDFS-17551) Fix unit test failure caused by HDFS-17464

2024-06-12 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17551. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix unit t

[jira] [Commented] (HDFS-17551) Fix unit test failure caused by HDFS-17464

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854486#comment-17854486 ] ASF GitHub Bot commented on HDFS-17551: --- hadoop-yetus commented on PR #6883: URL: https

[jira] [Commented] (HDFS-16757) Add a new method copyBlockCrossNamespace to DataNode

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854475#comment-17854475 ] ASF GitHub Bot commented on HDFS-16757: --- hadoop-yetus commented on PR #6882: URL: https

[jira] [Commented] (HDFS-17098) DatanodeManager does not handle null storage type properly

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854465#comment-17854465 ] ASF GitHub Bot commented on HDFS-17098: --- hadoop-yetus commented on PR #6840: URL: https

[jira] [Updated] (HDFS-17523) Add fine-grained locks metrics in DataSetLockManager

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17523: -- Labels: pull-request-available (was: ) > Add fine-grained locks metr

[jira] [Commented] (HDFS-17523) Add fine-grained locks metrics in DataSetLockManager

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854456#comment-17854456 ] ASF GitHub Bot commented on HDFS-17523: --- ThinkerLei opened a new pull request, #6886: URL: https

[jira] [Commented] (HDFS-17098) DatanodeManager does not handle null storage type properly

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854367#comment-17854367 ] ASF GitHub Bot commented on HDFS-17098: --- Hexiaoqiao commented on PR #6840: URL: https://github.com

[jira] [Commented] (HDFS-17534) RBF: Support leader follower mode for multiple subclusters

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854359#comment-17854359 ] ASF GitHub Bot commented on HDFS-17534: --- kokonguyen191 commented on code in PR #6861: URL: https

[jira] [Updated] (HDFS-17551) Fix unit test failure caused by HDFS-17464

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17551: -- Labels: pull-request-available (was: ) > Fix unit test failure caused by HDFS-17

[jira] [Commented] (HDFS-17551) Fix unit test failure caused by HDFS-17464

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854352#comment-17854352 ] ASF GitHub Bot commented on HDFS-17551: --- hfutatzhanghb commented on PR #6883: URL: https

[jira] [Commented] (HDFS-17551) Fix unit test failure caused by HDFS-17464

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854350#comment-17854350 ] ASF GitHub Bot commented on HDFS-17551: --- hfutatzhanghb opened a new pull request, #6883: URL: https

[jira] [Created] (HDFS-17551) Fix unit test failure caused by HDFS-17464

2024-06-12 Thread farmmamba (Jira)
farmmamba created HDFS-17551: Summary: Fix unit test failure caused by HDFS-17464 Key: HDFS-17551 URL: https://issues.apache.org/jira/browse/HDFS-17551 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-17464) Improve some logs output in class FsDatasetImpl

2024-06-12 Thread farmmamba (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854304#comment-17854304 ] farmmamba commented on HDFS-17464: -- @Ayush Saxena (Jira) Sir, thanks for reminding me. Will fix it soon

[jira] [Commented] (HDFS-16757) Add a new method copyBlockCrossNamespace to DataNode

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854286#comment-17854286 ] ASF GitHub Bot commented on HDFS-16757: --- LiuGuH opened a new pull request, #6882: URL: https

[jira] [Commented] (HDFS-17528) FsImageValidation: set txid when saving a new image

2024-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854284#comment-17854284 ] ASF GitHub Bot commented on HDFS-17528: --- hadoop-yetus commented on PR #6828: URL: https

[jira] [Commented] (HDFS-17528) FsImageValidation: set txid when saving a new image

2024-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854249#comment-17854249 ] ASF GitHub Bot commented on HDFS-17528: --- ayushtkn commented on PR #6828: URL: https://github.com

[jira] [Commented] (HDFS-17464) Improve some logs output in class FsDatasetImpl

2024-06-11 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854246#comment-17854246 ] Ayush Saxena commented on HDFS-17464: - [~zhanghaobo] this seems to be leading to a test failure https

[jira] [Commented] (HDFS-17546) Implementing Timeout for HostFileReader when FS hangs

2024-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854245#comment-17854245 ] ASF GitHub Bot commented on HDFS-17546: --- hadoop-yetus commented on PR #6873: URL: https

[jira] [Commented] (HDFS-17254) DataNode httpServer has too many worker threads

2024-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854207#comment-17854207 ] ASF GitHub Bot commented on HDFS-17254: --- hadoop-yetus commented on PR #6307: URL: https

[jira] [Commented] (HDFS-17528) FsImageValidation: set txid when saving a new image

2024-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854206#comment-17854206 ] ASF GitHub Bot commented on HDFS-17528: --- hadoop-yetus commented on PR #6828: URL: https

[jira] [Commented] (HDFS-17546) Implementing Timeout for HostFileReader when FS hangs

2024-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854174#comment-17854174 ] ASF GitHub Bot commented on HDFS-17546: --- hadoop-yetus commented on PR #6873: URL: https

[jira] [Commented] (HDFS-17543) [ARR]: AsyncUtil makes asynchronous code more concise and easier.

2024-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854151#comment-17854151 ] ASF GitHub Bot commented on HDFS-17543: --- hadoop-yetus commented on PR #6868: URL: https

[jira] [Comment Edited] (HDFS-17535) I have confirmed the EC corrupt file, can this corrupt file be restored?

2024-06-11 Thread ruiliang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854008#comment-17854008 ] ruiliang edited comment on HDFS-17535 at 6/11/24 11:51 AM: --- [https://github.com

[jira] [Commented] (HDFS-17534) RBF: Support leader follower mode for multiple subclusters

2024-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854020#comment-17854020 ] ASF GitHub Bot commented on HDFS-17534: --- yuanboliu commented on PR #6861: URL: https://github.com

[jira] [Commented] (HDFS-17539) TestFileChecksum should not spin up a MiniDFSCluster for every test

2024-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854011#comment-17854011 ] ASF GitHub Bot commented on HDFS-17539: --- hadoop-yetus commented on PR #6853: URL: https

[jira] [Commented] (HDFS-17535) I have confirmed the EC corrupt file, can this corrupt file be restored?

2024-06-11 Thread ruiliang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854008#comment-17854008 ] ruiliang commented on HDFS-17535: - [https://github.com/liangrui1988/hadoop-client-op/blob/main/src/main

[jira] [Commented] (HDFS-17534) RBF: Support leader follower mode for multiple subclusters

2024-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853955#comment-17853955 ] ASF GitHub Bot commented on HDFS-17534: --- hadoop-yetus commented on PR #6861: URL: https

[jira] [Commented] (HDFS-17528) FsImageValidation: set txid when saving a new image

2024-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853948#comment-17853948 ] ASF GitHub Bot commented on HDFS-17528: --- hadoop-yetus commented on PR #6828: URL: https

[jira] [Resolved] (HDFS-17539) TestFileChecksum should not spin up a MiniDFSCluster for every test

2024-06-11 Thread ZanderXu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZanderXu resolved HDFS-17539. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > TestFileChecksum sho

[jira] [Commented] (HDFS-17539) TestFileChecksum should not spin up a MiniDFSCluster for every test

2024-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853939#comment-17853939 ] ASF GitHub Bot commented on HDFS-17539: --- ZanderXu merged PR #6853: URL: https://github.com/apache

[jira] [Commented] (HDFS-17539) TestFileChecksum should not spin up a MiniDFSCluster for every test

2024-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853940#comment-17853940 ] ASF GitHub Bot commented on HDFS-17539: --- ZanderXu commented on PR #6853: URL: https://github.com

[jira] [Commented] (HDFS-17543) [ARR]: AsyncUtil makes asynchronous code more concise and easier.

2024-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853931#comment-17853931 ] ASF GitHub Bot commented on HDFS-17543: --- hadoop-yetus commented on PR #6868: URL: https

[jira] [Moved] (HDFS-17550) EC: Support decommissioning DataNode by EC block reconstruction

2024-06-11 Thread Chenyu Zheng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenyu Zheng moved HADOOP-19202 to HDFS-17550: -- Key: HDFS-17550 (was: HADOOP-19202) Project: Hadoop HDFS

[jira] [Commented] (HDFS-17534) RBF: Support leader follower mode for multiple subclusters

2024-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853903#comment-17853903 ] ASF GitHub Bot commented on HDFS-17534: --- hadoop-yetus commented on PR #6861: URL: https

[jira] [Commented] (HDFS-17534) RBF: Support leader follower mode for multiple subclusters

2024-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853897#comment-17853897 ] ASF GitHub Bot commented on HDFS-17534: --- hadoop-yetus commented on PR #6861: URL: https

[jira] [Commented] (HDFS-17534) RBF: Support leader follower mode for multiple subclusters

2024-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853877#comment-17853877 ] ASF GitHub Bot commented on HDFS-17534: --- yuanboliu commented on code in PR #6861: URL: https

[jira] [Commented] (HDFS-17534) RBF: Support leader follower mode for multiple subclusters

2024-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853872#comment-17853872 ] ASF GitHub Bot commented on HDFS-17534: --- yuanboliu commented on code in PR #6861: URL: https

[jira] [Commented] (HDFS-17534) RBF: Support leader follower mode for multiple subclusters

2024-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853871#comment-17853871 ] ASF GitHub Bot commented on HDFS-17534: --- yuanboliu commented on code in PR #6861: URL: https

[jira] [Commented] (HDFS-17534) RBF: Support leader follower mode for multiple subclusters

2024-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853864#comment-17853864 ] ASF GitHub Bot commented on HDFS-17534: --- yuanboliu commented on code in PR #6861: URL: https

[jira] [Commented] (HDFS-17528) FsImageValidation: set txid when saving a new image

2024-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853854#comment-17853854 ] ASF GitHub Bot commented on HDFS-17528: --- szetszwo commented on PR #6828: URL: https://github.com

[jira] [Commented] (HDFS-17528) FsImageValidation: set txid when saving a new image

2024-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853853#comment-17853853 ] ASF GitHub Bot commented on HDFS-17528: --- slfan1989 commented on PR #6828: URL: https://github.com

[jira] [Commented] (HDFS-17098) DatanodeManager does not handle null storage type properly

2024-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853852#comment-17853852 ] ASF GitHub Bot commented on HDFS-17098: --- slfan1989 commented on PR #6840: URL: https://github.com

[jira] [Commented] (HDFS-17546) Implementing Timeout for HostFileReader when FS hangs

2024-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853830#comment-17853830 ] ASF GitHub Bot commented on HDFS-17546: --- hadoop-yetus commented on PR #6873: URL: https

[jira] [Commented] (HDFS-15042) Add more tests for ByteBufferPositionedReadable

2024-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853767#comment-17853767 ] ASF GitHub Bot commented on HDFS-15042: --- steveloughran commented on PR #1747: URL: https

[jira] [Commented] (HDFS-17543) [ARR]: AsyncUtil makes asynchronous code more concise and easier.

2024-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853715#comment-17853715 ] ASF GitHub Bot commented on HDFS-17543: --- hadoop-yetus commented on PR #6868: URL: https

[jira] [Commented] (HDFS-17543) [ARR]: AsyncUtil makes asynchronous code more concise and easier.

2024-06-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853707#comment-17853707 ] ASF GitHub Bot commented on HDFS-17543: --- hadoop-yetus commented on PR #6868: URL: https

[jira] [Commented] (HDFS-17098) DatanodeManager does not handle null storage type properly

2024-06-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853498#comment-17853498 ] ASF GitHub Bot commented on HDFS-17098: --- GauthamBanasandra commented on PR #6840: URL: https

[jira] [Commented] (HDFS-17534) RBF: Support leader follower mode for multiple subclusters

2024-06-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853323#comment-17853323 ] ASF GitHub Bot commented on HDFS-17534: --- goiri commented on code in PR #6861: URL: https

[jira] [Created] (HDFS-17549) SecretManager should not hardcode HMAC algorithm

2024-06-07 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDFS-17549: - Summary: SecretManager should not hardcode HMAC algorithm Key: HDFS-17549 URL: https://issues.apache.org/jira/browse/HDFS-17549 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-17548) excessive NO_REQUIRED_STORAGE_TYPE messages

2024-06-07 Thread Szymon Orzechowski (Jira)
Szymon Orzechowski created HDFS-17548: - Summary: excessive NO_REQUIRED_STORAGE_TYPE messages Key: HDFS-17548 URL: https://issues.apache.org/jira/browse/HDFS-17548 Project: Hadoop HDFS

[jira] [Commented] (HDFS-17438) RBF: The newest STANDBY and UNAVAILABLE nn should be the lowest priority.

2024-06-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853118#comment-17853118 ] ASF GitHub Bot commented on HDFS-17438: --- KeeProMise commented on PR #6655: URL: https://github.com

[jira] [Commented] (HDFS-17543) [ARR]: AsyncUtil makes asynchronous code more concise and easier.

2024-06-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853088#comment-17853088 ] ASF GitHub Bot commented on HDFS-17543: --- hadoop-yetus commented on PR #6868: URL: https

[jira] [Commented] (HDFS-17543) [ARR]: AsyncUtil makes asynchronous code more concise and easier.

2024-06-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853085#comment-17853085 ] ASF GitHub Bot commented on HDFS-17543: --- hadoop-yetus commented on PR #6868: URL: https

[jira] [Commented] (HDFS-17543) [ARR]: AsyncUtil makes asynchronous code more concise and easier.

2024-06-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853081#comment-17853081 ] ASF GitHub Bot commented on HDFS-17543: --- hadoop-yetus commented on PR #6868: URL: https

[jira] [Updated] (HDFS-17542) EC: Optimize the EC block reconstruction.

2024-06-07 Thread Chenyu Zheng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenyu Zheng updated HDFS-17542: Description: The current reconstruction process of EC blocks is based on the original contiguous

[jira] [Updated] (HDFS-17547) debug verifyEC check error

2024-06-07 Thread ruiliang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ruiliang updated HDFS-17547: Attachment: image-2024-06-07-16-02-07-480.png Description: When I validate a block that has been

[jira] (HDFS-15759) EC: Verify EC reconstruction correctness on DataNode

2024-06-07 Thread ruiliang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15759 ] ruiliang deleted comment on HDFS-15759: - was (Author: ruilaing): When I validate a block that has been corrupted many times, does it appear normal? ByteBuffer hb show [0..] {code:java

[jira] [Created] (HDFS-17547) debug verifyEC check error

2024-06-07 Thread ruiliang (Jira)
ruiliang created HDFS-17547: --- Summary: debug verifyEC check error Key: HDFS-17547 URL: https://issues.apache.org/jira/browse/HDFS-17547 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Comment Edited] (HDFS-15759) EC: Verify EC reconstruction correctness on DataNode

2024-06-07 Thread ruiliang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853065#comment-17853065 ] ruiliang edited comment on HDFS-15759 at 6/7/24 7:55 AM: - When I validate a block

[jira] [Comment Edited] (HDFS-15759) EC: Verify EC reconstruction correctness on DataNode

2024-06-07 Thread ruiliang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853065#comment-17853065 ] ruiliang edited comment on HDFS-15759 at 6/7/24 7:54 AM: - When I validate a block

[jira] [Commented] (HDFS-15759) EC: Verify EC reconstruction correctness on DataNode

2024-06-07 Thread ruiliang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853065#comment-17853065 ] ruiliang commented on HDFS-15759: - When I validate a block that has been corrupted many times, does

[jira] [Commented] (HDFS-16479) EC: NameNode should not send a reconstruction work when the source datanodes are insufficient

2024-06-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853043#comment-17853043 ] ASF GitHub Bot commented on HDFS-16479: --- zhengchenyu commented on PR #4138: URL: https://github.com

[jira] [Commented] (HDFS-17531) RBF: Asynchronous router RPC

2024-06-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853001#comment-17853001 ] ASF GitHub Bot commented on HDFS-17531: --- KeeProMise closed pull request #6838: HDFS-17531. [Discuss

[jira] [Commented] (HDFS-17531) RBF: Asynchronous router RPC

2024-06-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853002#comment-17853002 ] ASF GitHub Bot commented on HDFS-17531: --- KeeProMise commented on PR #6838: URL: https://github.com

[jira] [Commented] (HDFS-17531) RBF: Asynchronous router RPC

2024-06-06 Thread Jian Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853000#comment-17853000 ] Jian Zhang commented on HDFS-17531: --- Thank you again for your attention. I will split this huge PR

[jira] [Commented] (HDFS-17545) [ARR] router async rpc client.

2024-06-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852999#comment-17852999 ] ASF GitHub Bot commented on HDFS-17545: --- KeeProMise commented on PR #6871: URL: https://github.com

[jira] [Commented] (HDFS-17544) [ARR] The router client rpc protocol supports asynchrony.

2024-06-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852997#comment-17852997 ] ASF GitHub Bot commented on HDFS-17544: --- KeeProMise commented on PR #6870: URL: https://github.com

[jira] [Commented] (HDFS-17543) [ARR]: AsyncUtil makes asynchronous code more concise and easier.

2024-06-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852995#comment-17852995 ] ASF GitHub Bot commented on HDFS-17543: --- KeeProMise commented on code in PR #6868: URL: https

[jira] [Commented] (HDFS-17544) [ARR] The router client rpc protocol supports asynchrony.

2024-06-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852992#comment-17852992 ] ASF GitHub Bot commented on HDFS-17544: --- hfutatzhanghb commented on PR #6870: URL: https

[jira] [Updated] (HDFS-17546) Implementing Timeout for HostFileReader when FS hangs

2024-06-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17546: -- Labels: pull-request-available (was: ) > Implementing Timeout for HostFileReader when

[jira] [Commented] (HDFS-17546) Implementing Timeout for HostFileReader when FS hangs

2024-06-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852960#comment-17852960 ] ASF GitHub Bot commented on HDFS-17546: --- NyteKnight opened a new pull request, #6873: URL: https

[jira] [Created] (HDFS-17546) Implementing Timeout for HostFileReader when FS hangs

2024-06-06 Thread Simbarashe Dzinamarira (Jira)
Simbarashe Dzinamarira created HDFS-17546: - Summary: Implementing Timeout for HostFileReader when FS hangs Key: HDFS-17546 URL: https://issues.apache.org/jira/browse/HDFS-17546 Project: Hadoop

[jira] [Commented] (HDFS-17534) RBF: Support leader follower mode for multiple subclusters

2024-06-06 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852949#comment-17852949 ] Simbarashe Dzinamarira commented on HDFS-17534: --- Could you please add more information

[jira] [Commented] (HDFS-17544) [ARR] The router client rpc protocol supports asynchrony.

2024-06-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852855#comment-17852855 ] ASF GitHub Bot commented on HDFS-17544: --- KeeProMise closed pull request #6870: HDFS-17544. [ARR

[jira] [Commented] (HDFS-17544) [ARR] The router client rpc protocol supports asynchrony.

2024-06-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852856#comment-17852856 ] ASF GitHub Bot commented on HDFS-17544: --- KeeProMise opened a new pull request, #6870: URL: https

[jira] [Updated] (HDFS-17544) [ARR] The router client rpc protocol supports asynchrony.

2024-06-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17544: -- Labels: pull-request-available (was: ) > [ARR] The router client rpc protocol suppo

[jira] [Updated] (HDFS-17545) [ARR] router async rpc client.

2024-06-06 Thread Jian Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian Zhang updated HDFS-17545: -- Description: *Describe* 1. Mainly using AsyncUtil to implement {*}RouterAsyncRpcClient{*}, this class

[jira] [Updated] (HDFS-17545) [ARR] router async rpc client.

2024-06-06 Thread Jian Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian Zhang updated HDFS-17545: -- Description: *Describe* 1. Mainly using AsyncUtil to implement {*}RouterAsyncRpcClient{*}, this class

[jira] [Commented] (HDFS-17543) [ARR]: AsyncUtil makes asynchronous code more concise and easier.

2024-06-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852850#comment-17852850 ] ASF GitHub Bot commented on HDFS-17543: --- hadoop-yetus commented on PR #6868: URL: https

[jira] [Updated] (HDFS-17545) [ARR] router async rpc client.

2024-06-06 Thread Jian Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian Zhang updated HDFS-17545: -- Description: *Describe* Mainly implementing RouterAsyncRpcClien > [ARR] router async rpc cli

[jira] [Commented] (HDFS-17545) [ARR] router async rpc client.

2024-06-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852846#comment-17852846 ] ASF GitHub Bot commented on HDFS-17545: --- KeeProMise opened a new pull request, #6871: URL: https

<    2   3   4   5   6   7   8   9   10   11   >