[jira] [Commented] (HDFS-17569) Setup Effective Work Number when Generating Block Reconstruction Work

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864252#comment-17864252 ] ASF GitHub Bot commented on HDFS-17569: --- hadoop-yetus commented on PR #6924:

[jira] [Commented] (HDFS-17569) Setup Effective Work Number when Generating Block Reconstruction Work

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864247#comment-17864247 ] ASF GitHub Bot commented on HDFS-17569: --- hadoop-yetus commented on PR #6924:

[jira] [Created] (HDFS-17575) SaslDataTransferClient should use SaslParticipant to create messages

2024-07-09 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDFS-17575: - Summary: SaslDataTransferClient should use SaslParticipant to create messages Key: HDFS-17575 URL: https://issues.apache.org/jira/browse/HDFS-17575 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-10535) Rename AsyncDistributedFileSystem

2024-07-09 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze resolved HDFS-10535. --- Resolution: Won't Fix This JIRA became stale. > Rename AsyncDistributedFi

[jira] [Resolved] (HDFS-11948) Ozone: change TestRatisManager to check cluster with data

2024-07-09 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze resolved HDFS-11948. --- Resolution: Won't Fix This JIRA became stale. > Ozone: change TestRatisManager to check

[jira] [Resolved] (HDFS-11734) Ozone: provide a way to validate ContainerCommandRequestProto

2024-07-09 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze resolved HDFS-11734. --- Resolution: Won't Fix This JIRA became stale. > Ozone: provide a way to

[jira] [Resolved] (HDFS-11735) Ozone: In Ratis, leader should validate ContainerCommandRequestProto before propagating it to followers

2024-07-09 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze resolved HDFS-11735. --- Resolution: Won't Fix This JIRA became stale. > Ozone: In Ratis, leader should

[jira] [Updated] (HDFS-4114) Remove the BackupNode and CheckpointNode from trunk

2024-07-09 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-4114: - Target Version/s: (was: ) Resolution: Won't Fix Status: Resolved (was:

[jira] [Commented] (HDFS-17569) Setup Effective Work Number when Generating Block Reconstruction Work

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864201#comment-17864201 ] ASF GitHub Bot commented on HDFS-17569: --- hadoop-yetus commented on PR #6924:

[jira] [Commented] (HDFS-17565) EC: dfs.datanode.ec.reconstruction.threads should support dynamic reconfigured.

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864197#comment-17864197 ] ASF GitHub Bot commented on HDFS-17565: --- hadoop-yetus commented on PR #6928:

[jira] [Updated] (HDFS-17574) Make NNThroughputBenchmark support argument blockSize suffix with k, m, g, t, p, e

2024-07-09 Thread wangzhongwei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangzhongwei updated HDFS-17574: Description:       As of now,We can not specify data units while specifying the -blockSize as

[jira] [Updated] (HDFS-17574) Make NNThroughputBenchmark support argument blockSize suffix with k, m, g, t, p, e

2024-07-09 Thread wangzhongwei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangzhongwei updated HDFS-17574: Status: Patch Available (was: Open) > Make NNThroughputBenchmark support argument blockS

[jira] [Commented] (HDFS-17574) Make NNThroughputBenchmark support argument blockSize suffix with k, m, g, t, p, e

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864169#comment-17864169 ] ASF GitHub Bot commented on HDFS-17574: --- granewang opened a new pull req

[jira] [Updated] (HDFS-17574) Make NNThroughputBenchmark support argument blockSize suffix with k, m, g, t, p, e

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17574: -- Labels: pull-request-available (was: ) > Make NNThroughputBenchmark support argum

[jira] [Commented] (HDFS-17566) Got wrong sorted block order when StorageType is considered.

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864162#comment-17864162 ] ASF GitHub Bot commented on HDFS-17566: --- hadoop-yetus commented on PR #6919:

[jira] [Created] (HDFS-17574) Make NNThroughputBenchmark support argument blockSize suffix with k, m, g, t, p, e

2024-07-09 Thread wangzhongwei (Jira)
wangzhongwei created HDFS-17574: --- Summary: Make NNThroughputBenchmark support argument blockSize suffix with k, m, g, t, p, e Key: HDFS-17574 URL: https://issues.apache.org/jira/browse/HDFS-17574

[jira] [Commented] (HDFS-17566) Got wrong sorted block order when StorageType is considered.

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864154#comment-17864154 ] ASF GitHub Bot commented on HDFS-17566: --- zhengchenyu commented on PR #6919:

[jira] [Commented] (HDFS-17566) Got wrong sorted block order when StorageType is considered.

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864152#comment-17864152 ] ASF GitHub Bot commented on HDFS-17566: --- hadoop-yetus commented on PR #6919:

[jira] [Commented] (HDFS-17566) Got wrong sorted block order when StorageType is considered.

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864148#comment-17864148 ] ASF GitHub Bot commented on HDFS-17566: --- hadoop-yetus commented on PR #6919:

[jira] [Commented] (HDFS-17566) Got wrong sorted block order when StorageType is considered.

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864138#comment-17864138 ] ASF GitHub Bot commented on HDFS-17566: --- hadoop-yetus commented on PR #6919:

[jira] [Commented] (HDFS-17566) Got wrong sorted block order when StorageType is considered.

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864134#comment-17864134 ] ASF GitHub Bot commented on HDFS-17566: --- Hexiaoqiao commented on PR #6919:

[jira] [Commented] (HDFS-16714) Remove okhttp and kotlin dependencies

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864116#comment-17864116 ] ASF GitHub Bot commented on HDFS-16714: --- pan3793 closed pull request #4684:

[jira] [Commented] (HDFS-16714) Remove okhttp and kotlin dependencies

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864117#comment-17864117 ] ASF GitHub Bot commented on HDFS-16714: --- pan3793 commented on PR #4684: URL: h

[jira] [Commented] (HDFS-16714) Remove okhttp and kotlin dependencies

2024-07-09 Thread Cheng Pan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864115#comment-17864115 ] Cheng Pan commented on HDFS-16714: -- Completed by HADOOP-18890, except for transi

[jira] [Resolved] (HDFS-16714) Remove okhttp and kotlin dependencies

2024-07-09 Thread Cheng Pan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Pan resolved HDFS-16714. -- Resolution: Duplicate > Remove okhttp and kotlin dependenc

[jira] [Commented] (HDFS-17569) Setup Effective Work Number when Generating Block Reconstruction Work

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864104#comment-17864104 ] ASF GitHub Bot commented on HDFS-17569: --- VicoWu opened a new pull request, #

[jira] [Commented] (HDFS-17544) [ARR] The router client rpc protocol PB supports asynchrony.

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864095#comment-17864095 ] ASF GitHub Bot commented on HDFS-17544: --- KeeProMise commented on PR #6870:

[jira] [Commented] (HDFS-17561) Make HeartbeatManager.Monitor use up-to-date heartbeatRecheckInterval

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864085#comment-17864085 ] ASF GitHub Bot commented on HDFS-17561: --- hadoop-yetus commented on PR #6909:

[jira] [Updated] (HDFS-17544) [ARR] The router client rpc protocol PB supports asynchrony.

2024-07-09 Thread Jian Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian Zhang updated HDFS-17544: -- Summary: [ARR] The router client rpc protocol PB supports asynchrony. (was: [ARR] The router client

[jira] [Updated] (HDFS-17544) [ARR] The router client rpc protocol supports asynchrony.

2024-07-09 Thread Jian Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian Zhang updated HDFS-17544: -- Description: *Describe* In order not to affect other modules, when implementing router asynchronous

[jira] [Updated] (HDFS-17544) [ARR] The router client rpc protocol supports asynchrony.

2024-07-09 Thread Jian Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian Zhang updated HDFS-17544: -- Description: *Describe* In order not to affect other modules, when implementing router asynchronous

[jira] [Commented] (HDFS-17544) [ARR] The router client rpc protocol supports asynchrony.

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864079#comment-17864079 ] ASF GitHub Bot commented on HDFS-17544: --- KeeProMise commented on PR #6870:

[jira] [Commented] (HDFS-17565) EC: dfs.datanode.ec.reconstruction.threads should support dynamic reconfigured.

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864070#comment-17864070 ] ASF GitHub Bot commented on HDFS-17565: --- zhengchenyu commented on code in PR #

[jira] [Commented] (HDFS-17565) EC: dfs.datanode.ec.reconstruction.threads should support dynamic reconfigured.

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864068#comment-17864068 ] ASF GitHub Bot commented on HDFS-17565: --- zhengchenyu commented on code in PR #

[jira] [Updated] (HDFS-17534) RBF: Support leader follower mode for multiple subclusters

2024-07-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-17534: Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Release Note: Adds new Mount Table mode

[jira] [Commented] (HDFS-17534) RBF: Support leader follower mode for multiple subclusters

2024-07-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864064#comment-17864064 ] Ayush Saxena commented on HDFS-17534: - Committed to trunk. Thanx [~yuanbo] for

[jira] [Commented] (HDFS-17534) RBF: Support leader follower mode for multiple subclusters

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864063#comment-17864063 ] ASF GitHub Bot commented on HDFS-17534: --- ayushtkn merged PR #6861: URL: h

[jira] [Commented] (HDFS-17565) EC: dfs.datanode.ec.reconstruction.threads should support dynamic reconfigured.

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864061#comment-17864061 ] ASF GitHub Bot commented on HDFS-17565: --- ayushtkn commented on code in PR #

[jira] [Commented] (HDFS-17555) Fix NumberFormatException of NNThroughputBenchmark when configured dfs.blocksize.

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864057#comment-17864057 ] ASF GitHub Bot commented on HDFS-17555: --- ayushtkn merged PR #6894: URL: h

[jira] [Updated] (HDFS-17555) Fix NumberFormatException of NNThroughputBenchmark when configured dfs.blocksize.

2024-07-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-17555: Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed Status

[jira] [Commented] (HDFS-17555) Fix NumberFormatException of NNThroughputBenchmark when configured dfs.blocksize.

2024-07-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864058#comment-17864058 ] Ayush Saxena commented on HDFS-17555: - Committed to trunk. Thanx [~zhongwei11]

[jira] [Commented] (HDFS-17573) Add test code for FSImage parallelization and compression

2024-07-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864003#comment-17864003 ] ASF GitHub Bot commented on HDFS-17573: --- Last-remote11 closed pull request #

[jira] [Commented] (HDFS-17573) Add test code for FSImage parallelization and compression

2024-07-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864004#comment-17864004 ] ASF GitHub Bot commented on HDFS-17573: --- Last-remote11 opened a new pull req

[jira] [Commented] (HDFS-17565) EC: dfs.datanode.ec.reconstruction.threads should support dynamic reconfigured.

2024-07-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863996#comment-17863996 ] ASF GitHub Bot commented on HDFS-17565: --- zhengchenyu commented on code in PR #

[jira] [Commented] (HDFS-17561) Make HeartbeatManager.Monitor use up-to-date heartbeatRecheckInterval

2024-07-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863988#comment-17863988 ] ASF GitHub Bot commented on HDFS-17561: --- kokon191 commented on code in PR #

[jira] [Commented] (HDFS-17566) Got wrong sorted block order when StorageType is considered.

2024-07-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863967#comment-17863967 ] ASF GitHub Bot commented on HDFS-17566: --- slfan1989 commented on PR #6919:

[jira] [Commented] (HDFS-17523) Add fine-grained locks metrics in DataSetLockManager

2024-07-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863966#comment-17863966 ] ASF GitHub Bot commented on HDFS-17523: --- slfan1989 commented on code in PR #

[jira] [Commented] (HDFS-17523) Add fine-grained locks metrics in DataSetLockManager

2024-07-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863965#comment-17863965 ] ASF GitHub Bot commented on HDFS-17523: --- slfan1989 commented on code in PR #

[jira] [Commented] (HDFS-17523) Add fine-grained locks metrics in DataSetLockManager

2024-07-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863964#comment-17863964 ] ASF GitHub Bot commented on HDFS-17523: --- slfan1989 commented on code in PR #

[jira] [Commented] (HDFS-17573) Add test code for FSImage parallelization and compression

2024-07-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863957#comment-17863957 ] ASF GitHub Bot commented on HDFS-17573: --- hadoop-yetus commented on PR #6929:

[jira] [Updated] (HDFS-17573) Add test code for FSImage parallelization and compression

2024-07-08 Thread Sungdong Kim (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sungdong Kim updated HDFS-17573: Description: The feature added HDFS-14617(in Improve FSImage load time by writing sub-sections to

[jira] [Updated] (HDFS-17573) Add test code for FSImage parallelization and compression

2024-07-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17573: -- Labels: pull-request-available (was: ) > Add test code for FSImage parallelization

[jira] [Commented] (HDFS-17573) Add test code for FSImage parallelization and compression

2024-07-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863842#comment-17863842 ] ASF GitHub Bot commented on HDFS-17573: --- Last-remote11 opened a new pull req

[jira] [Commented] (HDFS-17565) EC: dfs.datanode.ec.reconstruction.threads should support dynamic reconfigured.

2024-07-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863841#comment-17863841 ] ASF GitHub Bot commented on HDFS-17565: --- zeekling commented on code in PR #

[jira] [Updated] (HDFS-17573) Add test code for FSImage parallelization and compression

2024-07-08 Thread Sungdong Kim (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sungdong Kim updated HDFS-17573: Description: The feature added HDFS-14617(in Improve FSImage load time by writing sub-sections to

[jira] [Created] (HDFS-17573) Add test code for FSImage parallelization and compression

2024-07-08 Thread Sungdong Kim (Jira)
Sungdong Kim created HDFS-17573: --- Summary: Add test code for FSImage parallelization and compression Key: HDFS-17573 URL: https://issues.apache.org/jira/browse/HDFS-17573 Project: Hadoop HDFS

[jira] [Commented] (HDFS-17566) Got wrong sorted block order when StorageType is considered.

2024-07-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863810#comment-17863810 ] ASF GitHub Bot commented on HDFS-17566: --- zhengchenyu opened a new pull req

[jira] [Commented] (HDFS-17566) Got wrong sorted block order when StorageType is considered.

2024-07-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863809#comment-17863809 ] ASF GitHub Bot commented on HDFS-17566: --- zhengchenyu closed pull request #

[jira] [Commented] (HDFS-17565) EC: dfs.datanode.ec.reconstruction.threads should support dynamic reconfigured.

2024-07-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863789#comment-17863789 ] ASF GitHub Bot commented on HDFS-17565: --- hadoop-yetus commented on PR #6928:

[jira] [Commented] (HDFS-17568) [Decommission]Show Info Log for Repeated Useless refreshNode Operation

2024-07-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863768#comment-17863768 ] ASF GitHub Bot commented on HDFS-17568: --- VicoWu closed pull request #6921:

[jira] [Commented] (HDFS-17568) [Decommission]Show Info Log for Repeated Useless refreshNode Operation

2024-07-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863719#comment-17863719 ] ASF GitHub Bot commented on HDFS-17568: --- hadoop-yetus commented on PR #6921:

[jira] [Commented] (HDFS-17565) EC: dfs.datanode.ec.reconstruction.threads should support dynamic reconfigured.

2024-07-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863710#comment-17863710 ] ASF GitHub Bot commented on HDFS-17565: --- zhengchenyu opened a new pull req

[jira] [Updated] (HDFS-17565) EC: dfs.datanode.ec.reconstruction.threads should support dynamic reconfigured.

2024-07-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17565: -- Labels: pull-request-available (was: ) > EC: dfs.datanode.ec.reconstruction.threads sho

[jira] [Updated] (HDFS-17550) EC: Support decommissioning DataNode by EC block reconstruction

2024-07-08 Thread Chenyu Zheng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenyu Zheng updated HDFS-17550: Description: By enabling reconstruction to decommissioning datanode, the speed increased by 12

[jira] [Updated] (HDFS-17550) EC: Support decommissioning DataNode by EC block reconstruction

2024-07-08 Thread Chenyu Zheng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenyu Zheng updated HDFS-17550: Description: By enabling reconstruction to decommissioning datanode, the speed increased by 12

[jira] [Updated] (HDFS-17550) EC: Support decommissioning DataNode by EC block reconstruction

2024-07-08 Thread Chenyu Zheng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenyu Zheng updated HDFS-17550: Description: By enabling reconstruction to decommissioning datanode, the speed increased by 12

[jira] [Commented] (HDFS-17098) DatanodeManager does not handle null storage type properly

2024-07-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863680#comment-17863680 ] ASF GitHub Bot commented on HDFS-17098: --- Hexiaoqiao commented on PR #6840:

[jira] [Commented] (HDFS-17566) Got wrong sorted block order when StorageType is considered.

2024-07-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863679#comment-17863679 ] ASF GitHub Bot commented on HDFS-17566: --- hadoop-yetus commented on PR #6919:

[jira] [Commented] (HDFS-17566) Got wrong sorted block order when StorageType is considered.

2024-07-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863678#comment-17863678 ] ASF GitHub Bot commented on HDFS-17566: --- Hexiaoqiao commented on PR #6919:

[jira] [Commented] (HDFS-17566) Got wrong sorted block order when StorageType is considered.

2024-07-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863676#comment-17863676 ] ASF GitHub Bot commented on HDFS-17566: --- hadoop-yetus commented on PR #6919:

[jira] [Resolved] (HDFS-17571) TestDatanodeManager#testGetBlockLocationConsiderStorageType is flaky

2024-07-07 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17571. - Resolution: Duplicate > TestDatanodeManager#testGetBlockLocationConsiderStorageType is fl

[jira] [Commented] (HDFS-17569) Setup Effective Work Number when Generating Block Reconstruction Work

2024-07-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863674#comment-17863674 ] ASF GitHub Bot commented on HDFS-17569: --- VicoWu closed pull request #6924:

[jira] [Commented] (HDFS-17567) Return value of method RouterRpcClient#invokeSequential is not accurate

2024-07-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863661#comment-17863661 ] ASF GitHub Bot commented on HDFS-17567: --- hfutatzhanghb commented on PR #6923:

[jira] [Commented] (HDFS-17552) [ARR] IPC client uses CompletableFuture to support asynchronous operations.

2024-07-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863646#comment-17863646 ] ASF GitHub Bot commented on HDFS-17552: --- KeeProMise commented on PR #6888:

[jira] [Commented] (HDFS-16757) Add a new method copyBlockCrossNamespace to DataNode

2024-07-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863641#comment-17863641 ] ASF GitHub Bot commented on HDFS-16757: --- LiuGuH commented on PR #6926: URL: h

[jira] [Commented] (HDFS-16757) Add a new method copyBlockCrossNamespace to DataNode

2024-07-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863640#comment-17863640 ] ASF GitHub Bot commented on HDFS-16757: --- LiuGuH commented on PR #6926: URL: h

[jira] [Commented] (HDFS-17555) Fix NumberFormatException of NNThroughputBenchmark when configured dfs.blocksize.

2024-07-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863582#comment-17863582 ] ASF GitHub Bot commented on HDFS-17555: --- hadoop-yetus commented on PR #6894:

[jira] [Commented] (HDFS-17561) Make HeartbeatManager.Monitor use up-to-date heartbeatRecheckInterval

2024-07-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863581#comment-17863581 ] ASF GitHub Bot commented on HDFS-17561: --- zeekling commented on code in PR #

[jira] [Commented] (HDFS-16757) Add a new method copyBlockCrossNamespace to DataNode

2024-07-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863572#comment-17863572 ] ASF GitHub Bot commented on HDFS-16757: --- zeekling commented on PR #6926:

[jira] [Commented] (HDFS-17555) Fix NumberFormatException of NNThroughputBenchmark when configured dfs.blocksize.

2024-07-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863530#comment-17863530 ] ASF GitHub Bot commented on HDFS-17555: --- hadoop-yetus commented on PR #6894:

[jira] [Commented] (HDFS-17555) Fix NumberFormatException of NNThroughputBenchmark when configured dfs.blocksize.

2024-07-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863529#comment-17863529 ] ASF GitHub Bot commented on HDFS-17555: --- hadoop-yetus commented on PR #6894:

[jira] [Commented] (HDFS-17555) Fix NumberFormatException of NNThroughputBenchmark when configured dfs.blocksize.

2024-07-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863499#comment-17863499 ] ASF GitHub Bot commented on HDFS-17555: --- granewang commented on PR #6894:

[jira] [Commented] (HDFS-17568) [Decommission]Show Info Log for Repeated Useless refreshNode Operation

2024-07-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863467#comment-17863467 ] ASF GitHub Bot commented on HDFS-17568: --- hadoop-yetus commented on PR #6921:

[jira] [Commented] (HDFS-17557) Fix bug for TestRedundancyMonitor#testChooseTargetWhenAllDataNodesStop

2024-07-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863455#comment-17863455 ] ASF GitHub Bot commented on HDFS-17557: --- haiyang1987 commented on PR #6897:

[jira] [Commented] (HDFS-17559) Fix the uuid as null in NameNodeMXBean

2024-07-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863454#comment-17863454 ] ASF GitHub Bot commented on HDFS-17559: --- haiyang1987 commented on PR #6906:

[jira] [Commented] (HDFS-17557) Fix bug for TestRedundancyMonitor#testChooseTargetWhenAllDataNodesStop

2024-07-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863451#comment-17863451 ] Ayush Saxena commented on HDFS-17557: - Committed to trunk. Thanx [~haiyang Hu]

[jira] [Resolved] (HDFS-17557) Fix bug for TestRedundancyMonitor#testChooseTargetWhenAllDataNodesStop

2024-07-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-17557. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix bug

[jira] [Commented] (HDFS-17557) Fix bug for TestRedundancyMonitor#testChooseTargetWhenAllDataNodesStop

2024-07-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863450#comment-17863450 ] ASF GitHub Bot commented on HDFS-17557: --- ayushtkn merged PR #6897: URL: h

[jira] [Commented] (HDFS-17559) Fix the uuid as null in NameNodeMXBean

2024-07-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863449#comment-17863449 ] Ayush Saxena commented on HDFS-17559: - Committed to trunk. Thanx [~haiyang Hu]

[jira] [Commented] (HDFS-17559) Fix the uuid as null in NameNodeMXBean

2024-07-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863448#comment-17863448 ] ASF GitHub Bot commented on HDFS-17559: --- ayushtkn merged PR #6906: URL: h

[jira] [Commented] (HDFS-17555) Fix NumberFormatException of NNThroughputBenchmark when configured dfs.blocksize.

2024-07-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863445#comment-17863445 ] ASF GitHub Bot commented on HDFS-17555: --- ayushtkn commented on PR #6894:

[jira] [Commented] (HDFS-17570) Respect Non-Default HADOOP_ROOT_LOGGER when HADOOP_DAEMON_ROOT_LOGGER is not specified in Daemon mode

2024-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863436#comment-17863436 ] ASF GitHub Bot commented on HDFS-17570: --- hadoop-yetus commented on PR #6922:

[jira] [Commented] (HDFS-17564) EC: Fix the issue of inaccurate metrics when decommission mark busy DN

2024-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863435#comment-17863435 ] ASF GitHub Bot commented on HDFS-17564: --- haiyang1987 commented on PR #6911:

[jira] [Commented] (HDFS-16757) Add a new method copyBlockCrossNamespace to DataNode

2024-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863372#comment-17863372 ] ASF GitHub Bot commented on HDFS-16757: --- hadoop-yetus commented on PR #6926:

[jira] [Commented] (HDFS-17555) Fix NumberFormatException of NNThroughputBenchmark when configured dfs.blocksize.

2024-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863355#comment-17863355 ] ASF GitHub Bot commented on HDFS-17555: --- hadoop-yetus commented on PR #6894:

[jira] [Commented] (HDFS-17555) Fix NumberFormatException of NNThroughputBenchmark when configured dfs.blocksize.

2024-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863352#comment-17863352 ] ASF GitHub Bot commented on HDFS-17555: --- hadoop-yetus commented on PR #6894:

[jira] [Commented] (HDFS-17559) Fix the uuid as null in NameNodeMXBean

2024-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863345#comment-17863345 ] ASF GitHub Bot commented on HDFS-17559: --- hadoop-yetus commented on PR #6906:

[jira] [Commented] (HDFS-17571) TestDatanodeManager#testGetBlockLocationConsiderStorageType is flaky

2024-07-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863234#comment-17863234 ] Ayush Saxena commented on HDFS-17571: - Suspecting HDFS-17098, to be the reason,

[jira] [Commented] (HDFS-17098) DatanodeManager does not handle null storage type properly

2024-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863233#comment-17863233 ] ASF GitHub Bot commented on HDFS-17098: --- ayushtkn commented on PR #6840:

[jira] [Commented] (HDFS-17564) EC: Fix the issue of inaccurate metrics when decommission mark busy DN

2024-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863228#comment-17863228 ] ASF GitHub Bot commented on HDFS-17564: --- Hexiaoqiao commented on PR #6911:

<    4   5   6   7   8   9   10   11   12   13   >