[jira] [Commented] (HDFS-17560) RBF: When CurrentCall does not include StateId, it can still send requests to the Observer.

2024-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17866336#comment-17866336 ] ASF GitHub Bot commented on HDFS-17560: --- fuchaohong commented on PR #6905:

[jira] [Updated] (HDFS-17535) I have confirmed the EC corrupt file, can this corrupt file be restored?

2024-07-16 Thread ruiliang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ruiliang updated HDFS-17535: Description: 我了解到 EC 确实存在文件损坏的重错误 https://issues.apache.org/jira/browse/HDFS-15759 1:我已确认 EC 损坏文件,此损坏文件可以

[jira] [Updated] (HDFS-17535) I have confirmed the EC corrupt file, can this corrupt file be restored?

2024-07-16 Thread ruiliang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ruiliang updated HDFS-17535: Description: 我了解到 EC 确实存在文件损坏的重大错误 https://issues.apache.org/jira/browse/HDFS-15759 1:我已确认 EC 损坏文件,此损坏文件可

[jira] [Commented] (HDFS-17577) Add Support for CreateFlag.NO_LOCAL_WRITE in File Creation to Manage Disk Space and Network Load in Labeled YARN Nodes

2024-07-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17866272#comment-17866272 ] ASF GitHub Bot commented on HDFS-17577: --- hadoop-yetus commented on PR #6935:

[jira] [Commented] (HDFS-17577) Add Support for CreateFlag.NO_LOCAL_WRITE in File Creation to Manage Disk Space and Network Load in Labeled YARN Nodes

2024-07-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17866240#comment-17866240 ] ASF GitHub Bot commented on HDFS-17577: --- liangyu-1 commented on PR #6935:

[jira] [Updated] (HDFS-17581) Add FastCopy tool and support dfs -fastcp command

2024-07-15 Thread liuguanghua (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuguanghua updated HDFS-17581: --- Description: Add FastCopy Tool : (1) support data replication with replication files (2) support

[jira] [Created] (HDFS-17582) Distcp support fastcopy

2024-07-15 Thread liuguanghua (Jira)
liuguanghua created HDFS-17582: -- Summary: Distcp support fastcopy Key: HDFS-17582 URL: https://issues.apache.org/jira/browse/HDFS-17582 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-17581) Add FastCopy tool and support dfs -fastcp command

2024-07-15 Thread liuguanghua (Jira)
liuguanghua created HDFS-17581: -- Summary: Add FastCopy tool and support dfs -fastcp command Key: HDFS-17581 URL: https://issues.apache.org/jira/browse/HDFS-17581 Project: Hadoop HDFS Issue Type

[jira] [Commented] (HDFS-17577) Add Support for CreateFlag.NO_LOCAL_WRITE in File Creation to Manage Disk Space and Network Load in Labeled YARN Nodes

2024-07-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17866101#comment-17866101 ] ASF GitHub Bot commented on HDFS-17577: --- slfan1989 commented on PR #6935:

[jira] [Resolved] (HDFS-17580) Change the default value of dfs.datanode.lock.fair to false due to potential hang

2024-07-15 Thread farmmamba (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] farmmamba resolved HDFS-17580. -- Resolution: Won't Fix Only change to false can not prevent datanode hang.  We need some other me

[jira] [Updated] (HDFS-17580) Change the default value of dfs.datanode.lock.fair to false due to potential hang

2024-07-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17580: -- Labels: pull-request-available (was: ) > Change the default value of dfs.datanode.lock.f

[jira] [Commented] (HDFS-17580) Change the default value of dfs.datanode.lock.fair to false due to potential hang

2024-07-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865995#comment-17865995 ] ASF GitHub Bot commented on HDFS-17580: --- hfutatzhanghb opened a new pull req

[jira] [Updated] (HDFS-17580) Change the default value of dfs.datanode.lock.fair to false due to potential hang

2024-07-15 Thread farmmamba (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] farmmamba updated HDFS-17580: - Summary: Change the default value of dfs.datanode.lock.fair to false due to potential hang (was: Change

[jira] [Created] (HDFS-17580) Change the default value of dfs.datanode.lock.fair to false

2024-07-15 Thread farmmamba (Jira)
farmmamba created HDFS-17580: Summary: Change the default value of dfs.datanode.lock.fair to false Key: HDFS-17580 URL: https://issues.apache.org/jira/browse/HDFS-17580 Project: Hadoop HDFS

[jira] [Commented] (HDFS-17535) I have confirmed the EC corrupt file, can this corrupt file be restored?

2024-07-15 Thread Hongbing Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865983#comment-17865983 ] Hongbing Wang commented on HDFS-17535: -- [~ruilaing]   We had similar prob

[jira] [Commented] (HDFS-13270) RBF: Router audit logger

2024-07-14 Thread TIsNotT (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865892#comment-17865892 ] TIsNotT commented on HDFS-13270: This patch is very good for us, but there was a mis

[jira] [Updated] (HDFS-13270) RBF: Router audit logger

2024-07-14 Thread TIsNotT (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TIsNotT updated HDFS-13270: --- Attachment: image-2024-07-15-14-46-54-168.png > RBF: Router audit log

[jira] [Commented] (HDFS-17573) Add test code for FSImage parallelization and compression

2024-07-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865879#comment-17865879 ] ASF GitHub Bot commented on HDFS-17573: --- hadoop-yetus commented on PR #6929:

[jira] [Commented] (HDFS-16690) Automatically format new unformatted JournalNodes using JournalNodeSyncer

2024-07-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865821#comment-17865821 ] ASF GitHub Bot commented on HDFS-16690: --- hadoop-yetus commented on PR #6925:

[jira] [Commented] (HDFS-17573) Add test code for FSImage parallelization and compression

2024-07-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865816#comment-17865816 ] ASF GitHub Bot commented on HDFS-17573: --- hadoop-yetus commented on PR #6929:

[jira] [Commented] (HDFS-17573) Add test code for FSImage parallelization and compression

2024-07-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865815#comment-17865815 ] ASF GitHub Bot commented on HDFS-17573: --- hadoop-yetus commented on PR #6929:

[jira] [Commented] (HDFS-17573) Add test code for FSImage parallelization and compression

2024-07-14 Thread Sungdong Kim (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865779#comment-17865779 ] Sungdong Kim commented on HDFS-17573: - If I understand the questions properly.

[jira] [Updated] (HDFS-17573) Add test code for FSImage parallelization and compression

2024-07-14 Thread Sungdong Kim (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sungdong Kim updated HDFS-17573: Attachment: compressed-image-load-serial.png compressed-subsection-image-load

[jira] [Comment Edited] (HDFS-17573) Add test code for FSImage parallelization and compression

2024-07-12 Thread Sungdong Kim (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865643#comment-17865643 ] Sungdong Kim edited comment on HDFS-17573 at 7/13/24 6:3

[jira] [Comment Edited] (HDFS-17573) Add test code for FSImage parallelization and compression

2024-07-12 Thread Sungdong Kim (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865643#comment-17865643 ] Sungdong Kim edited comment on HDFS-17573 at 7/13/24 6:3

[jira] [Commented] (HDFS-17573) Add test code for FSImage parallelization and compression

2024-07-12 Thread Sungdong Kim (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865643#comment-17865643 ] Sungdong Kim commented on HDFS-17573: - Thanks for the review [~hexiaoqiao], I

[jira] [Commented] (HDFS-16690) Automatically format new unformatted JournalNodes using JournalNodeSyncer

2024-07-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865615#comment-17865615 ] ASF GitHub Bot commented on HDFS-16690: --- hadoop-yetus commented on PR #6925:

[jira] [Updated] (HDFS-17579) [DatanodeAdminDefaultMonitor] Better Comments Explaining Why Blocks Need Reconstruction May Not Block Decommission/Maintenance

2024-07-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17579: -- Labels: pull-request-available (was: ) > [DatanodeAdminDefaultMonitor] Better Comme

[jira] [Commented] (HDFS-17579) [DatanodeAdminDefaultMonitor] Better Comments Explaining Why Blocks Need Reconstruction May Not Block Decommission/Maintenance

2024-07-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865469#comment-17865469 ] ASF GitHub Bot commented on HDFS-17579: --- hadoop-yetus commented on PR #6941:

[jira] [Commented] (HDFS-17565) EC: dfs.datanode.ec.reconstruction.threads should support dynamic reconfigured.

2024-07-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865362#comment-17865362 ] ASF GitHub Bot commented on HDFS-17565: --- hadoop-yetus commented on PR #6928:

[jira] [Commented] (HDFS-17565) EC: dfs.datanode.ec.reconstruction.threads should support dynamic reconfigured.

2024-07-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865357#comment-17865357 ] ASF GitHub Bot commented on HDFS-17565: --- hadoop-yetus commented on PR #6928:

[jira] [Updated] (HDFS-17579) [DatanodeAdminDefaultMonitor] Better Comments Explaining Why Blocks Need Reconstruction May Not Block Decommission/Maintenance

2024-07-11 Thread wuchang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuchang updated HDFS-17579: --- Description: Below comments for explaining why blocks which need reconstruction may not block decommission

[jira] [Updated] (HDFS-17579) [DatanodeAdminDefaultMonitor] Better Comments Explaining Why Blocks Need Reconstruction May Not Block Decommission/Maintenance

2024-07-11 Thread wuchang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuchang updated HDFS-17579: --- Description: Below comments for explaining  > [DatanodeAdminDefaultMonitor] Better Comments Explaining

[jira] [Created] (HDFS-17579) [DatanodeAdminDefaultMonitor] Better Comments Explaining Why Blocks Need Reconstruction May Not Block Decommission/Maintenance

2024-07-11 Thread wuchang (Jira)
wuchang created HDFS-17579: -- Summary: [DatanodeAdminDefaultMonitor] Better Comments Explaining Why Blocks Need Reconstruction May Not Block Decommission/Maintenance Key: HDFS-17579 URL: https://issues.apache.org/jira

[jira] [Commented] (HDFS-17577) Add Support for CreateFlag.NO_LOCAL_WRITE in File Creation to Manage Disk Space and Network Load in Labeled YARN Nodes

2024-07-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865300#comment-17865300 ] ASF GitHub Bot commented on HDFS-17577: --- hadoop-yetus commented on PR #6935:

[jira] [Commented] (HDFS-17577) Add Support for CreateFlag.NO_LOCAL_WRITE in File Creation to Manage Disk Space and Network Load in Labeled YARN Nodes

2024-07-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865298#comment-17865298 ] ASF GitHub Bot commented on HDFS-17577: --- hadoop-yetus commented on PR #6935:

[jira] [Commented] (HDFS-17565) EC: dfs.datanode.ec.reconstruction.threads should support dynamic reconfigured.

2024-07-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865290#comment-17865290 ] ASF GitHub Bot commented on HDFS-17565: --- haiyang1987 commented on code in PR #

[jira] [Commented] (HDFS-17577) Add Support for CreateFlag.NO_LOCAL_WRITE in File Creation to Manage Disk Space and Network Load in Labeled YARN Nodes

2024-07-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865285#comment-17865285 ] ASF GitHub Bot commented on HDFS-17577: --- liangyu-1 commented on PR #6935:

[jira] [Commented] (HDFS-17565) EC: dfs.datanode.ec.reconstruction.threads should support dynamic reconfigured.

2024-07-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865276#comment-17865276 ] ASF GitHub Bot commented on HDFS-17565: --- haiyang1987 commented on code in PR #

[jira] [Commented] (HDFS-17578) ShellCommandFencer#setConfAsEnvVars should also replace '-' with '_'.

2024-07-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865272#comment-17865272 ] ASF GitHub Bot commented on HDFS-17578: --- fuchaohong commented on PR #6936:

[jira] [Commented] (HDFS-17573) Add test code for FSImage parallelization and compression

2024-07-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865225#comment-17865225 ] ASF GitHub Bot commented on HDFS-17573: --- hadoop-yetus commented on PR #6929:

[jira] [Commented] (HDFS-17574) Make NNThroughputBenchmark support argument blockSize suffix with k, m, g, t, p, e

2024-07-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865196#comment-17865196 ] ASF GitHub Bot commented on HDFS-17574: --- hadoop-yetus commented on PR #6931:

[jira] [Updated] (HDFS-17573) Add test code for FSImage parallelization and compression

2024-07-11 Thread Sungdong Kim (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sungdong Kim updated HDFS-17573: Fix Version/s: 3.5.0 > Add test code for FSImage parallelization and compress

[jira] [Commented] (HDFS-17573) Add test code for FSImage parallelization and compression

2024-07-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865103#comment-17865103 ] Xiaoqiao He commented on HDFS-17573: Thanks [~last-remote] involve me here. I

[jira] [Commented] (HDFS-17577) Add Support for CreateFlag.NO_LOCAL_WRITE in File Creation to Manage Disk Space and Network Load in Labeled YARN Nodes

2024-07-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865092#comment-17865092 ] ASF GitHub Bot commented on HDFS-17577: --- Hexiaoqiao commented on PR #6935:

[jira] [Commented] (HDFS-17578) ShellCommandFencer#setConfAsEnvVars should also replace '-' with '_'.

2024-07-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865086#comment-17865086 ] ASF GitHub Bot commented on HDFS-17578: --- Hexiaoqiao commented on PR #6936:

[jira] [Commented] (HDFS-16070) DataTransfer block storm when datanode's io is busy.

2024-07-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864983#comment-17864983 ] ASF GitHub Bot commented on HDFS-16070: --- zhengchenyu closed pull request #

[jira] [Resolved] (HDFS-17566) Got wrong sorted block order when StorageType is considered.

2024-07-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17566. Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Got wrong sorted bl

[jira] [Commented] (HDFS-17566) Got wrong sorted block order when StorageType is considered.

2024-07-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864982#comment-17864982 ] ASF GitHub Bot commented on HDFS-17566: --- Hexiaoqiao commented on PR #6934:

[jira] [Commented] (HDFS-17566) Got wrong sorted block order when StorageType is considered.

2024-07-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864981#comment-17864981 ] ASF GitHub Bot commented on HDFS-17566: --- Hexiaoqiao merged PR #6934: URL: h

[jira] [Commented] (HDFS-17566) Got wrong sorted block order when StorageType is considered.

2024-07-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864972#comment-17864972 ] ASF GitHub Bot commented on HDFS-17566: --- zhengchenyu commented on PR #6934:

[jira] [Commented] (HDFS-17566) Got wrong sorted block order when StorageType is considered.

2024-07-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864958#comment-17864958 ] ASF GitHub Bot commented on HDFS-17566: --- hadoop-yetus commented on PR #6934:

[jira] [Commented] (HDFS-17577) Add Support for CreateFlag.NO_LOCAL_WRITE in File Creation to Manage Disk Space and Network Load in Labeled YARN Nodes

2024-07-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864956#comment-17864956 ] ASF GitHub Bot commented on HDFS-17577: --- hadoop-yetus commented on PR #6935:

[jira] [Commented] (HDFS-17573) Add test code for FSImage parallelization and compression

2024-07-10 Thread Sungdong Kim (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864936#comment-17864936 ] Sungdong Kim commented on HDFS-17573: - [~hexiaoqiao] [~sodonnell] [~mofei]  H

[jira] [Commented] (HDFS-17575) SaslDataTransferClient should use SaslParticipant to create messages

2024-07-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864912#comment-17864912 ] ASF GitHub Bot commented on HDFS-17575: --- hadoop-yetus commented on PR #6933:

[jira] [Commented] (HDFS-17573) Add test code for FSImage parallelization and compression

2024-07-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864824#comment-17864824 ] ASF GitHub Bot commented on HDFS-17573: --- hadoop-yetus commented on PR #6929:

[jira] [Commented] (HDFS-17546) Implementing Timeout for HostFileReader when FS hangs

2024-07-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864736#comment-17864736 ] ASF GitHub Bot commented on HDFS-17546: --- hadoop-yetus commented on PR #6908:

[jira] [Commented] (HDFS-17573) Add test code for FSImage parallelization and compression

2024-07-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864729#comment-17864729 ] ASF GitHub Bot commented on HDFS-17573: --- Last-remote11 commented on PR #6929:

[jira] [Commented] (HDFS-16690) Automatically format new unformatted JournalNodes using JournalNodeSyncer

2024-07-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864723#comment-17864723 ] ASF GitHub Bot commented on HDFS-16690: --- hadoop-yetus commented on PR #6925:

[jira] [Commented] (HDFS-17574) Make NNThroughputBenchmark support argument blockSize suffix with k, m, g, t, p, e

2024-07-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864664#comment-17864664 ] ASF GitHub Bot commented on HDFS-17574: --- hadoop-yetus commented on PR #6931:

[jira] [Commented] (HDFS-17578) ShellCommandFencer#setConfAsEnvVars should also replace '-' with '_'.

2024-07-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864640#comment-17864640 ] ASF GitHub Bot commented on HDFS-17578: --- hadoop-yetus commented on PR #6936:

[jira] [Commented] (HDFS-17569) Setup Effective Work Number when Generating Block Reconstruction Work

2024-07-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864632#comment-17864632 ] ASF GitHub Bot commented on HDFS-17569: --- hadoop-yetus commented on PR #6924:

[jira] [Commented] (HDFS-17573) Add test code for FSImage parallelization and compression

2024-07-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864594#comment-17864594 ] ASF GitHub Bot commented on HDFS-17573: --- hadoop-yetus commented on PR #6929:

[jira] [Commented] (HDFS-17568) [Decommission]Show Aggregated Reason for Why Low-Redundancy Block is Skipped for Reconstruction

2024-07-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864592#comment-17864592 ] ASF GitHub Bot commented on HDFS-17568: --- hadoop-yetus commented on PR #6921:

[jira] [Commented] (HDFS-17568) [Decommission]Show Aggregated Reason for Why Low-Redundancy Block is Skipped for Reconstruction

2024-07-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864590#comment-17864590 ] ASF GitHub Bot commented on HDFS-17568: --- hadoop-yetus commented on PR #6921:

[jira] [Commented] (HDFS-17573) Add test code for FSImage parallelization and compression

2024-07-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864564#comment-17864564 ] ASF GitHub Bot commented on HDFS-17573: --- hadoop-yetus commented on PR #6929:

[jira] [Commented] (HDFS-17578) ShellCommandFencer#setConfAsEnvVars should also replace '-' with '_'.

2024-07-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864558#comment-17864558 ] ASF GitHub Bot commented on HDFS-17578: --- fuchaohong opened a new pull req

[jira] [Updated] (HDFS-17578) ShellCommandFencer#setConfAsEnvVars should also replace '-' with '_'.

2024-07-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17578: -- Labels: pull-request-available (was: ) > ShellCommandFencer#setConfAsEnvVars should a

[jira] [Created] (HDFS-17578) ShellCommandFencer#setConfAsEnvVars should also replace '-' with '_'.

2024-07-10 Thread fuchaohong (Jira)
fuchaohong created HDFS-17578: - Summary: ShellCommandFencer#setConfAsEnvVars should also replace '-' with '_'. Key: HDFS-17578 URL: https://issues.apache.org/jira/browse/HDFS-17578

[jira] [Commented] (HDFS-16524) Add configuration to control blocks deletion asynchronous or synchronous

2024-07-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864542#comment-17864542 ] ASF GitHub Bot commented on HDFS-16524: --- zeekling commented on code in PR #

[jira] [Commented] (HDFS-17574) Make NNThroughputBenchmark support argument blockSize suffix with k, m, g, t, p, e

2024-07-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864533#comment-17864533 ] ASF GitHub Bot commented on HDFS-17574: --- hadoop-yetus commented on PR #6931:

[jira] [Commented] (HDFS-17566) Got wrong sorted block order when StorageType is considered.

2024-07-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864530#comment-17864530 ] ASF GitHub Bot commented on HDFS-17566: --- hadoop-yetus commented on PR #6934:

[jira] [Commented] (HDFS-17577) Add Support for CreateFlag.NO_LOCAL_WRITE in File Creation to Manage Disk Space and Network Load in Labeled YARN Nodes

2024-07-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864517#comment-17864517 ] ASF GitHub Bot commented on HDFS-17577: --- hadoop-yetus commented on PR #6935:

[jira] [Updated] (HDFS-17570) Respect Non-Default HADOOP_ROOT_LOGGER when HADOOP_DAEMON_ROOT_LOGGER is not specified in Daemon mode

2024-07-10 Thread wuchang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuchang updated HDFS-17570: --- Description: h1. Description of PR the {{-Dhadoop.root.logger}} will use the value of

[jira] [Updated] (HDFS-17568) [Decommission]Show Aggregated Reason for Why Low-Redundancy Block is Skipped for Reconstruction

2024-07-10 Thread wuchang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuchang updated HDFS-17568: --- Summary: [Decommission]Show Aggregated Reason for Why Low-Redundancy Block is Skipped for Reconstruction

[jira] [Updated] (HDFS-17570) Respect Non-Default HADOOP_ROOT_LOGGER when HADOOP_DAEMON_ROOT_LOGGER is not specified in Daemon mode

2024-07-10 Thread wuchang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuchang updated HDFS-17570: --- Description: h1. Description of PR the {{-Dhadoop.root.logger}} will use the value of

[jira] [Updated] (HDFS-17568) [Decommission]Show Info Log for Repeated Useless refreshNode Operation

2024-07-10 Thread wuchang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuchang updated HDFS-17568: --- Description: The troubleshooting for decommission is very hard even in DEBUG mode. In somehow cases when

[jira] [Updated] (HDFS-17577) Add Support for CreateFlag.NO_LOCAL_WRITE in File Creation to Manage Disk Space and Network Load in Labeled YARN Nodes

2024-07-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17577: -- Labels: pull-request-available (was: ) > Add Support for CreateFlag.NO_LOCAL_WRITE in F

[jira] [Commented] (HDFS-17577) Add Support for CreateFlag.NO_LOCAL_WRITE in File Creation to Manage Disk Space and Network Load in Labeled YARN Nodes

2024-07-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864514#comment-17864514 ] ASF GitHub Bot commented on HDFS-17577: --- liangyu-1 opened a new pull req

[jira] [Updated] (HDFS-17570) Respect Non-Default HADOOP_ROOT_LOGGER when HADOOP_DAEMON_ROOT_LOGGER is not specified in Daemon mode

2024-07-10 Thread wuchang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuchang updated HDFS-17570: --- Description: h1. Description of PR the {{-Dhadoop.root.logger}} will use the value of

[jira] [Updated] (HDFS-17569) Setup Effective Work Number when Generating Block Reconstruction Work

2024-07-10 Thread wuchang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuchang updated HDFS-17569: --- Description: h1. Description of PR The *{{RedundancyMonitor}}* is a Daemon which will sleep *3s* for each

[jira] [Commented] (HDFS-17574) Make NNThroughputBenchmark support argument blockSize suffix with k, m, g, t, p, e

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864488#comment-17864488 ] ASF GitHub Bot commented on HDFS-17574: --- granewang commented on PR #6931:

[jira] [Commented] (HDFS-17574) Make NNThroughputBenchmark support argument blockSize suffix with k, m, g, t, p, e

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864481#comment-17864481 ] ASF GitHub Bot commented on HDFS-17574: --- hadoop-yetus commented on PR #6931:

[jira] [Commented] (HDFS-17575) SaslDataTransferClient should use SaslParticipant to create messages

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864473#comment-17864473 ] ASF GitHub Bot commented on HDFS-17575: --- hadoop-yetus commented on PR #6933:

[jira] [Updated] (HDFS-17577) Add Support for CreateFlag.NO_LOCAL_WRITE in File Creation to Manage Disk Space and Network Load in Labeled YARN Nodes

2024-07-09 Thread liang yu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liang yu updated HDFS-17577: Description: {*}Description{*}: I am currently using Apache Flink to write files into Hadoop. The Flink

[jira] [Updated] (HDFS-17577) Add Support for CreateFlag.NO_LOCAL_WRITE in File Creation to Manage Disk Space and Network Load in Labeled YARN Nodes

2024-07-09 Thread liang yu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liang yu updated HDFS-17577: Attachment: 6D939050-0BC4-4B17-A6A3-A1EBBD60338D.png > Add Support for CreateFlag.NO_LOCAL_WRITE in F

[jira] [Created] (HDFS-17577) Add Support for CreateFlag.NO_LOCAL_WRITE in File Creation to Manage Disk Space and Network Load in Labeled YARN Nodes

2024-07-09 Thread liang yu (Jira)
liang yu created HDFS-17577: --- Summary: Add Support for CreateFlag.NO_LOCAL_WRITE in File Creation to Manage Disk Space and Network Load in Labeled YARN Nodes Key: HDFS-17577 URL: https://issues.apache.org/jira/browse

[jira] [Commented] (HDFS-17568) [Decommission]Show Info Log for Repeated Useless refreshNode Operation

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864452#comment-17864452 ] ASF GitHub Bot commented on HDFS-17568: --- VicoWu opened a new pull request, #

[jira] [Commented] (HDFS-17566) Got wrong sorted block order when StorageType is considered.

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864449#comment-17864449 ] ASF GitHub Bot commented on HDFS-17566: --- zhengchenyu closed pull request #

[jira] [Commented] (HDFS-17566) Got wrong sorted block order when StorageType is considered.

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864448#comment-17864448 ] ASF GitHub Bot commented on HDFS-17566: --- zhengchenyu commented on PR #6919:

[jira] [Commented] (HDFS-17566) Got wrong sorted block order when StorageType is considered.

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864447#comment-17864447 ] ASF GitHub Bot commented on HDFS-17566: --- zhengchenyu opened a new pull req

[jira] [Commented] (HDFS-17566) Got wrong sorted block order when StorageType is considered.

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1786#comment-1786 ] ASF GitHub Bot commented on HDFS-17566: --- Hexiaoqiao commented on PR #6919:

[jira] [Updated] (HDFS-17575) SaslDataTransferClient should use SaslParticipant to create messages

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17575: -- Labels: pull-request-available (was: ) > SaslDataTransferClient should use SaslParticipant

[jira] [Commented] (HDFS-17575) SaslDataTransferClient should use SaslParticipant to create messages

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864442#comment-17864442 ] ASF GitHub Bot commented on HDFS-17575: --- szetszwo opened a new pull request, #

[jira] [Commented] (HDFS-17566) Got wrong sorted block order when StorageType is considered.

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864433#comment-17864433 ] ASF GitHub Bot commented on HDFS-17566: --- hadoop-yetus commented on PR #6919:

[jira] [Commented] (HDFS-17574) Make NNThroughputBenchmark support argument blockSize suffix with k, m, g, t, p, e

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864426#comment-17864426 ] ASF GitHub Bot commented on HDFS-17574: --- granewang commented on PR #6931:

[jira] [Commented] (HDFS-17569) Setup Effective Work Number when Generating Block Reconstruction Work

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864272#comment-17864272 ] ASF GitHub Bot commented on HDFS-17569: --- hadoop-yetus commented on PR #6924:

[jira] [Commented] (HDFS-17574) Make NNThroughputBenchmark support argument blockSize suffix with k, m, g, t, p, e

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864271#comment-17864271 ] ASF GitHub Bot commented on HDFS-17574: --- hadoop-yetus commented on PR #6931:

[jira] [Commented] (HDFS-17569) Setup Effective Work Number when Generating Block Reconstruction Work

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864270#comment-17864270 ] ASF GitHub Bot commented on HDFS-17569: --- hadoop-yetus commented on PR #6924:

[jira] [Commented] (HDFS-17573) Add test code for FSImage parallelization and compression

2024-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864266#comment-17864266 ] ASF GitHub Bot commented on HDFS-17573: --- hadoop-yetus commented on PR #6929:

<    3   4   5   6   7   8   9   10   11   12   >