[jira] [Commented] (HDFS-17360) Record the number of times a block is read during a certain time period.

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812124#comment-17812124 ] ASF GitHub Bot commented on HDFS-17360: --- zhangshuyan0 commented on PR #6505: URL:

[jira] [Commented] (HDFS-17356) RBF: Add Configuration dfs.federation.router.ns.name Optimization

2024-01-29 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-17356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812091#comment-17812091 ] Íñigo Goiri commented on HDFS-17356: In our internal setup, we mostly use option 1 to specify the

[jira] [Commented] (HDFS-17358) EC: infinite lease recovery caused by the length of RWR equals to zero.

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811978#comment-17811978 ] ASF GitHub Bot commented on HDFS-17358: --- hadoop-yetus commented on PR #6509: URL:

[jira] [Commented] (HDFS-17358) EC: infinite lease recovery caused by the length of RWR equals to zero.

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811969#comment-17811969 ] ASF GitHub Bot commented on HDFS-17358: --- hadoop-yetus commented on PR #6509: URL:

[jira] [Commented] (HDFS-17353) Fix failing RBF module tests

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811919#comment-17811919 ] ASF GitHub Bot commented on HDFS-17353: --- hadoop-yetus commented on PR #6491: URL:

[jira] [Comment Edited] (HDFS-17356) RBF: Add Configuration dfs.federation.router.ns.name Optimization

2024-01-29 Thread xiaojunxiang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811892#comment-17811892 ] xiaojunxiang edited comment on HDFS-17356 at 1/29/24 2:09 PM: -- [~tasanuma],

[jira] [Comment Edited] (HDFS-17356) RBF: Add Configuration dfs.federation.router.ns.name Optimization

2024-01-29 Thread xiaojunxiang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811892#comment-17811892 ] xiaojunxiang edited comment on HDFS-17356 at 1/29/24 2:08 PM: -- [~tasanuma],

[jira] [Commented] (HDFS-17358) EC: infinite lease recovery caused by the length of RWR equals to zero.

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811894#comment-17811894 ] ASF GitHub Bot commented on HDFS-17358: --- hadoop-yetus commented on PR #6509: URL:

[jira] [Comment Edited] (HDFS-17356) RBF: Add Configuration dfs.federation.router.ns.name Optimization

2024-01-29 Thread xiaojunxiang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811892#comment-17811892 ] xiaojunxiang edited comment on HDFS-17356 at 1/29/24 2:07 PM: -- [~tasanuma],

[jira] [Commented] (HDFS-17356) RBF: Add Configuration dfs.federation.router.ns.name Optimization

2024-01-29 Thread xiaojunxiang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811892#comment-17811892 ] xiaojunxiang commented on HDFS-17356: - [~tasanuma], [~hiwangzhihui] [~hexiaoqiao] thanks yours

[jira] [Updated] (HDFS-17356) RBF: Add Configuration dfs.federation.router.ns.name Optimization

2024-01-29 Thread xiaojunxiang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaojunxiang updated HDFS-17356: Attachment: screenshot-5.png > RBF: Add Configuration dfs.federation.router.ns.name Optimization >

[jira] [Commented] (HDFS-17146) Use the dfsadmin -reconfig command to initiate reconfiguration on all decommissioning datanodes.

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811887#comment-17811887 ] ASF GitHub Bot commented on HDFS-17146: --- zhtttylz commented on code in PR #6504: URL:

[jira] [Resolved] (HDFS-17363) Avoid initializing unnecessary objects in method getBlockRecoveryCommand

2024-01-29 Thread farmmamba (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] farmmamba resolved HDFS-17363. -- Resolution: Not A Problem > Avoid initializing unnecessary objects in method getBlockRecoveryCommand >

[jira] [Updated] (HDFS-17363) Avoid initializing unnecessary objects in method getBlockRecoveryCommand

2024-01-29 Thread farmmamba (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] farmmamba updated HDFS-17363: - Description: In method getBlockRecoveryCommand, we have below codes: {code:java} else {        

[jira] [Updated] (HDFS-17363) Avoid initializing unnecessary objects in method getBlockRecoveryCommand

2024-01-29 Thread farmmamba (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] farmmamba updated HDFS-17363: - Description: In method getBlockRecoveryCommand, we have below codes: {code:java} else {        

[jira] [Updated] (HDFS-17363) Avoid initializing unnecessary objects in method getBlockRecoveryCommand

2024-01-29 Thread farmmamba (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] farmmamba updated HDFS-17363: - Description: In method  > Avoid initializing unnecessary objects in method getBlockRecoveryCommand >

[jira] [Created] (HDFS-17363) Avoid initializing unnecessary objects in method getBlockRecoveryCommand

2024-01-29 Thread farmmamba (Jira)
farmmamba created HDFS-17363: Summary: Avoid initializing unnecessary objects in method getBlockRecoveryCommand Key: HDFS-17363 URL: https://issues.apache.org/jira/browse/HDFS-17363 Project: Hadoop HDFS

[jira] [Commented] (HDFS-17356) RBF: Add Configuration dfs.federation.router.ns.name Optimization

2024-01-29 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811863#comment-17811863 ] Takanobu Asanuma commented on HDFS-17356: - [~bigdata_zoodev] Thanks for your reply. In our

[jira] [Commented] (HDFS-17353) Fix failing RBF module tests

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811846#comment-17811846 ] ASF GitHub Bot commented on HDFS-17353: --- ssanchozz commented on code in PR #6491: URL:

[jira] [Commented] (HDFS-17316) Compatibility Benchmark over HCFS Implementations

2024-01-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811840#comment-17811840 ] Steve Loughran commented on HDFS-17316: --- good read. If you look at the hadoop test classes * we

[jira] [Commented] (HDFS-17358) EC: infinite lease recovery caused by the length of RWR equals to zero.

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811839#comment-17811839 ] ASF GitHub Bot commented on HDFS-17358: --- haiyang1987 commented on PR #6509: URL:

[jira] [Commented] (HDFS-17358) EC: infinite lease recovery caused by the length of RWR equals to zero.

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811838#comment-17811838 ] ASF GitHub Bot commented on HDFS-17358: --- hfutatzhanghb commented on PR #6509: URL:

[jira] [Commented] (HDFS-17358) EC: infinite lease recovery caused by the length of RWR equals to zero.

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811836#comment-17811836 ] ASF GitHub Bot commented on HDFS-17358: --- hfutatzhanghb commented on PR #6509: URL:

[jira] [Commented] (HDFS-17361) DiskBalancer: Query command support with multiple nodes

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811835#comment-17811835 ] ASF GitHub Bot commented on HDFS-17361: --- haiyang1987 commented on PR #6508: URL:

[jira] [Commented] (HDFS-17360) Record the number of times a block is read during a certain time period.

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811833#comment-17811833 ] ASF GitHub Bot commented on HDFS-17360: --- huangzhaobo99 commented on PR #6505: URL:

[jira] [Commented] (HDFS-17361) DiskBalancer: Query command support with multiple nodes

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811834#comment-17811834 ] ASF GitHub Bot commented on HDFS-17361: --- haiyang1987 commented on PR #6508: URL:

[jira] [Commented] (HDFS-17358) EC: infinite lease recovery caused by the length of RWR equals to zero.

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811832#comment-17811832 ] ASF GitHub Bot commented on HDFS-17358: --- haiyang1987 commented on PR #6509: URL:

[jira] [Commented] (HDFS-17358) EC: infinite lease recovery caused by the length of RWR equals to zero.

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811823#comment-17811823 ] ASF GitHub Bot commented on HDFS-17358: --- hfutatzhanghb commented on PR #6509: URL:

[jira] [Commented] (HDFS-17361) DiskBalancer: Query command support with multiple nodes

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811815#comment-17811815 ] ASF GitHub Bot commented on HDFS-17361: --- hadoop-yetus commented on PR #6508: URL:

[jira] [Comment Edited] (HDFS-17356) RBF: Add Configuration dfs.federation.router.ns.name Optimization

2024-01-29 Thread xiaojunxiang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811803#comment-17811803 ] xiaojunxiang edited comment on HDFS-17356 at 1/29/24 10:06 AM: ---

[jira] [Comment Edited] (HDFS-17356) RBF: Add Configuration dfs.federation.router.ns.name Optimization

2024-01-29 Thread xiaojunxiang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811803#comment-17811803 ] xiaojunxiang edited comment on HDFS-17356 at 1/29/24 10:05 AM: ---

[jira] [Commented] (HDFS-17356) RBF: Add Configuration dfs.federation.router.ns.name Optimization

2024-01-29 Thread xiaojunxiang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811803#comment-17811803 ] xiaojunxiang commented on HDFS-17356: - Thaks for your tip, but dfs.ha.namenode.id this configuration

[jira] [Updated] (HDFS-17356) RBF: Add Configuration dfs.federation.router.ns.name Optimization

2024-01-29 Thread xiaojunxiang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaojunxiang updated HDFS-17356: Attachment: screenshot-4.png > RBF: Add Configuration dfs.federation.router.ns.name Optimization >

[jira] [Commented] (HDFS-17358) EC: infinite lease recovery caused by the length of RWR equals to zero.

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811798#comment-17811798 ] ASF GitHub Bot commented on HDFS-17358: --- hfutatzhanghb commented on PR #6509: URL:

[jira] [Commented] (HDFS-17216) When distcp handle the small files, the bandwidth parameter will be invalid, resulting in serious overspeed behavior

2024-01-29 Thread wangzhihui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811795#comment-17811795 ] wangzhihui commented on HDFS-17216: --- [~bigdata_zoodev] You need to add a test case for this issue. >

[jira] [Commented] (HDFS-17342) Fix DataNode may invalidates normal block causing missing block

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811794#comment-17811794 ] ASF GitHub Bot commented on HDFS-17342: --- zhangshuyan0 commented on PR #6464: URL:

[jira] [Commented] (HDFS-17362) RBF: RouterObserverReadProxyProvider should use ConfiguredFailoverProxyProvider internally

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811785#comment-17811785 ] ASF GitHub Bot commented on HDFS-17362: --- hadoop-yetus commented on PR #6510: URL:

[jira] [Updated] (HDFS-17356) RBF: Add Configuration dfs.federation.router.ns.name Optimization

2024-01-29 Thread xiaojunxiang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaojunxiang updated HDFS-17356: Attachment: screenshot-3.png > RBF: Add Configuration dfs.federation.router.ns.name Optimization >

[jira] [Updated] (HDFS-17316) Compatibility Benchmark over HCFS Implementations

2024-01-29 Thread Han Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Han Liu updated HDFS-17316: --- Attachment: HDFS Compatibility Benchmark Design.pdf > Compatibility Benchmark over HCFS Implementations >

[jira] [Commented] (HDFS-17356) RBF: Add Configuration dfs.federation.router.ns.name Optimization

2024-01-29 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811768#comment-17811768 ] Takanobu Asanuma commented on HDFS-17356: - As the error log shows, dfs.nameservice.id and

[jira] [Commented] (HDFS-17353) Fix failing RBF module tests

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811766#comment-17811766 ] ASF GitHub Bot commented on HDFS-17353: --- ssanchozz commented on code in PR #6491: URL: