[jira] [Commented] (HDFS-17313) dfsadmin -reconfig option to start/query reconfig on all live namenodes.

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805921#comment-17805921 ] ASF GitHub Bot commented on HDFS-17313: --- virajjasani commented on PR #6395: URL:

[jira] [Commented] (HDFS-17036) Limit pendingReconstruction size

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805895#comment-17805895 ] ASF GitHub Bot commented on HDFS-17036: --- LiuGuH closed pull request #5710: HDFS-17036. Limit

[jira] [Commented] (HDFS-9550) DiskBalancer: Add Run Command

2024-01-11 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-9550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805867#comment-17805867 ] Haiyang Hu commented on HDFS-9550: -- This PR is still very practical, In the actual use of hdfs

[jira] [Commented] (HDFS-17335) Add metrics for syncWaitQ in FSEditLogAsync

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805866#comment-17805866 ] ASF GitHub Bot commented on HDFS-17335: --- hfutatzhanghb commented on PR #6431: URL:

[jira] [Commented] (HDFS-17338) Improve the doc related to permissions.

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805855#comment-17805855 ] ASF GitHub Bot commented on HDFS-17338: --- huangzhaobo99 commented on PR #6440: URL:

[jira] [Commented] (HDFS-17313) dfsadmin -reconfig option to start/query reconfig on all live namenodes.

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805854#comment-17805854 ] ASF GitHub Bot commented on HDFS-17313: --- huangzhaobo99 commented on PR #6395: URL:

[jira] [Commented] (HDFS-16064) Determine when to invalidate corrupt replicas based on number of usable replicas

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805765#comment-17805765 ] ASF GitHub Bot commented on HDFS-16064: --- shahrs87 commented on PR #6437: URL:

[jira] [Commented] (HDFS-17331) Fix Blocks are always -1 and DataNode`s version are always UNKNOWN in federationhealth.html

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805746#comment-17805746 ] ASF GitHub Bot commented on HDFS-17331: --- hadoop-yetus commented on PR #6429: URL:

[jira] [Commented] (HDFS-16064) Determine when to invalidate corrupt replicas based on number of usable replicas

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805742#comment-17805742 ] ASF GitHub Bot commented on HDFS-16064: --- shahrs87 commented on PR #6437: URL:

[jira] [Commented] (HDFS-16064) Determine when to invalidate corrupt replicas based on number of usable replicas

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805728#comment-17805728 ] ASF GitHub Bot commented on HDFS-16064: --- shahrs87 commented on PR #6437: URL:

[jira] [Commented] (HDFS-16064) Determine when to invalidate corrupt replicas based on number of usable replicas

2024-01-11 Thread Rushabh Shah (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805723#comment-17805723 ] Rushabh Shah commented on HDFS-16064: - [~KevinWikant]  By any chance you have draft PR for

[jira] [Commented] (HDFS-17291) DataNode metric bytesWritten is not totally accurate in some situations.

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805713#comment-17805713 ] ASF GitHub Bot commented on HDFS-17291: --- hadoop-yetus commented on PR #6360: URL:

[jira] [Commented] (HDFS-16064) Determine when to invalidate corrupt replicas based on number of usable replicas

2024-01-11 Thread Rushabh Shah (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805704#comment-17805704 ] Rushabh Shah commented on HDFS-16064: - Thank you [~KevinWikant]  for your reply. We also hit this bug

[jira] [Commented] (HDFS-16064) Determine when to invalidate corrupt replicas based on number of usable replicas

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805699#comment-17805699 ] ASF GitHub Bot commented on HDFS-16064: --- shahrs87 commented on code in PR #6437: URL:

[jira] [Commented] (HDFS-17337) RPC RESPONSE time seems not exactly accurate when using FSEditLogAsync.

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805651#comment-17805651 ] ASF GitHub Bot commented on HDFS-17337: --- hadoop-yetus commented on PR #6439: URL:

[jira] [Comment Edited] (HDFS-17221) Add NNThroughputBenchmark params to specify subcluster load in RBF

2024-01-11 Thread Alexander Bogdanov (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805644#comment-17805644 ] Alexander Bogdanov edited comment on HDFS-17221 at 1/11/24 3:04 PM:

[jira] [Commented] (HDFS-17335) Add metrics for syncWaitQ in FSEditLogAsync

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805638#comment-17805638 ] ASF GitHub Bot commented on HDFS-17335: --- hadoop-yetus commented on PR #6431: URL:

[jira] [Commented] (HDFS-17312) packetsReceived metric should ignore heartbeat packet

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805637#comment-17805637 ] ASF GitHub Bot commented on HDFS-17312: --- hfutatzhanghb commented on PR #6394: URL:

[jira] [Commented] (HDFS-17312) packetsReceived metric should ignore heartbeat packet

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805622#comment-17805622 ] ASF GitHub Bot commented on HDFS-17312: --- tasanuma commented on PR #6394: URL:

[jira] [Commented] (HDFS-17335) Add metrics for syncWaitQ in FSEditLogAsync

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805584#comment-17805584 ] ASF GitHub Bot commented on HDFS-17335: --- hadoop-yetus commented on PR #6431: URL:

[jira] [Commented] (HDFS-17329) DiskBalancerCluster#nodesToProcess should better use ArrayList

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805581#comment-17805581 ] ASF GitHub Bot commented on HDFS-17329: --- hfutatzhanghb commented on PR #6423: URL:

[jira] [Updated] (HDFS-17312) packetsReceived metric should ignore heartbeat packet

2024-01-11 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17312: Fix Version/s: 3.4.1 > packetsReceived metric should ignore heartbeat packet >

[jira] [Commented] (HDFS-16064) Determine when to invalidate corrupt replicas based on number of usable replicas

2024-01-11 Thread Kevin Wikant (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805579#comment-17805579 ] Kevin Wikant commented on HDFS-16064: - {quote}Any reason why we haven't backported this fix to

[jira] [Commented] (HDFS-17312) packetsReceived metric should ignore heartbeat packet

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805578#comment-17805578 ] ASF GitHub Bot commented on HDFS-17312: --- hfutatzhanghb commented on PR #6394: URL:

[jira] [Commented] (HDFS-17312) packetsReceived metric should ignore heartbeat packet

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805576#comment-17805576 ] ASF GitHub Bot commented on HDFS-17312: --- hfutatzhanghb commented on PR #6394: URL:

[jira] [Resolved] (HDFS-17312) packetsReceived metric should ignore heartbeat packet

2024-01-11 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17312. - Fix Version/s: 3.5.0 Resolution: Fixed > packetsReceived metric should ignore

[jira] [Commented] (HDFS-17312) packetsReceived metric should ignore heartbeat packet

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805573#comment-17805573 ] ASF GitHub Bot commented on HDFS-17312: --- tasanuma commented on PR #6394: URL:

[jira] [Commented] (HDFS-17312) packetsReceived metric should ignore heartbeat packet

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805572#comment-17805572 ] ASF GitHub Bot commented on HDFS-17312: --- tasanuma merged PR #6394: URL:

[jira] [Commented] (HDFS-17312) packetsReceived metric should ignore heartbeat packet

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805571#comment-17805571 ] ASF GitHub Bot commented on HDFS-17312: --- tasanuma commented on PR #6394: URL:

[jira] [Commented] (HDFS-17338) Improve the doc related to permissions.

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805523#comment-17805523 ] ASF GitHub Bot commented on HDFS-17338: --- huangzhaobo99 opened a new pull request, #6440: URL:

[jira] [Commented] (HDFS-17337) RPC RESPONSE time seems not exactly accurate when using FSEditLogAsync.

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805522#comment-17805522 ] ASF GitHub Bot commented on HDFS-17337: --- hfutatzhanghb commented on PR #6439: URL:

[jira] [Updated] (HDFS-17338) Improve the doc related to permissions.

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17338: -- Labels: pull-request-available (was: ) > Improve the doc related to permissions. >

[jira] [Commented] (HDFS-17337) RPC RESPONSE time seems not exactly accurate when using FSEditLogAsync.

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805520#comment-17805520 ] ASF GitHub Bot commented on HDFS-17337: --- hfutatzhanghb opened a new pull request, #6439: URL:

[jira] [Created] (HDFS-17338) Improve the doc related to permissions.

2024-01-11 Thread huangzhaobo (Jira)
huangzhaobo created HDFS-17338: -- Summary: Improve the doc related to permissions. Key: HDFS-17338 URL: https://issues.apache.org/jira/browse/HDFS-17338 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-17337) RPC RESPONSE time seems not exactly accurate when using FSEditLogAsync.

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17337: -- Labels: pull-request-available (was: ) > RPC RESPONSE time seems not exactly accurate when

[jira] [Commented] (HDFS-17336) Provide an option to enable/disable considering space used by .Trash folder for user quota compuation

2024-01-11 Thread Srinivasu Majeti (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805479#comment-17805479 ] Srinivasu Majeti commented on HDFS-17336: - I agree [~ayushtkn] with you. Having trash.home.prefix

[jira] [Commented] (HDFS-17337) RPC RESPONSE time seems not exactly accurate when using FSEditLogAsync.

2024-01-11 Thread farmmamba (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805470#comment-17805470 ] farmmamba commented on HDFS-17337: -- [~hexiaoqiao] [~zhangshuyan] [~tomscut] [~ayushsaxena] Sir, could

[jira] [Updated] (HDFS-17337) RPC RESPONSE time seems not exactly accurate when using FSEditLogAsync.

2024-01-11 Thread farmmamba (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] farmmamba updated HDFS-17337: - Description: Currently, FSEditLogAsync is enabled by default.  We have below codes in method

[jira] [Created] (HDFS-17337) RPC RESPONSE time seems not exactly accurate when using FSEditLogAsync.

2024-01-11 Thread farmmamba (Jira)
farmmamba created HDFS-17337: Summary: RPC RESPONSE time seems not exactly accurate when using FSEditLogAsync. Key: HDFS-17337 URL: https://issues.apache.org/jira/browse/HDFS-17337 Project: Hadoop HDFS

[jira] [Commented] (HDFS-17336) Provide an option to enable/disable considering space used by .Trash folder for user quota compuation

2024-01-11 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805443#comment-17805443 ] Ayush Saxena commented on HDFS-17336: - the */user* part in /user/user1/.Trash is configurable via

[jira] [Commented] (HDFS-17331) Fix Blocks are always -1 and DataNode`s version are always UNKNOWN in federationhealth.html

2024-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805438#comment-17805438 ] ASF GitHub Bot commented on HDFS-17331: --- hadoop-yetus commented on PR #6429: URL: