[jira] [Commented] (HDFS-16461) Expose JournalNode storage info in the jmx metrics

2022-02-21 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495888#comment-17495888 ] Viraj Jasani commented on HDFS-16461: - I see, so the workaround was to keep default methods in the

[jira] [Work logged] (HDFS-16475) Remove unnecessary shouldRetry variable in DFSOutputStream

2022-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16475?focusedWorklogId=730650=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-730650 ] ASF GitHub Bot logged work on HDFS-16475: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16476) Increase the number of metrics used to record PendingRecoveryBlocks

2022-02-21 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu updated HDFS-16476: Description: The complete process of block recovery is as follows: 1. NameNode collects which

[jira] [Assigned] (HDFS-16476) Increase the number of metrics used to record PendingRecoveryBlocks

2022-02-21 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu reassigned HDFS-16476: --- Assignee: JiangHua Zhu > Increase the number of metrics used to record

[jira] [Created] (HDFS-16476) Increase the number of metrics used to record PendingRecoveryBlocks

2022-02-21 Thread JiangHua Zhu (Jira)
JiangHua Zhu created HDFS-16476: --- Summary: Increase the number of metrics used to record PendingRecoveryBlocks Key: HDFS-16476 URL: https://issues.apache.org/jira/browse/HDFS-16476 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-16461) Expose JournalNode storage info in the jmx metrics

2022-02-21 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16461. - Fix Version/s: 3.4.0 Resolution: Fixed Merged to trunk. I didn't backport it into

[jira] [Updated] (HDFS-16456) EC: Decommission a rack with only on dn will fail when the rack number is equal with replication

2022-02-21 Thread caozhiqiang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] caozhiqiang updated HDFS-16456: --- Attachment: HDFS-16456.003.patch > EC: Decommission a rack with only on dn will fail when the rack

[jira] [Updated] (HDFS-16456) EC: Decommission a rack with only on dn will fail when the rack number is equal with replication

2022-02-21 Thread caozhiqiang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] caozhiqiang updated HDFS-16456: --- Status: Patch Available (was: Open) > EC: Decommission a rack with only on dn will fail when the

[jira] [Updated] (HDFS-16456) EC: Decommission a rack with only on dn will fail when the rack number is equal with replication

2022-02-21 Thread caozhiqiang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] caozhiqiang updated HDFS-16456: --- Status: Open (was: Patch Available) > EC: Decommission a rack with only on dn will fail when the

[jira] [Work logged] (HDFS-16461) Expose JournalNode storage info in the jmx metrics

2022-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16461?focusedWorklogId=730633=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-730633 ] ASF GitHub Bot logged work on HDFS-16461: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16461) Expose JournalNode storage info in the jmx metrics

2022-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16461?focusedWorklogId=730632=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-730632 ] ASF GitHub Bot logged work on HDFS-16461: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16475) Remove unnecessary shouldRetry variable in DFSOutputStream

2022-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-16475: -- Labels: pull-request-available (was: ) > Remove unnecessary shouldRetry variable in

[jira] [Work logged] (HDFS-16475) Remove unnecessary shouldRetry variable in DFSOutputStream

2022-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16475?focusedWorklogId=730631=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-730631 ] ASF GitHub Bot logged work on HDFS-16475: - Author: ASF GitHub Bot

[jira] [Created] (HDFS-16475) Remove unnecessary shouldRetry variable in DFSOutputStream

2022-02-21 Thread Kaijie Chen (Jira)
Kaijie Chen created HDFS-16475: -- Summary: Remove unnecessary shouldRetry variable in DFSOutputStream Key: HDFS-16475 URL: https://issues.apache.org/jira/browse/HDFS-16475 Project: Hadoop HDFS

[jira] [Work logged] (HDFS-16316) Improve DirectoryScanner: add regular file check related block

2022-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16316?focusedWorklogId=730609=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-730609 ] ASF GitHub Bot logged work on HDFS-16316: - Author: ASF GitHub Bot

[jira] [Resolved] (HDFS-16316) Improve DirectoryScanner: add regular file check related block

2022-02-21 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16316. Fix Version/s: 3.4.0 Resolution: Fixed > Improve DirectoryScanner: add regular file check related

[jira] [Work logged] (HDFS-16316) Improve DirectoryScanner: add regular file check related block

2022-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16316?focusedWorklogId=730608=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-730608 ] ASF GitHub Bot logged work on HDFS-16316: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16316) Improve DirectoryScanner: add regular file check related block

2022-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16316?focusedWorklogId=730607=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-730607 ] ASF GitHub Bot logged work on HDFS-16316: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

2022-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?focusedWorklogId=730528=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-730528 ] ASF GitHub Bot logged work on HDFS-15382: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16459) RBF: register RBFMetrics in MetricsSystem for promethuessink

2022-02-21 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-16459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495731#comment-17495731 ] Íñigo Goiri commented on HDFS-16459: Thanks [~max2049] for the PR. Merged PR 3999 to trunk. > RBF:

[jira] [Resolved] (HDFS-16459) RBF: register RBFMetrics in MetricsSystem for promethuessink

2022-02-21 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-16459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri resolved HDFS-16459. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > RBF: register

[jira] [Work logged] (HDFS-16459) RBF: register RBFMetrics in MetricsSystem for promethuessink

2022-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16459?focusedWorklogId=730510=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-730510 ] ASF GitHub Bot logged work on HDFS-16459: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16456) EC: Decommission a rack with only on dn will fail when the rack number is equal with replication

2022-02-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495694#comment-17495694 ] Hadoop QA commented on HDFS-16456: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Work logged] (HDFS-16461) Expose JournalNode storage info in the jmx metrics

2022-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16461?focusedWorklogId=730391=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-730391 ] ASF GitHub Bot logged work on HDFS-16461: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16429) Add DataSetLockManager to manage fine-grain locks for FsDataSetImpl

2022-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16429?focusedWorklogId=730361=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-730361 ] ASF GitHub Bot logged work on HDFS-16429: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

2022-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?focusedWorklogId=730349=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-730349 ] ASF GitHub Bot logged work on HDFS-15382: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

2022-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?focusedWorklogId=730333=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-730333 ] ASF GitHub Bot logged work on HDFS-15382: - Author: ASF GitHub Bot

[jira] [Comment Edited] (HDFS-16456) EC: Decommission a rack with only on dn will fail when the rack number is equal with replication

2022-02-21 Thread caozhiqiang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495451#comment-17495451 ] caozhiqiang edited comment on HDFS-16456 at 2/21/22, 11:02 AM: ---

[jira] [Work logged] (HDFS-16461) Expose JournalNode storage info in the jmx metrics

2022-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16461?focusedWorklogId=730296=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-730296 ] ASF GitHub Bot logged work on HDFS-16461: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16456) EC: Decommission a rack with only on dn will fail when the rack number is equal with replication

2022-02-21 Thread caozhiqiang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495451#comment-17495451 ] caozhiqiang commented on HDFS-16456: [~surendralilhore] , if we don't change network topology to

[jira] [Updated] (HDFS-16456) EC: Decommission a rack with only on dn will fail when the rack number is equal with replication

2022-02-21 Thread caozhiqiang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] caozhiqiang updated HDFS-16456: --- Description: In below scenario, decommission will fail by TOO_MANY_NODES_ON_RACK reason: # Enable

[jira] [Updated] (HDFS-16456) EC: Decommission a rack with only on dn will fail when the rack number is equal with replication

2022-02-21 Thread caozhiqiang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] caozhiqiang updated HDFS-16456: --- Attachment: HDFS-16456.002.patch > EC: Decommission a rack with only on dn will fail when the rack

[jira] [Updated] (HDFS-16456) EC: Decommission a rack with only on dn will fail when the rack number is equal with replication

2022-02-21 Thread caozhiqiang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] caozhiqiang updated HDFS-16456: --- Status: Patch Available (was: Open) > EC: Decommission a rack with only on dn will fail when the

[jira] [Updated] (HDFS-16456) EC: Decommission a rack with only on dn will fail when the rack number is equal with replication

2022-02-21 Thread caozhiqiang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] caozhiqiang updated HDFS-16456: --- Status: Open (was: Patch Available) > EC: Decommission a rack with only on dn will fail when the

[jira] [Updated] (HDFS-16456) EC: Decommission a rack with only on dn will fail when the rack number is equal with replication

2022-02-21 Thread caozhiqiang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] caozhiqiang updated HDFS-16456: --- Attachment: (was: HDFS-16456.002.patch) > EC: Decommission a rack with only on dn will fail when