[jira] [Commented] (HDFS-15904) Flaky test TestBalancer#testBalancerWithSortTopNodes()

2021-03-19 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304671#comment-17304671 ] Viraj Jasani commented on HDFS-15904: - Thanks a lot [~liuml07] for providing all nice

[jira] [Work logged] (HDFS-15904) Flaky test TestBalancer#testBalancerWithSortTopNodes()

2021-03-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15904?focusedWorklogId=568800&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568800 ] ASF GitHub Bot logged work on HDFS-15904: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15850) Superuser actions should be reported to external enforcers

2021-03-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15850?focusedWorklogId=568802&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568802 ] ASF GitHub Bot logged work on HDFS-15850: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15904) Flaky test TestBalancer#testBalancerWithSortTopNodes()

2021-03-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15904?focusedWorklogId=568806&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568806 ] ASF GitHub Bot logged work on HDFS-15904: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15901) Solve the problem of DN repeated block reports occupying too many RPCs during Safemode

2021-03-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304722#comment-17304722 ] Xiaoqiao He commented on HDFS-15901: Thanks for involving me here. IIRC, we have disc

[jira] [Work logged] (HDFS-15868) Possible Resource Leak in EditLogFileOutputStream

2021-03-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15868?focusedWorklogId=568822&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568822 ] ASF GitHub Bot logged work on HDFS-15868: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15868) Possible Resource Leak in EditLogFileOutputStream

2021-03-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15868?focusedWorklogId=568823&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568823 ] ASF GitHub Bot logged work on HDFS-15868: - Author: ASF GitHub Bot

[jira] [Resolved] (HDFS-15868) Possible Resource Leak in EditLogFileOutputStream

2021-03-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-15868. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk! Thank

[jira] [Work logged] (HDFS-15855) Solve the problem of incorrect EC progress when loading FsImage

2021-03-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15855?focusedWorklogId=568832&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568832 ] ASF GitHub Bot logged work on HDFS-15855: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15894) Trace Time-consuming RPC response of certain threshold.

2021-03-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304740#comment-17304740 ] Xiaoqiao He commented on HDFS-15894: Thanks [~prasad-acit] for your proposal. It is u

[jira] [Commented] (HDFS-15894) Trace Time-consuming RPC response of certain threshold.

2021-03-19 Thread Renukaprasad C (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304768#comment-17304768 ] Renukaprasad C commented on HDFS-15894: --- [~hexiaoqiao] Thanks for quick review, i w

[jira] [Created] (HDFS-15906) Close FSImage and FSNamesystem after formatting is complete

2021-03-19 Thread tomscut (Jira)
tomscut created HDFS-15906: -- Summary: Close FSImage and FSNamesystem after formatting is complete Key: HDFS-15906 URL: https://issues.apache.org/jira/browse/HDFS-15906 Project: Hadoop HDFS Issue Ty

[jira] [Work logged] (HDFS-15906) Close FSImage and FSNamesystem after formatting is complete

2021-03-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15906?focusedWorklogId=568918&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568918 ] ASF GitHub Bot logged work on HDFS-15906: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15906) Close FSImage and FSNamesystem after formatting is complete

2021-03-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-15906: -- Labels: pull-request-available (was: ) > Close FSImage and FSNamesystem after formatting is co

[jira] [Work logged] (HDFS-15879) Exclude slow nodes when choose targets for blocks

2021-03-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15879?focusedWorklogId=568921&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568921 ] ASF GitHub Bot logged work on HDFS-15879: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15879) Exclude slow nodes when choose targets for blocks

2021-03-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15879?focusedWorklogId=568922&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568922 ] ASF GitHub Bot logged work on HDFS-15879: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15906) Close FSImage and FSNamesystem after formatting is complete

2021-03-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15906?focusedWorklogId=568923&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568923 ] ASF GitHub Bot logged work on HDFS-15906: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15633) Avoid redundant RPC calls for getDiskStatus

2021-03-19 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304860#comment-17304860 ] Stephen O'Donnell commented on HDFS-15633: -- [~ayushtkn] This looks like another

[jira] [Commented] (HDFS-15868) Possible Resource Leak in EditLogFileOutputStream

2021-03-19 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304911#comment-17304911 ] Kihwal Lee commented on HDFS-15868: --- It is a good change. It was probably neglected dur

[jira] [Commented] (HDFS-15901) Solve the problem of DN repeated block reports occupying too many RPCs during Safemode

2021-03-19 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304928#comment-17304928 ] Kihwal Lee commented on HDFS-15901: --- bq. look forward to your new block report flow con

[jira] [Commented] (HDFS-15901) Solve the problem of DN repeated block reports occupying too many RPCs during Safemode

2021-03-19 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304933#comment-17304933 ] Kihwal Lee commented on HDFS-15901: --- [~jianghuazhu], when it happens again, take a look

[jira] [Comment Edited] (HDFS-15901) Solve the problem of DN repeated block reports occupying too many RPCs during Safemode

2021-03-19 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304933#comment-17304933 ] Kihwal Lee edited comment on HDFS-15901 at 3/19/21, 2:18 PM: -

[jira] [Work logged] (HDFS-15904) Flaky test TestBalancer#testBalancerWithSortTopNodes()

2021-03-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15904?focusedWorklogId=568978&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568978 ] ASF GitHub Bot logged work on HDFS-15904: - Author: ASF GitHub Bot

[jira] [Created] (HDFS-15907) Reduce Memory Overhead of AclFeature by avoiding AtomicInteger

2021-03-19 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDFS-15907: Summary: Reduce Memory Overhead of AclFeature by avoiding AtomicInteger Key: HDFS-15907 URL: https://issues.apache.org/jira/browse/HDFS-15907 Project: Hadoop

[jira] [Work logged] (HDFS-15906) Close FSImage and FSNamesystem after formatting is complete

2021-03-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15906?focusedWorklogId=568996&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568996 ] ASF GitHub Bot logged work on HDFS-15906: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15907) Reduce Memory Overhead of AclFeature by avoiding AtomicInteger

2021-03-19 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15907: - Attachment: HDFS-15907.001.patch > Reduce Memory Overhead of AclFeature by avoiding Atomi

[jira] [Updated] (HDFS-15907) Reduce Memory Overhead of AclFeature by avoiding AtomicInteger

2021-03-19 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15907: - Status: Patch Available (was: Open) > Reduce Memory Overhead of AclFeature by avoiding A

[jira] [Commented] (HDFS-15907) Reduce Memory Overhead of AclFeature by avoiding AtomicInteger

2021-03-19 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17305030#comment-17305030 ] Stephen O'Donnell commented on HDFS-15907: -- [~prasad-acit] [~hexiaoqiao] What do

[jira] [Commented] (HDFS-15907) Reduce Memory Overhead of AclFeature by avoiding AtomicInteger

2021-03-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17305077#comment-17305077 ] Ayush Saxena commented on HDFS-15907: - Thanx [~sodonnell] I had a quick look on HDFS-

[jira] [Commented] (HDFS-14731) [FGL] Remove redundant locking on NameNode.

2021-03-19 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17305081#comment-17305081 ] Konstantin Shvachko commented on HDFS-14731: Sure [~xilangyan] I was thinking

[jira] [Work logged] (HDFS-15904) Flaky test TestBalancer#testBalancerWithSortTopNodes()

2021-03-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15904?focusedWorklogId=569028&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-569028 ] ASF GitHub Bot logged work on HDFS-15904: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15633) Avoid redundant RPC calls for getDiskStatus

2021-03-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17305094#comment-17305094 ] Ayush Saxena commented on HDFS-15633: - Cherry-picked to branch-3.3,3.2 and 3.1 Thanx

[jira] [Created] (HDFS-15908) Possible Resource Leak in org.apache.hadoop.hdfs.qjournal.server.Journal

2021-03-19 Thread Narges Shadab (Jira)
Narges Shadab created HDFS-15908: Summary: Possible Resource Leak in org.apache.hadoop.hdfs.qjournal.server.Journal Key: HDFS-15908 URL: https://issues.apache.org/jira/browse/HDFS-15908 Project: Hadoo

[jira] [Work logged] (HDFS-15908) Possible Resource Leak in org.apache.hadoop.hdfs.qjournal.server.Journal

2021-03-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15908?focusedWorklogId=569044&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-569044 ] ASF GitHub Bot logged work on HDFS-15908: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15908) Possible Resource Leak in org.apache.hadoop.hdfs.qjournal.server.Journal

2021-03-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-15908: -- Labels: pull-request-available (was: ) > Possible Resource Leak in org.apache.hadoop.hdfs.qjou

[jira] [Resolved] (HDFS-15527) Error On adding new Namespace

2021-03-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-15527. - Resolution: Not A Bug > Error On adding new Namespace > - > >

[jira] [Updated] (HDFS-15438) Setting dfs.disk.balancer.max.disk.errors = 0 will fail the block copy

2021-03-19 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15438: - Fix Version/s: 3.2.3 3.1.5 3.3.1 > Setting dfs.disk

[jira] [Commented] (HDFS-15438) Setting dfs.disk.balancer.max.disk.errors = 0 will fail the block copy

2021-03-19 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17305227#comment-17305227 ] Stephen O'Donnell commented on HDFS-15438: -- This was a clean cherry-pick down to

[jira] [Work logged] (HDFS-15904) Flaky test TestBalancer#testBalancerWithSortTopNodes()

2021-03-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15904?focusedWorklogId=569191&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-569191 ] ASF GitHub Bot logged work on HDFS-15904: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15908) Possible Resource Leak in org.apache.hadoop.hdfs.qjournal.server.Journal

2021-03-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15908?focusedWorklogId=569201&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-569201 ] ASF GitHub Bot logged work on HDFS-15908: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15850) Superuser actions should be reported to external enforcers

2021-03-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15850?focusedWorklogId=569206&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-569206 ] ASF GitHub Bot logged work on HDFS-15850: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15907) Reduce Memory Overhead of AclFeature by avoiding AtomicInteger

2021-03-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17305261#comment-17305261 ] Hadoop QA commented on HDFS-15907: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Work logged] (HDFS-15904) Flaky test TestBalancer#testBalancerWithSortTopNodes()

2021-03-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15904?focusedWorklogId=569216&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-569216 ] ASF GitHub Bot logged work on HDFS-15904: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15904) Flaky test TestBalancer#testBalancerWithSortTopNodes()

2021-03-19 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17305296#comment-17305296 ] Mingliang Liu commented on HDFS-15904: -- Committed to Hadoop 3. [~vjasani] Could you

[jira] [Comment Edited] (HDFS-15904) Flaky test TestBalancer#testBalancerWithSortTopNodes()

2021-03-19 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17305296#comment-17305296 ] Mingliang Liu edited comment on HDFS-15904 at 3/20/21, 3:43 AM: ---

[jira] [Updated] (HDFS-15904) Flaky test TestBalancer#testBalancerWithSortTopNodes()

2021-03-19 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-15904: - Component/s: balancer & mover > Flaky test TestBalancer#testBalancerWithSortTopNodes() >

[jira] [Updated] (HDFS-15904) Flaky test TestBalancer#testBalancerWithSortTopNodes()

2021-03-19 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-15904: - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resol

[jira] [Work logged] (HDFS-15904) Flaky test TestBalancer#testBalancerWithSortTopNodes()

2021-03-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15904?focusedWorklogId=569217&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-569217 ] ASF GitHub Bot logged work on HDFS-15904: - Author: ASF GitHub Bot