[jira] [Created] (HDFS-15129) HDFS: Number of excess replica is not getting updated in hdfs fsck "-blockId" option for over-replicated blocks

2020-01-17 Thread Souryakanta Dwivedy (Jira)
Souryakanta Dwivedy created HDFS-15129: -- Summary: HDFS: Number of excess replica is not getting updated in hdfs fsck "-blockId" option for over-replicated blocks Key: HDFS-15129 URL: https://issues.apache.org

[jira] [Created] (HDFS-15130) HDFS:fsck "-blockId" has no option to display number of replicas for under replicated blocks

2020-01-17 Thread Souryakanta Dwivedy (Jira)
Souryakanta Dwivedy created HDFS-15130: -- Summary: HDFS:fsck "-blockId" has no option to display number of replicas for under replicated blocks Key: HDFS-15130 URL: https://issues.apache.org/jira/browse/HDFS-1

[jira] [Commented] (HDFS-15127) RBF: Do not allow writes when a subcluster is unavailable for HASH_ALL mount points.

2020-01-17 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018012#comment-17018012 ] Ayush Saxena commented on HDFS-15127: - Thanx [~elgoiri] for putting this up, I guess

[jira] [Assigned] (HDFS-15127) RBF: Do not allow writes when a subcluster is unavailable for HASH_ALL mount points.

2020-01-17 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reassigned HDFS-15127: --- Assignee: Íñigo Goiri > RBF: Do not allow writes when a subcluster is unavailable for HASH_A

[jira] [Commented] (HDFS-15130) HDFS:fsck "-blockId" has no option to display number of replicas for under replicated blocks

2020-01-17 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018019#comment-17018019 ] Ayush Saxena commented on HDFS-15130: - It is written there, no of expected and actual

[jira] [Commented] (HDFS-15129) HDFS: Number of excess replica is not getting updated in hdfs fsck "-blockId" option for over-replicated blocks

2020-01-17 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018029#comment-17018029 ] Ayush Saxena commented on HDFS-15129: - Is this not working in the scenario, that you

[jira] [Commented] (HDFS-15130) HDFS:fsck "-blockId" has no option to display number of replicas for under replicated blocks

2020-01-17 Thread Souryakanta Dwivedy (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018032#comment-17018032 ] Souryakanta Dwivedy commented on HDFS-15130: Then this kind of assumption can

[jira] [Commented] (HDFS-15130) HDFS:fsck "-blockId" has no option to display number of replicas for under replicated blocks

2020-01-17 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018047#comment-17018047 ] Ayush Saxena commented on HDFS-15130: - There is an ENUM for excess, but none for unde

[jira] [Comment Edited] (HDFS-15130) HDFS:fsck "-blockId" has no option to display number of replicas for under replicated blocks

2020-01-17 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018047#comment-17018047 ] Ayush Saxena edited comment on HDFS-15130 at 1/17/20 2:00 PM: -

[jira] [Created] (HDFS-15131) FoldedTreeSet appears to degrade over time

2020-01-17 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDFS-15131: Summary: FoldedTreeSet appears to degrade over time Key: HDFS-15131 URL: https://issues.apache.org/jira/browse/HDFS-15131 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-15126) testForcedRegistration fails Intermittently

2020-01-17 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018113#comment-17018113 ] Ahmed Hussein commented on HDFS-15126: -- {quote}I went over this class and this is a

[jira] [Updated] (HDFS-15131) FoldedTreeSet appears to degrade over time

2020-01-17 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15131: - Component/s: namenode datanode Target Version/s: 3.3.0

[jira] [Updated] (HDFS-15125) Pull back HDFS-11353, HDFS-13993, HDFS-13945, and HDFS-14324 to branch-2.10

2020-01-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-15125: --- Summary: Pull back HDFS-11353, HDFS-13993, HDFS-13945, and HDFS-14324 to branch-2.10 (was: Pull back

[jira] [Commented] (HDFS-15125) Pull back HDFS-11353, HDFS-13993, HDFS-13945, and HDFS-14324 to branch-2.10

2020-01-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018120#comment-17018120 ] Jim Brennan commented on HDFS-15125: I don't believe that any of the failed unit test

[jira] [Commented] (HDFS-15131) FoldedTreeSet appears to degrade over time

2020-01-17 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018189#comment-17018189 ] Stephen O'Donnell commented on HDFS-15131: -- Tracking a 3rd occurrence of this is

[jira] [Comment Edited] (HDFS-15131) FoldedTreeSet appears to degrade over time

2020-01-17 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018189#comment-17018189 ] Stephen O'Donnell edited comment on HDFS-15131 at 1/17/20 5:01 PM:

[jira] [Commented] (HDFS-15126) testForcedRegistration fails Intermittently

2020-01-17 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018211#comment-17018211 ] Íñigo Goiri commented on HDFS-15126: On top of the extension that you have, can we do

[jira] [Commented] (HDFS-14757) TestBalancerRPCDelay.testBalancerRPCDelay failed

2020-01-17 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018236#comment-17018236 ] Ahmed Hussein commented on HDFS-14757: -- [~weichiu], Can you please take a look at th

[jira] [Updated] (HDFS-15071) Add DataNode Read and Write throughput percentile metrics

2020-01-17 Thread Danny Becker (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Becker updated HDFS-15071: Attachment: HDFS-15071.004.patch > Add DataNode Read and Write throughput percentile metrics >

[jira] [Updated] (HDFS-15126) testForcedRegistration fails Intermittently

2020-01-17 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15126: - Attachment: HDFS-15126.002.patch > testForcedRegistration fails Intermittently >

[jira] [Commented] (HDFS-15125) Pull back HDFS-11353, HDFS-13993, HDFS-13945, and HDFS-14324 to branch-2.10

2020-01-17 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018286#comment-17018286 ] Ahmed Hussein commented on HDFS-15125: -- *(non-binding)* [~Jim_Brennan], Can we add a

[jira] [Updated] (HDFS-15131) FoldedTreeSet appears to degrade over time

2020-01-17 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15131: - Description: We have seen some occurrences of the Namenode getting very slow on delete o

[jira] [Commented] (HDFS-15125) Pull back HDFS-11353, HDFS-13993, HDFS-13945, and HDFS-14324 to branch-2.10

2020-01-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018297#comment-17018297 ] Jim Brennan commented on HDFS-15125: Thanks for the review [~ahussein]!  It's a good

[jira] [Comment Edited] (HDFS-15125) Pull back HDFS-11353, HDFS-13993, HDFS-13945, and HDFS-14324 to branch-2.10

2020-01-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018297#comment-17018297 ] Jim Brennan edited comment on HDFS-15125 at 1/17/20 8:42 PM: -

[jira] [Commented] (HDFS-15126) testForcedRegistration fails Intermittently

2020-01-17 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018313#comment-17018313 ] Íñigo Goiri commented on HDFS-15126: +1 on [^HDFS-15126.002.patch]. > testForcedRegi

[jira] [Updated] (HDFS-15127) RBF: Do not allow writes when a subcluster is unavailable for HASH_ALL mount points.

2020-01-17 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-15127: --- Attachment: HDFS-15127.001.patch > RBF: Do not allow writes when a subcluster is unavailable for HASH

[jira] [Commented] (HDFS-15127) RBF: Do not allow writes when a subcluster is unavailable for HASH_ALL mount points.

2020-01-17 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018349#comment-17018349 ] Íñigo Goiri commented on HDFS-15127: [^HDFS-15127.001.patch] takes a try to fixing th

[jira] [Commented] (HDFS-15127) RBF: Do not allow writes when a subcluster is unavailable for HASH_ALL mount points.

2020-01-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018386#comment-17018386 ] Hadoop QA commented on HDFS-15127: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15126) testForcedRegistration fails Intermittently

2020-01-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018397#comment-17018397 ] Hadoop QA commented on HDFS-15126: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15071) Add DataNode Read and Write throughput percentile metrics

2020-01-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018401#comment-17018401 ] Hadoop QA commented on HDFS-15071: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-15127) RBF: Do not allow writes when a subcluster is unavailable for HASH_ALL mount points.

2020-01-17 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-15127: --- Attachment: HDFS-15127.002.patch > RBF: Do not allow writes when a subcluster is unavailable for HASH

[jira] [Commented] (HDFS-15127) RBF: Do not allow writes when a subcluster is unavailable for HASH_ALL mount points.

2020-01-17 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018469#comment-17018469 ] Íñigo Goiri commented on HDFS-15127: [^HDFS-15127.002.patch] updates the rest of the

[jira] [Commented] (HDFS-15127) RBF: Do not allow writes when a subcluster is unavailable for HASH_ALL mount points.

2020-01-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018479#comment-17018479 ] Hadoop QA commented on HDFS-15127: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15127) RBF: Do not allow writes when a subcluster is unavailable for HASH_ALL mount points.

2020-01-17 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018519#comment-17018519 ] Ayush Saxena commented on HDFS-15127: - Thanx [~elgoiri] for the update, Seems the tes

[jira] [Commented] (HDFS-15126) testForcedRegistration fails Intermittently

2020-01-17 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018522#comment-17018522 ] Ayush Saxena commented on HDFS-15126: - Thanx [~ahussein] for the fix. I tried running

[jira] [Updated] (HDFS-15126) TestDatanodeRegistration#testForcedRegistration fails Intermittently

2020-01-17 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15126: Summary: TestDatanodeRegistration#testForcedRegistration fails Intermittently (was: testForcedRegi

[jira] [Comment Edited] (HDFS-15126) TestDatanodeRegistration#testForcedRegistration fails Intermittently

2020-01-17 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018522#comment-17018522 ] Ayush Saxena edited comment on HDFS-15126 at 1/18/20 6:44 AM: -