[jira] [Updated] (HDFS-8549) Abort the balancer if an upgrade is in progress
[ https://issues.apache.org/jira/browse/HDFS-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-8549: -- Labels: release-blocker (was: ) Target Version/s: 2.8.0, 2.7.4 (was: 2.8.0) > Abort the balancer if an upgrade is in progress > --- > > Key: HDFS-8549 > URL: https://issues.apache.org/jira/browse/HDFS-8549 > Project: Hadoop HDFS > Issue Type: Improvement > Components: balancer & mover >Affects Versions: 2.7.0 >Reporter: Andrew Wang >Assignee: Andrew Wang > Labels: release-blocker > Fix For: 2.8.0, 3.0.0-alpha1 > > Attachments: HDFS-8549.001.patch, HDFS-8549.002.patch, > HDFS-8549.003.patch, HDFS-8549.004.patch > > > Running the balancer during an ongoing upgrade has a negative affect, since > DNs do not actually delete blocks. This means the balancer is making lots of > extra replicas and not actually reducing the disk utilization of > over-utilized nodes. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-8549) Abort the balancer if an upgrade is in progress
[ https://issues.apache.org/jira/browse/HDFS-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-8549: -- Attachment: HDFS-8549-branch-2.7.patch > Abort the balancer if an upgrade is in progress > --- > > Key: HDFS-8549 > URL: https://issues.apache.org/jira/browse/HDFS-8549 > Project: Hadoop HDFS > Issue Type: Improvement > Components: balancer & mover >Affects Versions: 2.7.0 >Reporter: Andrew Wang >Assignee: Andrew Wang > Labels: release-blocker > Fix For: 2.8.0, 3.0.0-alpha1 > > Attachments: HDFS-8549.001.patch, HDFS-8549.002.patch, > HDFS-8549.003.patch, HDFS-8549.004.patch, HDFS-8549-branch-2.7.patch > > > Running the balancer during an ongoing upgrade has a negative affect, since > DNs do not actually delete blocks. This means the balancer is making lots of > extra replicas and not actually reducing the disk utilization of > over-utilized nodes. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-8549) Abort the balancer if an upgrade is in progress
[ https://issues.apache.org/jira/browse/HDFS-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-8549: -- Labels: (was: release-blocker) Hadoop Flags: Reviewed Fix Version/s: 2.7.4 Just committed to branch-2.7. Thank you [~ajisakaa] for HDFS-11808 backport. > Abort the balancer if an upgrade is in progress > --- > > Key: HDFS-8549 > URL: https://issues.apache.org/jira/browse/HDFS-8549 > Project: Hadoop HDFS > Issue Type: Improvement > Components: balancer & mover >Affects Versions: 2.7.0 >Reporter: Andrew Wang >Assignee: Andrew Wang > Fix For: 2.8.0, 2.7.4, 3.0.0-alpha1 > > Attachments: HDFS-8549.001.patch, HDFS-8549.002.patch, > HDFS-8549.003.patch, HDFS-8549.004.patch, HDFS-8549-branch-2.7.patch > > > Running the balancer during an ongoing upgrade has a negative affect, since > DNs do not actually delete blocks. This means the balancer is making lots of > extra replicas and not actually reducing the disk utilization of > over-utilized nodes. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-8549) Abort the balancer if an upgrade is in progress
[ https://issues.apache.org/jira/browse/HDFS-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8549: -- Attachment: HDFS-8549.001.patch Patch attached. > Abort the balancer if an upgrade is in progress > --- > > Key: HDFS-8549 > URL: https://issues.apache.org/jira/browse/HDFS-8549 > Project: Hadoop HDFS > Issue Type: Improvement > Components: balancer & mover >Affects Versions: 2.7.0 >Reporter: Andrew Wang >Assignee: Andrew Wang > Attachments: HDFS-8549.001.patch > > > Running the balancer during an ongoing upgrade has a negative affect, since > DNs do not actually delete blocks. This means the balancer is making lots of > extra replicas and not actually reducing the disk utilization of > over-utilized nodes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HDFS-8549) Abort the balancer if an upgrade is in progress
[ https://issues.apache.org/jira/browse/HDFS-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8549: -- Status: Patch Available (was: Open) > Abort the balancer if an upgrade is in progress > --- > > Key: HDFS-8549 > URL: https://issues.apache.org/jira/browse/HDFS-8549 > Project: Hadoop HDFS > Issue Type: Improvement > Components: balancer & mover >Affects Versions: 2.7.0 >Reporter: Andrew Wang >Assignee: Andrew Wang > Attachments: HDFS-8549.001.patch > > > Running the balancer during an ongoing upgrade has a negative affect, since > DNs do not actually delete blocks. This means the balancer is making lots of > extra replicas and not actually reducing the disk utilization of > over-utilized nodes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HDFS-8549) Abort the balancer if an upgrade is in progress
[ https://issues.apache.org/jira/browse/HDFS-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8549: -- Attachment: HDFS-8549.002.patch Fixed a long line and a comment > Abort the balancer if an upgrade is in progress > --- > > Key: HDFS-8549 > URL: https://issues.apache.org/jira/browse/HDFS-8549 > Project: Hadoop HDFS > Issue Type: Improvement > Components: balancer & mover >Affects Versions: 2.7.0 >Reporter: Andrew Wang >Assignee: Andrew Wang > Attachments: HDFS-8549.001.patch, HDFS-8549.002.patch > > > Running the balancer during an ongoing upgrade has a negative affect, since > DNs do not actually delete blocks. This means the balancer is making lots of > extra replicas and not actually reducing the disk utilization of > over-utilized nodes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HDFS-8549) Abort the balancer if an upgrade is in progress
[ https://issues.apache.org/jira/browse/HDFS-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8549: -- Attachment: HDFS-8549.003.patch Thanks for reviewing Colin. I added a "-runDuringUpgrade" flag and test it in the unit test. The TestFileTruncate failure also seems unrelated, worked locally. > Abort the balancer if an upgrade is in progress > --- > > Key: HDFS-8549 > URL: https://issues.apache.org/jira/browse/HDFS-8549 > Project: Hadoop HDFS > Issue Type: Improvement > Components: balancer & mover >Affects Versions: 2.7.0 >Reporter: Andrew Wang >Assignee: Andrew Wang > Attachments: HDFS-8549.001.patch, HDFS-8549.002.patch, > HDFS-8549.003.patch > > > Running the balancer during an ongoing upgrade has a negative affect, since > DNs do not actually delete blocks. This means the balancer is making lots of > extra replicas and not actually reducing the disk utilization of > over-utilized nodes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HDFS-8549) Abort the balancer if an upgrade is in progress
[ https://issues.apache.org/jira/browse/HDFS-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8549: -- Attachment: HDFS-8549.004.patch Wrapped a long line and deleted a trailing space. I'm not changing runDuringUpgrade to have getters for consistency with the other variables. > Abort the balancer if an upgrade is in progress > --- > > Key: HDFS-8549 > URL: https://issues.apache.org/jira/browse/HDFS-8549 > Project: Hadoop HDFS > Issue Type: Improvement > Components: balancer & mover >Affects Versions: 2.7.0 >Reporter: Andrew Wang >Assignee: Andrew Wang > Attachments: HDFS-8549.001.patch, HDFS-8549.002.patch, > HDFS-8549.003.patch, HDFS-8549.004.patch > > > Running the balancer during an ongoing upgrade has a negative affect, since > DNs do not actually delete blocks. This means the balancer is making lots of > extra replicas and not actually reducing the disk utilization of > over-utilized nodes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HDFS-8549) Abort the balancer if an upgrade is in progress
[ https://issues.apache.org/jira/browse/HDFS-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8549: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Pushed to trunk and branch-2, thanks Colin for reviewing. I fixed the last whitespace errors at commit time. > Abort the balancer if an upgrade is in progress > --- > > Key: HDFS-8549 > URL: https://issues.apache.org/jira/browse/HDFS-8549 > Project: Hadoop HDFS > Issue Type: Improvement > Components: balancer & mover >Affects Versions: 2.7.0 >Reporter: Andrew Wang >Assignee: Andrew Wang > Fix For: 2.8.0 > > Attachments: HDFS-8549.001.patch, HDFS-8549.002.patch, > HDFS-8549.003.patch, HDFS-8549.004.patch > > > Running the balancer during an ongoing upgrade has a negative affect, since > DNs do not actually delete blocks. This means the balancer is making lots of > extra replicas and not actually reducing the disk utilization of > over-utilized nodes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
