[jira] [Updated] (HDFS-4261) TestBalancerWithNodeGroup times out

[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4261: - Attachment: HDFS-4261-v6.patch In v6 patch, remove checking balanced for test case of

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13529610#comment-13529610 ] Junping Du commented on HDFS-4261: -- Yes. For each iteration, a new Balancer object is

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13529646#comment-13529646 ] Junping Du commented on HDFS-4261: -- Chris, Thanks for comments. Can you tell me the

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13529684#comment-13529684 ] Junping Du commented on HDFS-4261: -- Thanks. It is great if you can post the thread dumps.

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13528719#comment-13528719 ] Junping Du commented on HDFS-4261: -- Sure. I am looking into it now.

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13527398#comment-13527398 ] Junping Du commented on HDFS-4261: -- Great.Thanks Chris for investigation and ATM and

[jira] [Commented] (HDFS-4282) TestEditLog.testFuzzSequences FAILED in all pre-commit test

[ https://issues.apache.org/jira/browse/HDFS-4282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13511213#comment-13511213 ] Junping Du commented on HDFS-4282: -- Yes. Option 2 seems to be a better way.

[jira] [Updated] (HDFS-4261) TestBalancerWithNodeGroup times out

[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4261: - Attachment: HDFS-4261-v4.patch Address ATM's comments to fix a bug involved in previous JIRA patch.

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13511228#comment-13511228 ] Junping Du commented on HDFS-4261: -- Thanks ATM for the important reminder!

[jira] [Updated] (HDFS-4261) TestBalancerWithNodeGroup times out

[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4261: - Attachment: HDFS-4261-v3.patch TestBalancerWithNodeGroup times out

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13510989#comment-13510989 ] Junping Du commented on HDFS-4261: -- Yes. It looks like a better idea. I already addressed

[jira] [Updated] (HDFS-4282) TestEditLog.testFuzzSequences FAILED in all pre-commit test

[ https://issues.apache.org/jira/browse/HDFS-4282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4282: - Description: code Caught non-IOException throwable java.lang.RuntimeException: java.io.IOException:

[jira] [Created] (HDFS-4282) TestEditLog.testFuzzSequences FAILED in all pre-commit test

Junping Du created HDFS-4282: Summary: TestEditLog.testFuzzSequences FAILED in all pre-commit test Key: HDFS-4282 URL: https://issues.apache.org/jira/browse/HDFS-4282 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-4282) TestEditLog.testFuzzSequences FAILED in all pre-commit test

[ https://issues.apache.org/jira/browse/HDFS-4282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4282: - Description: Caught non-IOException throwable java.lang.RuntimeException: java.io.IOException: Invalid

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13511172#comment-13511172 ] Junping Du commented on HDFS-4261: -- Hi, ATM. You are right it should be a bug in HDFS-3495

[jira] [Updated] (HDFS-4261) TestBalancerWithNodeGroup times out

[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4261: - Attachment: HDFS-4261.patch Upload a patch with test case to reproduce time-out and fix it.

[jira] [Updated] (HDFS-4261) TestBalancerWithNodeGroup times out

[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4261: - Attachment: HDFS-4261-v2.patch TestBalancerWithNodeGroup times out

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13510219#comment-13510219 ] Junping Du commented on HDFS-4261: -- Thanks Nicolas for the review. I address your comments

[jira] [Updated] (HDFS-4261) TestBalancerWithNodeGroup times out

[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4261: - Target Version/s: 2.0.3-alpha, 1.1.2 Affects Version/s: 1.0.4 1.1.1

[jira] [Commented] (HDFS-4234) Use the generic code for choosing datanode in Balancer

[ https://issues.apache.org/jira/browse/HDFS-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509394#comment-13509394 ] Junping Du commented on HDFS-4234: -- Nicholas, the second patch looks the same as the first

[jira] [Commented] (HDFS-4234) Use the generic code for choosing datanode in Balancer

[ https://issues.apache.org/jira/browse/HDFS-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509413#comment-13509413 ] Junping Du commented on HDFS-4234: -- +1. Patch looks good to me. Thanks for the patch to

[jira] [Commented] (HDFS-4234) Use the generic code for choosing datanode in Balancer

[ https://issues.apache.org/jira/browse/HDFS-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508482#comment-13508482 ] Junping Du commented on HDFS-4234: -- Thanks Nicholas. You did a great job to abstract code

[jira] [Commented] (HDFS-4240) In nodegroup-aware case, make sure nodes are avoided to place replica if some replica are already under the same nodegroup

[ https://issues.apache.org/jira/browse/HDFS-4240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508494#comment-13508494 ] Junping Du commented on HDFS-4240: -- Thanks Jing for the review. Yes. Set checking stale

[jira] [Updated] (HDFS-3495) Update Balancer to support new NetworkTopology with NodeGroup

[ https://issues.apache.org/jira/browse/HDFS-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3495: - Attachment: HDFS-3495-v5.patch Update Balancer to support new NetworkTopology with NodeGroup

[jira] [Commented] (HDFS-3495) Update Balancer to support new NetworkTopology with NodeGroup

[ https://issues.apache.org/jira/browse/HDFS-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13505207#comment-13505207 ] Junping Du commented on HDFS-3495: -- Thanks Nicholas for your careful review. I address all

[jira] [Commented] (HDFS-3495) Update Balancer to support new NetworkTopology with NodeGroup

[ https://issues.apache.org/jira/browse/HDFS-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13502685#comment-13502685 ] Junping Du commented on HDFS-3495: -- Hi Nicholas, Thanks for your review and your great

[jira] [Updated] (HDFS-3495) Update Balancer to support new NetworkTopology with NodeGroup

[ https://issues.apache.org/jira/browse/HDFS-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3495: - Attachment: HADOOP-9045-v4.patch Nicholas, I address all your comments in v4 patch. Great thanks for your

[jira] [Updated] (HDFS-3495) Update Balancer to support new NetworkTopology with NodeGroup

[ https://issues.apache.org/jira/browse/HDFS-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3495: - Attachment: (was: HADOOP-9045-v4.patch) Update Balancer to support new NetworkTopology with

[jira] [Updated] (HDFS-3495) Update Balancer to support new NetworkTopology with NodeGroup

[ https://issues.apache.org/jira/browse/HDFS-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3495: - Attachment: HDFS-3495-v4.patch Update Balancer to support new NetworkTopology with NodeGroup

[jira] [Commented] (HDFS-3495) Update Balancer to support new NetworkTopology with NodeGroup

[ https://issues.apache.org/jira/browse/HDFS-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13502762#comment-13502762 ] Junping Du commented on HDFS-3495: -- Sorry. Above is a wrong patch, update a correct one of

[jira] [Commented] (HDFS-4204) TestNNThroughputBenchmark fails in branch-1

[ https://issues.apache.org/jira/browse/HDFS-4204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13502556#comment-13502556 ] Junping Du commented on HDFS-4204: -- Shall we figure out why null or empty is passed here?

[jira] [Updated] (HDFS-3495) Update Balancer to support new NetworkTopology with NodeGroup

[ https://issues.apache.org/jira/browse/HDFS-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3495: - Attachment: HDFS-3495-v2.patch Update with combine patches in HDFS-3496 and HDFS-3497 v3 patch.

[jira] [Updated] (HDFS-3495) Update Balancer to support new NetworkTopology with NodeGroup

[ https://issues.apache.org/jira/browse/HDFS-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3495: - Target Version/s: 2.0.2-alpha, 1.1.0 Affects Version/s: (was: 2.0.0-alpha)

[jira] [Commented] (HDFS-3495) Update Balancer to support new NetworkTopology with NodeGroup

[ https://issues.apache.org/jira/browse/HDFS-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13499970#comment-13499970 ] Junping Du commented on HDFS-3495: -- One test failure seems irrelevant. Also, this test is

[jira] [Updated] (HDFS-3495) Update Balancer to support new NetworkTopology with NodeGroup

[ https://issues.apache.org/jira/browse/HDFS-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3495: - Attachment: HDFS-3495-v3.patch Update Balancer to support new NetworkTopology with NodeGroup

[jira] [Commented] (HDFS-3941) Backport HDFS-3498 and HDFS3601: update replica placement policy for new added NodeGroup layer topology

[ https://issues.apache.org/jira/browse/HDFS-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13499431#comment-13499431 ] Junping Du commented on HDFS-3941: -- Thanks Nicholas and Jing! Backport

[jira] [Commented] (HDFS-3941) Backport HDFS-3498 and HDFS3601: update replica placement policy for new added NodeGroup layer topology

[ https://issues.apache.org/jira/browse/HDFS-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13498916#comment-13498916 ] Junping Du commented on HDFS-3941: -- Jing, your patch seems to also include a bug fix which

[jira] [Commented] (HDFS-3941) Backport HDFS-3498 and HDFS3601: update replica placement policy for new added NodeGroup layer topology

[ https://issues.apache.org/jira/browse/HDFS-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13498147#comment-13498147 ] Junping Du commented on HDFS-3941: -- Nicholas, I just file a related bug against trunk on

[jira] [Commented] (HDFS-3941) Backport HDFS-3498 and HDFS3601: update replica placement policy for new added NodeGroup layer topology

[ https://issues.apache.org/jira/browse/HDFS-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13498576#comment-13498576 ] Junping Du commented on HDFS-3941: -- Hi, Jing, I am currently working on this. Due to time

[jira] [Commented] (HDFS-3941) Backport HDFS-3498 and HDFS3601: update replica placement policy for new added NodeGroup layer topology

[ https://issues.apache.org/jira/browse/HDFS-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13496621#comment-13496621 ] Junping Du commented on HDFS-3941: -- Hi Nicholas. Ok. I will file a separated jira to fix

[jira] [Created] (HDFS-4127) Log message is not correct in case of short of replica

Junping Du created HDFS-4127: Summary: Log message is not correct in case of short of replica Key: HDFS-4127 URL: https://issues.apache.org/jira/browse/HDFS-4127 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-4127) Log message is not correct in case of short of replica

[ https://issues.apache.org/jira/browse/HDFS-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13486176#comment-13486176 ] Junping Du commented on HDFS-4127: -- Sure. I will add fix patch and unit test with example

[jira] [Assigned] (HDFS-4127) Log message is not correct in case of short of replica

[ https://issues.apache.org/jira/browse/HDFS-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned HDFS-4127: Assignee: Junping Du Log message is not correct in case of short of replica

[jira] [Updated] (HDFS-4127) Log message is not correct in case of short of replica

[ https://issues.apache.org/jira/browse/HDFS-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4127: - Attachment: HDFS-4127.patch Log message is not correct in case of short of replica

[jira] [Commented] (HDFS-4127) Log message is not correct in case of short of replica

[ https://issues.apache.org/jira/browse/HDFS-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13486191#comment-13486191 ] Junping Du commented on HDFS-4127: -- Hi Suresh, Please check the patch with an example

[jira] [Commented] (HDFS-4127) Log message is not correct in case of short of replica

[ https://issues.apache.org/jira/browse/HDFS-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13486387#comment-13486387 ] Junping Du commented on HDFS-4127: -- Hi Jing, Thanks for the comments. For calculating

[jira] [Updated] (HDFS-4127) Log message is not correct in case of short of replica

[ https://issues.apache.org/jira/browse/HDFS-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4127: - Attachment: HDFS-4127.patch Log message is not correct in case of short of replica

[jira] [Updated] (HDFS-4127) Log message is not correct in case of short of replica

[ https://issues.apache.org/jira/browse/HDFS-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4127: - Target Version/s: 2.0.2-alpha, 0.23.4, 1.1.0 (was: 1.1.0, 0.23.4, 2.0.2-alpha) Status:

[jira] [Commented] (HDFS-4127) Log message is not correct in case of short of replica

[ https://issues.apache.org/jira/browse/HDFS-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13486413#comment-13486413 ] Junping Du commented on HDFS-4127: -- Agree. Update new patch and make it patch available.

[jira] [Commented] (HDFS-1338) Improve TestDFSIO

[ https://issues.apache.org/jira/browse/HDFS-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13464772#comment-13464772 ] Junping Du commented on HDFS-1338: -- Hi, This jira looks to be pending for a long time.

[jira] [Updated] (HDFS-3941) Backport HDFS-3498 and HDFS3601: update replica placement policy for new added NodeGroup layer topology

[ https://issues.apache.org/jira/browse/HDFS-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3941: - Attachment: HDFS-3941.patch Backport HDFS-3498 and HDFS3601: update replica placement policy for new

[jira] [Updated] (HDFS-3942) Backport HDFS-3495: Update balancer policy for Network Topology with additional 'NodeGroup' layer

[ https://issues.apache.org/jira/browse/HDFS-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3942: - Attachment: HDFS-3942.patch Backport HDFS-3495: Update balancer policy for Network Topology with

[jira] [Updated] (HDFS-3941) Backport HDFS-3498 and HDFS3601: update replica placement policy for new added NodeGroup layer topology

[ https://issues.apache.org/jira/browse/HDFS-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3941: - Target Version/s: 1.2.0 (was: 1.0.3) Backport HDFS-3498 and HDFS3601: update replica placement

[jira] [Updated] (HDFS-3941) Backport HDFS-3498 and HDFS3601: update replica placement policy for new added NodeGroup layer topology

[ https://issues.apache.org/jira/browse/HDFS-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3941: - Description: With enabling additional layer of NodeGroup, the replica placement policy used in

[jira] [Updated] (HDFS-3941) Backport HDFS-3498 and HDFS3601: update replica placement policy for new added NodeGroup layer topology

[ https://issues.apache.org/jira/browse/HDFS-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3941: - Description: With enabling additional layer of NodeGroup, the replica placement policy used in

[jira] [Created] (HDFS-3941) Backport HDFS-3498 and HDFS3601: update replica placement policy for new added NodeGroup layer topology

Junping Du created HDFS-3941: Summary: Backport HDFS-3498 and HDFS3601: update replica placement policy for new added NodeGroup layer topology Key: HDFS-3941 URL: https://issues.apache.org/jira/browse/HDFS-3941

[jira] [Assigned] (HDFS-3941) Backport HDFS-3498 and HDFS3601: update replica placement policy for new added NodeGroup layer topology

[ https://issues.apache.org/jira/browse/HDFS-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned HDFS-3941: Assignee: Junping Du Backport HDFS-3498 and HDFS3601: update replica placement policy for new

[jira] [Created] (HDFS-3942) Backport HDFS-3495: Update balancer policy for Network Topology with additional 'NodeGroup' layer

Junping Du created HDFS-3942: Summary: Backport HDFS-3495: Update balancer policy for Network Topology with additional 'NodeGroup' layer Key: HDFS-3942 URL: https://issues.apache.org/jira/browse/HDFS-3942

[jira] [Assigned] (HDFS-3942) Backport HDFS-3495: Update balancer policy for Network Topology with additional 'NodeGroup' layer

[ https://issues.apache.org/jira/browse/HDFS-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned HDFS-3942: Assignee: Junping Du Backport HDFS-3495: Update balancer policy for Network Topology with

[jira] [Assigned] (HDFS-3747) balancer-Test failed because of time out

[ https://issues.apache.org/jira/browse/HDFS-3747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned HDFS-3747: Assignee: meng gong balancer-Test failed because of time out

[jira] [Commented] (HDFS-3295) Mismatch in number of bytes already moved and number of bytes being moved in balancer report

[ https://issues.apache.org/jira/browse/HDFS-3295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13426496#comment-13426496 ] Junping Du commented on HDFS-3295: -- +1 on the nice finding on the bug. However, shall we

[jira] [Reopened] (HDFS-3746) Invalid counter tag in HDFS balancer which lead to infinite loop

[ https://issues.apache.org/jira/browse/HDFS-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reopened HDFS-3746: -- Invalid counter tag in HDFS balancer which lead to infinite loop

[jira] [Assigned] (HDFS-3746) Invalid counter tag in HDFS balancer which lead to infinite loop

[ https://issues.apache.org/jira/browse/HDFS-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned HDFS-3746: Assignee: Junping Du (was: Jing Zhao) Invalid counter tag in HDFS balancer which lead to

[jira] [Commented] (HDFS-3746) Invalid counter tag in HDFS balancer which lead to infinite loop

[ https://issues.apache.org/jira/browse/HDFS-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13426310#comment-13426310 ] Junping Du commented on HDFS-3746: -- Meng, that's good finding. I think we should have a

[jira] [Commented] (HDFS-3746) Invalid counter tag in HDFS balancer which lead to infinite loop

[ https://issues.apache.org/jira/browse/HDFS-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13426312#comment-13426312 ] Junping Du commented on HDFS-3746: -- Eli, can you add Meng Gong to some alias so that I can

[jira] [Commented] (HDFS-3746) Invalid counter tag in HDFS balancer which lead to infinite loop

[ https://issues.apache.org/jira/browse/HDFS-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13426315#comment-13426315 ] Junping Du commented on HDFS-3746: -- Thanks! Eli. Invalid counter tag in

[jira] [Updated] (HDFS-3497) Update Balancer policy with NodeGroup layer

[ https://issues.apache.org/jira/browse/HDFS-3497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3497: - Attachment: HDFS-3497-v3.patch Update Balancer policy with NodeGroup layer

[jira] [Updated] (HDFS-3625) FSN#startActiveServices assumes standby services started

[ https://issues.apache.org/jira/browse/HDFS-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3625: - Attachment: HDFS-3625.patch Update patch to affect Backup node only.

[jira] [Commented] (HDFS-3625) FSN#startActiveServices assumes standby services started

[ https://issues.apache.org/jira/browse/HDFS-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13414922#comment-13414922 ] Junping Du commented on HDFS-3625: -- This patch is only for fixing current pre-commit test

[jira] [Updated] (HDFS-3497) Update Balancer policy with NodeGroup layer

[ https://issues.apache.org/jira/browse/HDFS-3497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3497: - Attachment: HDFS-3497-v2.patch Rebase to lastest trunk, previous PreCommit tests should be fixed.

[jira] [Updated] (HDFS-3625) FSN#startActiveServices assumes standby services started

[ https://issues.apache.org/jira/browse/HDFS-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3625: - Attachment: HDFS-3625.patch FSN#startActiveServices assumes standby services started

[jira] [Commented] (HDFS-3625) FSN#startActiveServices assumes standby services started

[ https://issues.apache.org/jira/browse/HDFS-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13414633#comment-13414633 ] Junping Du commented on HDFS-3625: -- The EditLog of BN should be initialized during

[jira] [Updated] (HDFS-3625) FSN#startActiveServices assumes standby services started

[ https://issues.apache.org/jira/browse/HDFS-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3625: - Status: Patch Available (was: Open) FSN#startActiveServices assumes standby services started

[jira] [Updated] (HDFS-3625) FSN#startActiveServices assumes standby services started

[ https://issues.apache.org/jira/browse/HDFS-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3625: - Priority: Blocker (was: Major) FSN#startActiveServices assumes standby services started

[jira] [Commented] (HDFS-3654) TestJspHelper#testGetUgi may fail

[ https://issues.apache.org/jira/browse/HDFS-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13413653#comment-13413653 ] Junping Du commented on HDFS-3654: -- Looks like in TestJspHelper#testGetUgi, servletContext

[jira] [Updated] (HDFS-3497) Update Balancer for performance optimization with Node Group- choose the target and source node on the same node group for balancing as the first priority

[ https://issues.apache.org/jira/browse/HDFS-3497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3497: - Attachment: HDFS-3497.patch Update Balancer for performance optimization with Node Group- choose the

[jira] [Updated] (HDFS-3497) Update Balancer for performance optimization with Node Group- choose the target and source node on the same node group for balancing as the first priority

[ https://issues.apache.org/jira/browse/HDFS-3497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3497: - Status: Patch Available (was: Open) Update Balancer for performance optimization with Node Group-

[jira] [Commented] (HDFS-3497) Update Balancer for performance optimization with Node Group- choose the target and source node on the same node group for balancing as the first priority

[ https://issues.apache.org/jira/browse/HDFS-3497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13412570#comment-13412570 ] Junping Du commented on HDFS-3497: -- This patch is for adding additional layer of nodegroup

[jira] [Updated] (HDFS-3497) Update Balancer policy with NodeGroup layer

[ https://issues.apache.org/jira/browse/HDFS-3497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3497: - Description: 1. Make sure Network Topology and BlockPlacementPolicy check in balancer is compatible with

[jira] [Commented] (HDFS-3497) Update Balancer policy with NodeGroup layer

[ https://issues.apache.org/jira/browse/HDFS-3497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13412703#comment-13412703 ] Junping Du commented on HDFS-3497: -- The test failure is tracked by HDFS-3625 which is not

[jira] [Commented] (HDFS-3619) isGoodBlockCandidate() in Balancer is not handling properly if replica factor 3

[ https://issues.apache.org/jira/browse/HDFS-3619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13410105#comment-13410105 ] Junping Du commented on HDFS-3619: -- I notice one comment of isGoodBlockCandidate() in

[jira] [Created] (HDFS-3619) isGoodBlockCandidate() in Balancer is not handling properly if replica factor 3

Junping Du created HDFS-3619: Summary: isGoodBlockCandidate() in Balancer is not handling properly if replica factor 3 Key: HDFS-3619 URL: https://issues.apache.org/jira/browse/HDFS-3619 Project: Hadoop

[jira] [Commented] (HDFS-3364) TestFileAppend4.testRecoverFinalizedBlock occasionally times out

[ https://issues.apache.org/jira/browse/HDFS-3364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13406354#comment-13406354 ] Junping Du commented on HDFS-3364: -- I saw this error in pre-commit test for HADOOP-8472,

[jira] [Commented] (HDFS-3500) Test for 4 layer NetworkTopology (with NodeGroup)

[ https://issues.apache.org/jira/browse/HDFS-3500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13404718#comment-13404718 ] Junping Du commented on HDFS-3500: -- This jira is created for testing HADOOP-8470, but the

[jira] [Resolved] (HDFS-3500) Test for 4 layer NetworkTopology (with NodeGroup)

[ https://issues.apache.org/jira/browse/HDFS-3500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved HDFS-3500. -- Resolution: Won't Fix Test for 4 layer NetworkTopology (with NodeGroup)

[jira] [Updated] (HDFS-3324) Update DatanodeManager to resolve network location with new API from HADOOP-8304 (DNSToSwitchMapping should add interface to resolve individual host besides a list of host

[ https://issues.apache.org/jira/browse/HDFS-3324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3324: - Resolution: Won't Fix Status: Resolved (was: Patch Available) From comments of HADOOP-8304, we

[jira] [Commented] (HDFS-3498) Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault extensible for reusing code in subclass

[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13403144#comment-13403144 ] Junping Du commented on HDFS-3498: -- Great. With this patch in, nothing is stopper for

[jira] [Commented] (HDFS-3498) Make ReplicaPlacementPolicyDefault extensible for reuse code in subclass

[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13400322#comment-13400322 ] Junping Du commented on HDFS-3498: -- I took a look at the log of javadoc testing:

[jira] [Commented] (HDFS-3498) Make ReplicaPlacementPolicyDefault extensible for reuse code in subclass

[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13400363#comment-13400363 ] Junping Du commented on HDFS-3498: -- File a separated JIRA HADOOP-8526 to fix this issue.

[jira] [Commented] (HDFS-1469) TestBlockTokenWithDFS fails on trunk

[ https://issues.apache.org/jira/browse/HDFS-1469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13400377#comment-13400377 ] Junping Du commented on HDFS-1469: -- I just check on trunk that unit test

[jira] [Updated] (HDFS-3498) Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault extensible for reusing code in subclass

[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3498: - Summary: Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault extensible for reusing

[jira] [Updated] (HDFS-3498) Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault extensible for reusing code in subclass

[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3498: - Attachment: HDFS-3498-v5.patch Make Replica Removal Policy pluggable and

[jira] [Commented] (HDFS-3498) Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault extensible for reusing code in subclass

[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13401136#comment-13401136 ] Junping Du commented on HDFS-3498: -- Thanks. Nicholas. I add a few comments of javadoc in

[jira] [Updated] (HDFS-3498) Make ReplicaPlacementPolicyDefault extensible for reuse code in subclass

[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3498: - Attachment: HDFS-3498-v4.patch Make ReplicaPlacementPolicyDefault extensible for reuse code in

[jira] [Commented] (HDFS-3498) Make ReplicaPlacementPolicyDefault extensible for reuse code in subclass

[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13400085#comment-13400085 ] Junping Du commented on HDFS-3498: -- From the test report, it seems like

[jira] [Updated] (HDFS-3498) Make ReplicaPlacementPolicyDefault extensible for reuse code in subclass

[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3498: - Attachment: (was: HDFS-3498-v4.patch) Make ReplicaPlacementPolicyDefault extensible for reuse

[jira] [Updated] (HDFS-3498) Make ReplicaPlacementPolicyDefault extensible for reuse code in subclass

[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3498: - Attachment: (was: HDFS-3498-v4.patch) Make ReplicaPlacementPolicyDefault extensible for reuse

[jira] [Updated] (HDFS-3498) Make ReplicaPlacementPolicyDefault extensible for reuse code in subclass

[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3498: - Attachment: HDFS-3498-v4.patch Make ReplicaPlacementPolicyDefault extensible for reuse code in

[jira] [Updated] (HDFS-3498) Make ReplicaPlacementPolicyDefault extensible for reuse code in subclass

[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3498: - Status: Patch Available (was: Open) Make ReplicaPlacementPolicyDefault extensible for reuse code in

[jira] [Updated] (HDFS-3498) Make ReplicaPlacementPolicyDefault extensible for reuse code in subclass

[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3498: - Status: Open (was: Patch Available) Looks like Jenkins didn't start auto test on the patch, so I cancel

<    6   7   8   9   10   11   12   >