[jira] [Updated] (HDFS-4884) [Umbrella] Block Placement Policy Optimizer

2013-06-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4884: - Issue Type: New Feature (was: Bug) [Umbrella] Block Placement Policy Optimizer

[jira] [Created] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-06-06 Thread Junping Du (JIRA)
Junping Du created HDFS-4885: Summary: Update verifyBlockPlacement() API in BlockPlacementPolicy Key: HDFS-4885 URL: https://issues.apache.org/jira/browse/HDFS-4885 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-4886) Override verifyBlockPlacement() API in BlockPlacementPolicyWithNodeGroup

2013-06-06 Thread Junping Du (JIRA)
Junping Du created HDFS-4886: Summary: Override verifyBlockPlacement() API in BlockPlacementPolicyWithNodeGroup Key: HDFS-4886 URL: https://issues.apache.org/jira/browse/HDFS-4886 Project: Hadoop HDFS

[jira] [Updated] (HDFS-4886) Override verifyBlockPlacement() API in BlockPlacementPolicyWithNodeGroup

2013-06-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4886: - Target Version/s: 3.0.0 Labels: HVE (was: ) Override verifyBlockPlacement() API in

[jira] [Commented] (HDFS-4885) Update verifyBlockPlacement() API in BlockPlacementPolicy

2013-06-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13677148#comment-13677148 ] Junping Du commented on HDFS-4885: -- Also, the parameter of minRacks doesn't make sense.

[jira] [Commented] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-06-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13677573#comment-13677573 ] Junping Du commented on HDFS-4376: -- You are right. Kihwal. This shouldn't be a test issue

[jira] [Updated] (HDFS-4884) Provide a way to enforce new Block Placement Policy to existing data after switch from old one

2013-06-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4884: - Issue Type: Improvement (was: New Feature) Summary: Provide a way to enforce new Block Placement

[jira] [Updated] (HDFS-4884) Provide a way to enforce new Block Placement Policy to existing data after switch from old one

2013-06-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4884: - Description: The BlockPlacementPolicy (BPP) is extensible and already multiple instances in system:

[jira] [Updated] (HDFS-4894) Multiple Replica Placement Policies support in one HDFS cluster

2013-06-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4894: - Issue Type: New Feature (was: Bug) Multiple Replica Placement Policies support in one HDFS cluster

[jira] [Created] (HDFS-4894) Multiple Replica Placement Policies support in one HDFS cluster

2013-06-06 Thread Junping Du (JIRA)
Junping Du created HDFS-4894: Summary: Multiple Replica Placement Policies support in one HDFS cluster Key: HDFS-4894 URL: https://issues.apache.org/jira/browse/HDFS-4894 Project: Hadoop HDFS

[jira] [Updated] (HDFS-4884) Provide a way to enforce new Block Placement Policy on existing data after switching from old one

2013-06-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4884: - Summary: Provide a way to enforce new Block Placement Policy on existing data after switching from old

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-06-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13672869#comment-13672869 ] Junping Du commented on HDFS-4261: -- Thanks Nicholas!

[jira] [Updated] (HDFS-3601) Implementation of ReplicaPlacementPolicyNodeGroup to support 4-layer network topology

2013-06-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3601: - Target Version/s: 2.0.5-alpha Status: Patch Available (was: Reopened) Implementation

[jira] [Updated] (HDFS-3601) Implementation of ReplicaPlacementPolicyNodeGroup to support 4-layer network topology

2013-06-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3601: - Attachment: HDFS-3601-branch-2.patch Submit a patch for branch-2. Implementation of

[jira] [Reopened] (HDFS-3601) Implementation of ReplicaPlacementPolicyNodeGroup to support 4-layer network topology

2013-06-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reopened HDFS-3601: -- Reopen issue to backport to branch-2. Implementation of ReplicaPlacementPolicyNodeGroup

[jira] [Reopened] (HDFS-4240) In nodegroup-aware case, make sure nodes are avoided to place replica if some replica are already under the same nodegroup

2013-06-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reopened HDFS-4240: -- Reopen JIRA for backport to branch-2 In nodegroup-aware case, make sure nodes are avoided

[jira] [Updated] (HDFS-4240) In nodegroup-aware case, make sure nodes are avoided to place replica if some replica are already under the same nodegroup

2013-06-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4240: - Attachment: HDFS-4240-branch-2.patch submit a patch for branch-2 which should be applied after HDFS-3498

[jira] [Updated] (HDFS-4240) In nodegroup-aware case, make sure nodes are avoided to place replica if some replica are already under the same nodegroup

2013-06-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4240: - Target Version/s: 2.0.5-alpha Status: Patch Available (was: Reopened) In

[jira] [Reopened] (HDFS-3495) Update Balancer to support new NetworkTopology with NodeGroup

2013-06-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reopened HDFS-3495: -- reopen this JIRA to backport to branch-2. Update Balancer to support new NetworkTopology

[jira] [Updated] (HDFS-3495) Update Balancer to support new NetworkTopology with NodeGroup

2013-06-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3495: - Attachment: HDFS-3495-branch-2.patch Attach a patch for branch-2. Update Balancer to

[jira] [Updated] (HDFS-3495) Update Balancer to support new NetworkTopology with NodeGroup

2013-06-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3495: - Fix Version/s: 1.2.0 Target Version/s: 2.0.5-alpha (was: 1.1.0, 2.0.2-alpha) Affects

[jira] [Updated] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-06-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4261: - Attachment: HDFS-4261-branch-2.patch Backport v8 patch to branch-2.

[jira] [Updated] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-06-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4261: - Target Version/s: 1.3.0, 2.0.5-alpha (was: 2.0.3-alpha, 1.3.0) Status: Patch Available

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-06-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13672086#comment-13672086 ] Junping Du commented on HDFS-4261: -- Hi Nicholas, I am backporting NodeGroup layer topology

[jira] [Updated] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-06-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4376: - Target Version/s: 2.1.0-beta, 1.3.0 Intermittent timeout of TestBalancerWithNodeGroup

[jira] [Assigned] (HDFS-4376) Intermittent timeout of TestBalancerWithNodeGroup

2013-06-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned HDFS-4376: Assignee: Junping Du Intermittent timeout of TestBalancerWithNodeGroup

[jira] [Updated] (HDFS-4240) In nodegroup-aware case, make sure nodes are avoided to place replica if some replica are already under the same nodegroup

2013-06-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4240: - Fix Version/s: 1.2.0 In nodegroup-aware case, make sure nodes are avoided to place replica if some

[jira] [Updated] (HDFS-3498) Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault extensible for reusing code in subclass

2013-06-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3498: - Fix Version/s: 1.2.0 Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault

[jira] [Updated] (HDFS-3601) Implementation of ReplicaPlacementPolicyNodeGroup to support 4-layer network topology

2013-06-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3601: - Fix Version/s: 1.2.0 Implementation of ReplicaPlacementPolicyNodeGroup to support 4-layer network

[jira] [Reopened] (HDFS-3498) Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault extensible for reusing code in subclass

2013-05-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reopened HDFS-3498: -- Reopen jira for backport to branch-2 Make Replica Removal Policy pluggable and

[jira] [Updated] (HDFS-3498) Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault extensible for reusing code in subclass

2013-05-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3498: - Target Version/s: 2.0.5-alpha Status: Patch Available (was: Reopened) Make Replica

[jira] [Updated] (HDFS-3498) Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault extensible for reusing code in subclass

2013-05-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3498: - Attachment: HDFS-3498-branch-2.patch Make Replica Removal Policy pluggable and

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-05-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13656879#comment-13656879 ] Junping Du commented on HDFS-4261: -- Ok. Will try to catch up with 1.2.1. Thanks Matt!

[jira] [Commented] (HDFS-4653) 4 unit tests in TestFcHdfsSymlink failed on trunk

2013-04-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13621539#comment-13621539 ] Junping Du commented on HDFS-4653: -- Ok. Good to know it. Thanks Eli! 4

[jira] [Updated] (HDFS-4665) Move TestNetworkTopologyWithNodeGroup to Common

2013-04-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4665: - Attachment: HDFS-4665.patch Attached the patch to remove TestNetworkTopologyWithNodeGroup in HDFS

[jira] [Created] (HDFS-4652) Node with one topology layer should be handled as fault topology when NodeGroup layer is enabled

2013-03-29 Thread Junping Du (JIRA)
Junping Du created HDFS-4652: Summary: Node with one topology layer should be handled as fault topology when NodeGroup layer is enabled Key: HDFS-4652 URL: https://issues.apache.org/jira/browse/HDFS-4652

[jira] [Updated] (HDFS-4652) Node with one topology layer should be handled as fault topology when NodeGroup layer is enabled

2013-03-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4652: - Status: Patch Available (was: Open) Node with one topology layer should be handled as fault

[jira] [Updated] (HDFS-4652) Node with one topology layer should be handled as fault topology when NodeGroup layer is enabled

2013-03-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4652: - Attachment: HDFS-4652.patch Node with one topology layer should be handled as fault topology when

[jira] [Updated] (HDFS-4652) Node with one topology layer should be handled as fault topology when NodeGroup layer is enabled

2013-03-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4652: - Attachment: HDFS-4652-branch1.patch The UT test failed seems unrelated. Attach branch-1 patch as well.

[jira] [Created] (HDFS-4653) 4 unit tests in TestFcHdfsSymlink failed on trunk

2013-03-29 Thread Junping Du (JIRA)
Junping Du created HDFS-4653: Summary: 4 unit tests in TestFcHdfsSymlink failed on trunk Key: HDFS-4653 URL: https://issues.apache.org/jira/browse/HDFS-4653 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-4652) Node with one topology layer should be handled as fault topology when NodeGroup layer is enabled

2013-03-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13617383#comment-13617383 ] Junping Du commented on HDFS-4652: -- The UT failed is a non-related issue as previous

[jira] [Commented] (HDFS-4653) 4 unit tests in TestFcHdfsSymlink failed on trunk

2013-03-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13617933#comment-13617933 ] Junping Du commented on HDFS-4653: -- Thanks Andrew for reply. Per discussion in

[jira] [Assigned] (HDFS-4653) 4 unit tests in TestFcHdfsSymlink failed on trunk

2013-03-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned HDFS-4653: Assignee: Andrew Wang 4 unit tests in TestFcHdfsSymlink failed on trunk

[jira] [Commented] (HDFS-3941) Backport HDFS-3498 and HDFS3601: update replica placement policy for new added NodeGroup layer topology

2013-03-17 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13604544#comment-13604544 ] Junping Du commented on HDFS-3941: -- Harsh, we reach to agreement to backport it to

[jira] [Commented] (HDFS-3941) Backport HDFS-3498 and HDFS3601: update replica placement policy for new added NodeGroup layer topology

2013-03-17 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13604844#comment-13604844 ] Junping Du commented on HDFS-3941: -- Per HDFS-4261, both Aaron and Suresh suggested we can

[jira] [Commented] (HDFS-4521) invalid network toploogies should not be cached

2013-03-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13603186#comment-13603186 ] Junping Du commented on HDFS-4521: -- For 3. YARN now doesn't cached register nodes into a

[jira] [Commented] (HDFS-4521) invalid network toploogies should not be cached

2013-03-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13604094#comment-13604094 ] Junping Du commented on HDFS-4521: -- Yes. latest patch looks good to me. Thanks Colin for

[jira] [Commented] (HDFS-4558) start balancer failed with NPE

2013-03-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13596001#comment-13596001 ] Junping Du commented on HDFS-4558: -- Yes. It should be 1.2.0 issue. That's a better idea

[jira] [Updated] (HDFS-4558) start balancer failed with NPE

2013-03-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4558: - Attachment: HDFS-4558-v2.patch Update as Nicholas suggestion in v2 patch. BTW, The default constructor of

[jira] [Updated] (HDFS-4558) start balancer failed with NPE

2013-03-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4558: - Attachment: HDFS-4558-v3.patch Ooops. You are right, Nicholas. v3 is the right one.

[jira] [Commented] (HDFS-4558) start balancer failed with NPE

2013-03-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13596775#comment-13596775 ] Junping Du commented on HDFS-4558: -- Thanks for review and comments. Nicholas!

[jira] [Assigned] (HDFS-4558) start balancer failed with NPE

2013-03-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned HDFS-4558: Assignee: Junping Du start balancer failed with NPE --

[jira] [Commented] (HDFS-4558) start balancer failed with NPE

2013-03-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13595444#comment-13595444 ] Junping Du commented on HDFS-4558: -- The conf in running balancer is not initialized well

[jira] [Updated] (HDFS-4558) start balancer failed with NPE

2013-03-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4558: - Target Version/s: 1.2.0 Affects Version/s: 1.1.2 start balancer failed with NPE

[jira] [Updated] (HDFS-4558) start balancer failed with NPE

2013-03-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4558: - Attachment: HDFS-4558.patch This is a pretty simple one, so not include a unit test. I verified it fix my

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13565015#comment-13565015 ] Junping Du commented on HDFS-4261: -- Sure. Nicholas. I will work on it soon.

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13563569#comment-13563569 ] Junping Du commented on HDFS-4261: -- Suresh, I am good to get this in branch-1 and we can

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13552953#comment-13552953 ] Junping Du commented on HDFS-4261: -- Nicholas, Thanks for your review. However, I notice

[jira] [Updated] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4261: - Attachment: HDFS-4261-branch-1.patch backport patch to branch-1.

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13550998#comment-13550998 ] Junping Du commented on HDFS-4261: -- I manually add TestBalancerWithNodeGroup on my

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551001#comment-13551001 ] Junping Du commented on HDFS-4261: -- Plan to lunch test-commit (with

[jira] [Updated] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4261: - Attachment: HDFS-4261-branch-1-v2.patch TestBalancerWithNodeGroup times out

[jira] [Updated] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4261: - Attachment: (was: HDFS-4261-branch-1-v2.patch) TestBalancerWithNodeGroup times out

[jira] [Updated] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4261: - Attachment: HDFS-4261-branch-1-v2.patch TestBalancerWithNodeGroup times out

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551059#comment-13551059 ] Junping Du commented on HDFS-4261: -- Oh, sorry to forget to correct stupid typo here. Yes.

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551064#comment-13551064 ] Junping Du commented on HDFS-4261: -- To Aaron's previous comments: {noformat} Please make

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551704#comment-13551704 ] Junping Du commented on HDFS-4261: -- I see. That make sense. Thanks ATM and Suresh.:)

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13550735#comment-13550735 ] Junping Du commented on HDFS-4261: -- Thanks Ted to fix the typo. I will file a JIRA to

[jira] [Created] (HDFS-4386) Backport HDFS-4261 to branch-1 to fix timeout in TestBalancerWithNodeGroup

2013-01-10 Thread Junping Du (JIRA)
Junping Du created HDFS-4386: Summary: Backport HDFS-4261 to branch-1 to fix timeout in TestBalancerWithNodeGroup Key: HDFS-4386 URL: https://issues.apache.org/jira/browse/HDFS-4386 Project: Hadoop HDFS

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13550773#comment-13550773 ] Junping Du commented on HDFS-4261: -- Oops. I already filed it before your comments...

[jira] [Resolved] (HDFS-4386) Backport HDFS-4261 to branch-1 to fix timeout in TestBalancerWithNodeGroup

2013-01-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved HDFS-4386. -- Resolution: Duplicate Due to others' feedback, we should address this in HDFS-4261 for other branch.

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13550785#comment-13550785 ] Junping Du commented on HDFS-4261: -- Hi Aaron, Yes. The backport work is tracked by:

[jira] [Updated] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4261: - Attachment: HDFS-4261-v8.patch TestBalancerWithNodeGroup times out

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13547044#comment-13547044 ] Junping Du commented on HDFS-4261: -- Chris, can you help to verify it again in your env? If

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13547504#comment-13547504 ] Junping Du commented on HDFS-4261: -- Thanks Chris and Aaron for verification. +1 to open

[jira] [Created] (HDFS-4337) Backport HDFS-4240 to branch-1: Make sure nodes are avoided to place replica if some replica are already under the same nodegroup.

2012-12-26 Thread Junping Du (JIRA)
Junping Du created HDFS-4337: Summary: Backport HDFS-4240 to branch-1: Make sure nodes are avoided to place replica if some replica are already under the same nodegroup. Key: HDFS-4337 URL:

[jira] [Updated] (HDFS-4337) Backport HDFS-4240 to branch-1: Make sure nodes are avoided to place replica if some replica are already under the same nodegroup.

2012-12-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4337: - Description: Update affects version from 1.0.0 to 1.2.0. Affects Version/s: (was: 1.0.0)

[jira] [Commented] (HDFS-4337) Backport HDFS-4240 to branch-1: Make sure nodes are avoided to place replica if some replica are already under the same nodegroup.

2012-12-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13539807#comment-13539807 ] Junping Du commented on HDFS-4337: -- Thanks Meng for doing this work. I will review your

[jira] [Commented] (HDFS-4337) Backport HDFS-4240 to branch-1: Make sure nodes are avoided to place replica if some replica are already under the same nodegroup.

2012-12-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13539821#comment-13539821 ] Junping Du commented on HDFS-4337: -- Thanks for the patch. There are some trivial issue

[jira] [Commented] (HDFS-4337) Backport HDFS-4240 to branch-1: Make sure nodes are avoided to place replica if some replica are already under the same nodegroup.

2012-12-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13539848#comment-13539848 ] Junping Du commented on HDFS-4337: -- Thanks for updating in v2 patch. The patch looks good

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13535003#comment-13535003 ] Junping Du commented on HDFS-4261: -- I think I found the reason. There is another balancer

[jira] [Updated] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4261: - Attachment: HDFS-4261-v7.patch Fix another infinite loop in v7 patch due to no blocks can be moved in a

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13535470#comment-13535470 ] Junping Du commented on HDFS-4261: -- Thanks Suresh for comments. I think I already did

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13535597#comment-13535597 ] Junping Du commented on HDFS-4261: -- Hi ATM, Thanks for your input. I run several rounds

[jira] [Commented] (HDFS-3942) Backport HDFS-3495: Update balancer policy for Network Topology with additional 'NodeGroup' layer

2012-12-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13533400#comment-13533400 ] Junping Du commented on HDFS-3942: -- Thanks Nicholas and Jing for help in review and

[jira] [Commented] (HDFS-3942) Backport HDFS-3495: Update balancer policy for Network Topology with additional 'NodeGroup' layer

2012-12-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13533404#comment-13533404 ] Junping Du commented on HDFS-3942: -- BTW, I agree that test-patch in branch-1 has problem

[jira] [Updated] (HDFS-3942) Backport HDFS-3495: Update balancer policy for Network Topology with additional 'NodeGroup' layer

2012-12-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3942: - Attachment: HDFS-3942-v5.patch Update patch as last comments from Nicholas. Will update test-patch result

[jira] [Commented] (HDFS-3942) Backport HDFS-3495: Update balancer policy for Network Topology with additional 'NodeGroup' layer

2012-12-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13533289#comment-13533289 ] Junping Du commented on HDFS-3942: -- Thanks Nicholas to post test-patch result. I am

[jira] [Updated] (HDFS-3942) Backport HDFS-3495: Update balancer policy for Network Topology with additional 'NodeGroup' layer

2012-12-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3942: - Attachment: HDFS-3942-v4.patch Remove unnecessary import and code in v4 patch. Backport

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13531115#comment-13531115 ] Junping Du commented on HDFS-4261: -- Thanks Chris. The jstack you attached here is very

[jira] [Commented] (HDFS-3942) Backport HDFS-3495: Update balancer policy for Network Topology with additional 'NodeGroup' layer

2012-12-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13532059#comment-13532059 ] Junping Du commented on HDFS-3942: -- Thanks Nicholas for the comments. Yes. I will try the

[jira] [Updated] (HDFS-3942) Backport HDFS-3495: Update balancer policy for Network Topology with additional 'NodeGroup' layer

2012-12-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3942: - Attachment: HDFS-3942-v2.patch Update patch due to refactor work for balancer in trunk branch.

[jira] [Updated] (HDFS-3942) Backport HDFS-3495: Update balancer policy for Network Topology with additional 'NodeGroup' layer

2012-12-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3942: - Description: This is the backport work for HDFS-3495 and HDFS-4234. Backport HDFS-3495: Update

[jira] [Updated] (HDFS-3942) Backport HDFS-3495: Update balancer policy for Network Topology with additional 'NodeGroup' layer

2012-12-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3942: - Target Version/s: 1.2.0, 1.1.2 (was: 1.2.0) Backport HDFS-3495: Update balancer policy for Network

[jira] [Commented] (HDFS-3942) Backport HDFS-3495: Update balancer policy for Network Topology with additional 'NodeGroup' layer

2012-12-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13529783#comment-13529783 ] Junping Du commented on HDFS-3942: -- Thanks Suresh for reminder. I just update target

[jira] [Commented] (HDFS-4234) Use the generic code for choosing datanode in Balancer

2012-12-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13529787#comment-13529787 ] Junping Du commented on HDFS-4234: -- Hi Nicholas, I backport this patch as well as

[jira] [Commented] (HDFS-3942) Backport HDFS-3495: Update balancer policy for Network Topology with additional 'NodeGroup' layer

2012-12-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13530681#comment-13530681 ] Junping Du commented on HDFS-3942: -- Thanks Nicholas for review and comments. I will

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13529015#comment-13529015 ] Junping Du commented on HDFS-4261: -- I cannot reproduce the failure in may local

[jira] [Updated] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4261: - Attachment: HDFS-4261-v5.patch TestBalancerWithNodeGroup times out

[jira] [Updated] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4261: - Status: Patch Available (was: Reopened) TestBalancerWithNodeGroup times out

<    5   6   7   8   9   10   11   12   >