[jira] [Updated] (HDFS-3498) Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault extensible for reusing code in subclass
[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-3498: -- Issue Type: Improvement (was: Bug) > Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault > extensible for reusing code in subclass > --- > > Key: HDFS-3498 > URL: https://issues.apache.org/jira/browse/HDFS-3498 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namenode >Affects Versions: 1.0.0, 2.0.0-alpha >Reporter: Junping Du >Assignee: Junping Du > Fix For: 1.2.0, 2.1.0-beta > > Attachments: Hadoop-8471-BlockPlacementDefault-extensible.patch, > HDFS-3498-branch-2.patch, HDFS-3498.patch, HDFS-3498-v2.patch, > HDFS-3498-v3.patch, HDFS-3498-v4.patch, HDFS-3498-v5.patch > > > ReplicaPlacementPolicy is already a pluggable component in Hadoop. However, > the Replica Removal Policy is still nested in BlockManager that need to be > separated out into a ReplicaPlacementPolicy then can be override later. Also > it looks like hadoop unit test lack the testing on replica removal policy, so > we add it here. > On the other hand, as a implementation of ReplicaPlacementPolicy, > ReplicaPlacementDefault still show lots of generic for other topology cases > like: virtualization, and we want to make code in > ReplicaPlacementPolicyDefault can be reused as much as possible so a few of > its methods were changed from private to protected. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-3498) Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault extensible for reusing code in subclass
[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3498: - Resolution: Fixed Fix Version/s: (was: 3.0.0) 2.1.0-beta Status: Resolved (was: Patch Available) Merged this to branch-2. > Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault > extensible for reusing code in subclass > --- > > Key: HDFS-3498 > URL: https://issues.apache.org/jira/browse/HDFS-3498 > Project: Hadoop HDFS > Issue Type: Bug > Components: namenode >Affects Versions: 1.0.0, 2.0.0-alpha >Reporter: Junping Du >Assignee: Junping Du > Fix For: 2.1.0-beta, 1.2.0 > > Attachments: Hadoop-8471-BlockPlacementDefault-extensible.patch, > HDFS-3498-branch-2.patch, HDFS-3498.patch, HDFS-3498-v2.patch, > HDFS-3498-v3.patch, HDFS-3498-v4.patch, HDFS-3498-v5.patch > > > ReplicaPlacementPolicy is already a pluggable component in Hadoop. However, > the Replica Removal Policy is still nested in BlockManager that need to be > separated out into a ReplicaPlacementPolicy then can be override later. Also > it looks like hadoop unit test lack the testing on replica removal policy, so > we add it here. > On the other hand, as a implementation of ReplicaPlacementPolicy, > ReplicaPlacementDefault still show lots of generic for other topology cases > like: virtualization, and we want to make code in > ReplicaPlacementPolicyDefault can be reused as much as possible so a few of > its methods were changed from private to protected. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-3498) Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault extensible for reusing code in subclass
[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3498: - Fix Version/s: 1.2.0 > Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault > extensible for reusing code in subclass > --- > > Key: HDFS-3498 > URL: https://issues.apache.org/jira/browse/HDFS-3498 > Project: Hadoop HDFS > Issue Type: Bug > Components: namenode >Affects Versions: 1.0.0, 2.0.0-alpha >Reporter: Junping Du >Assignee: Junping Du > Fix For: 1.2.0, 3.0.0 > > Attachments: Hadoop-8471-BlockPlacementDefault-extensible.patch, > HDFS-3498-branch-2.patch, HDFS-3498.patch, HDFS-3498-v2.patch, > HDFS-3498-v3.patch, HDFS-3498-v4.patch, HDFS-3498-v5.patch > > > ReplicaPlacementPolicy is already a pluggable component in Hadoop. However, > the Replica Removal Policy is still nested in BlockManager that need to be > separated out into a ReplicaPlacementPolicy then can be override later. Also > it looks like hadoop unit test lack the testing on replica removal policy, so > we add it here. > On the other hand, as a implementation of ReplicaPlacementPolicy, > ReplicaPlacementDefault still show lots of generic for other topology cases > like: virtualization, and we want to make code in > ReplicaPlacementPolicyDefault can be reused as much as possible so a few of > its methods were changed from private to protected. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-3498) Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault extensible for reusing code in subclass
[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3498: - Attachment: HDFS-3498-branch-2.patch > Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault > extensible for reusing code in subclass > --- > > Key: HDFS-3498 > URL: https://issues.apache.org/jira/browse/HDFS-3498 > Project: Hadoop HDFS > Issue Type: Bug > Components: namenode >Affects Versions: 1.0.0, 2.0.0-alpha >Reporter: Junping Du >Assignee: Junping Du > Fix For: 3.0.0 > > Attachments: Hadoop-8471-BlockPlacementDefault-extensible.patch, > HDFS-3498-branch-2.patch, HDFS-3498.patch, HDFS-3498-v2.patch, > HDFS-3498-v3.patch, HDFS-3498-v4.patch, HDFS-3498-v5.patch > > > ReplicaPlacementPolicy is already a pluggable component in Hadoop. However, > the Replica Removal Policy is still nested in BlockManager that need to be > separated out into a ReplicaPlacementPolicy then can be override later. Also > it looks like hadoop unit test lack the testing on replica removal policy, so > we add it here. > On the other hand, as a implementation of ReplicaPlacementPolicy, > ReplicaPlacementDefault still show lots of generic for other topology cases > like: virtualization, and we want to make code in > ReplicaPlacementPolicyDefault can be reused as much as possible so a few of > its methods were changed from private to protected. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-3498) Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault extensible for reusing code in subclass
[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3498: - Target Version/s: 2.0.5-alpha Status: Patch Available (was: Reopened) > Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault > extensible for reusing code in subclass > --- > > Key: HDFS-3498 > URL: https://issues.apache.org/jira/browse/HDFS-3498 > Project: Hadoop HDFS > Issue Type: Bug > Components: namenode >Affects Versions: 2.0.0-alpha, 1.0.0 >Reporter: Junping Du >Assignee: Junping Du > Fix For: 3.0.0 > > Attachments: Hadoop-8471-BlockPlacementDefault-extensible.patch, > HDFS-3498-branch-2.patch, HDFS-3498.patch, HDFS-3498-v2.patch, > HDFS-3498-v3.patch, HDFS-3498-v4.patch, HDFS-3498-v5.patch > > > ReplicaPlacementPolicy is already a pluggable component in Hadoop. However, > the Replica Removal Policy is still nested in BlockManager that need to be > separated out into a ReplicaPlacementPolicy then can be override later. Also > it looks like hadoop unit test lack the testing on replica removal policy, so > we add it here. > On the other hand, as a implementation of ReplicaPlacementPolicy, > ReplicaPlacementDefault still show lots of generic for other topology cases > like: virtualization, and we want to make code in > ReplicaPlacementPolicyDefault can be reused as much as possible so a few of > its methods were changed from private to protected. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-3498) Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault extensible for reusing code in subclass
[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3498: - Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) I have committed this. Thanks, Junping! > Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault > extensible for reusing code in subclass > --- > > Key: HDFS-3498 > URL: https://issues.apache.org/jira/browse/HDFS-3498 > Project: Hadoop HDFS > Issue Type: Bug > Components: name-node >Affects Versions: 1.0.0, 2.0.0-alpha >Reporter: Junping Du >Assignee: Junping Du > Fix For: 3.0.0 > > Attachments: HDFS-3498-v2.patch, HDFS-3498-v3.patch, > HDFS-3498-v4.patch, HDFS-3498-v5.patch, HDFS-3498.patch, > Hadoop-8471-BlockPlacementDefault-extensible.patch > > > ReplicaPlacementPolicy is already a pluggable component in Hadoop. However, > the Replica Removal Policy is still nested in BlockManager that need to be > separated out into a ReplicaPlacementPolicy then can be override later. Also > it looks like hadoop unit test lack the testing on replica removal policy, so > we add it here. > On the other hand, as a implementation of ReplicaPlacementPolicy, > ReplicaPlacementDefault still show lots of generic for other topology cases > like: virtualization, and we want to make code in > ReplicaPlacementPolicyDefault can be reused as much as possible so a few of > its methods were changed from private to protected. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-3498) Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault extensible for reusing code in subclass
[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3498: - Attachment: HDFS-3498-v5.patch > Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault > extensible for reusing code in subclass > --- > > Key: HDFS-3498 > URL: https://issues.apache.org/jira/browse/HDFS-3498 > Project: Hadoop HDFS > Issue Type: Bug > Components: name-node >Affects Versions: 1.0.0, 2.0.0-alpha >Reporter: Junping Du >Assignee: Junping Du > Attachments: HDFS-3498-v2.patch, HDFS-3498-v3.patch, > HDFS-3498-v4.patch, HDFS-3498-v5.patch, HDFS-3498.patch, > Hadoop-8471-BlockPlacementDefault-extensible.patch > > > ReplicaPlacementPolicy is already a pluggable component in Hadoop. However, > the Replica Removal Policy is still nested in BlockManager that need to be > separated out into a ReplicaPlacementPolicy then can be override later. Also > it looks like hadoop unit test lack the testing on replica removal policy, so > we add it here. > On the other hand, as a implementation of ReplicaPlacementPolicy, > ReplicaPlacementDefault still show lots of generic for other topology cases > like: virtualization, and we want to make code in > ReplicaPlacementPolicyDefault can be reused as much as possible so a few of > its methods were changed from private to protected. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-3498) Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault extensible for reusing code in subclass
[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3498: - Component/s: (was: data-node) name-node Hadoop Flags: Reviewed +1 patch looks good. > Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault > extensible for reusing code in subclass > --- > > Key: HDFS-3498 > URL: https://issues.apache.org/jira/browse/HDFS-3498 > Project: Hadoop HDFS > Issue Type: Bug > Components: name-node >Affects Versions: 1.0.0, 2.0.0-alpha >Reporter: Junping Du >Assignee: Junping Du > Attachments: HDFS-3498-v2.patch, HDFS-3498-v3.patch, > HDFS-3498-v4.patch, HDFS-3498.patch, > Hadoop-8471-BlockPlacementDefault-extensible.patch > > > ReplicaPlacementPolicy is already a pluggable component in Hadoop. However, > the Replica Removal Policy is still nested in BlockManager that need to be > separated out into a ReplicaPlacementPolicy then can be override later. Also > it looks like hadoop unit test lack the testing on replica removal policy, so > we add it here. > On the other hand, as a implementation of ReplicaPlacementPolicy, > ReplicaPlacementDefault still show lots of generic for other topology cases > like: virtualization, and we want to make code in > ReplicaPlacementPolicyDefault can be reused as much as possible so a few of > its methods were changed from private to protected. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-3498) Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault extensible for reusing code in subclass
[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3498: - Summary: Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault extensible for reusing code in subclass (was: Make ReplicaPlacementPolicyDefault extensible for reuse code in subclass) > Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault > extensible for reusing code in subclass > --- > > Key: HDFS-3498 > URL: https://issues.apache.org/jira/browse/HDFS-3498 > Project: Hadoop HDFS > Issue Type: Bug > Components: data-node >Affects Versions: 1.0.0, 2.0.0-alpha >Reporter: Junping Du >Assignee: Junping Du > Attachments: HDFS-3498-v2.patch, HDFS-3498-v3.patch, > HDFS-3498-v4.patch, HDFS-3498.patch, > Hadoop-8471-BlockPlacementDefault-extensible.patch > > > ReplicaPlacementPolicy is already a pluggable component in Hadoop. However, > the Replica Removal Policy is still nested in BlockManager that need to be > separated out into a ReplicaPlacementPolicy then can be override later. Also > it looks like hadoop unit test lack the testing on replica removal policy, so > we add it here. > On the other hand, as a implementation of ReplicaPlacementPolicy, > ReplicaPlacementDefault still show lots of generic for other topology cases > like: virtualization, and we want to make code in > ReplicaPlacementPolicyDefault can be reused as much as possible so a few of > its methods were changed from private to protected. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
