[jira] [Updated] (HDDS-1572) Implement a Pipeline scrubber to maintain healthy number of pipelines in a cluster

2019-11-18 Thread Li Cheng (Jira)


 [ 
https://issues.apache.org/jira/browse/HDDS-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Li Cheng updated HDDS-1572:
---
Description: 
The design document talks about initial requirements for the pipeline scrubber.
 - Scan the pipelines that the nodes are a part of to select candidates for 
teardown.
 - Scan pipelines that do not have open containers currently in use and 
datanodes are in violation.
 - Schedule tear down operation if a candidate pipeline is found.

  was:
The design document talks about initial requirements for the pipeline scrubber.

- Maintain a datastructure for datanodes violating the pipeline membership soft 
upper bound.
- Scan the pipelines that the nodes are a part of to select candidates for 
teardown.
- Scan pipelines that do not have open containers currently in use and 
datanodes are in violation.
- Schedule tear down operation if a candidate pipeline is found.



> Implement a Pipeline scrubber to maintain healthy number of pipelines in a 
> cluster
> --
>
> Key: HDDS-1572
> URL: https://issues.apache.org/jira/browse/HDDS-1572
> Project: Hadoop Distributed Data Store
>  Issue Type: Sub-task
>  Components: SCM
>Reporter: Siddharth Wagle
>Assignee: Li Cheng
>Priority: Major
>
> The design document talks about initial requirements for the pipeline 
> scrubber.
>  - Scan the pipelines that the nodes are a part of to select candidates for 
> teardown.
>  - Scan pipelines that do not have open containers currently in use and 
> datanodes are in violation.
>  - Schedule tear down operation if a candidate pipeline is found.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDDS-1572) Implement a Pipeline scrubber to maintain healthy number of pipelines in a cluster

2019-11-20 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HDDS-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated HDDS-1572:
-
Labels: pull-request-available  (was: )

> Implement a Pipeline scrubber to maintain healthy number of pipelines in a 
> cluster
> --
>
> Key: HDDS-1572
> URL: https://issues.apache.org/jira/browse/HDDS-1572
> Project: Hadoop Distributed Data Store
>  Issue Type: Sub-task
>  Components: SCM
>Reporter: Siddharth Wagle
>Assignee: Li Cheng
>Priority: Major
>  Labels: pull-request-available
>
> The design document talks about initial requirements for the pipeline 
> scrubber.
>  - Scan the pipelines that the nodes are a part of to select candidates for 
> teardown.
>  - Scan pipelines that do not have open containers currently in use and 
> datanodes are in violation.
>  - Schedule tear down operation if a candidate pipeline is found.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org