[jira] [Updated] (FLINK-14312) Support building logical pipelined regions from JobGraph
[
https://issues.apache.org/jira/browse/FLINK-14312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated FLINK-14312:
---
Labels: pull-request-available (was: )
> Support building logical pipelined regions from JobGraph
>
>
> Key: FLINK-14312
> URL: https://issues.apache.org/jira/browse/FLINK-14312
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Coordination
>Affects Versions: 1.10.0
>Reporter: Zhu Zhu
>Assignee: Zhu Zhu
>Priority: Major
> Labels: pull-request-available
> Fix For: 1.10.0
>
>
> Logical pipelined region partitioning is needed by FLINK-14060 to determine
> JobVertex slot sharing group.
> We can leverage PipelinedRegionComputeUtil#computePipelinedRegions to do this
> by adapting JobGraph to a base Topology.
> With changes from FLINK-14453, we can build {{LogicalPipelinedRegions}} from
> {{JobGraph}} by:
> 1. Introduce LogicalTopology which extends Topology
> 2. Implement DefaultLogicalTopology as an adapter of JobGraph to
> LogicalTopology
> 3. Add DefaultLogicalTopology#getLogicalPipelinedRegions to return the
> logical pipelined regions of a JobGraph
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (FLINK-14312) Support building logical pipelined regions from JobGraph
[
https://issues.apache.org/jira/browse/FLINK-14312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhu Zhu updated FLINK-14312:
Description:
Logical pipelined region partitioning is needed by FLINK-14060 to determine
JobVertex slot sharing group.
We can leverage PipelinedRegionComputeUtil#computePipelinedRegions to do this
by adapting JobGraph to a base Topology.
With changes from FLINK-14453, we can build {{LogicalPipelinedRegions}} from
{{JobGraph}} by:
1. Introduce LogicalTopology which extends Topology
2. Implement DefaultLogicalTopology as an adapter of JobGraph to LogicalTopology
3. Add DefaultLogicalTopology#getLogicalPipelinedRegions to return the logical
pipelined regions of a JobGraph
was:
Logical pipelined region partitioning is needed by FLINK-14060 to determine
{{JobVertex}} slot sharing group.
It would be better if we can leverage
{{PipelinedRegionComputeUtil#computePipelinedRegions}} to do this. So that we
do not need to implement a very similar logic twice.
This would require a unification of the interfaces of FailoverTopology and
JobGraph.
With changes from FLINK-14453, we can build {{LogicalPipelinedRegions}} from
{{JobGraph}} by:
1. Introduce {{LogicalTopology}}
2. Implement {{DefaultLogicalTopology}} as an adapter of {{JobGraph}} to
{{LogicalTopology}}
3. Add {{DefaultLogicalTopology#getLogicalPipelinedRegions}} to return the
logical pipelined regions of a JobGraph
> Support building logical pipelined regions from JobGraph
>
>
> Key: FLINK-14312
> URL: https://issues.apache.org/jira/browse/FLINK-14312
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Coordination
>Affects Versions: 1.10.0
>Reporter: Zhu Zhu
>Assignee: Zhu Zhu
>Priority: Major
> Fix For: 1.10.0
>
>
> Logical pipelined region partitioning is needed by FLINK-14060 to determine
> JobVertex slot sharing group.
> We can leverage PipelinedRegionComputeUtil#computePipelinedRegions to do this
> by adapting JobGraph to a base Topology.
> With changes from FLINK-14453, we can build {{LogicalPipelinedRegions}} from
> {{JobGraph}} by:
> 1. Introduce LogicalTopology which extends Topology
> 2. Implement DefaultLogicalTopology as an adapter of JobGraph to
> LogicalTopology
> 3. Add DefaultLogicalTopology#getLogicalPipelinedRegions to return the
> logical pipelined regions of a JobGraph
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (FLINK-14312) Support building logical pipelined regions from JobGraph
[
https://issues.apache.org/jira/browse/FLINK-14312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhu Zhu updated FLINK-14312:
Description:
Logical pipelined region partitioning is needed by FLINK-14060 to determine
{{JobVertex}} slot sharing group.
It would be better if we can leverage
{{PipelinedRegionComputeUtil#computePipelinedRegions}} to do this. So that we
do not need to implement a very similar logic twice.
This would require a unification of the interfaces of FailoverTopology and
JobGraph.
With changes from FLINK-14453, we can build {{LogicalPipelinedRegions}} from
{{JobGraph}} by:
1. Introduce {{LogicalTopology}}
2. Implement {{DefaultLogicalTopology}} as an adapter of {{JobGraph}} to
{{LogicalTopology}}
3. Add {{DefaultLogicalTopology#getLogicalPipelinedRegions}} to return the
logical pipelined regions of a JobGraph
was:
Logical pipelined region partitioning is needed by FLINK-14060 to determine
{{JobVertex}} slot sharing group.
It would be better if we can leverage
{{PipelinedRegionComputeUtil#computePipelinedRegions}} to do this. So that we
do not need to implement a very similar logic twice.
This would require a unification of the interfaces of FailoverTopology and
JobGraph.
With changes from FLINK-14453, we can build {{LogicalPipelinedRegions}} from
{{JobGraph}} by:
1. Introduce {{LogicalTopology}}
2. Implement {{DefaultLogicalTopology}} as an adapter of {{JobGraph}} to
{{LogicalTopology}}
3. Add {{DefaultLogicalTopology#getLogicalPipelinedTopology}} to return the
logical pipelined regions of a JobGraph
> Support building logical pipelined regions from JobGraph
>
>
> Key: FLINK-14312
> URL: https://issues.apache.org/jira/browse/FLINK-14312
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Coordination
>Affects Versions: 1.10.0
>Reporter: Zhu Zhu
>Assignee: Zhu Zhu
>Priority: Major
> Fix For: 1.10.0
>
>
> Logical pipelined region partitioning is needed by FLINK-14060 to determine
> {{JobVertex}} slot sharing group.
> It would be better if we can leverage
> {{PipelinedRegionComputeUtil#computePipelinedRegions}} to do this. So that we
> do not need to implement a very similar logic twice.
> This would require a unification of the interfaces of FailoverTopology and
> JobGraph.
> With changes from FLINK-14453, we can build {{LogicalPipelinedRegions}} from
> {{JobGraph}} by:
> 1. Introduce {{LogicalTopology}}
> 2. Implement {{DefaultLogicalTopology}} as an adapter of {{JobGraph}} to
> {{LogicalTopology}}
> 3. Add {{DefaultLogicalTopology#getLogicalPipelinedRegions}} to return the
> logical pipelined regions of a JobGraph
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (FLINK-14312) Support building logical pipelined regions from JobGraph
[
https://issues.apache.org/jira/browse/FLINK-14312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhu Zhu updated FLINK-14312:
Description:
Logical pipelined region partitioning is needed by FLINK-14060 to determine
{{JobVertex}} slot sharing group.
It would be better if we can leverage
{{PipelinedRegionComputeUtil#computePipelinedRegions}} to do this. So that we
do not need to implement a very similar logic twice.
This would require a unification of the interfaces of FailoverTopology and
JobGraph.
With changes from FLINK-14453, we can build {{LogicalPipelinedRegions}} from
{{JobGraph}} by:
1. Introduce {{LogicalTopology}}
2. Implement {{DefaultLogicalTopology}} as an adapter of {{JobGraph}} to
{{LogicalTopology}}
3. Add {{DefaultLogicalTopology#getLogicalPipelinedTopology}} to return the
logical pipelined regions of a JobGraph
was:
Logical pipelined region partitioning is needed by FLINK-14060 to determine
{{JobVertex}} slot sharing group.
It would be better if we can leverage
{{PipelinedRegionComputeUtil#computePipelinedRegions}} to do this. So that we
do not need to implement a very similar logic twice.
This would require a unification of the interfaces of FailoverTopology and
JobGraph.
With
> Support building logical pipelined regions from JobGraph
>
>
> Key: FLINK-14312
> URL: https://issues.apache.org/jira/browse/FLINK-14312
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Coordination
>Affects Versions: 1.10.0
>Reporter: Zhu Zhu
>Priority: Major
> Fix For: 1.10.0
>
>
> Logical pipelined region partitioning is needed by FLINK-14060 to determine
> {{JobVertex}} slot sharing group.
> It would be better if we can leverage
> {{PipelinedRegionComputeUtil#computePipelinedRegions}} to do this. So that we
> do not need to implement a very similar logic twice.
> This would require a unification of the interfaces of FailoverTopology and
> JobGraph.
> With changes from FLINK-14453, we can build {{LogicalPipelinedRegions}} from
> {{JobGraph}} by:
> 1. Introduce {{LogicalTopology}}
> 2. Implement {{DefaultLogicalTopology}} as an adapter of {{JobGraph}} to
> {{LogicalTopology}}
> 3. Add {{DefaultLogicalTopology#getLogicalPipelinedTopology}} to return the
> logical pipelined regions of a JobGraph
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (FLINK-14312) Support building logical pipelined regions from JobGraph
[
https://issues.apache.org/jira/browse/FLINK-14312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhu Zhu updated FLINK-14312:
Description:
Logical pipelined region partitioning is needed by FLINK-14060 to determine
{{JobVertex}} slot sharing group.
It would be better if we can leverage
{{PipelinedRegionComputeUtil#computePipelinedRegions}} to do this. So that we
do not need to implement a very similar logic twice.
This would require a unification of the interfaces of FailoverTopology and
JobGraph.
With
was:
Logical pipelined region partitioning is needed by FLINK-14060 to determine
{{JobVertex}} slot sharing group.
It would be better if we can leverage
{{PipelinedRegionComputeUtil#computePipelinedRegions}} to do this. So that we
do not need to implement a very similar logic twice.
This would require a unification of the interfaces of FailoverTopology and
JobGraph.
> Support building logical pipelined regions from JobGraph
>
>
> Key: FLINK-14312
> URL: https://issues.apache.org/jira/browse/FLINK-14312
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Coordination
>Affects Versions: 1.10.0
>Reporter: Zhu Zhu
>Priority: Major
> Fix For: 1.10.0
>
>
> Logical pipelined region partitioning is needed by FLINK-14060 to determine
> {{JobVertex}} slot sharing group.
> It would be better if we can leverage
> {{PipelinedRegionComputeUtil#computePipelinedRegions}} to do this. So that we
> do not need to implement a very similar logic twice.
> This would require a unification of the interfaces of FailoverTopology and
> JobGraph.
> With
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (FLINK-14312) Support building logical pipelined regions from JobGraph
[
https://issues.apache.org/jira/browse/FLINK-14312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhu Zhu updated FLINK-14312:
Summary: Support building logical pipelined regions from JobGraph (was:
Support logical pipelined region partitioning of JobGraph)
> Support building logical pipelined regions from JobGraph
>
>
> Key: FLINK-14312
> URL: https://issues.apache.org/jira/browse/FLINK-14312
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Coordination
>Affects Versions: 1.10.0
>Reporter: Zhu Zhu
>Priority: Major
> Fix For: 1.10.0
>
>
> Logical pipelined region partitioning is needed by FLINK-14060 to determine
> {{JobVertex}} slot sharing group.
> It would be better if we can leverage
> {{PipelinedRegionComputeUtil#computePipelinedRegions}} to do this. So that we
> do not need to implement a very similar logic twice.
> This would require a unification of the interfaces of FailoverTopology and
> JobGraph.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
