[
https://issues.apache.org/jira/browse/FLINK-6227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhijiang updated FLINK-6227:
----------------------------
Description:
It is part of FLIP-1.
We define a new abstract special exception called PartitionException to
indicate the downstream task failure in consuming upstream partition. This
special exception is reported to JobMaster as a hint for unavailable partition
data, and then JobMaster could track the upstream executions to restart for
reproducing the partition data.
We make current PartitionNotFoundException extend PartitionException, because
it is reasonable to restart producer task when the requested partition is
already released.
was:
It is part of FLIP-1.
We define a new special exception to indicate the downstream task failure in
consuming upstream data.
The {{JobManager}} will receive and consider this special exception to
calculate the minimum connected sub-graph which is called {{FailoverRegion}}.
So the {{DataConsumptionException}} should contain {{ResultPartitionID}}
information for {{JobMaster}} tracking upstream executions.
> Introduce the DataConsumptionException for downstream task failure
> ------------------------------------------------------------------
>
> Key: FLINK-6227
> URL: https://issues.apache.org/jira/browse/FLINK-6227
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Coordination, Runtime / Network
> Reporter: zhijiang
> Assignee: zhijiang
> Priority: Minor
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> It is part of FLIP-1.
>
> We define a new abstract special exception called PartitionException to
> indicate the downstream task failure in consuming upstream partition. This
> special exception is reported to JobMaster as a hint for unavailable
> partition data, and then JobMaster could track the upstream executions to
> restart for reproducing the partition data.
> We make current PartitionNotFoundException extend PartitionException, because
> it is reasonable to restart producer task when the requested partition is
> already released.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
