[
https://issues.apache.org/jira/browse/FLINK-19547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuan Mei updated FLINK-19547:
-----------------------------
Summary: Partial Record Cleanup after the Consumer Task Fails and Restart
(was: Partial record clean up after receiver task fails and restart)
> Partial Record Cleanup after the Consumer Task Fails and Restart
> ----------------------------------------------------------------
>
> Key: FLINK-19547
> URL: https://issues.apache.org/jira/browse/FLINK-19547
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Network
> Affects Versions: 1.12.0
> Reporter: Yuan Mei
> Assignee: Yuan Mei
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.12.0
>
>
> Partial records happen if a record can not fit into one buffer, then the
> remaining part of the same record is put into the next buffer. Hence partial
> records only exist at the beginning of a buffer.
> Partial record clean-up is needed in the mode of approximate local recovery.
> If a record is spanning over multiple buffers, and the first (several)
> buffers have got lost due to the failure of the receiver task, the remaining
> data belonging to the same record in transition should be cleaned up.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
