Nico Kruber created FLINK-13535:
-----------------------------------
Summary: Do not abort transactions twice during KafkaProducer
startup
Key: FLINK-13535
URL: https://issues.apache.org/jira/browse/FLINK-13535
Project: Flink
Issue Type: Improvement
Components: Connectors / Kafka
Affects Versions: 1.8.1, 1.9.0
Reporter: Nico Kruber
Assignee: Nico Kruber
During startup of a transactional Kafka producer from previous state, we
recover in two steps:
# in {{TwoPhaseCommitSinkFunction}}, we commit pending commit-transactions and
abort pending transactions and then call into {{finishRecoveringContext()}}
# in {{FlinkKafkaProducer#finishRecoveringContext()}} we iterate over all
recovered transaction IDs and abort them
This may lead to some transactions being worked on twice. Since this is quite
some expensive operation, we unnecessarily slow down the job startup but could
easily give {{finishRecoveringContext()}} a set of transactions that
{{TwoPhaseCommitSinkFunction}} already covered instead.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
