Peter Vary created FLINK-33328:
----------------------------------
Summary: Allow TwoPhaseCommittingSink WithPreCommitTopology to
alter the type of the Committable
Key: FLINK-33328
URL: https://issues.apache.org/jira/browse/FLINK-33328
Project: Flink
Issue Type: Sub-task
Components: API / DataStream, Connectors / Common
Reporter: Peter Vary
In case of the Iceberg Sink, we would like to use the _WithPreCommitTopology_
to aggregate the writer results and create a single committable from them. So
we would like to change both the type, and the number of the messages. Using
the current _WithPreCommitTopology_ interface we can work around the issue by
using a Tuple, or POJO where some of the fields are used only before the
_addPreCommitTopology_ method, and some of the fields are only used after the
method, but this seems more like abusing the interface than using it.
This is a more generic issue where the _WithPreCommitTopology_ should provide a
way to transform not only the data, but the type of the data channelled through
it.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
