Hi everyone,

The latest version of the Flink Kafka connector that's available is
currently v3.0.2, which is compatible with both Flink 1.17 and Flink 1.18.

I would like to propose to create a release which is either v3.1, or v4.0
(see below), with compatibility for Flink 1.17 and Flink 1.18. This newer
version would contain many improvements [1] [2] like:

* FLIP-246 Dynamic Kafka Source
* FLIP-288 Dynamic Partition Discovery
* Rack Awareness support
* Kafka Record support for KafkaSink
* Misc bug fixes and CVE issues

If there are no objections, I would like to volunteer as release manager.

The only thing why I'm not sure if this should be a v3.1 or a v4.0, is
because I'm not 100% sure if FLIP-246 introduces incompatible API changes
(requiring a new major version), or if the functionality was added in a
backwards compatible matter (meaning a new minor version would be
sufficient). I'm looping in Hongshun Wang and Leonard Xu to help clarify
this.

There's also a discussion happening in an open PR [3] on dropping support
for Flink 1.18 afterwards (since this PR would add support for
RecordEvaluator, which only exists in Flink 1.19). My proposal would be
that after either v3.1 or v4.0 is released, we would indeed drop support
for Flink 1.18 with that PR and the next Flink Kafka connector would be
either v4.0 (if v3.1 is the next release) or v5.0 (if v4.0 is the next
release).

Best regards,

Martijn

[1]
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522&version=12353135
[2]
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522&version=12352917
[3]
https://github.com/apache/flink-connector-kafka/pull/76#pullrequestreview-1844645464

Reply via email to