Dennis-Mircea Ciupitu created FLINK-39588:
---------------------------------------------
Summary: Migrate the DataGen table connector off deprecated source
APIs
Key: FLINK-39588
URL: https://issues.apache.org/jira/browse/FLINK-39588
Project: Flink
Issue Type: Improvement
Components: Connectors / Common, Table SQL / API
Affects Versions: 2.3.0
Reporter: Dennis-Mircea Ciupitu
h1. Summary
The built-in {{'connector' = 'datagen'}} table source
({{{}DataGenTableSource{}}} in {{{}flink-table-api-java-bridge{}}}) is still
implemented on top of long-deprecated APIs:
* SourceFunctionProvider
* The legacy SourceFunction-based {{DataGeneratorSource}} and its
{{RandomGenerator}} / {{SequenceGenerator}} hierarchy
These are the last remaining usages of those APIs from a built-in table
connector and they account for a sizeable chunk of the frozen entries in
{{{}flink-architecture-tests-production{}}}.
This ticket tracks migrating the connector to the FLIP-27 source stack
({{{}Source{}}} API + {{{}SourceProvider{}}}) while preserving its user-visible
behavior (same DDL options, same value distributions, same parallelism and
rate-limiting semantics, same termination behavior for bounded sequences).
h1. Goals
* Remove the last table-side dependency on {{SourceFunctionProvider}} and the
legacy {{DataGeneratorSource}}.
* Align the datagen connector with the modern source stack used by all other
built-in connectors.
* Reduce the architecture-violations baseline.
h1. Compatibility
* SQL surface: unchanged.
* Savepoint compatibility for in-flight datagen jobs is not preserved
(acceptable for a test/demo connector with {{@Internal}} operator state).
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
