Hi, all.
Flink CDC provides the schema evolution ability to sync the entire
database. I think it could satisfy your needs.
Flink CDC pipeline sources and sinks are listed in [1]. Iceberg pipeline
connector is not provided by now.
> What is not is the automatic syncing of entire databases, with
Flink CDC 3.0 focuses on data integration scenarios, so you don't need to
pay attention to the framework implementation, you just need to use the
YAML format to describe the data source and target to quickly build a data
synchronization task with schema evolution.And it supports rich source and
退订
Hi Oliver,
I am not experienced in StateFun but its doc says 'Along with the standard
metric scopes, Stateful Functions supports Function Scope which one level
below operator scope.' So, as long as you can collect flink's metric via
Prometheus, ideally, there should be no difference between using
Hi Otto,
Flink CDC [1] now provides full-DB sync and schema evolution ability as a
pipeline job. Iceberg sink support was suggested before, and we’re trying to
implement this in the next few releases. Does it cover the use-cases you
mentioned?
[1]
