[
https://issues.apache.org/jira/browse/FLINK-37653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yux updated FLINK-37653:
------------------------
Description:
Currently, HybridSplitAssigners and StreamSplitAssigners in incremental
snapshot framework implicitly assumes that there will be at most one unbounded
stream split, which isn't true for some data sources that supports multi change
stream, like MongoDB and PolarDB-X.
This change should extend assigners' API without changing existing data
sources' behavior.
was:
Currently, HybridSplitAssigners and StreamSplitAssigners in incremental
snapshot framework implicitly assumes that there will be at most one unbounded
stream split, which isn't true for some data sources that supports multi change
stream, like MongoDB and PolarDB.
This change should extend assigners' API without changing existing data
sources' behavior.
> Incremental snapshot framework supports assigning multiple StreamSplit
> ----------------------------------------------------------------------
>
> Key: FLINK-37653
> URL: https://issues.apache.org/jira/browse/FLINK-37653
> Project: Flink
> Issue Type: Improvement
> Components: Flink CDC
> Reporter: yux
> Assignee: yux
> Priority: Minor
>
> Currently, HybridSplitAssigners and StreamSplitAssigners in incremental
> snapshot framework implicitly assumes that there will be at most one
> unbounded stream split, which isn't true for some data sources that supports
> multi change stream, like MongoDB and PolarDB-X.
> This change should extend assigners' API without changing existing data
> sources' behavior.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
