[
https://issues.apache.org/jira/browse/FLINK-31084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17690427#comment-17690427
]
xzw0223 commented on FLINK-31084:
---------------------------------
My idea is that we don't have to pre-load all the data, we generate the data
when we call the next method, then we record the value of the current generated
data and save it as state, and when ck and restore we just need to recalculate
the new value of the location we have sent to and send it downstream.
This avoids the time consuming process of preloading all the data.
[~mapohl] I would like to hear your views,looking forward for your reply, thank
you.
> DataGen sequence generator requires the definition of start/end values
> ----------------------------------------------------------------------
>
> Key: FLINK-31084
> URL: https://issues.apache.org/jira/browse/FLINK-31084
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / Common
> Affects Versions: 1.17.0, 1.15.3, 1.16.1
> Reporter: Matthias Pohl
> Assignee: xzw0223
> Priority: Major
> Labels: starter
>
> The [DataGen connector's
> parameters|https://nightlies.apache.org/flink/flink-docs-release-1.16/docs/connectors/table/datagen/#connector-options]
> are not precisely documented: The start/end parameters are labeled as
> required for the sequence generator even though they are (see
> [SequenceGeneratorVisitor:85ff|https://github.com/apache/flink/blob/ef9ce854a3169014001f39e0d5908c703453f2b8/flink-table/flink-table-api-java-bridge/src/main/java/org/apache/flink/connector/datagen/table/SequenceGeneratorVisitor.java#L85]).
> But instead of updating the documentation, we should just come up with
> reasonable default values. As a user, I would expect the positive integer
> values to be returned starting from 0 if I don't specify anything here.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
