[ https://issues.apache.org/jira/browse/FLINK-24234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17415700#comment-17415700 ]
Danny Cranmer commented on FLINK-24234: --------------------------------------- Thanks [~CrynetLogistics], I have merged this. Resolving ticket > [FLIP-171] Byte Based & Time Based Flushing for AsyncSinkBase > ------------------------------------------------------------- > > Key: FLINK-24234 > URL: https://issues.apache.org/jira/browse/FLINK-24234 > Project: Flink > Issue Type: New Feature > Components: Connectors / Common > Reporter: Zichen Liu > Assignee: Zichen Liu > Priority: Major > Labels: pull-request-available > Fix For: 1.15.0 > > > *User stories* > * As a Sink user, I’d like to configure the batch size for items to send to > the destination at once (e.g. “flush if there are x number of items in the > batch”) > * As a Sink user, I’d like to configure the batching logic so that I can > flush the batch of requests based on time period (e.g. “flush every 2 > seconds”) > * As a Sink user I’d like to specify the number of bytes for the batch of > requests to be flushed (e.g. ”submit the batch after the total number of > bytes in it is above 1KB”) > * As a Sink developer, I’d like to use the configuration mechanism provided > to allow Sink users to configure my Sink implementation > * > *Scope* > * Allow Sink developers and users to pass batch size config to the > AsyncSinkWriter > * Add support for time-based flushing (e.g. “flush after x miliseconds”) > using the ProcessingTimeService which is part of the Sink interface > * Add support for byte-based flushing > * Consider the combination of time-based flushing and byte-based flushing, > if there are more bytes than configured in the time-based batch, then the > last few (however many necessary) items should go in the next batch to > satisfy the requirement for the number of bytes. > *References* > More details to be found > [https://cwiki.apache.org/confluence/display/FLINK/FLIP-171%3A+Async+Sink] -- This message was sent by Atlassian Jira (v8.3.4#803005)