[
https://issues.apache.org/jira/browse/FLINK-37298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17925927#comment-17925927
]
Ahmed Hamdy commented on FLINK-37298:
-------------------------------------
Hi [~poorvank] , Thanks for the suggestion.
This seems like a core improvement for {{Async Sink. I would suggest to raise a
[Flip|https://cwiki.apache.org/confluence/display/Flink/Flink+Improvement+Proposals],
Also I remember there is
[FLIP-284|https://cwiki.apache.org/confluence/display/FLINK/FLIP-284+%3A+Making+AsyncSinkWriter+Flush+triggers+adjustable]
with similar suggestion so you can revive the discussion thread but if you
don't find it aligned with what you need feel free to open another Flip. }}
> Custom Batch Handling in AsyncSink
> ----------------------------------
>
> Key: FLINK-37298
> URL: https://issues.apache.org/jira/browse/FLINK-37298
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / Common
> Reporter: Poorvank Bhatia
> Priority: Not a Priority
> Fix For: 1.18.0
>
>
> Enhance the existing AsyncSink by introducing a pluggable batch:
> The current AsyncSink in Apache Flink does not support custom batch creation,
> batching is primarily controlled by parameters such as maxBatchSize,
> maxBatchSizeInBytes.
> It lacks the flexibility to support advanced and customizable batching
> strategies.
> For a detailed solution, please refer to this doc: [Custom Batching For Async
> Sink|https://docs.google.com/document/d/1XI2DV-8r-kOwbMd2ZMdV4u0Q_s5m8Stojv4HSdJA8ZU/edit?tab=t.0]
>
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
