Thanks for your response ! Much appreciated
On Thu, May 12, 2022 at 5:51 PM Teoh, Hong wrote:
> Hi Zain,
>
> For Flink 1.13, we use the KinesisProducerLibrary. If you are using
> aggregation, you can control the maximum size of aggregated records by
> configuring the AggregationMaxSize in the
Hi Zain,
For Flink 1.13, we use the KinesisProducerLibrary. If you are using
aggregation, you can control the maximum size of aggregated records by
configuring the AggregationMaxSize in the producer config when constructing the
FlinkKinesisProducer. (See [1] for more docs)
Hi,
I am using a kinesis sink with flink 1.13.
The amount of data is in millions and it choke the 1MB cap for kinesis data
streams.
Is there any way to send data to kinesis sink in batches of less than 1MB?
or any other workaround
