Yes, I meant true general purpose exactly-once :)
> There are some ideas about using a WAL (write ahead log) and then
periodically "shipping" that to Kafka but nothing concrete.
But that would still need to be using Kafka transactions for "shipping"
records. That's what I meant that one way or
On 2021/01/08 10:00, Piotr Nowojski wrote:
Moreover I don't think there is a way to implement exactly once producer
without some use of transactions one way or another.
There are some ways I can think of. If messages have consistent IDs, we
could check whether a message is already in Kafka
On 2021/01/07 14:17, Pramod Immaneni wrote:
Is there a Kafka producer that can do exactly once semantic without the use
of transactions?
I'm afraid not right now. There are some ideas about using a WAL (write
ahead log) and then periodically "shipping" that to Kafka but nothing
concrete.
Hi Pramod,
Moreover I don't think there is a way to implement exactly once producer
without some use of transactions one way or another.
Best,
Piotrek
pt., 8 sty 2021 o 09:34 Till Rohrmann napisał(a):
> Hi Pramod,
>
> Flink's Kafka connector uses transactions in order to support exactly once
Hi Pramod,
Flink's Kafka connector uses transactions in order to support exactly once
semantic.
Cheers,
Till
On Thu, Jan 7, 2021 at 11:17 PM Pramod Immaneni wrote:
> Is there a Kafka producer that can do exactly once semantic without the use
> of transactions?
>
> Thanks
>
Is there a Kafka producer that can do exactly once semantic without the use
of transactions?
Thanks
