Is that possible to make __consumer_offsets retention to be size-based
instead of time-based like with "retention.bytes" property?
Sergi
On Sun, Apr 19, 2020 at 12:37 PM Liam Clarke
wrote:
> Hi Nitin,
>
> Default in Kafka 2.0+ is 7 days, previously it was 24 hours IIRC. Only
> reason you need t
e can help you further.
>
Thanks a lot for your help!
BTW, here is the link to the project if you are interested:
https://github.com/svladykin/ReplicaMap
Sergi
>
> Cheers!
> --
> Jonathan
>
> On Mon, Nov 25, 2019 at 6:51 AM Sergi Vladykin
> wrote:
>
> > Thank
ist with diff scenarios of a
> KafkaProducer, hope this help:
> https://gist.github.com/jonathansantilli/3b69ebbcd24e7a30f66db790ef648f99
>
>
> Cheers!
> --
> Jonathan
>
>
>
> On Sat, Nov 23, 2019 at 8:33 PM Sergi Vladykin
> wrote:
>
> > Hi!
> >
> > I
Hi!
I have two questions related to transactional producers:
1. Is it OK to mix transactional and non-transactional approach with a
single KafkaProducer instance? I mean sometimes I want to publish multiple
messages transactionally, but oftentimes just a single message. Starting a
transaction for
Hi,
Maybe this library will be useful for someone:
https://github.com/svladykin/ReplicaMap
Future plans:
- Optimistic transactions: update multiple keys in a single TX
- Sharding: distribute the partitions across multiple clients
Sergi
:)
> >
> > Alex
> >
> > On Wed, Oct 30, 2019 at 10:04 PM Kidong Lee wrote:
> >
> >> Hi,
> >>
> >> It may be not for your case, but I have implemented an example about
> kafka
> >> transaction:
> >>
> >> https://medi
s you have to consider for all messaging solutions (not only Kafka) in
> your technical design.
>
> > Am 30.10.2019 um 20:30 schrieb Sergi Vladykin >:
> >
> > Hi!
> >
> > I investigate possibilities of "exactly once" Kafka transactions for
> >
Hi!
I investigate possibilities of "exactly once" Kafka transactions for
consume-transform-produce pattern. As far as I understand, the logic must
be the following (in pseudo-code):
var cons = createKafkaConsumer(MY_CONSUMER_GROUP_ID);
cons.subscribe(TOPIC_A);
for (;;) {
var recs = cons.poll(
