Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2019-02-04 Thread Edoardo Comar
Edoardo Comar > > > > IBM Event Streams > > > > > > Edoardo Comar wrote on 13/12/2018 17:50:30: > > > > > From: Edoardo Comar > > > To: dev@kafka.apache.org > > > Date: 13/12/2018 17:50 > > > Subject: Re: [DISCUSS] KIP-39

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2019-01-22 Thread radai
on 13/12/2018 17:50:30: > > > From: Edoardo Comar > > To: dev@kafka.apache.org > > Date: 13/12/2018 17:50 > > Subject: Re: [DISCUSS] KIP-391: Allow Producing with Offsets for > > Cluster Replication > > > > Hi, > > as we haven't

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2019-01-07 Thread Edoardo Comar
gt; To: dev@kafka.apache.org > Date: 13/12/2018 17:50 > Subject: Re: [DISCUSS] KIP-391: Allow Producing with Offsets for > Cluster Replication > > Hi, > as we haven't got any more feedback, we'd like to start a vote on KIP-391 > on Monda

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-12-13 Thread Edoardo Comar
ams IBM UK Ltd, Hursley Park, SO21 2JN Edoardo Comar/UK/IBM wrote on 10/12/2018 10:20:06: > From: Edoardo Comar/UK/IBM > To: dev@kafka.apache.org > Date: 10/12/2018 10:20 > Subject: Re: [DISCUSS] KIP-391: Allow Producing with Offsets for > Cluster Replication > > (shameless b

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-12-10 Thread Edoardo Comar
(shameless bump) any additional feedback is welcome ... thanks! Edoardo Comar wrote on 27/11/2018 15:35:09: > From: Edoardo Comar > To: dev@kafka.apache.org > Date: 27/11/2018 15:35 > Subject: Re: [DISCUSS] KIP-391: Allow Producing with Offsets for > Cluster Replication >

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-27 Thread Edoardo Comar
request where all the data > > > is to be assumed with offset, > > > or all without offsets, seems to suffice, > > > So we added only a toplevel flag, not a per-topic-partition one. > > > > > > Thanks for your interest ! > > > cheers > > > Edo > >

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-27 Thread Edoardo Comar
because > > of > > > > > > invalid offsets. > > > > > > Same if two producers were sending with offsets, likely both would > > > > then > > > > > > fail. > > > > > > > > > > > > > Does it make sense t

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-27 Thread Edoardo Comar
t; Edo > > -------------- > > > > Edoardo Comar > > > > IBM Event Streams > > IBM UK Ltd, Hursley Park, SO21 2JN > > > > > > Stanislav Kozlovski wrote on 22/11/2018 22:32:42: > > > > > Fr

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-26 Thread Jason Gustafson
gt; > > > > > > Does it make sense to *lock* the topic from other producers while > > > there > > > > > is > > > > > > one that uses offsets? > > > > > > > > > > You could do that with ACL permissions if you

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-26 Thread Mayuresh Gharat
o the ACL, do > we > > > > need > > > > > the `use_offset` field in the produce request? Maybe we make it > > > > mandatory > > > > > for produce requests with that ACL to have offsets. > > > > > > > > The flag is ne

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-26 Thread radai
Ltd, Hursley Park, SO21 2JN > > > Stanislav Kozlovski wrote on 22/11/2018 22:32:42: > > > From: Stanislav Kozlovski > > To: dev@kafka.apache.org > > Date: 22/11/2018 22:33 > > Subject: Re: [DISCUSS] KIP-391: Allow Producing with Offsets for > > Cluster Repl

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-23 Thread Edoardo Comar
& Mickael > > > > ---------------------- > > > > Edoardo Comar > > > > IBM Event Streams > > IBM UK Ltd, Hursley Park, SO21 2JN > > > > > > Stanislav Kozlovski wrote on 22/11/2018 16:17:11: > > &

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-22 Thread Stanislav Kozlovski
-- > > Edoardo Comar > > IBM Event Streams > IBM UK Ltd, Hursley Park, SO21 2JN > > > Stanislav Kozlovski wrote on 22/11/2018 16:17:11: > > > From: Stanislav Kozlovski > > To: dev@kafka.apache.org > > Date: 22/11/20

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-22 Thread Edoardo Comar
--- Edoardo Comar IBM Event Streams IBM UK Ltd, Hursley Park, SO21 2JN Stanislav Kozlovski wrote on 22/11/2018 16:17:11: > From: Stanislav Kozlovski > To: dev@kafka.apache.org > Date: 22/11/2018 16:17 > Subject: Re: [DISCUSS] KIP-391: Allow Producing with Offsets for

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-22 Thread Stanislav Kozlovski
Hey Edurdo, thanks for the KIP! I have some questions, apologies if they are naive: Is this intended to work for a single producer use case only? How would it work if two producers were producing to the same topic with offsets? How would it work if two producers, one with offsets and one without w

[DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-21 Thread Edoardo Comar
Hi, we've opened a KIP to improve data replication between Kafka clusters : https://cwiki.apache.org/confluence/display/KAFKA/KIP-391%3A+Allow+Producing+with+Offsets+for+Cluster+Replication We'd like to start a discussion, please post your feedback in this thread. Thank you Edo and Mickael ---