Re: [VOTE] KIP-710: Full support for distributed mode in dedicated MirrorMaker 2.0 clusters
Hi all, First off, congratulations to Daniel on your KIP passing! With regards to the question of exactly-once support, I believe it should be fully-supported by dedicated MM2 clusters once this KIP is implemented and merged. Speaking of implementation--I've already put together a patch for the REST-related changes described in this KIP (but not the config provider-related changes) to use on Aiven's fork of Mirror Maker 2. I've reached out and discussed this with Daniel offline, and we've agreed to use this patch for the implementation of the KIP on the official Kafka upstream repo. I plan to file a PR for this patch in the next week or so. Cheers, Chris On Wed, Jan 11, 2023 at 7:31 AM Ryanne Dolan wrote: > +1 (non-binding) > > On Sat, Oct 22, 2022, 2:38 AM Urbán Dániel wrote: > > > Hi everyone, > > > > I would like to start a vote on KIP-710 which aims to support running a > > dedicated MM2 cluster in distributed mode: > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-710%3A+Full+support+for+distributed+mode+in+dedicated+MirrorMaker+2.0+clusters > > > > Regards, > > Daniel > > > > > > -- > > Ezt az e-mailt átvizsgálta az Avast AntiVirus szoftver. > > www.avast.com > > >
Re: [VOTE] KIP-710: Full support for distributed mode in dedicated MirrorMaker 2.0 clusters
+1 (non-binding) On Sat, Oct 22, 2022, 2:38 AM Urbán Dániel wrote: > Hi everyone, > > I would like to start a vote on KIP-710 which aims to support running a > dedicated MM2 cluster in distributed mode: > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-710%3A+Full+support+for+distributed+mode+in+dedicated+MirrorMaker+2.0+clusters > > Regards, > Daniel > > > -- > Ezt az e-mailt átvizsgálta az Avast AntiVirus szoftver. > www.avast.com >
Re: [VOTE] KIP-710: Full support for distributed mode in dedicated MirrorMaker 2.0 clusters
As for the vote, thanks for participating, the vote passed with 3 binding and 1 non-binding votes. Moving the KIP forward. Daniel Dániel Urbán ezt írta (időpont: 2023. jan. 11., Sze, 13:28): > Hi Mickael, > Yes, after this KIP is implemented, the nested Connect workers inside MM2 > will behave the same way as vanilla Connect, and EOS will be supported. > I would like to ask Chris to confirm, as I'm not too familiar with the > details of KIP-618, but I really don't see any issues after KIP-710 passes. > Thanks, > Daniel > > Mickael Maison ezt írta (időpont: 2023. jan. > 10., K, 11:53): > >> Hi Daniel, >> >> Can you confirm that, following this KIP, MM in dedicated mode will be >> able to run with exactly once enabled? >> (Once the PR [0] to add KIP-618 support to MM is merged) >> >> 0: https://github.com/apache/kafka/pull/12366 >> >> Thanks, >> Mickael >> >> On Tue, Jan 10, 2023 at 11:36 AM Viktor Somogyi-Vass >> wrote: >> > >> > Ok, then +1 (binding) :) >> > >> > On Mon, Jan 9, 2023 at 3:44 PM John Roesler >> wrote: >> > >> > > Yes, you are! >> > > >> > > Congrats again :) >> > > -John >> > > >> > > On Mon, Jan 9, 2023, at 08:25, Viktor Somogyi-Vass wrote: >> > > > Hey all, >> > > > >> > > > Now that I'm a committer am I allowed to change my non-binding vote >> to >> > > > binding to pass the KIP? :) >> > > > >> > > > On Thu, Nov 10, 2022 at 6:13 PM Greg Harris >> > > > > >> > > > wrote: >> > > > >> > > >> +1 (non-binding) >> > > >> >> > > >> Thanks for the KIP, this is an important improvement. >> > > >> >> > > >> Greg >> > > >> >> > > >> On Thu, Nov 10, 2022 at 7:21 AM John Roesler >> > > wrote: >> > > >> >> > > >> > Thanks for the KIP, Daniel! >> > > >> > >> > > >> > I'm no MM expert, but I've read over the KIP and discussion, and >> it >> > > seems >> > > >> > reasonable to me. >> > > >> > >> > > >> > I'm +1 (binding). >> > > >> > >> > > >> > Thanks, >> > > >> > -John >> > > >> > >> > > >> > On 2022/10/22 07:38:38 Urbán Dániel wrote: >> > > >> > > Hi everyone, >> > > >> > > >> > > >> > > I would like to start a vote on KIP-710 which aims to support >> > > running a >> > > >> > > dedicated MM2 cluster in distributed mode: >> > > >> > > >> > > >> > > >> > > >> > >> > > >> >> > > >> https://cwiki.apache.org/confluence/display/KAFKA/KIP-710%3A+Full+support+for+distributed+mode+in+dedicated+MirrorMaker+2.0+clusters >> > > >> > > >> > > >> > > Regards, >> > > >> > > Daniel >> > > >> > > >> > > >> > > >> > > >> > > -- >> > > >> > > Ezt az e-mailt átvizsgálta az Avast AntiVirus szoftver. >> > > >> > > www.avast.com >> > > >> > > >> > > >> > >> > > >> >> > > >> >
Re: [VOTE] KIP-710: Full support for distributed mode in dedicated MirrorMaker 2.0 clusters
Hi Mickael, Yes, after this KIP is implemented, the nested Connect workers inside MM2 will behave the same way as vanilla Connect, and EOS will be supported. I would like to ask Chris to confirm, as I'm not too familiar with the details of KIP-618, but I really don't see any issues after KIP-710 passes. Thanks, Daniel Mickael Maison ezt írta (időpont: 2023. jan. 10., K, 11:53): > Hi Daniel, > > Can you confirm that, following this KIP, MM in dedicated mode will be > able to run with exactly once enabled? > (Once the PR [0] to add KIP-618 support to MM is merged) > > 0: https://github.com/apache/kafka/pull/12366 > > Thanks, > Mickael > > On Tue, Jan 10, 2023 at 11:36 AM Viktor Somogyi-Vass > wrote: > > > > Ok, then +1 (binding) :) > > > > On Mon, Jan 9, 2023 at 3:44 PM John Roesler wrote: > > > > > Yes, you are! > > > > > > Congrats again :) > > > -John > > > > > > On Mon, Jan 9, 2023, at 08:25, Viktor Somogyi-Vass wrote: > > > > Hey all, > > > > > > > > Now that I'm a committer am I allowed to change my non-binding vote > to > > > > binding to pass the KIP? :) > > > > > > > > On Thu, Nov 10, 2022 at 6:13 PM Greg Harris > > > > > > > > wrote: > > > > > > > >> +1 (non-binding) > > > >> > > > >> Thanks for the KIP, this is an important improvement. > > > >> > > > >> Greg > > > >> > > > >> On Thu, Nov 10, 2022 at 7:21 AM John Roesler > > > wrote: > > > >> > > > >> > Thanks for the KIP, Daniel! > > > >> > > > > >> > I'm no MM expert, but I've read over the KIP and discussion, and > it > > > seems > > > >> > reasonable to me. > > > >> > > > > >> > I'm +1 (binding). > > > >> > > > > >> > Thanks, > > > >> > -John > > > >> > > > > >> > On 2022/10/22 07:38:38 Urbán Dániel wrote: > > > >> > > Hi everyone, > > > >> > > > > > >> > > I would like to start a vote on KIP-710 which aims to support > > > running a > > > >> > > dedicated MM2 cluster in distributed mode: > > > >> > > > > > >> > > > > > >> > > > > >> > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-710%3A+Full+support+for+distributed+mode+in+dedicated+MirrorMaker+2.0+clusters > > > >> > > > > > >> > > Regards, > > > >> > > Daniel > > > >> > > > > > >> > > > > > >> > > -- > > > >> > > Ezt az e-mailt átvizsgálta az Avast AntiVirus szoftver. > > > >> > > www.avast.com > > > >> > > > > > >> > > > > >> > > > >
Re: [VOTE] KIP-710: Full support for distributed mode in dedicated MirrorMaker 2.0 clusters
Hi Daniel, Can you confirm that, following this KIP, MM in dedicated mode will be able to run with exactly once enabled? (Once the PR [0] to add KIP-618 support to MM is merged) 0: https://github.com/apache/kafka/pull/12366 Thanks, Mickael On Tue, Jan 10, 2023 at 11:36 AM Viktor Somogyi-Vass wrote: > > Ok, then +1 (binding) :) > > On Mon, Jan 9, 2023 at 3:44 PM John Roesler wrote: > > > Yes, you are! > > > > Congrats again :) > > -John > > > > On Mon, Jan 9, 2023, at 08:25, Viktor Somogyi-Vass wrote: > > > Hey all, > > > > > > Now that I'm a committer am I allowed to change my non-binding vote to > > > binding to pass the KIP? :) > > > > > > On Thu, Nov 10, 2022 at 6:13 PM Greg Harris > > > > > wrote: > > > > > >> +1 (non-binding) > > >> > > >> Thanks for the KIP, this is an important improvement. > > >> > > >> Greg > > >> > > >> On Thu, Nov 10, 2022 at 7:21 AM John Roesler > > wrote: > > >> > > >> > Thanks for the KIP, Daniel! > > >> > > > >> > I'm no MM expert, but I've read over the KIP and discussion, and it > > seems > > >> > reasonable to me. > > >> > > > >> > I'm +1 (binding). > > >> > > > >> > Thanks, > > >> > -John > > >> > > > >> > On 2022/10/22 07:38:38 Urbán Dániel wrote: > > >> > > Hi everyone, > > >> > > > > >> > > I would like to start a vote on KIP-710 which aims to support > > running a > > >> > > dedicated MM2 cluster in distributed mode: > > >> > > > > >> > > > > >> > > > >> > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-710%3A+Full+support+for+distributed+mode+in+dedicated+MirrorMaker+2.0+clusters > > >> > > > > >> > > Regards, > > >> > > Daniel > > >> > > > > >> > > > > >> > > -- > > >> > > Ezt az e-mailt átvizsgálta az Avast AntiVirus szoftver. > > >> > > www.avast.com > > >> > > > > >> > > > >> > >
Re: [VOTE] KIP-710: Full support for distributed mode in dedicated MirrorMaker 2.0 clusters
Ok, then +1 (binding) :) On Mon, Jan 9, 2023 at 3:44 PM John Roesler wrote: > Yes, you are! > > Congrats again :) > -John > > On Mon, Jan 9, 2023, at 08:25, Viktor Somogyi-Vass wrote: > > Hey all, > > > > Now that I'm a committer am I allowed to change my non-binding vote to > > binding to pass the KIP? :) > > > > On Thu, Nov 10, 2022 at 6:13 PM Greg Harris > > > wrote: > > > >> +1 (non-binding) > >> > >> Thanks for the KIP, this is an important improvement. > >> > >> Greg > >> > >> On Thu, Nov 10, 2022 at 7:21 AM John Roesler > wrote: > >> > >> > Thanks for the KIP, Daniel! > >> > > >> > I'm no MM expert, but I've read over the KIP and discussion, and it > seems > >> > reasonable to me. > >> > > >> > I'm +1 (binding). > >> > > >> > Thanks, > >> > -John > >> > > >> > On 2022/10/22 07:38:38 Urbán Dániel wrote: > >> > > Hi everyone, > >> > > > >> > > I would like to start a vote on KIP-710 which aims to support > running a > >> > > dedicated MM2 cluster in distributed mode: > >> > > > >> > > > >> > > >> > https://cwiki.apache.org/confluence/display/KAFKA/KIP-710%3A+Full+support+for+distributed+mode+in+dedicated+MirrorMaker+2.0+clusters > >> > > > >> > > Regards, > >> > > Daniel > >> > > > >> > > > >> > > -- > >> > > Ezt az e-mailt átvizsgálta az Avast AntiVirus szoftver. > >> > > www.avast.com > >> > > > >> > > >> >
Re: [VOTE] KIP-710: Full support for distributed mode in dedicated MirrorMaker 2.0 clusters
Yes, you are! Congrats again :) -John On Mon, Jan 9, 2023, at 08:25, Viktor Somogyi-Vass wrote: > Hey all, > > Now that I'm a committer am I allowed to change my non-binding vote to > binding to pass the KIP? :) > > On Thu, Nov 10, 2022 at 6:13 PM Greg Harris > wrote: > >> +1 (non-binding) >> >> Thanks for the KIP, this is an important improvement. >> >> Greg >> >> On Thu, Nov 10, 2022 at 7:21 AM John Roesler wrote: >> >> > Thanks for the KIP, Daniel! >> > >> > I'm no MM expert, but I've read over the KIP and discussion, and it seems >> > reasonable to me. >> > >> > I'm +1 (binding). >> > >> > Thanks, >> > -John >> > >> > On 2022/10/22 07:38:38 Urbán Dániel wrote: >> > > Hi everyone, >> > > >> > > I would like to start a vote on KIP-710 which aims to support running a >> > > dedicated MM2 cluster in distributed mode: >> > > >> > > >> > >> https://cwiki.apache.org/confluence/display/KAFKA/KIP-710%3A+Full+support+for+distributed+mode+in+dedicated+MirrorMaker+2.0+clusters >> > > >> > > Regards, >> > > Daniel >> > > >> > > >> > > -- >> > > Ezt az e-mailt átvizsgálta az Avast AntiVirus szoftver. >> > > www.avast.com >> > > >> > >>
Re: [VOTE] KIP-710: Full support for distributed mode in dedicated MirrorMaker 2.0 clusters
Hey all, Now that I'm a committer am I allowed to change my non-binding vote to binding to pass the KIP? :) On Thu, Nov 10, 2022 at 6:13 PM Greg Harris wrote: > +1 (non-binding) > > Thanks for the KIP, this is an important improvement. > > Greg > > On Thu, Nov 10, 2022 at 7:21 AM John Roesler wrote: > > > Thanks for the KIP, Daniel! > > > > I'm no MM expert, but I've read over the KIP and discussion, and it seems > > reasonable to me. > > > > I'm +1 (binding). > > > > Thanks, > > -John > > > > On 2022/10/22 07:38:38 Urbán Dániel wrote: > > > Hi everyone, > > > > > > I would like to start a vote on KIP-710 which aims to support running a > > > dedicated MM2 cluster in distributed mode: > > > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-710%3A+Full+support+for+distributed+mode+in+dedicated+MirrorMaker+2.0+clusters > > > > > > Regards, > > > Daniel > > > > > > > > > -- > > > Ezt az e-mailt átvizsgálta az Avast AntiVirus szoftver. > > > www.avast.com > > > > > >
Re: [VOTE] KIP-710: Full support for distributed mode in dedicated MirrorMaker 2.0 clusters
+1 (non-binding) Thanks for the KIP, this is an important improvement. Greg On Thu, Nov 10, 2022 at 7:21 AM John Roesler wrote: > Thanks for the KIP, Daniel! > > I'm no MM expert, but I've read over the KIP and discussion, and it seems > reasonable to me. > > I'm +1 (binding). > > Thanks, > -John > > On 2022/10/22 07:38:38 Urbán Dániel wrote: > > Hi everyone, > > > > I would like to start a vote on KIP-710 which aims to support running a > > dedicated MM2 cluster in distributed mode: > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-710%3A+Full+support+for+distributed+mode+in+dedicated+MirrorMaker+2.0+clusters > > > > Regards, > > Daniel > > > > > > -- > > Ezt az e-mailt átvizsgálta az Avast AntiVirus szoftver. > > www.avast.com > > >
Re: [VOTE] KIP-710: Full support for distributed mode in dedicated MirrorMaker 2.0 clusters
Thanks for the KIP, Daniel! I'm no MM expert, but I've read over the KIP and discussion, and it seems reasonable to me. I'm +1 (binding). Thanks, -John On 2022/10/22 07:38:38 Urbán Dániel wrote: > Hi everyone, > > I would like to start a vote on KIP-710 which aims to support running a > dedicated MM2 cluster in distributed mode: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-710%3A+Full+support+for+distributed+mode+in+dedicated+MirrorMaker+2.0+clusters > > Regards, > Daniel > > > -- > Ezt az e-mailt átvizsgálta az Avast AntiVirus szoftver. > www.avast.com >
Re: [VOTE] KIP-710: Full support for distributed mode in dedicated MirrorMaker 2.0 clusters
+1 (non-binding). Thanks for the KIP! On Mon, Oct 24, 2022 at 3:23 PM Chris Egerton wrote: > +1 (binding). Thanks for the KIP! > > On Sat, Oct 22, 2022 at 3:38 AM Urbán Dániel > wrote: > > > Hi everyone, > > > > I would like to start a vote on KIP-710 which aims to support running a > > dedicated MM2 cluster in distributed mode: > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-710%3A+Full+support+for+distributed+mode+in+dedicated+MirrorMaker+2.0+clusters > > > > Regards, > > Daniel > > > > > > -- > > Ezt az e-mailt átvizsgálta az Avast AntiVirus szoftver. > > www.avast.com > > >
Re: [VOTE] KIP-710: Full support for distributed mode in dedicated MirrorMaker 2.0 clusters
+1 (binding). Thanks for the KIP! On Sat, Oct 22, 2022 at 3:38 AM Urbán Dániel wrote: > Hi everyone, > > I would like to start a vote on KIP-710 which aims to support running a > dedicated MM2 cluster in distributed mode: > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-710%3A+Full+support+for+distributed+mode+in+dedicated+MirrorMaker+2.0+clusters > > Regards, > Daniel > > > -- > Ezt az e-mailt átvizsgálta az Avast AntiVirus szoftver. > www.avast.com >
