Re: Cleaning up command line tools argument parsing a little

Sönke - I think this is a great idea. I’d be willing to help out where I can if there is a new issue to track this. > On Apr 17, 2019, at 9:02 AM, Sönke Liebau > wrote: > > I actually have a theory how that came about. > > All classes that use argparse4j are situated in the tools and connect

Re: [VOTE] KIP-415: Incremental Cooperative Rebalancing in Kafka Connect

+1 (non-binding) > On Mar 6, 2019, at 3:40 PM, Ryanne Dolan wrote: > > +1 (non-binding) > > Thanks! > Ryanne > > On Wed, Mar 6, 2019, 4:28 PM Konstantine Karantasis < > konstant...@confluent.io> wrote: > >> I'd like to open the vote on KIP-415: Incremental Cooperative Rebalancing >> in Kafka

Re: Statestore restoration & scaling questions - possible KIP as well.

Adam, I don’t have an answer for you but I would also be interested in clarification of this process if anyone can provide more details. If your reading is correct I would welcome the KIP to reduce the scaling pauses. Cheers, Rhys McCaig > On Feb 6, 2019, at 7:44 AM, Adam Bellemare wrote: >

Re: [EXTERNAL] [VOTE] KIP-382 MirrorMaker 2.0

+1 (non-binding). Fantastic work on the KIP Ryanne. > On Dec 25, 2018, at 9:10 AM, Stephane Maarek > wrote: > > +1 ! Great stuff > > Stephane > > On Mon., 24 Dec. 2018, 12:07 pm Edoardo Comar >> +1 non-binding >> >> thanks for the KIP >> -- >

Re: [DISCUSS] KIP-310: Add a Kafka Source Connector to Kafka Connect

e fact that this connector targets Kafka itself as a > source is not an adequate reason to include it in apache/kafka within the > Connect framework. It seems it can evolve naturally, as every other > connector, in its own repository. > > Regards, > Konstantine > > >

Re: [DISCUSS] KIP-382: MirrorMaker 2.0

Also notice this is done at the topic level, not per record. The records > don't need any special header or anything for this cycle detection > mechanism to work. > > Thanks! > Ryanne > > On Mon, Oct 15, 2018 at 3:40 PM McCaig, Rhys > wrote: > >> Hi Ryanne, >

Re: [DISCUSS] KIP-382: MirrorMaker 2.0

Hi Ryanne, This KIP is fantastic. It provides a great vision for how MirrorMaker should evolve in the Kafka project. I have a question on cycle detection - In a scenario where I have 3 clusters replicating between each other, it seems it may be easy to misconfigure the connectors if auto topic

Re: [EXTERNAL] Incremental Cooperative Rebalancing

This is fantastic. Im really excited to see the work on this. > On Oct 2, 2018, at 4:22 PM, Konstantine Karantasis > wrote: > > Hey everyone, > > I'd like to bring to your attention a general design document that was just > published in Apache Kafka's wiki space: > > https://cwiki.apache.org

Re: [EXTERNAL] Apache Kafka project charter

;> and flexible, both in terms of releasing and using/deploying software >>>> related to Kafka Connect. I might even say that I'd be in favor of >>>> extending this approach to all the Connect components, including >>>> Transformations and Converters. &

Re: [EXTERNAL] [DISCUSS] KIP-310: Add a Kafka Source Connector to Kafka Connect

is connector targets Kafka itself as a > source is not an adequate reason to include it in apache/kafka within the > Connect framework. It seems it can evolve naturally, as every other > connector, in its own repository. > > Regards, > Konstantine > > > On Sat, Aug 4, 201

Re: [VOTE] KIP-310: Add a Kafka Source Connector to Kafka Connect

Hi All, Bumping this again. Can I get feedback from some binding vote holders on this KIP? I think its fairly straightforward KIP and worthwhile addition to Kafka Connect. Cheers, Rhys > On Sep 4, 2018, at 12:32 PM, McCaig, Rhys wrote: > > Bumping this thread. > >> O

Re: [EXTERNAL] [VOTE] KIP-158: Kafka Connect should allow source connectors to set topic-specific settings for new topics

Looks great Randall +1 (non-binding) > On Sep 9, 2018, at 7:17 PM, Gwen Shapira wrote: > > +1 > Useful improvement, thanks Randall. > > > On Fri, Sep 7, 2018, 3:28 PM Randall Hauch wrote: > >> I believe the feedback on KIP-158 has been addressed. I'd like to start a >> vote. >> >> KIP: >>

Re: [EXTERNAL] [VOTE] KIP-310: Add a Kafka Source Connector to Kafka Connect

Bumping this thread. > On Aug 14, 2018, at 11:00 AM, McCaig, Rhys wrote: > > Bumping this thread. Looking for some binding votes or further request for > discussion. > >> On Aug 10, 2018, at 12:38 PM, McCaig, Rhys wrote: >> >> Thanks Stephane! >&g

Re: [EXTERNAL] [DISCUSS] KIP-158: Kafka Connect should allow source connectors to set topic-specific settings for new topics

Randall, This KIP looks great to me. As for _updating_ topic configs - It’s a nice to have but certainly something that I could live without in order to get this KIP implemented. (Its not something I would use in my current setup but I can see some cases where it could be part of the workflow f

Re: [EXTERNAL] [VOTE] KIP-310: Add a Kafka Source Connector to Kafka Connect

Bumping this thread. Looking for some binding votes or further request for discussion. > On Aug 10, 2018, at 12:38 PM, McCaig, Rhys wrote: > > Thanks Stephane! > > If there is a desire for further discussion I am certainly open to reverting > this to a discussion thread.

Re: [EXTERNAL] [VOTE] KIP-310: Add a Kafka Source Connector to Kafka Connect

s from the community. > Can we get some input from other people? > > Thanks for starting the vote nonetheless :) > Stephane > > On 8 August 2018 at 20:28, McCaig, Rhys wrote: > >> Hi >> >> Could we get a couple of votes on this KIP - voting closes in 24

Re: [EXTERNAL] [VOTE] KIP-310: Add a Kafka Source Connector to Kafka Connect

Hi Could we get a couple of votes on this KIP - voting closes in 24 hours. Thanks, Rhys > On Aug 6, 2018, at 11:51 AM, McCaig, Rhys wrote: > > Hi All, > > I’m starting a vote on KIP-310: Add a Kafka Source Connector to Kafka Connect > > KIP: > https://cwiki.apach

[VOTE] KIP-310: Add a Kafka Source Connector to Kafka Connect

Hi All, I’m starting a vote on KIP-310: Add a Kafka Source Connector to Kafka Connect KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-310%3A+Add+a+Kafka+Source+Connector+to+Kafka+Connect

Re: [EXTERNAL] [DISCUSS] KIP-310: Add a Kafka Source Connector to Kafka Connect

Hi All, If there are no further comments on this KIP I’ll start a vote early this week. Rhys On Aug 1, 2018, at 12:32 AM, McCaig, Rhys mailto:rhys_mcc...@cable.comcast.com>> wrote: Hi All, I’ve updated the proposal to include the improvements suggested by Stephane. I have also submi

Re: [EXTERNAL] [DISCUSS] KIP-310: Add a Kafka Source Connector to Kafka Connect

available to me, though I have seen very good performance in that test stack (200k messages/sec@100bytes on limited compute resource containers). Further benchmarking might take a few days. Review and comments would be appreciated. Cheers, Rhys On Jun 18, 2018, at 9:00 AM, McCaig, Rhys

Re: [EXTERNAL] [DISCUSS] KIP-310: Add a Kafka Source Connector to Kafka Connect

t; > - Is there a way to be flexible and merge list and regex, or offer the two > simultaneously ? source_topics=my_static_topic,prefix.* ? > > Hope that helps > Stephane > > Kind regards, > Stephane > > [image: Simple Machines] > > Stephane Maarek | Develope

[DISCUSS] KIP-310: Add a Kafka Source Connector to Kafka Connect

Kafka+Connect Let me know if you have any comments or feedback, would love to hear them. Cheers, Rhys > On May 28, 2018, at 10:23 PM, McCaig, Rhys wrote: > > Sorry for the bad link to the KIP, here it is: > https://cwiki.apache.org/confluence/display/KAFKA/KIP-308%3A+Add+a+Kafka+So

Re: [EXTERNAL] [DISCUSS] KIP-308: Add a Kafka Source Connector to Kafka Connect

Sorry for the bad link to the KIP, here it is: https://cwiki.apache.org/confluence/display/KAFKA/KIP-308%3A+Add+a+Kafka+Source+Connector+to+Kafka+Connect > On May 28, 2018, at 10:19 PM, McCaig, Rhys wrote: > > Hi All, > > I added a KIP to include a Kafka Source Connector wit

[DISCUSS] KIP-308: Add a Kafka Source Connector to Kafka Connect

Hi All, I added a KIP to include a Kafka Source Connector with Kafka Connect. Here is the KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-308%3A+Add+a+Kafka+Source+Connector+to+Kafka+Connect

Re: [EXTERNAL] Kafka Connect: New Kafka Source Connector

Hi Team, Would someone be able to provide me with Confluence permission in order to write a KIP for the below code. User: https://cwiki.apache.org/confluence/display/~mccaig Cheers, Rhys On May 11, 2018, at 4:45 PM, McCaig, Rhys mailto:rhys_mcc...@comcast.com>> wrote: Hi there, O

Kafka Connect: New Kafka Source Connector

Hi there, Over at Comcast we just open sourced a Kafka source connector for Kafka Connect. (https://github.com/Comcast/MirrorTool-for-Kafka-Connect) We’ve used this as an alternative to MirrorMaker on a couple of projects. While discussing open sourcing the project, we realized that the function