Re: Newbie contributor

2022-03-09 Thread Mickael Maison
Hi Francisco, Welcome! I've added you to the contributor list. Thanks for your interest in Apache Kafka. Thanks, Mickael On Wed, Mar 9, 2022 at 4:16 PM Francisco José Becerra López wrote: > > Hi, > > Hope you are well > > May I be added to the contribution list to lend a hand on this project,

Re: [DISCUSS] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

2022-03-08 Thread Mickael Maison
Hi Sergio, Thanks for the KIP. Instead of specifying the size in bytes, have you considered specifying it in terms of number of batches? I think it's a bit more user friendly than a size in raw bytes. For example: --num-batches: The number of batches to read from the log segment. Thanks, Mickael

Re: [VOTE] 3.0.1 RC0

2022-03-07 Thread Mickael Maison
All seems to work fine, no issues found. > > Thanks > Jakub > > On Thu, Mar 3, 2022 at 7:05 PM Mickael Maison wrote: > > > Hello Kafka users, developers and client-developers, > > > > This is the first candidate for release of Apache Kafka 3.0.1. > > > >

[jira] [Resolved] (KAFKA-10759) ARM support for Kafka

2022-03-07 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-10759. Fix Version/s: 3.0.0 Resolution: Fixed > ARM support for Ka

[jira] [Resolved] (KAFKA-13671) Power (ppc64le) support for kafka

2022-03-07 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-13671. Fix Version/s: 3.2.0 Resolution: Fixed > Power (ppc64le) support for ka

[VOTE] 3.0.1 RC0

2022-03-03 Thread Mickael Maison
Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 3.0.1. Apache Kafka 3.0.1 is a bugfix release and 29 issues have been fixed since 3.0.0. Release notes for the 3.0.1 release:

Re: Proposal to add IBM Power (ppc64le) to apache kafka jenkins CI

2022-03-03 Thread Mickael Maison
urther steps? > https://issues.apache.org/jira/browse/INFRA-22612 > > Regards, > Abhijit > > On Wed, Jan 26, 2022 at 8:40 PM Mickael Maison > wrote: > > > > Hi Abhijit, > > > > Thanks for offering a ppc64le VM. Looking at the INFRA ticket, it > > looks l

[jira] [Resolved] (KAFKA-13510) KIP-769: Connect APIs to list all connector plugins and retrieve their configuration definitions

2022-03-03 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-13510. Resolution: Fixed > KIP-769: Connect APIs to list all connector plugins and retri

Re: Call for review: KIP-618

2022-02-23 Thread Mickael Maison
this rate, I estimate it won't receive a > > > complete review--let alone be approved and merged--until October this > > year, > > > at the earliest. > > > > > > I understand that review for moderately large features like this one (the > > > cu

Re: [VOTE] KIP-815: Support max-timestamp in GetOffsetShell

2022-02-23 Thread Mickael Maison
Hi, I'm +1 (binding) too. Just one minor comment: Could we make the "time" argument also accept "earliest", "latest" and "max-timestamp" alongside -1, -2, -3. I think it's a bit confusing to use these negative numbers to specify the desired timestamps. Thanks On Tue, Feb 22, 2022 at 8:05 AM

Re: [DISCUSS] Apache Kafka 3.2.0 release

2022-02-15 Thread Mickael Maison
Hi Bruno, Thanks for publishing the release plan! Can we add KIP-769 to the plan? Thanks, Mickael On Tue, Feb 15, 2022 at 12:37 PM Bruno Cadonna wrote: > > Hi all, > > I published a release plan for the Apache Kafka 3.2.0 release here: >

Re: [VOTE] KIP-769: Connect APIs to list all connector plugins and retrieve their configuration definitions

2022-02-15 Thread Mickael Maison
I'm +1 (binding) too The vote passes with: - 3 +1 (binding) votes from Tom, John and myself - 5 +1 (non-binding) from Chris, Ryanne, Viktor, Julien and Dongjin Thanks for the votes and feedback On Tue, Feb 15, 2022 at 6:54 PM Mickael Maison wrote: > > Hi Chris, > > Yes committers

Re: [VOTE] KIP-769: Connect APIs to list all connector plugins and retrieve their configuration definitions

2022-02-15 Thread Mickael Maison
: > > +1 (non-binding) > > > > Thanks, > > Dongjin > > > > On Wed, Feb 9, 2022, 2:07 AM Mickael Maison > > wrote: > > > >> Bumping this vote. > >> > >> We have 1 binding and 4 non-binding votes so far. > >> Let me know

[jira] [Resolved] (KAFKA-13577) Replace EasyMock and PowerMock with Mockito in core module

2022-02-11 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-13577. Fix Version/s: 3.2.0 Resolution: Fixed > Replace EasyMock and PowerM

Re: [ANNOUNCE] New committer: Luke Chen

2022-02-10 Thread Mickael Maison
Congratulations Luke! On Thu, Feb 10, 2022 at 8:54 AM Tom Bentley wrote: > > Congratulations Luke! > > On Thu, 10 Feb 2022 at 06:41, Josep Prat > wrote: > > > Congrats Luke! > > > > ——— > > Josep Prat > > > > Aiven Deutschland GmbH > > > > Immanuelkirchstraße 26, 10405 Berlin > > > >

Re: [VOTE] KIP-769: Connect APIs to list all connector plugins and retrieve their configuration definitions

2022-02-08 Thread Mickael Maison
t; > > > > > +1 (non-binding) from me. > > > > > > Viktor > > > > > > On Thu, Jan 13, 2022 at 11:32 AM Mickael Maison < > > mickael.mai...@gmail.com> > > > wrote: > > > > > > > Bumping this vote. > > &

Re: [DISCUSS] Apache Kafka 3.0.1

2022-02-08 Thread Mickael Maison
gt; > +1 Thank you! > > > > Best, > > Bruno > > > > On 07.02.22 18:24, Ismael Juma wrote: > > > Thanks Mickael, +1. > > > > > > Ismael > > > > > > On Mon, Feb 7, 2022 at 9:17 AM Mickael Maison > > wrote: > > > >

[DISCUSS] Apache Kafka 3.0.1

2022-02-07 Thread Mickael Maison
Hi, I'd like to volunteer to be the release manager for the next bugfix release, 3.0.1. Thanks, Mickael

Re: [DISCUSS] Should we automatically close stale PRs?

2022-02-07 Thread Mickael Maison
Hi David, I agree with you, I think we should close stale PRs. Overall, I think we should also see if there are other Github actions that may ease the work for reviewers and/or give more visibility of the process to PR authors. I'm thinking things like: - code coverage changes - better view on

[jira] [Resolved] (KAFKA-13527) Add top-level error code field to DescribeLogDirsResponse

2022-02-01 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-13527. Fix Version/s: 3.2.0 Resolution: Fixed > Add top-level error code fi

[jira] [Resolved] (KAFKA-13595) Allow producing records with null values in Kafka Console Producer

2022-02-01 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-13595. Fix Version/s: 3.2.0 Resolution: Fixed > Allow producing records with null val

Re: KIP-769: Connect API to retrieve connector configuration definitions

2022-01-31 Thread Mickael Maison
Hi, I have updated the KIP accordingly. Thanks, Mickael On Fri, Jan 28, 2022 at 7:01 PM Chris Egerton wrote: > > I think a simple approach here is fine. +1 for removing versioning for > other plugins. > > On Fri, Jan 28, 2022 at 11:17 AM Mickael Maison > wrote: > >

Re: KIP-769: Connect API to retrieve connector configuration definitions

2022-01-28 Thread Mickael Maison
e would obviously require plugins to provide versions, but we could > > potentially add some failsafe logic in order to still support versionless > > plugins with the understanding that it would not be possible to colocate > > multiple versions of them on the same worker. > >

Re: [DISCUSS] KIP-653: Upgrade log4j to log4j2

2022-01-28 Thread Mickael Maison
Hi Dongjin, Before starting to review the PR, I was doing a bit of research of the topic and I noticed ZooKeeper actually depends on log4j1. In zookeeper-server, by default a few JMX beans are registered for log4j1. When starting ZooKeeper you get a log line like: INFO Log4j 1.2 jmx support

[jira] [Resolved] (KAFKA-13348) Allow Source Tasks to Handle Producer Exceptions

2022-01-27 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-13348. Fix Version/s: 3.2.0 Resolution: Fixed > Allow Source Tasks to Handle Produ

Re: KIP-769: Connect API to retrieve connector configuration definitions

2022-01-27 Thread Mickael Maison
. Thanks, Mickael On Mon, Jan 24, 2022 at 5:41 PM Mickael Maison wrote: > > Hi Tom, > > Thanks for the feedback. > > You're right we don't have any contracts around the version field. > Like Chris I've only used the current field to find the exact source > code of connectors. Ev

[jira] [Resolved] (KAFKA-13618) BatchAccumulator `Exptected` rename to `Expected`

2022-01-26 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-13618. Fix Version/s: 3.2.0 Resolution: Fixed > BatchAccumulator `Exptected` ren

Re: Proposal to add IBM Power (ppc64le) to apache kafka jenkins CI

2022-01-26 Thread Mickael Maison
Hi Abhijit, Thanks for offering a ppc64le VM. Looking at the INFRA ticket, it looks like it was added to Jenkins successfully. The spec looks appropriate for Kafka builds. Let's wait a few days to see if anybody has questions or concerns. Thanks, Mickael On Mon, Jan 24, 2022 at 11:03 AM

Re: [DISCUSS] KIP-787 - MM2 Interface to manage Kafka resources

2022-01-26 Thread Mickael Maison
Hi Omnia, Thanks for the KIP, sorry for taking so long to comment. I've only had time to take a quick look so far. This seems to address a relatively advanced and specific use case. My initial concern is this may make it hard to evolve MirrorMaker as we'll likely need to update this new

Re: [VOTE] KIP-808: Add support for unix epoch precision in TimestampConverter SMT

2022-01-26 Thread Mickael Maison
+1 (binding) Thanks Julien for the KIP! On Wed, Jan 26, 2022 at 12:05 PM Tom Bentley wrote: > > Hi Julien, > > Thanks again for this KIP. +1 (binding). > > Kind regards, > > Tom > > On Tue, 18 Jan 2022 at 08:15, Julien Chanaud > wrote: > > > Hi everyone, > > > > I'd like to start a vote for

[jira] [Resolved] (KAFKA-9279) Silent data loss in Kafka producer

2022-01-26 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-9279. --- Fix Version/s: 3.2.0 Resolution: Fixed > Silent data loss in Kafka produ

Re: [VOTE] KIP-784: Add top-level error code field to DescribeLogDirsResponse

2022-01-25 Thread Mickael Maison
Thanks for the KIP! > > On Mon, Dec 13, 2021 at 11:14 AM Mickael Maison > wrote: > > > > Bumping this thread another time. > > > > This is a very minor change to make DescribeLogDirsResponse consistent > > with the other APIs. > > Let me know if

Re: [ANNOUNCE] Apache Kafka 3.1.0

2022-01-24 Thread Mickael Maison
Jim Galasyn, > JoeCqupt, Joel Hamill, John Gray, John Roesler, Jongho Jeon, Jorge Esteban > Quilcate Otoya, Jose Sancio, Josep Prat, José Armando García Sancio, Jun Rao, > Justine Olshan, Kalpesh Patel, Kamal Chandraprakash, Kevin Zhang, Kirk True, > Konstantine Karantasis, Kowshik Praka

Re: KIP-769: Connect API to retrieve connector configuration definitions

2022-01-24 Thread Mickael Maison
lear what > > the consumer of the version string is supposed to do with it. So I think if > > we're going to be using Versioned more extensively it would be good to make > > the expectations clearer, for both authors and people wanting to reason > > about versions. > > &

Re: [VOTE] 3.1.0 RC1

2022-01-20 Thread Mickael Maison
Thanks David for running this release! I checked signatures and keys, built from source and ran unit tests with Java 11. I also ran the quickstart. +1 (binding) Thanks, Mickael On Wed, Jan 19, 2022 at 9:20 PM Bill Bejeck wrote: > > Hi David, > > Thanks for running the release! > > I did the

Re: [DISCUSS] KIP-719: Add Log4J2 Appender

2022-01-17 Thread Mickael Maison
ns are released and users have to update in high-pace > > > > * actually, a CVE was also reported for logback (CVE-2021-42550) > > but > > > it > > > > requires edit-permission of the config file for an attacker so it's > > much > > > > less thre

Re: [VOTE] KIP-719: Deprecate Log4J Appender

2022-01-17 Thread Mickael Maison
Hi Dongjin, +1 (binding) Thanks for all your efforts on this KIP Thanks, Mickael On Tue, Dec 21, 2021 at 10:00 AM Dongjin Lee wrote: > > Hi All, > > I hope to reboot the voting for KIP-719: Deprecate Log4J Appender. > >

Re: [DISCUSS] Enable links from Github commits to Jira Issues

2022-01-13 Thread Mickael Maison
t 9:58 AM Bruno Cadonna > >> wrote: > >> > > >> > > Hi Mickael, > >> > > > >> > > I agree that your proposal would be useful. > >> > > > >> > > Thank you for starting this. > >> >

[jira] [Created] (KAFKA-13595) Allow producing records with null values in Kafka Console Producer

2022-01-13 Thread Mickael Maison (Jira)
Mickael Maison created KAFKA-13595: -- Summary: Allow producing records with null values in Kafka Console Producer Key: KAFKA-13595 URL: https://issues.apache.org/jira/browse/KAFKA-13595 Project

Re: [VOTE] KIP-810: Allow producing records with null values in Kafka Console Producer

2022-01-13 Thread Mickael Maison
>>> Thanks, > >>> John > >>> > >>> On Tue, Jan 4, 2022, at 08:53, Israel Ekpo wrote: > >>>> Thanks for the KIP, Mickael > >>>> > >>>> Looks great! > >>>> > >>>> +1 (non-binding) > &

Re: [VOTE] KIP-769: Connect APIs to list all connector plugins and retrieve their configuration definitions

2022-01-13 Thread Mickael Maison
Bumping this vote. We have 2 non-binding votes so far. Please take a look and let me know if you have any feedback. Thanks, Mickael On Mon, Dec 13, 2021 at 10:50 PM Ryanne Dolan wrote: > > +1 (non-binding) > > Ryanne > > On Mon, Dec 13, 2021, 4:18 AM Mickael Maison >

[jira] [Resolved] (KAFKA-7589) Allow configuring num.network.threads per listener

2022-01-13 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-7589. --- Fix Version/s: 3.2.0 Resolution: Fixed > Allow configuring num.network.threads

Re: [DISCUSS] KIP-808: Add support for unix epoch precision in TimestampConverter SMT

2022-01-12 Thread Mickael Maison
Hi Julien, Thanks for the KIP. I looks like a useful improvement to the TimestampConverter SMT. I'd suggest adding the documentation for the new setting to the KIP. I've had to go check your PR to fully understand how you want to use it, both for input and output. Apart from that, if you don't

Re: [DISCUSS] KIP-810: Allow producing records with null values in Kafka Console Producer

2022-01-12 Thread Mickael Maison
not like the user couldn't easily select a different null marker to > avoid a collision with a header key. Was there a reason you went for these > semantics? > > Kind regards, > > Tom > > On Mon, 20 Dec 2021 at 17:06, Mickael Maison > wrote: > > > Thanks for the feed

Re: Request to Contribute

2022-01-10 Thread Mickael Maison
Hi, I've added you to the contributor list. Thanks, Mickael On Mon, Jan 10, 2022 at 12:53 AM Ari Iramanesh wrote: > > Hi Apache Kafka team, > > I hope you're doing well! I'd like to contribute to Kafka. I've gone > through the developer documentation and found some tickets to work on. May > I

Re: Contribution to Kafka project

2022-01-09 Thread Mickael Maison
Hi Mohsin, I've granted you permissions in JIRA. Thanks for your interest in Apache Kafka. Thanks, Mickael On Sun, Jan 9, 2022 at 12:30 AM mohsin ahmed wrote: > > Hello Team, > > I am keen to start contributing to the Kafka open source project. I have > gone through the how to contribute page

[jira] [Created] (KAFKA-13577) Replace EasyMock and PowerMock with Mockito in core module

2022-01-06 Thread Mickael Maison (Jira)
Mickael Maison created KAFKA-13577: -- Summary: Replace EasyMock and PowerMock with Mockito in core module Key: KAFKA-13577 URL: https://issues.apache.org/jira/browse/KAFKA-13577 Project: Kafka

[VOTE] KIP-810: Allow producing records with null values in Kafka Console Producer

2022-01-04 Thread Mickael Maison
Hi, I'd like to start a vote on KIP-810 that adds the option to produce records with a null value https://cwiki.apache.org/confluence/display/KAFKA/KIP-810%3A+Allow+producing+records+with+null+values+in+Kafka+Console+Producer Let me know if you have any feedback. Thanks, Mickael

Re: [VOTE] 3.1.0 RC0

2022-01-03 Thread Mickael Maison
Hi David, - verified checksums and signatures - checked javadocs - built from source using Java 11 - ran unit tests - ran quickstart using the 2.13 binaries +1 (binding) Thanks for running this release! On Sun, Jan 2, 2022 at 8:45 PM Israel Ekpo wrote: > > I have completed my validation of the

Re: [DISCUSS] KIP-719: Add Log4J2 Appender

2021-12-20 Thread Mickael Maison
r as I know, the answer is yes; I am now updating my PR, so I will > > notify you as soon as I complete the work. > > > > Best, > > Dongjin > > > > On Wed, Dec 15, 2021 at 2:00 AM Mickael Maison > > wrote: > > > >> Hi Dongjin, > >> > >

Re: [DISCUSS] KIP-810: Allow producing records with null values in Kafka Console Producer

2021-12-20 Thread Mickael Maison
gt; > of a line that correspond to the record's key, value, header key, or header > > value? I imagine so but think it may be worth calling out (and possibly > > illustrating with an example or two) in the KIP. > > > > [1] - > > > > https://cwiki.apache.org/confluence/dis

Re: [ANNOUNCE] New Kafka PMC member: David Jacot

2021-12-18 Thread Mickael Maison
Congratulations David! On Sat, Dec 18, 2021 at 9:07 AM Kowshik Prakasam wrote: > > Congrats David! Very well deserved. > > > Cheers, > Kowshik > > On Fri, Dec 17, 2021 at 9:06 PM Kirk True wrote: > > > Congrats! > > > > On Fri, Dec 17, 2021, at 8:55 PM, Luke Chen wrote: > > > Congrats, David! >

Re: Request for linking my Jira account to the Kafka Project External

2021-12-15 Thread Mickael Maison
Hi Venkat, I've added you to the contributors list. You should now be able to assign tickets to yourself. Thanks, Mickael On Wed, Dec 15, 2021 at 4:57 PM Venkat Teki wrote: > > Hi Kafka team, > I have raised an issue with Kafka Connect component >

[DISCUSS] KIP-810: Allow producing records with null values in Kafka Console Producer

2021-12-15 Thread Mickael Maison
Hi all, I opened a KIP to add the option to produce records with a null value using the Console Producer: https://cwiki.apache.org/confluence/display/KAFKA/KIP-810%3A+Allow+producing+records+with+null+values+in+Kafka+Console+Producer Let me know if you have any feedback. Thanks, Mickael

Re: [DISCUSS] KIP-719: Add Log4J2 Appender

2021-12-14 Thread Mickael Maison
artifact. So, > I suggest separating the upgrade to log4j2 and removing the log4j-appender > module. > > How do you think? If you agree, I will update the KIP and the PR > accordingly ASAP. > > Thanks, > Dongjin > > On Mon, Nov 15, 2021 at 8:06 PM Mickael Maison >

[DISCUSS] Enable links from Github commits to Jira Issues

2021-12-14 Thread Mickael Maison
Hi all, A number of Apache projects have enabled JIRA links in Github commits. You can see it in action in the following repositories for example: - https://github.com/apache/camel - https://github.com/apache/spark where the CAMEL-XXX and SPARK-XXX prefixes link to individual JIRAs I find this

Re: [DISCUSS] Please review the 3.1.0 blog post

2021-12-13 Thread Mickael Maison
Hi David, It looks good, I just noticed a typo: "KIP-733" should be "KIP-773" Thanks On Sun, Dec 12, 2021 at 4:05 PM David Jacot wrote: > > Hi Luke, > > Thanks for your feedback. I have found and have fixed the issue. It was > actually > due to the formatting of the title of the AK 3.0 blog

[VOTE] KIP-769: Connect APIs to list all connector plugins and retrieve their configuration definitions

2021-12-13 Thread Mickael Maison
Hi all, I'd like to start a vote on KIP-769 which proposes adding new endpoints to the Connect REST API to list all connectors plugins and retrieve their configurations.

Re: [VOTE] KIP-784: Add top-level error code field to DescribeLogDirsResponse

2021-12-13 Thread Mickael Maison
but I think consistency is a useful trait, and it's > easily achievable here. > > +1 (binding). > > Kind regards, > > Tom > > > On Thu, Nov 18, 2021 at 2:56 PM Mickael Maison > wrote: > > > Bumping this thread. > > > > Let me know if you have any feedb

[jira] [Resolved] (KAFKA-10333) Provide an API to retrieve Kafka Connect task configurations

2021-12-09 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-10333. Fix Version/s: 2.8.0 Resolution: Duplicate DUP of KAFKA-10833 > Provide an

[jira] [Created] (KAFKA-13527) Add top-level error code field to DescribeLogDirsResponse

2021-12-09 Thread Mickael Maison (Jira)
Mickael Maison created KAFKA-13527: -- Summary: Add top-level error code field to DescribeLogDirsResponse Key: KAFKA-13527 URL: https://issues.apache.org/jira/browse/KAFKA-13527 Project: Kafka

Re: [DISCUSS] KIP-784: Add top-level error code field to DescribeLogDirsResponse

2021-12-07 Thread Mickael Maison
t, if needed. > > Thanks, > Magnus > > > Den mån 18 okt. 2021 kl 17:08 skrev Mickael Maison >: > > > Hi, > > > > I wrote a very minor KIP that proposes adding a top-level error code > > field to DescribeLogDirsResponse: > > > > https:/

[jira] [Created] (KAFKA-13510) KIP-769: Connect APIs to list all connector plugins and retrieve their configuration definitions

2021-12-07 Thread Mickael Maison (Jira)
Mickael Maison created KAFKA-13510: -- Summary: KIP-769: Connect APIs to list all connector plugins and retrieve their configuration definitions Key: KAFKA-13510 URL: https://issues.apache.org/jira/browse/KAFKA

Re: [DISCUSS] KIP-682: Connect TimestampConverter support for multiple fields and multiple input formats

2021-12-07 Thread Mickael Maison
Thanks Joshua for this KIP, it looks like a useful addition. I have a few questions: 1. In Public Interfaces and Proposed Changes, the KIP mentions the current "field" setting will be renamed to "fields". Do you instead mean a new setting "fields" will be added and the existing setting will be

Re: [VOTE] KIP-799: Align behaviour for producer callbacks with documented behaviour

2021-12-06 Thread Mickael Maison
Thanks for the KIP! +1 (binding) On Sat, Dec 4, 2021 at 3:49 AM Luke Chen wrote: > > Hi Séamus, > > Thanks for the update. > Looks better now! > > Thank you. > Luke > > On Sat, Dec 4, 2021 at 12:57 AM Séamus Ó Ceanainn < > seamus.oceana...@zalando.ie> wrote: > > > Hey Luke, > > > > Thanks for

Re: KIP-769: Connect API to retrieve connector configuration definitions

2021-12-06 Thread Mickael Maison
on the right way to do it. For that reason, I'm dropping this feature from this KIP. We can address this issue in another KIP. I have updated the KIP. Thanks, Mickael On Mon, Dec 6, 2021 at 10:15 AM Mickael Maison wrote: > > Thanks Randall, updated. > > On Sun, Dec 5, 2021 at 6:05 AM

Re: KIP-769: Connect API to retrieve connector configuration definitions

2021-12-06 Thread Mickael Maison
t; > > The response structure of the objects in the array remain unchanged, but > > this proposal does add "converter", "header_converter" and "transformation" > > to the allowed values for the "type" field, in addition to the exis

Re: KIP-769: Connect API to retrieve connector configuration definitions

2021-12-04 Thread Mickael Maison
Hi Randall, Sure. The types are sink, source, converter, header_converter, transformation and predicate. I've updated the KIP. Thanks, Mickael On Fri, Dec 3, 2021 at 10:14 PM Randall Hauch wrote: > > One more thing, inline below: > > Randall > > On Fri, Dec 3, 2021 at 10:38

Re: KIP-769: Connect API to retrieve connector configuration definitions

2021-12-03 Thread Mickael Maison
ify the > worker config for all workers to take advantage of that. Second, > adding this method increases the surface area and therefore risk of > additional attack vectors, despite not really being able to use the > resulting information in any other part of the API. > > Be

Re: KIP-769: Connect API to retrieve connector configuration definitions

2021-12-01 Thread Mickael Maison
it to just "classpath" or "plugin path" in > order to avoid leaking worker file paths into the REST API, which might > bother super security-conscious users. > > Cheers, > > Chris > > On Mon, Nov 29, 2021 at 5:52 AM Mickael Maison > wrote: > > > H

[jira] [Resolved] (KAFKA-13200) Fix version of MirrorMaker2 connectors

2021-11-29 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-13200. Fix Version/s: 3.2.0 Resolution: Fixed > Fix version of MirrorMaker2 connect

Re: [VOTE] KIP-779: Allow Source Tasks to Handle Producer Exceptions

2021-11-29 Thread Mickael Maison
Hi Knowles, +1 (binding) Thanks for the KIP! On Mon, Nov 29, 2021 at 12:56 PM Knowles Atchison Jr wrote: > > Good morning, > > Bringing this back to the top. > > We currently have > > 1 binding > 4 non-binding > > Knowles > > On Fri, Nov 19, 2021 at 10:02 AM Knowles Atchison Jr > wrote: > > >

Re: KIP-769: Connect API to retrieve connector configuration definitions

2021-11-29 Thread Mickael Maison
have a default implementation, making it > backwards-incompatible. Should we add a default implementation that returns > either null or an empty ConfigDef? > > Cheers, > > Chris > > On Fri, Nov 26, 2021 at 8:35 AM Mickael Maison > wrote: > > > Hi Chris, > >

Re: KIP-769: Connect API to retrieve connector configuration definitions

2021-11-26 Thread Mickael Maison
on not to also support aliases (e.g., "FileStreamSinkConnector" or > "FileStreamSink" instead of > "org.apache.kafka.connect.file.FileStreamSinkConnector")? > > Cheers, > > Chris > > On Tue, Nov 23, 2021 at 12:07 PM Mickael Maison > w

Re: [VOTE] KIP-800: Add reason to LeaveGroupRequest

2021-11-25 Thread Mickael Maison
+1 (binding) Thanks for the KIP Just a small suggestion: in other Options classes we don't seem to prefix setters with "set", so I think we could use void reason(final String reason). On Thu, Nov 25, 2021 at 1:48 PM Luke Chen wrote: > > Hi David, > Thanks for the KIP! > It is good to have the

Re: KIP-800: Add reason to LeaveGroupRequest

2021-11-25 Thread Mickael Maison
Hi David, Thanks for the KIP, it looks like a useful addition. You propose adding a new method removeMembersFromConsumerGroup(String, String, RemoveMembersFromConsumerGroupOptions) to Admin. Have you considered keeping the existing method and instead add the reason to

Re: [DISCUSS] Apache Kafka 3.1.0 release

2021-11-23 Thread Mickael Maison
team, > > > > >> > > > > > > > > >> > > > > KIP freeze for the next major release of Apache Kafka was > > > > >> > > > > reached > > > > >> > > > > last week. > > > > >> > >

Re: KIP-769: Connect API to retrieve connector configuration definitions

2021-11-23 Thread Mickael Maison
t; different as it validates the given (dummy) request. In case of sink > > > connectors one would need to also provide a topic name. > > > > > > A suggestion for the KIP: I think it can be useful to return the config > > > groups and the connector class' name simila

[jira] [Resolved] (KAFKA-13455) The Apache Kafka quickstart guide does not contain any steps for running Kafka Connect

2021-11-22 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-13455. Fix Version/s: 3.2.0 Resolution: Fixed > The Apache Kafka quickstart guide d

[ANNOUNCE] Apache Kafka 2.7.2

2021-11-22 Thread Mickael Maison
, Matthias J. Sax, Michael Carter, Mickael Maison, Rajini Sivaram, Randall Hauch, Shay Elkin, Stanislav Vodetskyi, Tom Bentley We welcome your help and feedback. For more information on how to report problems, and to get involved, visit the project website at https://kafka.apache.org/ Thank you

[ANNOUNCE] Apache Kafka 2.6.3

2021-11-22 Thread Mickael Maison
, and Zalando, among others. A big thank you for the following 12 contributors to this release! A. Sophie Blee-Goldman, ableegoldman, Alexander Iskuskov, Chris Egerton, Ismael Juma, Jason Gustafson, Konstantine Karantasis, Lee Dongjin, Matthias J. Sax, Mickael Maison, Rajini Sivaram, Randall Hauch

Re: [ANNOUNCE] New Kafka PMC Member: Tom Bentley

2021-11-18 Thread Mickael Maison
Congratulations Tom! On Thu, Nov 18, 2021 at 4:54 PM Chris Egerton wrote: > > Congrats Tom! > > On Thu, Nov 18, 2021 at 10:49 AM Jun Rao wrote: > > > Hi, Everyone, > > > > Tom Bentley has been a Kafka committer since Mar. 15, 2021. He has been > > very instrumental to the community since

Re: [VOTE] KIP-784: Add top-level error code field to DescribeLogDirsResponse

2021-11-18 Thread Mickael Maison
k you. > Luke > > On Wed, Oct 27, 2021 at 9:01 PM Mickael Maison > wrote: > > > Hi all, > > > > I'd like to start the vote on this minor KIP. > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-784%3A+Add+top-level+error+code+field+to+DescribeL

[jira] [Resolved] (KAFKA-13397) MirrorMaker2 shouldn't mirror Connect's internal topics

2021-11-17 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-13397. Fix Version/s: 3.2.0 Resolution: Fixed > MirrorMaker2 shouldn't mirror Connec

[jira] [Resolved] (KAFKA-13441) improve upgrade doc

2021-11-15 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-13441. Fix Version/s: 3.2.0 Resolution: Fixed > improve upgrade

Re: [DISCUSS] KIP-719: Add Log4J2 Appender

2021-11-15 Thread Mickael Maison
t; > [^1]: > https://docs.cloudera.com/csa/1.2.0/monitoring/topics/csa-kafka-logging.html > [^2]: > https://stackoverflow.com/questions/22034895/how-to-use-kafka-0-8-log4j-appender > [^3]: > https://stackoverflow.com/questions/32402405/delay-in-kafka-log4j-appender > [^4]

[jira] [Resolved] (KAFKA-13255) Mirrormaker config property config.properties.exclude is not working as expected

2021-11-15 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-13255. Fix Version/s: 3.2.0 Resolution: Fixed > Mirrormaker config prope

[RESULTS] [VOTE] Release Kafka version 2.7.2

2021-11-12 Thread Mickael Maison
This vote passes with 6 +1 votes (3 bindings) and no 0 or -1 votes. +1 votes PMC Members: * Bill Bejeck * Manikumar Reddy * Konstantine Karantasis Committers: * Tom Bentley Community: * Israel Ekpo * Luke Chen 0 votes * No votes -1 votes * No votes Vote thread:

[RESULTS] [VOTE] Release Kafka version 2.6.3

2021-11-12 Thread Mickael Maison
This vote passes with 5 +1 votes (3 bindings) and no 0 or -1 votes. +1 votes PMC Members: * Bill Bejeck * Manikumar Reddy * Konstantine Karantasis Committers: * Tom Bentley Community: * Israel Ekpo 0 votes * No votes -1 votes * No votes Vote thread:

Re: [DISCUSS] KIP-714: Client metrics and observability

2021-11-10 Thread Mickael Maison
instance ID using clientId as a prefix. Now that the client instance ID is > > a UUID, would we want to add clientId as a supported selector? > > Let me know what you think. > > > > David > > > > On Tue, Oct 19, 2021 at 12:33 PM Magnus Edenhill > >

Re: [VOTE] KIP-788: Allow configuring num.network.threads per listener

2021-11-10 Thread Mickael Maison
> > +1 (binding) > > > Thanks for the KIP! > > > > > > Regards, > > > > > > Rajini > > > > > > > > > On Thu, Nov 4, 2021 at 11:00 AM Mickael Maison > > > wrote: > > > > > > > Hi Luke, > &

Re: [kafka-clients] [VOTE] 2.7.2 RC0

2021-11-10 Thread Mickael Maison
gt; > Thanks for running the release! > > Thanks, > Manikumar > > On Tue, Nov 2, 2021 at 11:16 PM Mickael Maison wrote: > > > Bumping the thread. > > > > Contributors, committers and PMC, please take some time to test this > > release candidate and vote

Re: [kafka-clients] [VOTE] 2.6.3 RC0

2021-11-10 Thread Mickael Maison
gt; > Thanks for running the release! > > Thanks, > Manikumar > > On Tue, Nov 2, 2021 at 11:15 PM Mickael Maison > wrote: > > > Bumping the thread. > > > > Contributors, committers and PMC, please take some time to test this > > release candidate and v

Re: [DISCUSS] KIP-719: Add Log4J2 Appender

2021-11-08 Thread Mickael Maison
Hi Dongjin, Thanks for working on the update to log4j2, it's definitively something we should complete. I have a couple of comments: 1) Is the KIP proposing to replace the existing log4-appender or simply add a new one for log4j2? Reading the KIP and with its current title, it's not entirely

Re: [VOTE] KIP-788: Allow configuring num.network.threads per listener

2021-11-04 Thread Mickael Maison
1. The discussion thread is not attached in KIP > 2. Israel raised the case-sensitive comment and your response didn't put > into the KIP > > Otherwise, LGTM! > +1 (non-binding) > > Thank you. > Luke > > On Wed, Nov 3, 2021 at 8:17 PM Mickael Maison > wrote: &g

Re: [DISCUSS] KIP-786: Emit Metric Client Quota Values

2021-11-03 Thread Mickael Maison
Hi Mason, Thanks for the KIP. I think it's a good idea to also emit quota limits as metrics. It certainly simplifies monitoring/graphing if all the data come from the same source. The KIP looks good overall, just a couple of questions: - Have you considered enabling the new metrics by default? -

Re: [DISCUSS] KIP-786: Use localhost:9092 as default bootstrap-server/broker-list in client tools

2021-11-03 Thread Mickael Maison
onfluence/pages/viewpage.action?pageId=191335433 > <https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=191335433> > > Thanks > > Deng Ziming > > > On Oct 31, 2021, at 10:39 PM, Mickael Maison > > wrote: > > > > Hi, > > > &

Re: [DISCUSS] KIP-788: Allow configuring num.network.threads per listener

2021-11-03 Thread Mickael Maison
scale the > > different components independently > > > > Looks great to me > > > > > > > > On Tue, Oct 26, 2021 at 1:27 PM Ryanne Dolan > > wrote: > > > > > Neat! Makes sense to me. > > > > > > Ryanne > > > > > > On

[VOTE] KIP-788: Allow configuring num.network.threads per listener

2021-11-03 Thread Mickael Maison
Hi all, I'd like to start the vote on KIP-788. It will allow setting the number of network threads per listener. https://cwiki.apache.org/confluence/display/KAFKA/KIP-788%3A+Allow+configuring+num.network.threads+per+listener Please let me know if you have any feedback. Thanks

Re: [VOTE] KIP-782: Expandable batch size in producer

2021-11-03 Thread Mickael Maison
Hi Luke, Thanks for the KIP. It looks like an interesting idea. I like the concept of dynamically adjusting settings to handle load. I wonder if other client settings could also benefit from a similar logic. Just a couple of questions: - When under load, the producer may allocate extra buffers.

<    1   2   3   4   5   6   7   8   9   10   >