Re: [VOTE] KIP-719: Add Log4J2 Appender

Hi all, @Ismael As I stated in the KIP (see subsection 2 of 'Motivation'), the log4j community's implementation can't be an alternative for the existing 'log4j-appender' users since their message format is different, breaking the related, already running pipelines. Add to this, the log4j

[jira] [Created] (KAFKA-12944) KIP-724: Always write record batches with message format v2

Ismael Juma created KAFKA-12944: --- Summary: KIP-724: Always write record batches with message format v2 Key: KAFKA-12944 URL: https://issues.apache.org/jira/browse/KAFKA-12944 Project: Kafka

Re: [VOTE] KIP-749: Add --files and --file-separator options to the ConsoleProducer

Thanks for the updates Wenbing, the KIP looks good now. One suggestion would be removing the implementation details around "MessageReader" and "FileMessageReader" in the KIP, which should be reviewed in the actual PR. It's ok to briefly mention your high level approach in the `proposed changes`

[jira] [Created] (KAFKA-12943) Bug in Kafka Streams Documentation (Aggregating)

Rajesh KSV created KAFKA-12943: -- Summary: Bug in Kafka Streams Documentation (Aggregating) Key: KAFKA-12943 URL: https://issues.apache.org/jira/browse/KAFKA-12943 Project: Kafka Issue Type: Bug

Re: [VOTE] KIP-719: Add Log4J2 Appender

It looks like some of the language in the KIP is suggesting that the Kafka Dev community is going to provide the log4j2 equivalent and would be responsible for maintaining it: “ User-interfacing configurations (like broker logging config), provide additional log4j2-equivalent configuration with

[jira] [Created] (KAFKA-12941) Remove excluded Streams tests when running with JDK 16

Ismael Juma created KAFKA-12941: --- Summary: Remove excluded Streams tests when running with JDK 16 Key: KAFKA-12941 URL: https://issues.apache.org/jira/browse/KAFKA-12941 Project: Kafka Issue

[jira] [Created] (KAFKA-12942) Remove Connect excluded tests when running with JDK 16

Ismael Juma created KAFKA-12942: --- Summary: Remove Connect excluded tests when running with JDK 16 Key: KAFKA-12942 URL: https://issues.apache.org/jira/browse/KAFKA-12942 Project: Kafka Issue

[jira] [Created] (KAFKA-12940) Enable JDK 16 builds in Jenkins

Ismael Juma created KAFKA-12940: --- Summary: Enable JDK 16 builds in Jenkins Key: KAFKA-12940 URL: https://issues.apache.org/jira/browse/KAFKA-12940 Project: Kafka Issue Type: Sub-task

[jira] [Resolved] (KAFKA-12905) Replace EasyMock and PowerMock with Mockito for NamedCacheMetricsTest

[ https://issues.apache.org/jira/browse/KAFKA-12905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-12905. - Resolution: Fixed > Replace EasyMock and PowerMock with Mockito for NamedCacheMetricsTest >

[jira] [Resolved] (KAFKA-12924) Replace EasyMock and PowerMock with Mockito in streams module(metrics)

[ https://issues.apache.org/jira/browse/KAFKA-12924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-12924. - Fix Version/s: 3.0.0 Resolution: Fixed > Replace EasyMock and PowerMock with Mockito in

[jira] [Resolved] (KAFKA-10585) Kafka Streams should clean up the state store directory from cleanup

[ https://issues.apache.org/jira/browse/KAFKA-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-10585. --- Fix Version/s: 3.0.0 Resolution: Fixed > Kafka Streams should clean up the state

[jira] [Created] (KAFKA-12939) After migrating processors, search the codebase for missed migrations

John Roesler created KAFKA-12939: Summary: After migrating processors, search the codebase for missed migrations Key: KAFKA-12939 URL: https://issues.apache.org/jira/browse/KAFKA-12939 Project: Kafka

Re: MM2 taking into consideration automatic topic creation property from original cluster

Hi Matthew, If an administrator want to control topic creation, they should use ACLs to prevents users creating topic. Relying on all applications to not create topics is unlikely to succeed. Each refresh.topics.interval.seconds, MM2 checks if it needs to create topics/partitions by comparing

Re: [VOTE] KIP-719: Add Log4J2 Appender

I'm personally not sure about this. We have not maintained the existing log4j-appender very actively, so are we sure that we can do a better job than the log4j community? Ismael On Tue, May 25, 2021, 6:46 AM Dongjin Lee wrote: > Hi Kafka dev, > > I'd like to kick-off the voting for KIP-719:

Re: MM2 taking into consideration automatic topic creation property from original cluster

Matthew, I wonder what the expected behavior would be when topic-creation is disabled and MM is asked to replicate a topic that doesn't exist on the target cluster? Maybe the task should fail at that point, or maybe it should replicate whatever it can? I think the current behavior is reasonable,

Re: [VOTE] KIP-716: Allow configuring the location of the offset-syncs topic with MirrorMaker2

+1 (non-binding), thanks! Ryanne On Fri, Jun 11, 2021, 3:25 AM Tom Bentley wrote: > Hi Mickael, > > Thanks for the KIP, +1 (binding). > > Cheers, > > Tom > > On Tue, Apr 13, 2021 at 4:56 PM Mickael Maison > wrote: > > > Hi, > > > > It has been a few weeks since I opened this vote and I have

Re: [VOTE] KIP-716: Allow configuring the location of the offset-syncs topic with MirrorMaker2

Providing this flexibility makes sense. Thanks Mickael. +1 (binding) Konstantine On Fri, Jun 11, 2021 at 1:31 AM Tom Bentley wrote: > Hi Mickael, > > Thanks for the KIP, +1 (binding). > > Cheers, > > Tom > > On Tue, Apr 13, 2021 at 4:56 PM Mickael Maison > wrote: > > > Hi, > > > > It has

Re: [VOTE] KIP-719: Add Log4J2 Appender

+1 (binding) Konstantine On Fri, Jun 11, 2021 at 7:57 AM Boojapho O wrote: > +1 (non-binding) > > On 2021/06/09 15:31:13, Dongjin Lee wrote: > > Bumping up the voting thread. > > > > Please note that today is the KIP freeze day. > > > > Thanks, > > Dongjin > > > > On Mon, Jun 7, 2021 at 9:28

[jira] [Created] (KAFKA-12938) Fix and reenable testChrootExistsAndRootIsLocked

Igor Soarez created KAFKA-12938: --- Summary: Fix and reenable testChrootExistsAndRootIsLocked Key: KAFKA-12938 URL: https://issues.apache.org/jira/browse/KAFKA-12938 Project: Kafka Issue Type:

Re: [VOTE] KIP-719: Add Log4J2 Appender

+1 (non-binding) On 2021/06/09 15:31:13, Dongjin Lee wrote: > Bumping up the voting thread. > > Please note that today is the KIP freeze day. > > Thanks, > Dongjin > > On Mon, Jun 7, 2021 at 9:28 PM Dongjin Lee wrote: > > > Bumping up the voting thread. > > > > > > As a reminder: Please

Re: [DISCUSS] KIP-719: Add Log4J2 Appender

Continuing to use log4j would leave several known security vulnerabilities in Apache Kafka, including https://nvd.nist.gov/vuln/detail/CVE-2019-17571. The Apache log4j team will not fix this vulnerability and is urging an upgrade to log4j2. See https://logging.apache.org/log4j/1.2/ for

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #217

See

Re: [DISCUSS] KIP-755: Add new AUTO_CREATE ACL for auto topic creation

Does anyone have any thoughts or feedback on this KIP? On Tue, Jun 8, 2021 at 2:09 PM Christopher Shannon < christopher.l.shan...@gmail.com> wrote: > Hi Everyone, > > I'd like to propose KIP-755: Add new AUTO_CREATE ACL for auto topic > creation > > The KIP can be found here: >

Re: [CWIKI] Contributing Code Changes update

Thank you, Manikumar! I've made the changes! Regards, Martin On 2021/06/11 12:51:33, Manikumar wrote: > Hi, > > I've given you the wiki permissions. Thanks for your interest in the Kafka > Project. > > Thanks, > Manikumar > > > On Fri, Jun 11, 2021 at 6:11 PM Martin Tzvetanov Grigorov <

[idea] Kafka topic metadata

Hello Apache Kafka community, In the driection to make Kafka more cloud friendly, do you think it make sense to have key-velue metadata in the topic definition, this will allow to search, filter, select ... topics not only by name but also by metadata Ex: topic name: test topic metadata:

Re: [CWIKI] Contributing Code Changes update

Hi, I've given you the wiki permissions. Thanks for your interest in the Kafka Project. Thanks, Manikumar On Fri, Jun 11, 2021 at 6:11 PM Martin Tzvetanov Grigorov < mgrigo...@apache.org> wrote: > Hello Kafka devs, > > I am reading >

[CWIKI] Contributing Code Changes update

Hello Kafka devs, I am reading https://cwiki.apache.org/confluence/display/KAFKA/Contributing+Code+Changes and I've found few things which could be improved: For example: - "The Jenkins will not automatic builder for pull request. " needs to be re-worded - " In the near future, we will also

[jira] [Created] (KAFKA-12937) Mirrormaker2 can only start from the beginning of a topic

Daan Bosch created KAFKA-12937: -- Summary: Mirrormaker2 can only start from the beginning of a topic Key: KAFKA-12937 URL: https://issues.apache.org/jira/browse/KAFKA-12937 Project: Kafka Issue

MM2 taking into consideration automatic topic creation property from original cluster

Hello everyone, We have an interesting feature request from a client regarding having the property of automatic topic creation to be reflected in a MM2. Specifically the current behaviour where if you have automatic topic creation set to false for the original Kafla cluster, MM2 configuration

Re: [VOTE] KIP-716: Allow configuring the location of the offset-syncs topic with MirrorMaker2

Hi Mickael, Thanks for the KIP, +1 (binding). Cheers, Tom On Tue, Apr 13, 2021 at 4:56 PM Mickael Maison wrote: > Hi, > > It has been a few weeks since I opened this vote and I have not seen > any replies yet. > Let me know if you have any feedback. > > Thanks > > On Wed, Mar 24, 2021 at

Re: [VOTE] KIP-390: Support Compression Level (rebooted)

This KIP is now passed with: - binding: +3 (Ismael, Tom, Konstantine) - non-binding: +1 (Ryanne) Thanks again to all the supporters. I also updated the KIP by moving the compression buffer option into the 'Future Works' section, as Ismael proposed. Best, Dongjin On Fri, Jun 11, 2021 at 3:03