Re: [VOTE] KIP-953: partition method to be overloaded to accept headers as well.

2023-09-27 Thread Jack Tomy
Bumping up. On Sun, Sep 17, 2023 at 9:34 AM Jack Tomy wrote: > Hey Ismael, Sagar and everyone, > > Sorry I seem to have interpreted the thread wrong. Before we go ahead with > the DTO based approach I have few reasons not to go with it. > a. It is not following the pattern we are following t

[jira] [Created] (KAFKA-15516) Provide kafka-client library as a proper java Jigsaw module

2023-09-27 Thread Chad Preisler (Jira)
Chad Preisler created KAFKA-15516: - Summary: Provide kafka-client library as a proper java Jigsaw module Key: KAFKA-15516 URL: https://issues.apache.org/jira/browse/KAFKA-15516 Project: Kafka

Re: [VOTE] KIP-858: Handle JBOD broker disk failure in KRaft

2023-09-27 Thread Igor Soarez
Hi everyone, After a conversation with Colin McCabe and Proven Provenzano yesterday, we decided that the benefits outweigh the concerns with the overhead of associating a directory UUID to every replica in the metadata partition records. i.e. We prefer to always associate the log dir UUID even whe

Re: Apache Kafka 3.6.0 release

2023-09-27 Thread Divij Vaidya
Ismael, Thank you for checking. Multiple other folks have validated after I left the comment here that it doesn't impact log truncation and hence won't lead to data loss. I agree that it's not a blocker. (ref: https://github.com/apache/kafka/pull/14457) -- Divij Vaidya On Wed, Sep 27, 2023 at 8:

[GitHub] [kafka-site] tombentley commented on pull request #410: KAFKA-13882 Docker to preview docs locally

2023-09-27 Thread via GitHub
tombentley commented on PR #410: URL: https://github.com/apache/kafka-site/pull/410#issuecomment-1738021296 Thanks for the contribution @qingwei91! @divijvaidya thanks, updated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Created] (KAFKA-15515) Remove duplicated integration tests for new consumer

2023-09-27 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-15515: -- Summary: Remove duplicated integration tests for new consumer Key: KAFKA-15515 URL: https://issues.apache.org/jira/browse/KAFKA-15515 Project: Kafka Issu

[GitHub] [kafka-site] tombentley merged pull request #410: KAFKA-13882 Docker to preview docs locally

2023-09-27 Thread via GitHub
tombentley merged PR #410: URL: https://github.com/apache/kafka-site/pull/410 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@kafka.apac

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2237

2023-09-27 Thread Apache Jenkins Server
See

Re: Apache Kafka 3.6.0 release

2023-09-27 Thread Ismael Juma
Doesn't look like a blocker to me. Ismael On Wed, Sep 27, 2023 at 2:36 AM Divij Vaidya wrote: > Hey team > > I need help in determining whether > https://github.com/apache/kafka/pull/14457 is a release blocker bug or > not. If someone is familiar with replication protocol (on the log > diverang

[GitHub] [kafka-site] qingwei91 commented on pull request #410: KAFKA-13882 Docker to preview docs locally

2023-09-27 Thread via GitHub
qingwei91 commented on PR #410: URL: https://github.com/apache/kafka-site/pull/410#issuecomment-1737867753 Hi @mimaison , sure, I've incorporated the change. Would be nice to merge this if everything is ok -- This is an automated message from the Apache Git Service. To respond to the mess

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2236

2023-09-27 Thread Apache Jenkins Server
See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.6 #71

2023-09-27 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-15514) Controller-side replica management changes

2023-09-27 Thread Igor Soarez (Jira)
Igor Soarez created KAFKA-15514: --- Summary: Controller-side replica management changes Key: KAFKA-15514 URL: https://issues.apache.org/jira/browse/KAFKA-15514 Project: Kafka Issue Type: Sub-task

[jira] [Reopened] (KAFKA-15489) split brain in KRaft cluster

2023-09-27 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen reopened KAFKA-15489: --- > split brain in KRaft cluster > - > > Key: KAFKA-15489 >

Jira issues for CVEs in dependencies?

2023-09-27 Thread Arnout Engelen
Hello, Kafka has the gradle dependency-check plugin configured, which can detect when CVEs are issued for dependencies of the project. Now, more often than not, those CVEs don't actually affect Kafka, but generally it's good to at least consider them: every once in a while they might justify exped

Re: [DISCUSS] KIP-971 Expose replication-offset-lag MirrorMaker2 metric

2023-09-27 Thread Viktor Somogyi-Vass
Hi Elkhan, I don't see the config you introduced on the KIP. Otherwise it looks good to me. If no one has objections or anything to add then I think you can start the vote after updating the KIP. >I added the configurable poll interval as an optional - I believe it is useful to let users to confi

Re: Re: [DISCUSS] KIP-951: Leader discovery optimisations for the client

2023-09-27 Thread Mayank Shekhar Narula
Adding to Crispin. The new micro-benchmark shows improvements of 88% in p99.9 with the KIP changes Vs baseline(& rejected alternate). Its hypothesised improvements are seen as KIP avoids a full metadata refresh(Vs baseline/rejected alternate), and the full metadata refresh can be slow due to metada

Re: [VOTE] KIP-951: Leader discovery optimisations for the client

2023-09-27 Thread Mayank Shekhar Narula
Reviving this thread, as the discussion thread has been updated. On Fri, Jul 28, 2023 at 11:29 AM Mayank Shekhar Narula < mayanks.nar...@gmail.com> wrote: > Thanks Jose. > > On Thu, Jul 27, 2023 at 5:46 PM José Armando García Sancio > wrote: > >> The KIP LGTM. Thanks for the design. I am looking

[jira] [Resolved] (KAFKA-15177) MirrorMaker 2 should implement the alterOffsets KIP-875 API

2023-09-27 Thread Yash Mayya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yash Mayya resolved KAFKA-15177. Fix Version/s: 3.6.0 Resolution: Fixed > MirrorMaker 2 should implement the alterOffsets KI

Re: [DISCUSS] KIP-975 Docker Image for Apache Kafka

2023-09-27 Thread Viktor Somogyi-Vass
Hi Krishna, Thanks for the answer. I've seen multiple such images where environment variables are used and I think they are generally good but it's unsafe for passing around secrets, jaas configs and so on. Perhaps for secrets we could recommend using the file config provider. Then users can creat

[jira] [Created] (KAFKA-15513) KRaft cluster fails with SCRAM authentication enabled for control-plane

2023-09-27 Thread migruiz4 (Jira)
migruiz4 created KAFKA-15513: Summary: KRaft cluster fails with SCRAM authentication enabled for control-plane Key: KAFKA-15513 URL: https://issues.apache.org/jira/browse/KAFKA-15513 Project: Kafka

[jira] [Created] (KAFKA-15512) EOL zookeeper component in kafka

2023-09-27 Thread Aleksandra Drobnjak (Jira)
Aleksandra Drobnjak created KAFKA-15512: --- Summary: EOL zookeeper component in kafka Key: KAFKA-15512 URL: https://issues.apache.org/jira/browse/KAFKA-15512 Project: Kafka Issue Type: Ta

Re: Apache Kafka 3.6.0 release

2023-09-27 Thread Divij Vaidya
Hey team I need help in determining whether https://github.com/apache/kafka/pull/14457 is a release blocker bug or not. If someone is familiar with replication protocol (on the log diverange and reconciliation process), please add your comments on the PR. -- Divij Vaidya On Wed, Sep 27, 2023 at

[GitHub] [kafka-site] mimaison commented on pull request #410: KAFKA-13882 Docker to preview docs locally

2023-09-27 Thread via GitHub
mimaison commented on PR #410: URL: https://github.com/apache/kafka-site/pull/410#issuecomment-1736988414 @tombentley It would have been nice to understand the .htaccess inconsistency but the duplication is minor and this PR really simplifies testing the website so I'm happy to merge it.

Re: Apache Kafka 3.6.0 release

2023-09-27 Thread Divij Vaidya
A community member reported another bug in TS feature in 3.6 - https://issues.apache.org/jira/browse/KAFKA-15511 I don't consider it as a blocker for release because the bug occurs in rare situations when the index on disk or in a remote store is corrupted and fails a sanity check. Sharing it here

[jira] [Created] (KAFKA-15511) Exception not handled correctly if indexFile is corrupted.

2023-09-27 Thread Arpit Goyal (Jira)
Arpit Goyal created KAFKA-15511: --- Summary: Exception not handled correctly if indexFile is corrupted. Key: KAFKA-15511 URL: https://issues.apache.org/jira/browse/KAFKA-15511 Project: Kafka Is