Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2217

See

Re: [kafka-clients] [VOTE] 3.6.0 RC1

Thanks Greg for verifying the release including the earlier blocker(KAFKA-15473) verification. ~Satish. On Wed, 20 Sept 2023 at 22:30, Greg Harris wrote: > Hi all, > > I verified the functionality of KIP-898 and the recent fix for > KAFKA-15473 with the following steps: > > 1. I started a

Re: [kafka-clients] [VOTE] 3.6.0 RC1

Hi Divij, Thanks for calling out documentation issues. Some of them are being addressed in the existing documentation PRs. We will keep addressing the remaining documentation issues by making respective changes in kafka-site repo for 3.6.0 release. I think documentation is important but I do not

[jira] [Created] (KAFKA-15483) Update metrics documentation for the new metrics implemented as part of KIP-938

Satish Duggana created KAFKA-15483: -- Summary: Update metrics documentation for the new metrics implemented as part of KIP-938 Key: KAFKA-15483 URL: https://issues.apache.org/jira/browse/KAFKA-15483

Re: [VOTE]KIP-966: Eligible Leader Replicas

Thanks Calvin. I think this will be very helpful going forward to minimize data loss. +1 from me (binding) Justine On Wed, Sep 20, 2023 at 3:42 PM Calvin Liu wrote: > Hi all, > I'd like to call for a vote on KIP-966 which includes a series of > enhancements to the current ISR model. > >-

[jira] [Resolved] (KAFKA-15092) KafkaClusterTestKit in test jar depends on MockFaultHandler

[ https://issues.apache.org/jira/browse/KAFKA-15092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-15092. Resolution: Invalid > KafkaClusterTestKit in test jar depends on MockFaultHandler >

[jira] [Resolved] (KAFKA-15482) kafka.utils.TestUtils Depends on MockTime Which is Not in Any Jar

[ https://issues.apache.org/jira/browse/KAFKA-15482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-15482. Resolution: Invalid > kafka.utils.TestUtils Depends on MockTime Which is Not in Any Jar >

[VOTE]KIP-966: Eligible Leader Replicas

Hi all, I'd like to call for a vote on KIP-966 which includes a series of enhancements to the current ISR model. - Introduce the new HWM advancement requirement which enables the system to have more potentially data-safe replicas. - Introduce Eligible Leader Replicas(ELR) to represent

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2216

See

Re: [DISCUSS] KIP-979: Allow independently stop KRaft controllers or brokers

Hi Ron, Thank you very much for the comment. I think it makes sense to me that we provide an even more specific way to kill individual controllers/brokers. I have one question: does the command line for ZooKeeper cluster provide such a way to kill individual controllers/brokers? Thanks, Hailey

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.6 #58

See Changes: -- [...truncated 305359 lines...] Gradle Test Run :streams:test > Gradle Test Executor 84 > DefaultTaskManagerTest > shouldAddTask() PASSED Gradle Test Run

Re: [kafka-clients] [VOTE] 3.6.0 RC1

My apologies; both classes are in the server-common...-test jar. Both issues can be closed. From: Gary Russell Sent: Wednesday, September 20, 2023 3:56 PM To: us...@kafka.apache.org ; dev Subject: Re: [kafka-clients] [VOTE] 3.6.0 RC1 I have lowered the priority

Re: [kafka-clients] [VOTE] 3.6.0 RC1

I have lowered the priority because I found a work around, but it's still bad practice for a public class to depend on a class that is not published anywhere. This is similar to [2], which has been open for months. [1]: https://issues.apache.org/jira/browse/KAFKA-15482 [2]:

Re: [kafka-clients] [VOTE] 3.6.0 RC1

This is a blocker for me [1]. https://issues.apache.org/jira/browse/KAFKA-15482 From: Greg Harris Sent: Wednesday, September 20, 2023 12:45 PM To: us...@kafka.apache.org Cc: dev ; kafka-clie...@googlegroups.com Subject: Re: [kafka-clients] [VOTE] 3.6.0 RC1

[jira] [Created] (KAFKA-15482) kafka.utils.TestUtils Depends on MockTime Which is Not in Any Jar

Gary Russell created KAFKA-15482: Summary: kafka.utils.TestUtils Depends on MockTime Which is Not in Any Jar Key: KAFKA-15482 URL: https://issues.apache.org/jira/browse/KAFKA-15482 Project: Kafka

Re: [DISCUSS] KIP-714: Client metrics and observability

Hi, Andrew, Thanks for updating the KIP and sorry for the late response. A few more comments. 110. Another potential motivation is the multiple clients support. Some of the places may not have good monitoring support for non-java clients. 111. OpenTelemetry Naming: We replace '-' with '.' for

Re: [DISCUSS] KIP-974 Docker Image for GraalVM based Native Kafka Broker

Hi Krishna, Thanks for the KIP. The results are impressive! A few quick comments: 1. I noticed that the graalvm-reachability-metadata project now includes kafka-clients[1]. Worth checking if the metadata over there matches what we've observed for our own attempt. 2. Can we please add peak memory

Re: [DISCUSS] KIP-974 Docker Image for GraalVM based Native Kafka Broker

Hi Federico, I suggest taking this conversation to KIP-975 and keeping this one to the graalvm specifics. Ismael On Fri, Sep 8, 2023 at 2:38 AM Federico Valeri wrote: > Hi Krishna, thanks for opening this discussion. > > I see you created two separate KIPs (974 and 975), but there are some >

Re: [DISCUSS] KIP-975 Docker Image for Apache Kafka

Hi Krishna, Thanks for the KIP. A few quick questions: 1. Since this will only be available for Kafka 3.7 in the best case, I suggest we go with Java 21 instead of Java 17. Also, we should be clear about Java version expectations. Are we allowed to change the Java version whenever we want? Or

Re: [DISCUSS] KIP-975 Docker Image for Apache Kafka

Hi Viktor, Thanks for the clarification. This is a separate KIP because the scope is simpler than the graalvm docker images - there is much more to figure out when it comes to using Kafka with graalvm. Ismael On Tue, Sep 19, 2023 at 3:12 AM Viktor Somogyi-Vass wrote: > Hi Ismael, > > I'm not

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.6 #57

See

[DISCUSS] KIP-982: Access SslPrincipalMapper and kerberosShortNamer in Custom KafkaPrincipalBuilder

Hi everyone, I would like to start the discussion on the KIP-982 to Access SslPrincipalMapper and kerberosShortNamer in Custom KafkaPrincipalBuilder https://cwiki.apache.org/confluence/display/KAFKA/KIP-982%3A+Access+SslPrincipalMapper+and+kerberosShortNamer+in+Custom+KafkaPrincipalBuilder

Re: [kafka-clients] [VOTE] 3.6.0 RC1

Hi all, I verified the functionality of KIP-898 and the recent fix for KAFKA-15473 with the following steps: 1. I started a 3.5.1 broker, and a 3.5.1 worker with most (>400) publicly available plugins installed 2. I captured the output of /connector-plugins 3. I upgraded the worker to 3.6.0-rc1

[GitHub] [kafka-site] satishd commented on a diff in pull request #547: Added a blog entry for 3.6.0 release

satishd commented on code in PR #547: URL: https://github.com/apache/kafka-site/pull/547#discussion_r1331784605 ## blog.html: ## @@ -22,6 +22,46 @@ Blog + + + +Apache Kafka

[GitHub] [kafka-site] satishd commented on pull request #547: Added a blog entry for 3.6.0 release

satishd commented on PR #547: URL: https://github.com/apache/kafka-site/pull/547#issuecomment-1727830289 @mumrah @divijvaidya Thanks for the review. Addressed the review comments with the latest commits. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [kafka-site] divijvaidya commented on a diff in pull request #547: Added a blog entry for 3.6.0 release

divijvaidya commented on code in PR #547: URL: https://github.com/apache/kafka-site/pull/547#discussion_r1331252329 ## blog.html: ## @@ -22,6 +22,46 @@ Blog + + + +Apache Kafka

Re: [kafka-clients] [VOTE] 3.6.0 RC1

Hey Satish My comments about documentation misses from RC0 vote thread [1] are still not addressed (such as missing metric documentation, formatting problems etc). Could you please mention why we shouldn't consider them as blockers to make RC1 as the final release? [1]

[GitHub] [kafka-site] satishd commented on a diff in pull request #547: Added a blog entry for 3.6.0 release

satishd commented on code in PR #547: URL: https://github.com/apache/kafka-site/pull/547#discussion_r1331713531 ## blog.html: ## @@ -22,6 +22,46 @@ Blog + + + +Apache Kafka

[VOTE] 3.6.0 RC1

Hello Kafka users, developers and client-developers, This is the second candidate for the release of Apache Kafka 3.6.0. Some of the major features include: * KIP-405 : Kafka Tiered Storage * KIP-868 : KRaft Metadata Transactions * KIP-875: First-class offsets support in Kafka Connect * KIP-898:

[GitHub] [kafka-site] clolov commented on a diff in pull request #547: Added a blog entry for 3.6.0 release

clolov commented on code in PR #547: URL: https://github.com/apache/kafka-site/pull/547#discussion_r1331664528 ## blog.html: ## @@ -22,6 +22,46 @@ Blog + + + +Apache Kafka

Re: Re: [DISCUSS] KIP-951: Leader discovery optimisations for the client

Hi, I've updated the KIP with benchmark results focusing more directly on the redirect case, please review and +1 in the voting thread if convinced. Thank you, Crispin On Wed, Jul 26, 2023 at 11:13 PM Luke Chen wrote: > Thanks for adding the benchmark results, Crispin! > IMO, 2~5% performance

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.6 #55

See

[GitHub] [kafka-site] gaurav-narula commented on a diff in pull request #547: Added a blog entry for 3.6.0 release

gaurav-narula commented on code in PR #547: URL: https://github.com/apache/kafka-site/pull/547#discussion_r1331193907 ## blog.html: ## @@ -22,6 +22,46 @@ Blog + + + +Apache

Re: [VOTE] 3.6.0 RC0

Thanks Luke for reviewing and running the changes https://github.com/apache/kafka/pull/14409 for merging into 3.6. On Wed, 20 Sept 2023 at 06:09, Satish Duggana wrote: > > Hi David, > Thanks for the update. Please get it reviewed sooner. I plan to create > RC1 in the next 5 hrs. As it is not a

Re: [DISCUSS] KIP-980: Allow creating connectors in a stopped state

Thanks Yash! This is very useful for migrating connectors from one cluster to another. I had the following comments/questions 1. Is the offset read using `GET /offsets` api always guaranteed to be in a format accepted by `PATCH /offsets` ? 2. I had to tackle a similar migration situation but the

[GitHub] [kafka-site] mumrah commented on a diff in pull request #547: Added a blog entry for 3.6.0 release

mumrah commented on code in PR #547: URL: https://github.com/apache/kafka-site/pull/547#discussion_r1331519680 ## blog.html: ## @@ -22,6 +22,46 @@ Blog + + + +Apache Kafka

[jira] [Created] (KAFKA-15480) Add RemoteStorageInterruptedException

Mital Awachat created KAFKA-15480: - Summary: Add RemoteStorageInterruptedException Key: KAFKA-15480 URL: https://issues.apache.org/jira/browse/KAFKA-15480 Project: Kafka Issue Type: Task

[jira] [Created] (KAFKA-15481) Concurrency bug in RemoteIndexCache leads to IOException

Divij Vaidya created KAFKA-15481: Summary: Concurrency bug in RemoteIndexCache leads to IOException Key: KAFKA-15481 URL: https://issues.apache.org/jira/browse/KAFKA-15481 Project: Kafka

[GitHub] [kafka-site] mumrah commented on a diff in pull request #547: Added a blog entry for 3.6.0 release

mumrah commented on code in PR #547: URL: https://github.com/apache/kafka-site/pull/547#discussion_r1331517587 ## blog.html: ## @@ -22,6 +22,46 @@ Blog + + + +Apache Kafka

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.6 #56

See