Re: [DISCUSS] Should we continue to merge without a green build? No!

Hi Divij, I think this proposal overall makes sense. My only nit sort of a suggestion is that let's also consider a label called newbie++[1] for flaky tests if we are considering adding newbie as a label. I think some of the flaky tests need familiarity with the codebase or the test setup so as a

[jira] [Created] (KAFKA-15821) Active topics for deleted connectors are not reset in standalone mode

Chris Egerton created KAFKA-15821: - Summary: Active topics for deleted connectors are not reset in standalone mode Key: KAFKA-15821 URL: https://issues.apache.org/jira/browse/KAFKA-15821 Project: Kafk

Re: [DISCUSS] KIP-1002: Fetch remote segment indexes at once

Divij, thanks for your prompt feedback! 1. Agree, caching at the plugin level was my initial idea as well; though, keeping two caches for the same data both at the broker and at the plugin seems wasteful. (added this as a rejected alternative in the meantime) 2. Not necessarially. The API allows

Re: [PR] Update Satish added as a PMC member [kafka-site]

satishd merged PR #566: URL: https://github.com/apache/kafka-site/pull/566 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@kafka.apache.

Re: [PR] Update Satish added as a PMC member [kafka-site]

satishd commented on PR #566: URL: https://github.com/apache/kafka-site/pull/566#issuecomment-1809575763 Thanks @jlprat @showuon -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

[jira] [Created] (KAFKA-15820) Add a metric to track the number of partitions under min ISR

Calvin Liu created KAFKA-15820: -- Summary: Add a metric to track the number of partitions under min ISR Key: KAFKA-15820 URL: https://issues.apache.org/jira/browse/KAFKA-15820 Project: Kafka Iss

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.6 #112

See Changes: -- [...truncated 310614 lines...] Gradle Test Run :core:test > Gradle Test Executor 93 > KafkaZkClientTest > testConditionalUpdatePath() PASSED Gradle Test Run

Re: [VOTE] KIP-892: Transactional StateStores

+1 (binding) Thanks a lot for this KIP! On Mon, Nov 13, 2023 at 8:39 AM Lucas Brutschy wrote: > Hi Nick, > > really happy with the final KIP. Thanks a lot for the hard work! > > +1 (binding) > > Lucas > > On Mon, Nov 13, 2023 at 4:20 PM Colt McNealy wrote: > > > > +1 (non-binding). > > > > Tha

Re: [VOTE] KIP-979 Allow independently stop KRaft processes

Hi Colin, Thank you for your review. I removed the "absolute path need to be provided" line from the KIP, and will modify the code to get the absolute path to the config files using some bash in the kafka-server-start file. For your second question, I've added a line in the KIP: "If both parameter

[jira] [Created] (KAFKA-15819) KafkaServer leaks KafkaRaftManager when ZK migration enabled

Greg Harris created KAFKA-15819: --- Summary: KafkaServer leaks KafkaRaftManager when ZK migration enabled Key: KAFKA-15819 URL: https://issues.apache.org/jira/browse/KAFKA-15819 Project: Kafka I

[jira] [Created] (KAFKA-15818) Implement max poll internval

Philip Nee created KAFKA-15818: -- Summary: Implement max poll internval Key: KAFKA-15818 URL: https://issues.apache.org/jira/browse/KAFKA-15818 Project: Kafka Issue Type: Task Component

[jira] [Created] (KAFKA-15817) Avoid reconnecting to the same IP address if multiple addresses are available

Bob Barrett created KAFKA-15817: --- Summary: Avoid reconnecting to the same IP address if multiple addresses are available Key: KAFKA-15817 URL: https://issues.apache.org/jira/browse/KAFKA-15817 Project:

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.6 #111

See Changes: -- [...truncated 409483 lines...] Gradle Test Run :core:test > Gradle Test Executor 91 > KafkaZkClientTest > testGetAllTopicsInClusterTriggersWatch() PASSED Gr

[jira] [Resolved] (KAFKA-15532) ZkWriteBehindLag should not be reported by inactive controllers

[ https://issues.apache.org/jira/browse/KAFKA-15532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-15532. -- Resolution: Fixed > ZkWriteBehindLag should not be reported by inactive controllers >

[jira] [Created] (KAFKA-15816) Typos in tests leak network sockets

Greg Harris created KAFKA-15816: --- Summary: Typos in tests leak network sockets Key: KAFKA-15816 URL: https://issues.apache.org/jira/browse/KAFKA-15816 Project: Kafka Issue Type: Bug C

[jira] [Created] (KAFKA-15815) JsonRestServer leaks sockets via HttpURLConnection when keep-alive enabled

Greg Harris created KAFKA-15815: --- Summary: JsonRestServer leaks sockets via HttpURLConnection when keep-alive enabled Key: KAFKA-15815 URL: https://issues.apache.org/jira/browse/KAFKA-15815 Project: Kaf

Re: [DISCUSS] Should we continue to merge without a green build? No!

Hi David et al, I agree with all the suggestions, but from what I've seen, the flaky tests tend to get ignored, and I'm afraid that disabling them would leave them getting forgotten. If the Jira ticket is accurate, we've got plenty of tickets opened for > 2 years

[jira] [Created] (KAFKA-15814) SASL Kerberos authentication cannot be used with load balanced bootstrap

Piotr Smolinski created KAFKA-15814: --- Summary: SASL Kerberos authentication cannot be used with load balanced bootstrap Key: KAFKA-15814 URL: https://issues.apache.org/jira/browse/KAFKA-15814 Projec

Re: Apache Kafka 3.6.1 release

Hi, Ok, I've put together a release plan: https://cwiki.apache.org/confluence/display/KAFKA/Release+plan+3.6.1 I'll start chasing the owners of the few open issues. If there's any other issues you'd like to have in 3.6.1, please let me know. Thanks, Mickael On Mon, Nov 13, 2023 at 4:26 PM Divij

Re: [VOTE] KIP-892: Transactional StateStores

Hi Nick, really happy with the final KIP. Thanks a lot for the hard work! +1 (binding) Lucas On Mon, Nov 13, 2023 at 4:20 PM Colt McNealy wrote: > > +1 (non-binding). > > Thank you, Nick, for making all of the changes (especially around the > `default.state.isolation.level` config). > > Colt M

Re: [DISCUSS] Should we continue to merge without a green build? No!

> Please, do it. We can use specific labels to effectively filter those tickets. We already have a label and a way to discover flaky tests. They are tagged with the label "flaky-test" [1]. There is also a label "newbie" [2] meant for folks who are new to Apache Kafka code base. My suggestion is t

Re: Apache Kafka 3.6.1 release

Thanks for volunteering Mickael. Please feel free to take over this thread. >From a Tiered Storage perspective, there is a long list of known bugs in 3.6.0 [1] but we shouldn't wait on fixing them all for 3.6.1. This should be ok since this feature is in early access. We will do a best-effort to m

Re: Apache Kafka 3.6.1 release

That would be awesome Mickael. Ismael On Mon, Nov 13, 2023 at 7:10 AM Mickael Maison wrote: > Hi Divij, > > You beat me to it, I was about to propose doing a 3.6.1 release later this > week. > While there's only a dozen or so issues fixed since 3.6.0, as > mentioned there's a few important depe

Re: [DISCUSS] Should we continue to merge without a green build? No!

> To kickstart this effort, we can publish a list of such tickets in the > community and assign one or more committers the role of a «shepherd" for each > ticket. Please, do it. We can use specific label to effectively filter those tickets. > 13 нояб. 2023 г., в 15:16, Divij Vaidya написал(а

Re: [VOTE] KIP-892: Transactional StateStores

+1 (non-binding). Thank you, Nick, for making all of the changes (especially around the `default.state.isolation.level` config). Colt McNealy *Founder, LittleHorse.dev* On Mon, Nov 13, 2023 at 7:15 AM Nick Telford wrote: > Hi everyone, > > I'd like to call a vote for KIP-892: Transactional S

[VOTE] KIP-892: Transactional StateStores

Hi everyone, I'd like to call a vote for KIP-892: Transactional StateStores[1], which makes Kafka Streams StateStores transactional under EOS. Regards, Nick 1: https://cwiki.apache.org/confluence/display/KAFKA/KIP-892%3A+Transactional+Semantics+for+StateStores

Re: Apache Kafka 3.6.1 release

Hi Divij, You beat me to it, I was about to propose doing a 3.6.1 release later this week. While there's only a dozen or so issues fixed since 3.6.0, as mentioned there's a few important dependency upgrades that would be good to release. I'm happy to volunteer to run the release if we agree to re

Re: Apache Kafka 3.6.1 release

Sounds good. Let's see if someone else volunteers for an earlier 3.6.1. I'll ping some people at Confluent to check if anyone has time. Ismael On Mon, Nov 13, 2023 at 6:57 AM Divij Vaidya wrote: > Hi Ismael, I am all-in favour for frequent releases. Sooner is always > better. Unfortunately, I w

Re: Apache Kafka 3.6.1 release

Hi Ismael, I am all-in favour for frequent releases. Sooner is always better. Unfortunately, I won't have bandwidth to volunteer for a release in December. If someone else volunteers to be RM prior to this timeline, I would be happy to ceed the RM role to them but in the worst case scenario, my off

Re: [DISCUSS] KIP-1002: Fetch remote segment indexes at once

Hi Jorge 1. I don't think we need a new API here because alternatives solutions exist even with the current API. As an example, when the first index is fetched, the RSM plugin can choose to download all indexes and cache it locally. On the next call to fetch an index from the remote tier, we will

Re: Apache Kafka 3.6.1 release

Hi Divij, I think we should be releasing 3.6.1 this year rather than next. There are some critical bugs in 3.6.0 and I don't think we should be waiting that long to fix them. What do you think? Ismael On Mon, Nov 13, 2023 at 6:32 AM Divij Vaidya wrote: > Hey folks, > > > I'd like to volunteer

Apache Kafka 3.6.1 release

Hey folks, I'd like to volunteer to be the release manager for a bug fix release of the 3.6 line. This will be the first bug fix release of this line and will be version 3.6.1. It would contain critical bug fixes for features such as Transaction verification [1], will stabilize Tiered Storage ea

Re: [DISCUSS] KIP-977: Partition-Level Throughput Metrics

Thank you for updating the KIP Qichao. I don't have any more questions or suggestions. Looks good to move forward from my perspective. -- Divij Vaidya On Fri, Nov 10, 2023 at 2:25 PM Qichao Chu wrote: > Thank you again for the nice suggestions, Jorge! > I will wait for Divij's response and

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2380

See Changes: -- [...truncated 431558 lines...] > Task :connect:json:compileTestJava UP-TO-DATE > Task :connect:json:testClasses UP-TO-DATE > Task :connect:api:jar UP-TO-DAT

Re: [DISCUSS] Should we continue to merge without a green build? No!

Thanks for bringing this up David. My primary concern revolves around the possibility that the currently disabled tests may remain inactive indefinitely. We currently have unresolved JIRA tickets for flaky tests that have been pending for an extended period. I am inclined to support the idea of di

[jira] [Created] (KAFKA-15813) Improve implementation of client instnce cache

Apoorv Mittal created KAFKA-15813: - Summary: Improve implementation of client instnce cache Key: KAFKA-15813 URL: https://issues.apache.org/jira/browse/KAFKA-15813 Project: Kafka Issue Type: