Re: Improve flaky test reporting (KAFKA-12216)

Hi David, I agree it'll be great if we could distinguish between "flakyFailure" and "alwaysFailure". And I also agree we should still show the "flakyFailure" tests because there could be some potential bugs there. Thanks for working on it. Luke On Tue, Feb 13, 2024 at 12:57 AM Ismael Juma wrote

[jira] [Created] (KAFKA-16232) kafka hangs forever in the starting process if the authorizer future is not returned

Luke Chen created KAFKA-16232: - Summary: kafka hangs forever in the starting process if the authorizer future is not returned Key: KAFKA-16232 URL: https://issues.apache.org/jira/browse/KAFKA-16232

[jira] [Resolved] (KAFKA-16157) Topic recreation with offline disk doesn't update leadership/shrink ISR correctly

[ https://issues.apache.org/jira/browse/KAFKA-16157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-16157. --- Resolution: Fixed > Topic recreation with offline disk doesn't update leadership/sh

[jira] [Created] (KAFKA-16214) No user info when SASL authentication failure

Luke Chen created KAFKA-16214: - Summary: No user info when SASL authentication failure Key: KAFKA-16214 URL: https://issues.apache.org/jira/browse/KAFKA-16214 Project: Kafka Issue Type: Bug

[jira] [Resolved] (KAFKA-16101) KRaft migration rollback documentation is incorrect

[ https://issues.apache.org/jira/browse/KAFKA-16101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-16101. --- Resolution: Fixed > KRaft migration rollback documentation is incorr

Re: Broken build

Thanks for the quick fix, Josep! On Tue, Jan 30, 2024 at 7:21 PM Josep Prat wrote: > Hi Kafka Devs! > I noticed the current trunk build is broken under Scala 2.12 only. > I found the faulty error and sent a PR to fix it: > https://github.com/apache/kafka/pull/15290 > > If someone has the time a

[jira] [Created] (KAFKA-16209) fetchSnapshot might return null if topic is created before v2.8

Luke Chen created KAFKA-16209: - Summary: fetchSnapshot might return null if topic is created before v2.8 Key: KAFKA-16209 URL: https://issues.apache.org/jira/browse/KAFKA-16209 Project: Kafka

[jira] [Resolved] (KAFKA-16085) remote copy lag bytes/segments metrics don't update all topic value

[ https://issues.apache.org/jira/browse/KAFKA-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-16085. --- Fix Version/s: 3.7.0 Assignee: Luke Chen Resolution: Fixed > remote copy lag by

Re: [DISCUSS] KIP-877: Mechanism for plugins and connectors to register metrics

Hi Mickael, Thanks for the KIP. The motivation and solution makes sense to me. Just one question: If we could extend `closable` for Converter plugin, why don't we do that for the "Unsupported Plugins" without close method? I don't say we must do that in this KIP, but maybe you could add the reaso

Re: [DISCUSS] KIP-853: KRaft Controller Membership Changes

Hi José, Thanks for the great KIP. It took me quite a lot of time reading and digesting! Some questions and comments: 1. About "VotersRecord": > When a KRaft voter becomes leader it will write a KRaftVersionRecord and VotersRecord to the log if the log or the latest snapshot doesn't contain any

[jira] [Resolved] (KAFKA-16144) Controller leader checkQuorum timer should skip only 1 controller case

[ https://issues.apache.org/jira/browse/KAFKA-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-16144. --- Resolution: Fixed > Controller leader checkQuorum timer should skip only 1 controller c

Re: [VOTE] KIP-1011: Use incrementalAlterConfigs when updating broker configs by kafka-configs.sh

Hi Ziming, +1(binding) from me. Thanks. Luke On Mon, Jan 22, 2024 at 11:50 AM Kamal Chandraprakash < kamal.chandraprak...@gmail.com> wrote: > +1 (non-binding) > > On Mon, Jan 22, 2024 at 8:34 AM ziming deng > wrote: > >> Hello everyone, >> I'd like to initiate a vote for KIP-1011. >> This KIP

[jira] [Resolved] (KAFKA-16163) Constant resignation/reelection of controller when starting a single node in combined mode

[ https://issues.apache.org/jira/browse/KAFKA-16163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-16163. --- Resolution: Duplicate > Constant resignation/reelection of controller when starting a single n

Re: [VOTE] 3.7.0 RC2

t;>>>>> RequestContext(header=RequestHeader(apiKey=ASSIGN_REPLICAS_TO_DIRS, > >>>>>>> apiVersion=0, clientId=1000, correlationId=14, headerVersion=2), > >>>>>>> connectionId='172.16.14.219:9090-172.16.14.217:53590-7', >

[jira] [Created] (KAFKA-16162) New created topics are unavailable after upgrading to 3.7

Luke Chen created KAFKA-16162: - Summary: New created topics are unavailable after upgrading to 3.7 Key: KAFKA-16162 URL: https://issues.apache.org/jira/browse/KAFKA-16162 Project: Kafka Issue

[jira] [Resolved] (KAFKA-16132) Upgrading from 3.6 to 3.7 in KRaft will have seconds of partitions unavailable

[ https://issues.apache.org/jira/browse/KAFKA-16132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-16132. --- Resolution: Duplicate > Upgrading from 3.6 to 3.7 in KRaft will have seconds of partiti

[jira] [Created] (KAFKA-16144) Controller leader checkQuorum timer should skip only 1 controller case

Luke Chen created KAFKA-16144: - Summary: Controller leader checkQuorum timer should skip only 1 controller case Key: KAFKA-16144 URL: https://issues.apache.org/jira/browse/KAFKA-16144 Project: Kafka

Re: [VOTE] KIP-1005: Expose EarliestLocalOffset and TieredOffset

+1 binding from me. Thanks for the KIP! Luke On Fri, Jan 12, 2024 at 5:41 PM Federico Valeri wrote: > +1 non binding > > Thanks > > On Fri, Jan 12, 2024 at 1:31 AM Boudjelda Mohamed Said > wrote: > > > > +1 (binding) > > > > > > On Fri, Jan 12, 2024 at 1:21 AM Satish Duggana > > > wrote: > >

[jira] [Created] (KAFKA-16132) Upgrading from 3.6 to 3.7 in KRaft will have seconds of partitions unavailable

Luke Chen created KAFKA-16132: - Summary: Upgrading from 3.6 to 3.7 in KRaft will have seconds of partitions unavailable Key: KAFKA-16132 URL: https://issues.apache.org/jira/browse/KAFKA-16132 Project

Re: [DISCUSS] KIP-1005: Add EarliestLocalOffset to GetOffsetShell

et me > know if you disagree! > > Best, > Christo > > On Fri, 12 Jan 2024 at 03:43, Luke Chen wrote: > > > Hi Christo, > > > > Thanks for the KIP! > > One question: > > > > What will the offset return if tiered storage is disabled? > &

Re: [VOTE] 3.7.0 RC2

.errors.UnsupportedVersionException: > Directory > > >>> > assignment is not supported yet. > > >>> > > > >>> > at > > >>> > > > >>> > > > >>> > > > java.base/java.util.concurrent.Complet

Re: [VOTE] 3.7.0 RC2

Hi Stanislav, I commented in the "Apache Kafka 3.7.0 Release" thread, but maybe you missed it. cross-posting here: There is a bug KAFKA-16101 reporting that "Kafka cluster will be unavailable during KRaft migration rollback". The impact for this

Re: DISCUSS KIP-1011: Use incrementalAlterConfigs when updating broker configs by kafka-configs.sh

Hi Ziming, Thanks for the KIP! LGTM! Using incremental by defaul and fallback automatically if it's not supported is a good idea! One minor comment: 1. so I'm inclined to move it to incrementalAlterConfigs and "provide a flag" to still use alterConfigs for new client to interact with old server

Re: [DISCUSS] KIP-1005: Add EarliestLocalOffset to GetOffsetShell

Hi Christo, Thanks for the KIP! One question: What will the offset return if tiered storage is disabled? For "-4 or earliest-local", it should be the same as "-2 or earliest", right? For "-5 or latest-tiered", it will be...0? I think the result should be written in the KIP (or script help text)

Re: Apache Kafka 3.7.0 Release

Hi all, There is a bug KAFKA-16101 reporting that "Kafka cluster will be unavailable during KRaft migration rollback". The impact for this issue is that if brokers try to rollback to ZK mode during KRaft migration process, there will be a period

Re: Logging in Kafka

Hi Mickael, I agree it's good to make it clear about what we're going to adopt for the logging library. For keeping reload4j or adopting log4j2, I don't have any preference TBH. But if Viktor is willing to drive log4j2 tasks, then we don't have any reason not to adopt log4j2. (Thanks Viktor!) Tha

[jira] [Created] (KAFKA-16085) remote copy lag bytes/segments metrics don't update all topic value

Luke Chen created KAFKA-16085: - Summary: remote copy lag bytes/segments metrics don't update all topic value Key: KAFKA-16085 URL: https://issues.apache.org/jira/browse/KAFKA-16085 Project:

Re: Contributor permissions request

Hi Jimmy, Your accounts are all set. Thanks. Luke On Fri, Jan 5, 2024 at 11:39 AM zw wrote: > Hi all, I kindly request the permission for being a contributor to > Kafka project. > > > Jira username: JimmyWang > GitHub username: JimmyWang6 > Wiki: JimmyWang > > > > > Best,  > Jimmy Wang

[jira] [Resolved] (KAFKA-16079) Fix leak in LocalLeaderEndPointTest/FinalizedFeatureChangeListenerTest/KafkaApisTest/ReplicaManagerConcurrencyTest

[ https://issues.apache.org/jira/browse/KAFKA-16079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-16079. --- Fix Version/s: 3.7.0 Resolution: Fixed > Fix leak in > LocalLeaderEndPoi

[jira] [Created] (KAFKA-16079) Fix leak in LocalLeaderEndPointTest/FinalizedFeatureChangeListenerTest/KafkaApisTest/ReplicaManagerConcurrencyTest

Luke Chen created KAFKA-16079: - Summary: Fix leak in LocalLeaderEndPointTest/FinalizedFeatureChangeListenerTest/KafkaApisTest/ReplicaManagerConcurrencyTest Key: KAFKA-16079 URL: https://issues.apache.org/jira/browse

[jira] [Created] (KAFKA-16071) NPE in testDescribeUnderReplicatedPartitionsWhenReassignmentIsInProgress

Luke Chen created KAFKA-16071: - Summary: NPE in testDescribeUnderReplicatedPartitionsWhenReassignmentIsInProgress Key: KAFKA-16071 URL: https://issues.apache.org/jira/browse/KAFKA-16071 Project: Kafka

[jira] [Created] (KAFKA-16065) Fix leak in DelayedOperationTest

Luke Chen created KAFKA-16065: - Summary: Fix leak in DelayedOperationTest Key: KAFKA-16065 URL: https://issues.apache.org/jira/browse/KAFKA-16065 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-16064) improve ControllerApiTest

Luke Chen created KAFKA-16064: - Summary: improve ControllerApiTest Key: KAFKA-16064 URL: https://issues.apache.org/jira/browse/KAFKA-16064 Project: Kafka Issue Type: Test Reporter

[jira] [Created] (KAFKA-16058) Fix leaked in ControllerApiTest

Luke Chen created KAFKA-16058: - Summary: Fix leaked in ControllerApiTest Key: KAFKA-16058 URL: https://issues.apache.org/jira/browse/KAFKA-16058 Project: Kafka Issue Type: Sub-task

[ANNOUNCE] New Kafka PMC Member: Divij Vaidya

Hi, Everyone, Divij has been a Kafka committer since June, 2023. He has remained very active and instructive in the community since becoming a committer. It's my pleasure to announce that Divij is now a member of Kafka PMC. Congratulations Divij! Luke on behalf of Apache Kafka PMC

Re: Kafka trunk test & build stability

Hi Sophie and Philip and all, I share the same pain as you. I've been waiting for a CI build result in a PR for days. Unfortunately, I can only get 1 result each day because it takes 8 hours for each run, and with failed results. :( I've looked into the 8 hour timeout build issue and would like t

[jira] [Resolved] (KAFKA-16035) add integration test for ExpiresPerSec and RemoteLogSizeComputationTime metrics

[ https://issues.apache.org/jira/browse/KAFKA-16035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-16035. --- Fix Version/s: 3.7.0 Resolution: Fixed > add integration test for ExpiresPerSec

Re: [DISCUSS] Road to Kafka 4.0

t; > 3.7.x. We have already said that we will backport critical fixes to > > 3.7.x > > > > for some time. > > > > 2. Quorum reconfiguration is important to include in 4.0, the release > > > > where ZK won't be supported. This doesn't need a 3.8

Re: [VOTE] KIP-1007: Introduce Remote Storage Not Ready Exception

Hi Kamal, Thanks for the KIP. +1 (binding) from me. Luke On Thu, Dec 21, 2023 at 4:51 PM Christo Lolov wrote: > Heya Kamal, > > The proposed change makes sense to me as it will be a more explicit > behaviour than what Kafka does today - I am happy with it! > > +1 (non-binding) from me > > Best

[jira] [Created] (KAFKA-16035) add integration test for ExpiresPerSec and RemoteLogSizeComputationTime metrics

Luke Chen created KAFKA-16035: - Summary: add integration test for ExpiresPerSec and RemoteLogSizeComputationTime metrics Key: KAFKA-16035 URL: https://issues.apache.org/jira/browse/KAFKA-16035 Project

Re: [DISCUSS] Road to Kafka 4.0

6 should be > preferable to the old unclean leader election configuration. > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-966%3A+Eligible+Leader+Replicas#KIP966:EligibleLeaderReplicas-Uncleanrecovery > > Let me know if we don't think this is sufficient. > > Justine

[jira] [Resolved] (KAFKA-15158) Add metrics for RemoteDeleteRequestsPerSec, RemoteDeleteErrorsPerSec, BuildRemoteLogAuxStateRequestsPerSec, BuildRemoteLogAuxStateErrorsPerSec

[ https://issues.apache.org/jira/browse/KAFKA-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-15158. --- Resolution: Fixed > Add metrics for RemoteDeleteRequestsPerSec, RemoteDeleteErrorsPer

[jira] [Created] (KAFKA-16031) Enabling testApplyDeltaShouldHandleReplicaAssignedToOnlineDirectory for tiered storage after supporting JBOD

Luke Chen created KAFKA-16031: - Summary: Enabling testApplyDeltaShouldHandleReplicaAssignedToOnlineDirectory for tiered storage after supporting JBOD Key: KAFKA-16031 URL: https://issues.apache.org/jira/browse/KAFKA

Re: [DISCUSS] Road to Kafka 4.0

"what is to stop us from > > redrawing it again and again?", wouldn't the suggestion of parallel work > > lanes brought up by Josep address this concern? > > > > It's very important not to fragment the community by supporting multiple > long-running

Re: Request contributor permissions

Hi Alex, I've granted you access to JIRA and WIKI. Thanks. Luke On Fri, Dec 15, 2023 at 1:06 PM Alexander Aghili wrote: > > Hello, > I have started contributing to Apache Kafka. > Could you please grant contributor access? > > JIRA username: AlexanderAghili > Wiki username: alexanderaghili > Gi

Re: New Release Branch 3.7

Hi Stanislav, For KIP-963, there are only 1 remaining task and 2 PRs which should be close to get merged. (ref: https://issues.apache.org/jira/browse/KAFKA-15147) Since this is an improvement for tiered storage metrics, not a huge change, I'd like to backport them into 3.7 branch if no objection f

[jira] [Created] (KAFKA-16014) Implement RemoteLogSizeComputationTime, RemoteLogSizeBytes, RemoteLogMetadataCount

Luke Chen created KAFKA-16014: - Summary: Implement RemoteLogSizeComputationTime, RemoteLogSizeBytes, RemoteLogMetadataCount Key: KAFKA-16014 URL: https://issues.apache.org/jira/browse/KAFKA-16014 Project

[jira] [Created] (KAFKA-16013) Implement ExpiresPerSec metric

Luke Chen created KAFKA-16013: - Summary: Implement ExpiresPerSec metric Key: KAFKA-16013 URL: https://issues.apache.org/jira/browse/KAFKA-16013 Project: Kafka Issue Type: Sub-task

[ANNOUNCE] Apache Kafka 3.5.2

, Levani Kokhreidze, Lucas Brutschy, Luke Chen, Manikumar Reddy, Matthias J. Sax, Mickael Maison, Nick Telford, Okada Haruki, Omnia G.H Ibrahim, Robert Wagner, Rohan, Said Boudjelda, sciclon2, Vincent Jiang, Xiaobing Fang, Yash Mayya We welcome your help and feedback. For more information on how to

Re: [DISCUSS] KIP-1007: Introduce Remote Storage Not Ready Exception

Hi Kamal, Thanks for the KIP! LGTM. Thanks. Luke On Wed, Nov 22, 2023 at 7:28 PM Kamal Chandraprakash < kamal.chandraprak...@gmail.com> wrote: > Hi, > > I would like to start a discussion to introduce a new error code for > retriable remote storage errors. Please take a look at the proposal: >

[jira] [Resolved] (KAFKA-15979) Add KIP-1001 CurrentControllerId metric

[ https://issues.apache.org/jira/browse/KAFKA-15979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-15979. --- Resolution: Duplicate Duplicated with KAFKA-15980. Closing this one. cc [~cmccabe] > Add KIP-1

Re: [ANNOUNCE] Apache Kafka 3.6.1

a, > Federico Valeri, Greg Harris, Guozhang Wang, Hao Li, hudeqi, > iit2009060, Ismael Juma, Jorge Esteban Quilcate Otoya, Josep Prat, > Jotaniya Jeel, Justine Olshan, Kamal Chandraprakash, kumarpritam863, > Levani Kokhreidze, Lucas Brutschy, Luke Chen, Manikumar Reddy, > Matthias J. Sax,

Re: [VOTE] 3.5.2 RC1

test results > > and the validations, +1 (binding) from me. > > > > Thanks, > > Justine > > > > On Tue, Dec 5, 2023 at 3:59 AM Luke Chen wrote: > > > > > Hi all, > > > > > > Thanks for helping validate the RC1 build. > > &g

Re: [VOTE] KIP-996: Pre-Vote

Hi Alyssa, +1 from me. Thanks for the improvements! Luke On Fri, Dec 8, 2023 at 10:36 AM Jason Gustafson wrote: > +1 Thanks for the KIP! Nice to see progress with the raft protocol. > > On Thu, Dec 7, 2023 at 5:10 PM Alyssa Huang > wrote: > > > Hey folks, > > > > I would like to start a vote

Re: [DISCUSS] KIP-996: Pre-Vote

Hi Alyssa, Thanks for the update. LGTM now. Luke On Fri, Dec 8, 2023 at 10:03 AM José Armando García Sancio wrote: > Hi Alyssa, > > Thanks for the answers and the updates to the KIP. I took a look at > the latest version and it looks good to me. > > -- > -José >

Re: [VOTE] 3.5.2 RC1

23 at 10:41 AM Jakub Scholz wrote: > > > > +1 non-binding. I used the staged Scala 2.13 binaries and the staged > Maven > > repo to run my tests and all seems to work fine. > > > > Thanks & Regards > > Jakub > > > > On Tue, Nov 21, 2023 at 11:09

Re: [VOTE] 3.6.1 RC0

Hi Mickael: I did: 1. Validated all checksums, signatures, and hashes 2. Ran quick start for KRaft using scala 2.12 artifacts 3. Spot checked the documentation and Javadoc 4. Validated the licence file When running the validation to scala 2.12 package, I found these libraries are miss

Re: [DISCUSS] KIP-996: Pre-Vote

Hi Alyssa, Thanks for the KIP! This is an important improvement for KRaft quorum. Some comments: 1. Follower transitions to: Prospective: After expiration of the election timeout -> Is this the fetch timeout, not election timeout? 2. I also agree we don't bump the epoch in prospective state. A

Re: [DISCUSS] KIP-956: Tiered Storage Quotas

Hi Abhijeet, Thanks for the KIP! This is an important feature for tiered storage. Some comments: 1. Will we introduce new metrics for this tiered storage quotas? This is important because the admin can know the throttling status by checking the metrics while the remote write/read are slow, like t

[jira] [Created] (KAFKA-15911) KRaft quorum leader should make sure the follower fetch is making progress

Luke Chen created KAFKA-15911: - Summary: KRaft quorum leader should make sure the follower fetch is making progress Key: KAFKA-15911 URL: https://issues.apache.org/jira/browse/KAFKA-15911 Project: Kafka

Re: [DISCUSS] Road to Kafka 4.0

k8s controlling the DNS, you simply remap c.local > to point > >> >> >> ot the IP address of your new pod for controller 102, and you're > done. No > >> >> >> need to update controller.quorum.voters. > >> >> >> > >>

[VOTE] 3.5.2 RC1

Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 3.5.2. This is a bugfix release with several fixes since the release of 3.5.1, including dependency version bumps for CVEs. Release notes for the 3.5.2 release: https://home.apache.org/~s

Re: [VOTE] KIP-963: Additional metrics in Tiered Storage

+1 (binding) from me. Thanks for the KIP. Luke On Tue, Nov 21, 2023 at 11:53 AM Satish Duggana wrote: > +1 (binding) > Thanks for the KIP and the discussion. > > Discussion mail thread for the KIP: > https://lists.apache.org/thread/40vsyc240hyody37mf2f0pn90shkzb45 > > > > On Tue, 21 Nov 2023 at

Re: [DISCUSS] KIP-963: Upload and delete lag metrics in Tiered Storage

ation, it will have an effect on RLM task leading > to > > > > > > remote log copy and delete lags. > > > > > > > > > > > > RLMM and RSM implementations can always add more metrics for > > > > > > observability based on the res

[jira] [Resolved] (KAFKA-15552) Duplicate Producer ID blocks during ZK migration

[ https://issues.apache.org/jira/browse/KAFKA-15552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-15552. --- Resolution: Fixed > Duplicate Producer ID blocks during ZK migrat

Re: [DISCUSS] Apache Kafka 3.5.2 release

e finished our testing, and think we are go. > > Thanks for giving us the opportunity to get the RocksDB version bump in. > Let's ship it! > > > -Matthias > > On 11/2/23 4:37 PM, Luke Chen wrote: > > Hi Matthias, > > > > Is there any update about the test

Re: [DISCUSS] KIP-963: Upload and delete lag metrics in Tiered Storage

Hi Christo, Thanks for the KIP! Some comments: 1. I agree with Kamal that a metric to cover the time taken to read data from remote storage is helpful. 2. I can see there are some metrics are only on topic level, but some are on partition level. Could you explain why some of them are only on top

Re: [DISCUSS] Apache Kafka 3.5.2 release

Hi Matthias, Is there any update about the test status for RocksDB versions bumps? Could I create a 3.5.2 RC build next week? Thanks. Luke On Sat, Oct 21, 2023 at 1:01 PM Luke Chen wrote: > Hi Matthias, > > I agree it's indeed a blocker for 3.5.2 to address CVE in RocksDB. &

[jira] [Resolved] (KAFKA-15689) KRaftMigrationDriver not logging the skipped event when expected state is wrong

[ https://issues.apache.org/jira/browse/KAFKA-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-15689. --- Fix Version/s: 3.7.0 Resolution: Fixed > KRaftMigrationDriver not logging the skipped ev

Re: [ANNOUNCE] New Kafka PMC Member: Satish Duggana

Congrats Satish! Luke On Sat, Oct 28, 2023 at 11:16 AM ziming deng wrote: > Congratulations Satish! > > > On Oct 27, 2023, at 23:03, Jun Rao wrote: > > > > Hi, Everyone, > > > > Satish Duggana has been a Kafka committer since 2022. He has been very > > instrumental to the community since becom

[jira] [Created] (KAFKA-15702) apiVersion request doesn't send when DNS is not ready at first

Luke Chen created KAFKA-15702: - Summary: apiVersion request doesn't send when DNS is not ready at first Key: KAFKA-15702 URL: https://issues.apache.org/jira/browse/KAFKA-15702 Project:

Re: UncleanLeaderElectionsPerSec metric and Raft

Hi Justine, Thanks for the response. I also agree that even if after KIP-966 the unclean leader election might be changed, we should still figure out if it's a missing feature or not, and what's our plan for it. Thanks. Luke On Mon, Oct 23, 2023 at 11:48 PM Justine Olshan wrote: > Hey Neil, >

[jira] [Created] (KAFKA-15670) KRaft controller using wrong listener to send RPC to brokers in dual-write mode

Luke Chen created KAFKA-15670: - Summary: KRaft controller using wrong listener to send RPC to brokers in dual-write mode Key: KAFKA-15670 URL: https://issues.apache.org/jira/browse/KAFKA-15670 Project

[jira] [Created] (KAFKA-15667) preCheck the invalid configuration for tiered storage replication factor

Luke Chen created KAFKA-15667: - Summary: preCheck the invalid configuration for tiered storage replication factor Key: KAFKA-15667 URL: https://issues.apache.org/jira/browse/KAFKA-15667 Project: Kafka

[jira] [Resolved] (KAFKA-15566) Flaky tests in FetchRequestTest.scala in KRaft mode

[ https://issues.apache.org/jira/browse/KAFKA-15566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-15566. --- Fix Version/s: 3.7.0 Resolution: Fixed > Flaky tests in FetchRequestTest.scala in KRaft m

Re: [DISCUSS] Apache Kafka 3.5.2 release

nch, what would take at least > one week; we could do the cherry-pick on Monday and start testing. > > Please let us know if such a delay for 3.5.2 is acceptable or not. > > Thanks. > > -Matthias > > > On 10/20/23 5:44 AM, Luke Chen wrote: > > Hi Ryan, >

Re: Re: [DISCUSS] Apache Kafka 3.5.2 release

Tue, 17 Oct 2023 at 11:58, Josep Prat > wrote: > > > > Hi Luke, > > > > Thanks for taking this one! > > > > Best, > > > > On Tue, Oct 17, 2023 at 8:12 AM Luke Chen wrote: > > > > > Hi all, > > > > > > I'd like to

Re: [DISCUSS] Apache Kafka 3.5.2 release

; Thanks Luke for volunteering for 3.5.2 release. > >>> > >>> On Tue, 17 Oct 2023 at 11:58, Josep Prat > >>> wrote: > >>>> > >>>> Hi Luke, > >>>> > >>>> Thanks for taking this one! > >>>> &

[jira] [Resolved] (KAFKA-15620) Duplicate remote log DELETE_SEGMENT metadata is generated when there are multiple leader epochs in the segment

[ https://issues.apache.org/jira/browse/KAFKA-15620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-15620. --- Fix Version/s: 3.7.0 Resolution: Duplicate > Duplicate remote log DELETE_SEGMENT metadata

[DISCUSS] Apache Kafka 3.5.2 release

Hi all, I'd like to volunteer as release manager for the Apache Kafka 3.5.2, to have an important bug/vulnerability fix release for 3.5.1. If there are no objections, I'll start building a release plan in thewiki in the next couple of weeks. Thanks, Luke

Re: [DISCUSS] 3.5.2 Release

Hi Levani and Divij, I can work on the 3.5.2 release. I'll start a new thread for volunteering it maybe next week. Thanks. Luke On Thu, Oct 12, 2023 at 5:07 PM Divij Vaidya wrote: > Hello Levani > > From a process perspective, there is no fixed schedule for bug fix > releases. If we have a vol

[DISCUSS] Road to Kafka 4.0

Hi all, While Kafka 3.6.0 is released, I’d like to start the discussion for the “road to Kafka 4.0”. Based on the plan in KIP-833 , the next release 3.7 will be t

Re: [ANNOUNCE] Apache Kafka 3.6.0

Gustafson, > Jeff Kim, Jim Galasyn, John Roesler, Joobi S B, Jorge Esteban Quilcate > Otoya, Josep Prat, Joseph (Ting-Chou) Lin, José Armando García Sancio, > Jun Rao, Justine Olshan, Kamal Chandraprakash, Keith Wall, Kirk True, > Lianet Magrans, LinShunKang, Liu Zeyu, lixy, Lucas Bradstre

[jira] [Resolved] (KAFKA-15507) adminClient should not throw retriable exception when closing instance

[ https://issues.apache.org/jira/browse/KAFKA-15507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-15507. --- Fix Version/s: 3.7.0 Resolution: Fixed > adminClient should not throw retriable except

Re: Apache Kafka 3.7.0 Release

Thanks Stanislav! On Tue, Oct 10, 2023 at 3:05 AM Josep Prat wrote: > Thanks Stanislav! > > ——— > Josep Prat > > Aiven Deutschland GmbH > > Alexanderufer 3-7, 10117 Berlin > > Amtsgericht Charlottenburg, HRB 209739 B > > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen > > m: +491715557497 > >

[jira] [Created] (KAFKA-15536) dynamically resize remoteIndexCache

Luke Chen created KAFKA-15536: - Summary: dynamically resize remoteIndexCache Key: KAFKA-15536 URL: https://issues.apache.org/jira/browse/KAFKA-15536 Project: Kafka Issue Type: Improvement

Re: [VOTE] 3.6.0 RC2

gt; > > > > > > > > > > https://github.com/apache/kafka/commit/2f71708955b293658cec3b27e9a5588d39c38d7e > > > > > > aren't available in the documentation (cc: Justine). I don't > > consider > > > > > this >

Re: [VOTE] 3.6.0 RC2

Hi Satish, I verified with: 1. Ran quick start in KRaft for scala 2.12 artifact 2. Making sure the checksum are correct 3. Browsing release notes, documents, javadocs, protocols. 4. Verified the tiered storage feature works well. +1 (binding). Thanks. Luke On Mon, Oct 2, 2023 at 5:23 AM Jakub

[jira] [Reopened] (KAFKA-15489) split brain in KRaft cluster

[ https://issues.apache.org/jira/browse/KAFKA-15489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen reopened KAFKA-15489: --- > split brain in KRaft cluster > - > > Key:

[jira] [Created] (KAFKA-15507) adminClient should not throw retriable exception when closing instance

Luke Chen created KAFKA-15507: - Summary: adminClient should not throw retriable exception when closing instance Key: KAFKA-15507 URL: https://issues.apache.org/jira/browse/KAFKA-15507 Project: Kafka

Re: [kafka-clients] [VOTE] 3.6.0 RC1

Hi Jose, Sounds good to me. Let's have further discussion in JIRA/PR, and target to v3.6.1/v3.7.0. Thanks. Luke On Tue, Sep 26, 2023 at 1:35 AM José Armando García Sancio wrote: > On Sat, Sep 23, 2023 at 3:08 AM Luke Chen wrote: > > > > Hi Satish, > > >

Re: [kafka-clients] [VOTE] 3.6.0 RC1

sues.apache.org/jira/browse/KAFKA-15001 > > > > 2. I was hoping you could post the results of system tests before I > > vote on this. I am particularly interested in looking at > > producer/consumer performance results since we have quite a few > > changes in this re

Re: [kafka-clients] [VOTE] 3.6.0 RC1

> > > > > - Verified signature and checksum > > > - Built from source with Java 17 and Scala 2.13 > > > - Ran all unit and integration tests > > > - Spot checked release notes and documentation > > > - Ran a custom client using staging artifacts on

Re: [kafka-clients] [VOTE] 3.6.0 RC1

; critical paths? > > > > 1. https://issues.apache.org/jira/browse/KAFKA-15489 > > > > Thanks, > > Satish. > > > > On Sat, 23 Sept 2023 at 03:08, Luke Chen wrote: > > > > > > Hi Satish, > > > > > > I found the current

[jira] [Created] (KAFKA-15491) RackId doesn't exist while running WordCountDemo

Luke Chen created KAFKA-15491: - Summary: RackId doesn't exist while running WordCountDemo Key: KAFKA-15491 URL: https://issues.apache.org/jira/browse/KAFKA-15491 Project: Kafka Issue Type

Re: [kafka-clients] [VOTE] 3.6.0 RC1

Hi Satish, I found the current KRaft implementation will have "split brain" issue when network partition happens, which will cause inconsistent metadata returned from the controller. Filed KAFKA-15489 for this issue, and PR

[jira] [Created] (KAFKA-15489) split brain in KRaft cluster

Luke Chen created KAFKA-15489: - Summary: split brain in KRaft cluster Key: KAFKA-15489 URL: https://issues.apache.org/jira/browse/KAFKA-15489 Project: Kafka Issue Type: Bug Components

[ANNOUNCE] New Kafka PMC Member: Justine Olshan

Hi, Everyone, Justine Olshan has been a Kafka committer since Dec. 2022. She has been very active and instrumental to the community since becoming a committer. It's my pleasure to announce that Justine is now a member of Kafka PMC. Congratulations Justine! Luke on behalf of Apache Kafka PMC

Re: question

Hi 殿杰 In short, we don't support it now. But welcome to submit a PR to fix the gap. You can check this ticket for more information: https://issues.apache.org/jira/browse/KAFKA-7025 Thanks. Luke On Sat, Sep 23, 2023 at 2:14 AM shidian...@mxnavi.com wrote: > > hello， > > I‘m working inKafika

Re: [ANNOUNCE] New committer: Yash Mayya

Congratulations, Yash! Luke On Fri, Sep 22, 2023 at 7:16 AM Hector Geraldino (BLOOMBERG/ 919 3RD A) < hgerald...@bloomberg.net> wrote: > Congrats! Well deserved > > From: dev@kafka.apache.org At: 09/21/23 17:05:01 UTC-4:00To: > dev@kafka.apache.org > Cc: r...@confluent.io.invalid > Subject: Re:

<    1   2   3   4   5   6   7   8   9   10   >