Re: [ANNOUNCE] Apache Kafka 3.6.1

2023-12-08 Thread Luke Chen
a, > Federico Valeri, Greg Harris, Guozhang Wang, Hao Li, hudeqi, > iit2009060, Ismael Juma, Jorge Esteban Quilcate Otoya, Josep Prat, > Jotaniya Jeel, Justine Olshan, Kamal Chandraprakash, kumarpritam863, > Levani Kokhreidze, Lucas Brutschy, Luke Chen, Manikumar Reddy, > Matthias J. Sax,

Re: [VOTE] 3.5.2 RC1

2023-12-08 Thread Luke Chen
t; > and the validations, +1 (binding) from me. > > > > Thanks, > > Justine > > > > On Tue, Dec 5, 2023 at 3:59 AM Luke Chen wrote: > > > > > Hi all, > > > > > > Thanks for helping validate the RC1 build. > > > I've got 1 b

Re: [VOTE] KIP-996: Pre-Vote

2023-12-08 Thread Luke Chen
Hi Alyssa, +1 from me. Thanks for the improvements! Luke On Fri, Dec 8, 2023 at 10:36 AM Jason Gustafson wrote: > +1 Thanks for the KIP! Nice to see progress with the raft protocol. > > On Thu, Dec 7, 2023 at 5:10 PM Alyssa Huang > wrote: > > > Hey folks, > > > > I would like to start a vote

Re: [DISCUSS] KIP-996: Pre-Vote

2023-12-08 Thread Luke Chen
Hi Alyssa, Thanks for the update. LGTM now. Luke On Fri, Dec 8, 2023 at 10:03 AM José Armando García Sancio wrote: > Hi Alyssa, > > Thanks for the answers and the updates to the KIP. I took a look at > the latest version and it looks good to me. > > -- > -José >

Re: [VOTE] 3.5.2 RC1

2023-12-05 Thread Luke Chen
lz wrote: > > > > +1 non-binding. I used the staged Scala 2.13 binaries and the staged > Maven > > repo to run my tests and all seems to work fine. > > > > Thanks & Regards > > Jakub > > > > On Tue, Nov 21, 2023 at 11:09 AM Luke Chen wrote: >

Re: [VOTE] 3.6.1 RC0

2023-12-04 Thread Luke Chen
Hi Mickael: I did: 1. Validated all checksums, signatures, and hashes 2. Ran quick start for KRaft using scala 2.12 artifacts 3. Spot checked the documentation and Javadoc 4. Validated the licence file When running the validation to scala 2.12 package, I found these libraries are

Re: [DISCUSS] KIP-996: Pre-Vote

2023-11-29 Thread Luke Chen
Hi Alyssa, Thanks for the KIP! This is an important improvement for KRaft quorum. Some comments: 1. Follower transitions to: Prospective: After expiration of the election timeout -> Is this the fetch timeout, not election timeout? 2. I also agree we don't bump the epoch in prospective state. A

Re: [DISCUSS] KIP-956: Tiered Storage Quotas

2023-11-28 Thread Luke Chen
Hi Abhijeet, Thanks for the KIP! This is an important feature for tiered storage. Some comments: 1. Will we introduce new metrics for this tiered storage quotas? This is important because the admin can know the throttling status by checking the metrics while the remote write/read are slow, like

[jira] [Created] (KAFKA-15911) KRaft quorum leader should make sure the follower fetch is making progress

2023-11-27 Thread Luke Chen (Jira)
Luke Chen created KAFKA-15911: - Summary: KRaft quorum leader should make sure the follower fetch is making progress Key: KAFKA-15911 URL: https://issues.apache.org/jira/browse/KAFKA-15911 Project: Kafka

Re: [DISCUSS] Road to Kafka 4.0

2023-11-21 Thread Luke Chen
No > >> >> >> need to update controller.quorum.voters. > >> >> >> > >> >> >> Another question is whether you re-create the pod data from > scratch every > >> >> >> time you add a new node. If you store the controlle

[VOTE] 3.5.2 RC1

2023-11-21 Thread Luke Chen
Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 3.5.2. This is a bugfix release with several fixes since the release of 3.5.1, including dependency version bumps for CVEs. Release notes for the 3.5.2 release:

Re: [VOTE] KIP-963: Additional metrics in Tiered Storage

2023-11-20 Thread Luke Chen
+1 (binding) from me. Thanks for the KIP. Luke On Tue, Nov 21, 2023 at 11:53 AM Satish Duggana wrote: > +1 (binding) > Thanks for the KIP and the discussion. > > Discussion mail thread for the KIP: > https://lists.apache.org/thread/40vsyc240hyody37mf2f0pn90shkzb45 > > > > On Tue, 21 Nov 2023

Re: [DISCUSS] KIP-963: Upload and delete lag metrics in Tiered Storage

2023-11-20 Thread Luke Chen
k leading > to > > > > > > remote log copy and delete lags. > > > > > > > > > > > > RLMM and RSM implementations can always add more metrics for > > > > > > observability based on the respective implementations. > > >

[jira] [Resolved] (KAFKA-15552) Duplicate Producer ID blocks during ZK migration

2023-11-16 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-15552. --- Resolution: Fixed > Duplicate Producer ID blocks during ZK migrat

Re: [DISCUSS] Apache Kafka 3.5.2 release

2023-11-09 Thread Luke Chen
ished our testing, and think we are go. > > Thanks for giving us the opportunity to get the RocksDB version bump in. > Let's ship it! > > > -Matthias > > On 11/2/23 4:37 PM, Luke Chen wrote: > > Hi Matthias, > > > > Is there any update about the test status for

Re: [DISCUSS] KIP-963: Upload and delete lag metrics in Tiered Storage

2023-11-09 Thread Luke Chen
Hi Christo, Thanks for the KIP! Some comments: 1. I agree with Kamal that a metric to cover the time taken to read data from remote storage is helpful. 2. I can see there are some metrics are only on topic level, but some are on partition level. Could you explain why some of them are only on

Re: [DISCUSS] Apache Kafka 3.5.2 release

2023-11-02 Thread Luke Chen
Hi Matthias, Is there any update about the test status for RocksDB versions bumps? Could I create a 3.5.2 RC build next week? Thanks. Luke On Sat, Oct 21, 2023 at 1:01 PM Luke Chen wrote: > Hi Matthias, > > I agree it's indeed a blocker for 3.5.2 to address CVE in RocksDB. > P

[jira] [Resolved] (KAFKA-15689) KRaftMigrationDriver not logging the skipped event when expected state is wrong

2023-10-30 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-15689. --- Fix Version/s: 3.7.0 Resolution: Fixed > KRaftMigrationDriver not logging the skipped ev

Re: [ANNOUNCE] New Kafka PMC Member: Satish Duggana

2023-10-28 Thread Luke Chen
Congrats Satish! Luke On Sat, Oct 28, 2023 at 11:16 AM ziming deng wrote: > Congratulations Satish! > > > On Oct 27, 2023, at 23:03, Jun Rao wrote: > > > > Hi, Everyone, > > > > Satish Duggana has been a Kafka committer since 2022. He has been very > > instrumental to the community since

[jira] [Created] (KAFKA-15702) apiVersion request doesn't send when DNS is not ready at first

2023-10-27 Thread Luke Chen (Jira)
Luke Chen created KAFKA-15702: - Summary: apiVersion request doesn't send when DNS is not ready at first Key: KAFKA-15702 URL: https://issues.apache.org/jira/browse/KAFKA-15702 Project: Kafka

Re: UncleanLeaderElectionsPerSec metric and Raft

2023-10-24 Thread Luke Chen
Hi Justine, Thanks for the response. I also agree that even if after KIP-966 the unclean leader election might be changed, we should still figure out if it's a missing feature or not, and what's our plan for it. Thanks. Luke On Mon, Oct 23, 2023 at 11:48 PM Justine Olshan wrote: > Hey Neil, >

[jira] [Created] (KAFKA-15670) KRaft controller using wrong listener to send RPC to brokers in dual-write mode

2023-10-23 Thread Luke Chen (Jira)
Luke Chen created KAFKA-15670: - Summary: KRaft controller using wrong listener to send RPC to brokers in dual-write mode Key: KAFKA-15670 URL: https://issues.apache.org/jira/browse/KAFKA-15670 Project

[jira] [Created] (KAFKA-15667) preCheck the invalid configuration for tiered storage replication factor

2023-10-23 Thread Luke Chen (Jira)
Luke Chen created KAFKA-15667: - Summary: preCheck the invalid configuration for tiered storage replication factor Key: KAFKA-15667 URL: https://issues.apache.org/jira/browse/KAFKA-15667 Project: Kafka

[jira] [Resolved] (KAFKA-15566) Flaky tests in FetchRequestTest.scala in KRaft mode

2023-10-22 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-15566. --- Fix Version/s: 3.7.0 Resolution: Fixed > Flaky tests in FetchRequestTest.scala in KRaft m

Re: [DISCUSS] Apache Kafka 3.5.2 release

2023-10-20 Thread Luke Chen
what would take at least > one week; we could do the cherry-pick on Monday and start testing. > > Please let us know if such a delay for 3.5.2 is acceptable or not. > > Thanks. > > -Matthias > > > On 10/20/23 5:44 AM, Luke Chen wrote: > > Hi Ryan, > >

Re: Re: [DISCUSS] Apache Kafka 3.5.2 release

2023-10-20 Thread Luke Chen
ct 2023 at 11:58, Josep Prat > wrote: > > > > Hi Luke, > > > > Thanks for taking this one! > > > > Best, > > > > On Tue, Oct 17, 2023 at 8:12 AM Luke Chen wrote: > > > > > Hi all, > > > > > &g

Re: [DISCUSS] Apache Kafka 3.5.2 release

2023-10-20 Thread Luke Chen
; Thanks Luke for volunteering for 3.5.2 release. > >>> > >>> On Tue, 17 Oct 2023 at 11:58, Josep Prat > >>> wrote: > >>>> > >>>> Hi Luke, > >>>> > >>>> Thanks for taking this one

[jira] [Resolved] (KAFKA-15620) Duplicate remote log DELETE_SEGMENT metadata is generated when there are multiple leader epochs in the segment

2023-10-18 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-15620. --- Fix Version/s: 3.7.0 Resolution: Duplicate > Duplicate remote log DELETE_SEGMENT metad

[DISCUSS] Apache Kafka 3.5.2 release

2023-10-17 Thread Luke Chen
Hi all, I'd like to volunteer as release manager for the Apache Kafka 3.5.2, to have an important bug/vulnerability fix release for 3.5.1. If there are no objections, I'll start building a release plan in thewiki in the next couple of weeks. Thanks, Luke

Re: [DISCUSS] 3.5.2 Release

2023-10-12 Thread Luke Chen
Hi Levani and Divij, I can work on the 3.5.2 release. I'll start a new thread for volunteering it maybe next week. Thanks. Luke On Thu, Oct 12, 2023 at 5:07 PM Divij Vaidya wrote: > Hello Levani > > From a process perspective, there is no fixed schedule for bug fix > releases. If we have a

[DISCUSS] Road to Kafka 4.0

2023-10-11 Thread Luke Chen
Hi all, While Kafka 3.6.0 is released, I’d like to start the discussion for the “road to Kafka 4.0”. Based on the plan in KIP-833 , the next release 3.7 will be

Re: [ANNOUNCE] Apache Kafka 3.6.0

2023-10-11 Thread Luke Chen
Gustafson, > Jeff Kim, Jim Galasyn, John Roesler, Joobi S B, Jorge Esteban Quilcate > Otoya, Josep Prat, Joseph (Ting-Chou) Lin, José Armando García Sancio, > Jun Rao, Justine Olshan, Kamal Chandraprakash, Keith Wall, Kirk True, > Lianet Magrans, LinShunKang, Liu Zeyu, lixy, Lucas Bradstre

[jira] [Resolved] (KAFKA-15507) adminClient should not throw retriable exception when closing instance

2023-10-10 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-15507. --- Fix Version/s: 3.7.0 Resolution: Fixed > adminClient should not throw retriable except

Re: Apache Kafka 3.7.0 Release

2023-10-09 Thread Luke Chen
Thanks Stanislav! On Tue, Oct 10, 2023 at 3:05 AM Josep Prat wrote: > Thanks Stanislav! > > ——— > Josep Prat > > Aiven Deutschland GmbH > > Alexanderufer 3-7, 10117 Berlin > > Amtsgericht Charlottenburg, HRB 209739 B > > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen > > m: +491715557497 >

[jira] [Created] (KAFKA-15536) dynamically resize remoteIndexCache

2023-10-03 Thread Luke Chen (Jira)
Luke Chen created KAFKA-15536: - Summary: dynamically resize remoteIndexCache Key: KAFKA-15536 URL: https://issues.apache.org/jira/browse/KAFKA-15536 Project: Kafka Issue Type: Improvement

Re: [VOTE] 3.6.0 RC2

2023-10-03 Thread Luke Chen
gt; > > > > > > > https://github.com/apache/kafka/commit/2f71708955b293658cec3b27e9a5588d39c38d7e > > > > > > aren't available in the documentation (cc: Justine). I don't > > consider > > > > > this > > > > > >

Re: [VOTE] 3.6.0 RC2

2023-10-02 Thread Luke Chen
Hi Satish, I verified with: 1. Ran quick start in KRaft for scala 2.12 artifact 2. Making sure the checksum are correct 3. Browsing release notes, documents, javadocs, protocols. 4. Verified the tiered storage feature works well. +1 (binding). Thanks. Luke On Mon, Oct 2, 2023 at 5:23 AM

[jira] [Reopened] (KAFKA-15489) split brain in KRaft cluster

2023-09-27 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen reopened KAFKA-15489: --- > split brain in KRaft cluster > - > > Key:

[jira] [Created] (KAFKA-15507) adminClient should not throw retriable exception when closing instance

2023-09-26 Thread Luke Chen (Jira)
Luke Chen created KAFKA-15507: - Summary: adminClient should not throw retriable exception when closing instance Key: KAFKA-15507 URL: https://issues.apache.org/jira/browse/KAFKA-15507 Project: Kafka

Re: [kafka-clients] [VOTE] 3.6.0 RC1

2023-09-25 Thread Luke Chen
Hi Jose, Sounds good to me. Let's have further discussion in JIRA/PR, and target to v3.6.1/v3.7.0. Thanks. Luke On Tue, Sep 26, 2023 at 1:35 AM José Armando García Sancio wrote: > On Sat, Sep 23, 2023 at 3:08 AM Luke Chen wrote: > > > > Hi Satish, > > > >

Re: [kafka-clients] [VOTE] 3.6.0 RC1

2023-09-25 Thread Luke Chen
FKA-15001 > > > > 2. I was hoping you could post the results of system tests before I > > vote on this. I am particularly interested in looking at > > producer/consumer performance results since we have quite a few > > changes in this release. What is the plan on the

Re: [kafka-clients] [VOTE] 3.6.0 RC1

2023-09-25 Thread Luke Chen
> > - Verified signature and checksum > > > - Built from source with Java 17 and Scala 2.13 > > > - Ran all unit and integration tests > > > - Spot checked release notes and documentation > > > - Ran a custom client using staging artifacts on a 3-nodes

Re: [kafka-clients] [VOTE] 3.6.0 RC1

2023-09-24 Thread Luke Chen
s? > > > > 1. https://issues.apache.org/jira/browse/KAFKA-15489 > > > > Thanks, > > Satish. > > > > On Sat, 23 Sept 2023 at 03:08, Luke Chen wrote: > > > > > > Hi Satish, > > > > > > I found the current KRaft implemen

[jira] [Created] (KAFKA-15491) RackId doesn't exist while running WordCountDemo

2023-09-24 Thread Luke Chen (Jira)
Luke Chen created KAFKA-15491: - Summary: RackId doesn't exist while running WordCountDemo Key: KAFKA-15491 URL: https://issues.apache.org/jira/browse/KAFKA-15491 Project: Kafka Issue Type: Bug

Re: [kafka-clients] [VOTE] 3.6.0 RC1

2023-09-23 Thread Luke Chen
Hi Satish, I found the current KRaft implementation will have "split brain" issue when network partition happens, which will cause inconsistent metadata returned from the controller. Filed KAFKA-15489 for this issue, and PR

[jira] [Created] (KAFKA-15489) split brain in KRaft cluster

2023-09-23 Thread Luke Chen (Jira)
Luke Chen created KAFKA-15489: - Summary: split brain in KRaft cluster Key: KAFKA-15489 URL: https://issues.apache.org/jira/browse/KAFKA-15489 Project: Kafka Issue Type: Bug Components

[ANNOUNCE] New Kafka PMC Member: Justine Olshan

2023-09-22 Thread Luke Chen
Hi, Everyone, Justine Olshan has been a Kafka committer since Dec. 2022. She has been very active and instrumental to the community since becoming a committer. It's my pleasure to announce that Justine is now a member of Kafka PMC. Congratulations Justine! Luke on behalf of Apache Kafka PMC

Re: question

2023-09-22 Thread Luke Chen
Hi 殿杰 In short, we don't support it now. But welcome to submit a PR to fix the gap. You can check this ticket for more information: https://issues.apache.org/jira/browse/KAFKA-7025 Thanks. Luke On Sat, Sep 23, 2023 at 2:14 AM shidian...@mxnavi.com wrote: > > hello, > > I‘m working

Re: [ANNOUNCE] New committer: Yash Mayya

2023-09-21 Thread Luke Chen
Congratulations, Yash! Luke On Fri, Sep 22, 2023 at 7:16 AM Hector Geraldino (BLOOMBERG/ 919 3RD A) < hgerald...@bloomberg.net> wrote: > Congrats! Well deserved > > From: dev@kafka.apache.org At: 09/21/23 17:05:01 UTC-4:00To: > dev@kafka.apache.org > Cc: r...@confluent.io.invalid > Subject:

Re: [ANNOUNCE] New committer: Lucas Brutschy

2023-09-21 Thread Luke Chen
Congratulations, Lukas! Luke On Fri, Sep 22, 2023 at 6:53 AM Tom Bentley wrote: > Congratulations! > > On Fri, 22 Sept 2023 at 09:11, Sophie Blee-Goldman > > wrote: > > > Congrats Lucas! > > >

Re: Help to the community with review

2023-09-19 Thread Luke Chen
Hi Taras, Thank you very much for your offers. Really appreciate it! For KIPs review, it's also great if the community can help review them if available. I'll also try my best to have a look when available. Thank you for your contribution! Luke On Tue, Sep 19, 2023 at 3:08 PM Taras Ledkov

Re: Help to the community with review

2023-09-19 Thread Luke Chen
Hi nizhikov, Thank you for your consideration and help! Yes, we really need the community developers to help review PRs to share the loading. One thing to note, PR review is also counted as one of the contribution! Please do that soon if you have spare cycle. :) BTW, I'll review your PRs this

[jira] [Resolved] (KAFKA-15442) add document to introduce tiered storage feature and the usage

2023-09-14 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-15442. --- Resolution: Fixed > add document to introduce tiered storage feature and the us

Re: Apache Kafka 3.6.0 release

2023-09-13 Thread Luke Chen
Hi Satish, Since this PR: https://github.com/apache/kafka/pull/14366 only changes the doc, I've backported to 3.6 branch. FYI. Thanks. Luke On Thu, Sep 14, 2023 at 12:15 AM Justine Olshan wrote: > Hey Satish -- yes, you are correct. KAFKA-15459 only affects 3.6. > PR should be finalized soon.

[jira] [Created] (KAFKA-15442) add document to introduce tiered storage feature and the usage

2023-09-07 Thread Luke Chen (Jira)
Luke Chen created KAFKA-15442: - Summary: add document to introduce tiered storage feature and the usage Key: KAFKA-15442 URL: https://issues.apache.org/jira/browse/KAFKA-15442 Project: Kafka

[jira] [Resolved] (KAFKA-15052) Fix flaky test QuorumControllerTest.testBalancePartitionLeaders()

2023-09-04 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-15052. --- Resolution: Fixed > Fix flaky test QuorumControllerTest.testBalancePartitionLead

[jira] [Resolved] (KAFKA-15427) Integration tests in TS test harness detect resource leaks

2023-09-03 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-15427. --- Resolution: Fixed > Integration tests in TS test harness detect resource le

[jira] [Resolved] (KAFKA-15412) Reading an unknown version of quorum-state-file should trigger an error

2023-08-30 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-15412. --- Fix Version/s: 3.7.0 Resolution: Fixed > Reading an unknown version of quorum-state-f

Kafka jenkins is unavailable now

2023-08-29 Thread Luke Chen
Hi all, Just found Kafka jenkins is unavailable currently. Filed an INFRA issue: https://issues.apache.org/jira/browse/INFRA-24940 FYI. Thanks. Luke

[jira] [Created] (KAFKA-15414) remote logs get deleted after partition reassignment

2023-08-28 Thread Luke Chen (Jira)
Luke Chen created KAFKA-15414: - Summary: remote logs get deleted after partition reassignment Key: KAFKA-15414 URL: https://issues.apache.org/jira/browse/KAFKA-15414 Project: Kafka Issue Type

[jira] [Created] (KAFKA-15409) Distinguishing controller configs from broker configs in KRaft mode

2023-08-28 Thread Luke Chen (Jira)
Luke Chen created KAFKA-15409: - Summary: Distinguishing controller configs from broker configs in KRaft mode Key: KAFKA-15409 URL: https://issues.apache.org/jira/browse/KAFKA-15409 Project: Kafka

Re: FYI - CI failures due to Apache Infra (Issue with creating launcher for agent)

2023-08-28 Thread Luke Chen
Thanks for the info, Divij! Luke On Mon, Aug 28, 2023 at 6:01 PM Divij Vaidya wrote: > Hey folks > > During you CI runs, you may notice that some test pipelines fail to > start with messages such as: > > "ERROR: Issue with creating launcher for agent builds38. The agent is > being

[jira] [Resolved] (KAFKA-14780) Make RefreshingHttpsJwksTest#testSecondaryRefreshAfterElapsedDelay deterministic

2023-08-23 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-14780. --- Fix Version/s: 3.6.0 Resolution: Fixed > Make RefreshingHttpsJwksT

Re: [REVIEW REQUEST] Move ReassignPartitionsCommandArgsTest to java

2023-08-23 Thread Luke Chen
Hi, Sorry that we're mostly working on features for v3.6.0, which is expected to be released in the following weeks. I'll review your PR after releasing. (Please ping me then if I forget it!) Also, it'd be good if the devs in the community can help on PR review when available. That'll help a

Re: Requesting permissions to contribute to Apache Kafka

2023-08-23 Thread Luke Chen
Hi Animesh, Your accounts are all set. Thanks. Luke On Tue, Aug 22, 2023 at 9:25 PM Animesh Kumar wrote: > Hi Team, > Please provide access to contribute to Apache Kafka > JIRA id -- akanimesh7 > Wiki Id -- akanimesh7 > -- > Animesh Kumar > 8120004556 >

[jira] [Created] (KAFKA-15353) Empty ISR returned from controller after AlterPartition request

2023-08-16 Thread Luke Chen (Jira)
Luke Chen created KAFKA-15353: - Summary: Empty ISR returned from controller after AlterPartition request Key: KAFKA-15353 URL: https://issues.apache.org/jira/browse/KAFKA-15353 Project: Kafka

[jira] [Resolved] (KAFKA-15329) Make default `remote.log.metadata.manager.class.name` as topic based RLMM

2023-08-15 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-15329. --- Resolution: Fixed > Make default `remote.log.metadata.manager.class.name` as topic based R

[jira] [Created] (KAFKA-15329) Make default `remote.log.metadata.manager.class.name` as topic based RLMM

2023-08-10 Thread Luke Chen (Jira)
Luke Chen created KAFKA-15329: - Summary: Make default `remote.log.metadata.manager.class.name` as topic based RLMM Key: KAFKA-15329 URL: https://issues.apache.org/jira/browse/KAFKA-15329 Project: Kafka

[jira] [Resolved] (KAFKA-14421) OffsetFetchRequest throws NPE Exception

2023-08-10 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-14421. --- Resolution: Resolved Resolved in the later release. > OffsetFetchRequest throws NPE Except

Re: [DISCUSS] Apache Kafka 3.4.1 release

2023-08-09 Thread Luke Chen
Hi José, Thanks for the reminder. Yes, I did miss that. Already updated and pushed. Thanks. Luke On Wed, Aug 9, 2023 at 8:08 AM José Armando García Sancio wrote: > Hey Luke, > > Thanks for working on the release for 3.4.1. I was working on some > cherry picks and I noticed that branch 3.4

Re: Request permission to contribute

2023-08-03 Thread Luke Chen
Hi Adrian, Your account is all set. Thanks. Luke On Thu, Aug 3, 2023 at 4:25 PM Adrian Preston wrote: > Hello, > Please could my JIRA account (prestona) be given the permissions required > to contribute to Kafka? > Thanks, > Adrian > > Unless otherwise stated above: > > IBM United Kingdom

[jira] [Created] (KAFKA-15294) Make remote storage related configs as public (i.e. non-internal)

2023-08-02 Thread Luke Chen (Jira)
Luke Chen created KAFKA-15294: - Summary: Make remote storage related configs as public (i.e. non-internal) Key: KAFKA-15294 URL: https://issues.apache.org/jira/browse/KAFKA-15294 Project: Kafka

Re: Request permission to contribute

2023-07-31 Thread Luke Chen
Hi Qichao, Your accounts are all set up. Thanks. Luke On Mon, Jul 31, 2023 at 1:19 PM Qichao Chu wrote: > Hi Bruno, > > Is it ok for you to set me up for contribution too? I would like to create > a KIP. > My account ID in Confluence and JIRA is ex172000 and my email is > ex172...@gmail.com.

Re: Re: [DISCUSS] KIP-951: Leader discovery optimisations for the client

2023-07-26 Thread Luke Chen
gt;> > > > uses PreferredReadReplica. So as long as leader is available, > > > >> > > > PreferredReadReplica would be found in subsequent fetches. > > > >> > > > > > > >> > > > Also, under this case, should we

Re: [VOTE] KIP-919: Allow AdminClient to Talk Directly with the KRaft Controller Quorum and add Controller Registration

2023-07-26 Thread Luke Chen
+1 (binding) from me. Thanks for the KIP! Luke On Tue, Jul 25, 2023 at 1:24 AM Colin McCabe wrote: > Hi all, > > I'd like to start the vote for KIP-919: Allow AdminClient to Talk Directly > with the KRaft Controller Quorum and add Controller Registration. > > The KIP is here:

[jira] [Resolved] (KAFKA-15218) NPE will be thrown while deleting topic and fetch from follower concurrently

2023-07-25 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-15218. --- Fix Version/s: 3.6.0 Resolution: Fixed > NPE will be thrown while deleting topic and fe

Re: [VOTE] KIP-930: Tiered Storage Metrics

2023-07-25 Thread Luke Chen
+1 (binding) from me. Thanks. Luke On Tue, Jul 25, 2023 at 7:51 PM Jorge Esteban Quilcate Otoya < quilcate.jo...@gmail.com> wrote: > +1 (non-binding) > > Thanks, Abhijeet! > > > On Tue, 25 Jul 2023 at 14:22, Abhijeet Kumar > wrote: > > > Please find the updated link to the KIP: > > > > >

Re: KIP-919: Allow AdminClient to Talk Directly with the KRaft Controller Quorum

2023-07-25 Thread Luke Chen
Hi Colin, Some more comments: 1. In the KIP, we mentioned "controller heartbeats", but it is not explained anywhere. I think "controller heartbeats" = controller registration", is that correct? If no, please explain more about it in the KIP. 2. Following this question: > Which endpoint will the

Re: [DISCUSS] KIP-930: Tiered Storage Metrics

2023-07-25 Thread Luke Chen
Hi Abhijeet, Thanks for the KIP! I don't have much preference for the name changing. But if it could confuse other people, it's good to make it clear. Thank you. Luke On Tue, Jul 25, 2023 at 2:53 PM Abhijeet Kumar wrote: > Hi Kamal, > > As we discussed offline, I will rename this KIP so that

Re: [ANNOUNCE] Apache Kafka 3.5.1

2023-07-24 Thread Luke Chen
Thanks for running the release! Luke On Mon, Jul 24, 2023 at 6:35 PM Manyanda Chitimbo < manyanda.chiti...@gmail.com> wrote: > Thanks for running the release Divij. > > On Mon 24 Jul 2023 at 12:15, Kamal Chandraprakash < > kamal.chandraprak...@gmail.com> wrote: > > > Thanks for running the

[jira] [Created] (KAFKA-15239) producerPerformance system test for old client failed after v3.5.0

2023-07-24 Thread Luke Chen (Jira)
Luke Chen created KAFKA-15239: - Summary: producerPerformance system test for old client failed after v3.5.0 Key: KAFKA-15239 URL: https://issues.apache.org/jira/browse/KAFKA-15239 Project: Kafka

[jira] [Resolved] (KAFKA-14712) Confusing error when writing downgraded FeatureImage

2023-07-23 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-14712. --- Resolution: Fixed > Confusing error when writing downgraded FeatureIm

Re: Request contributor permissions to kafka

2023-07-22 Thread Luke Chen
Hi, Your account is all set. Thanks. Luke On Sat, Jul 22, 2023 at 2:17 AM Boudjelda Mohamed Said wrote: > Hi > I would like to have a contributor permission to kafka, this is my jira > id: *bmscomp* > > > Best regards >

Re: Requesting permission to contribute to Apache Kafka

2023-07-20 Thread Luke Chen
Hi Kenneth, Your accounts are all set. Thanks. Luke On Fri, Jul 21, 2023 at 1:25 AM Kenneth Eversole wrote: > Hello, > > I am requesting permission to contribute to Apache Kafka > > wiki id: keversole > jira id: keversole > > > Thank you, > > Kenneth Eversole >

[jira] [Resolved] (KAFKA-15176) Add missing tests for remote storage metrics

2023-07-20 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-15176. --- Fix Version/s: 3.6.0 Resolution: Fixed > Add missing tests for remote storage metr

Re: FYI - Timeout waiting to lock zinc...It is currently in use by another Gradle instance

2023-07-19 Thread Luke Chen
Hi Divij, Thanks for the info. I was trying to investigate it, but cannot find the failed CI build with the zinc error. The PR: https://github.com/apache/kafka/pull/14032 is merged in build #2013 . >From build #2013 to the latest

[jira] [Created] (KAFKA-15218) NPE will be thrown while deleting topic and fetch from follower concurrently

2023-07-19 Thread Luke Chen (Jira)
Luke Chen created KAFKA-15218: - Summary: NPE will be thrown while deleting topic and fetch from follower concurrently Key: KAFKA-15218 URL: https://issues.apache.org/jira/browse/KAFKA-15218 Project

Re: [DISCUSS] KIP-951: Leader discovery optimisations for the client

2023-07-18 Thread Luke Chen
Hi Mayank, Thanks for the KIP! Some questions: 1. I can see most of the cases we only care about consumer fetch from the leader. But what if the consumer was fetching from the follower? We already include `PreferredReadReplica` in the fetch response. Should we put the node info of

Re: [VOTE] 3.5.1 RC1

2023-07-18 Thread Luke Chen
Hi Divij, I've run: 1. Download kafka_2.12-3.5.1.tgz 2. Run quick start using KRaft mode 3. Verified the checksum 4. Sanity check the javadoc All looks good. +1 (binding) Thanks. Luke On Tue, Jul 18, 2023 at 5:15 AM Chris Egerton wrote: > Hi Divij, > > Thanks for running this release! > > To

[jira] [Resolved] (KAFKA-15185) Consumers using the latest strategy may lose data after the topic adds partitions

2023-07-13 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-15185. --- Resolution: Duplicate > Consumers using the latest strategy may lose data after the topic a

Re: [VOTE] KIP-852: Optimize calculation of size for log in remote tier

2023-07-13 Thread Luke Chen
+1 (binding) from me. Thanks for the KIP! Luke On Sun, Jul 2, 2023 at 11:49 AM Kamal Chandraprakash < kamal.chandraprak...@gmail.com> wrote: > +1 (non-binding). Thanks for the KIP! > > — > Kamal > > On Mon, 7 Nov 2022 at 2:20 AM, John Roesler wrote: > > > Hi Divij, > > > > Thanks for the KIP!

Re: [DISCUSS] KIP-852 Optimize calculation of size for log in remote tier

2023-07-13 Thread Luke Chen
Hi Divij, One minor comment: remoteLogSize takes 2 parameters, but in the code snippet, you only provide 1 parameter. Otherwise, LGTM Thank you. Luke On Wed, Jul 12, 2023 at 8:56 PM Divij Vaidya wrote: > Jorge, > About API name: Good point. I have changed it to remoteLogSize instead of >

[jira] [Created] (KAFKA-15176) Add missing tests for remote storage metrics

2023-07-11 Thread Luke Chen (Jira)
Luke Chen created KAFKA-15176: - Summary: Add missing tests for remote storage metrics Key: KAFKA-15176 URL: https://issues.apache.org/jira/browse/KAFKA-15176 Project: Kafka Issue Type: Sub-task

Re: Permissions for contributing to Kafka

2023-07-10 Thread Luke Chen
Hi Zixuan, Your accounts are all set. Thanks. Luke On Tue, Jul 11, 2023 at 10:54 AM Zixuan Bai wrote: > Hi master, > > Could you help grant me permissions to contribute to Kafka? > > Wiki ID: zixuan.bai > Jira ID: zixuan.bai > > Thanks a lot! > > Best regards, >

Re: wiki id

2023-07-10 Thread Luke Chen
Hi Willma, Your accounts are all set. Thank you. Luke On Tue, Jul 11, 2023 at 9:21 AM Willma wrote: > Hi team, I have signed up for a wiki id under the email " > phuctran3...@gmail.com", I have also requested for a jira id under the > same > email, if possible can the team approve it?

Re: [ANNOUNCE] New committer: Greg Harris

2023-07-10 Thread Luke Chen
Congrats Greg! Luke On Tue, Jul 11, 2023 at 8:19 AM Matthew de Detrich wrote: > Congratulations, well deserved! > > On Mon, Jul 10, 2023 at 5:45 PM Chris Egerton wrote: > > > Hi all, > > > > The PMC for Apache Kafka has invited Greg Harris to become a committer, > and > > we are happy to

Re: Permission to contribute to Apache Kafka

2023-07-06 Thread Luke Chen
Hi Shay, Your accounts are all set. Thanks. Luke On Fri, Jul 7, 2023 at 7:08 AM Shay Lin wrote: > Hi all, > > Could you give me the appropriate access (edit Wiki/KIP, Jira etc) to > contribute to AK? > > My confluence and Jira IDs are the same: lqxshay > > Thanks in advance, > Shay >

Re: KIP-919: Allow AdminClient to Talk Directly with the KRaft Controller Quorum

2023-07-04 Thread Luke Chen
pr 28, 2023 at 1:42 AM Colin McCabe wrote: > On Wed, Apr 26, 2023, at 22:08, Luke Chen wrote: > > Hi Colin, > > > > Some comments: > > 1. I agree we should set "top-level" errors for metadata response > > > > 2. In the "brokers" fie

[jira] [Resolved] (KAFKA-15135) RLM listener configurations passed but ignored by RLMM

2023-07-02 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-15135. --- Fix Version/s: 3.6.0 Resolution: Fixed > RLM listener configurations passed but igno

[jira] [Resolved] (KAFKA-8982) Admin.deleteRecords should retry when failing to fetch metadata

2023-07-02 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-8982. -- Fix Version/s: 3.6.0 Resolution: Fixed > Admin.deleteRecords should retry when failing to fe

<    1   2   3   4   5   6   7   8   9   10   >