Re: apply for permission to contribute to Apache Kafka

Thanks, After obtaining permission, I want to assign this JIRA ticket to myself, but there's no 「Assign」 button for me. [image:

Re: [DISCUSS] KIP-926: introducing acks=min.insync.replicas config

Hi Luke, As discussed in the other KIP, there are some subtleties when it comes to the semantics of the system if we don't wait for all members of the isr before we ack. I don't understand why you say the leader election question is out of scope - it seems to be a core aspect to me. Ismael On

Re: [DISCUSS] KIP-926: introducing acks=min.insync.replicas config

Hi Ismael, No, I didn't know about this similar KIP! I hope I've known that so that I don't need to spend time to write it again! :( I checked the KIP and all the discussions (here ). I think the consensus is that adding a

Re: [DISCUSS] KIP-925: rack aware task assignment in Kafka Streams

Hello Hao, First of all, THANK YOU for putting this together. I had been hoping someone might bring something like this forward. A few comments: **1: Runtime Complexity > Klein’s cycle canceling algorithm can solve the min-cost flow problem in O(E^2CU) time where C is max cost and U is max

Re: [DISCUSS] KIP-926: introducing acks=min.insync.replicas config

Hi Luke, Are you aware of https://cwiki.apache.org/confluence/display/KAFKA/KIP-250+Add+Support+for+Quorum-based+Producer+Acknowledgment ? Ismael On Tue, May 9, 2023 at 10:14 PM Luke Chen wrote: > Hi all, > > I'd like to start a discussion for the KIP-926: introducing >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.3 #175

See

Re: [DISCUSS] KIP-926: introducing acks=min.insync.replicas config

Hi Justine, Thanks for the comment. Yes, I know we have a configuration min.insync.replicas to avoid this case. And actually, that's my following paragraph is talking about. Please let me know if you have other comments. Thanks Luke Justine Olshan 於 2023年5月10日 週三 上午1:01 寫道： > Hey Luke, > > I

[jira] [Created] (KAFKA-14981) Set `group.instance.id` in streams consumer so that rebalance will not happen if a instance is restarted

Hao Li created KAFKA-14981: -- Summary: Set `group.instance.id` in streams consumer so that rebalance will not happen if a instance is restarted Key: KAFKA-14981 URL: https://issues.apache.org/jira/browse/KAFKA-14981

[DISCUSS] KIP-925: rack aware task assignment in Kafka Streams

Hi all, I have submitted KIP-925 to add rack awareness logic in task assignment in Kafka Streams and would like to start a discussion: https://cwiki.apache.org/confluence/display/KAFKA/KIP-925%3A+Rack+aware+task+assignment+in+Kafka+Streams -- Thanks, Hao

Call for Presentations, Community Over Code 2023

(Note: You are receiving this because you are subscribed to the dev@ list for one or more Apache Software Foundation projects.) The Call for Presentations (CFP) for Community Over Code (formerly Apachecon) 2023 is open at https://communityovercode.org/call-for-presentations/, and will close Thu,

Re: [DISCUSS] Apache Kafka 3.5.0 release

Hey Mickael, I noticed a bug in the new versioned key-value byte store where it's delegating to the wrong API (copy/paste error I assume). I extracted this into its own PR which I think should be included in the 3.5 release. The tests are still running, but it's just a one-liner so I'll merge it

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.3 #174

See

Re: [DISCUSS] Apache Kafka 3.5.0 release

Thanks, Mickael. I've cherry-picked that commit to the `3.5` branch ( https://issues.apache.org/jira/browse/KAFKA-14974). Best regards, Randall On Tue, May 9, 2023 at 2:13 PM Mickael Maison wrote: > Hi Randall/Luke, > > Yes you can go ahead and merge these into 3.5. I've not started making >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1832

See

Re: [DISCUSS] Apache Kafka 3.5.0 release

Hi Randall/Luke, Yes you can go ahead and merge these into 3.5. I've not started making a release yet because: - I found a regression today in MirrorMaker: https://issues.apache.org/jira/browse/KAFKA-14980 - The 3.5 branch builder job in Jenkins has been disabled:

Re: [DISCUSS] Apache Kafka 3.5.0 release

Hi Mickael, Since we haven't had the CR created yet, I'm thinking we should backport this doc improvement to v3.5.0 to make the doc complete. https://github.com/apache/kafka/pull/13660 What do you think? Luke On Sat, May 6, 2023 at 11:31 PM David Arthur wrote: > I resolved these three: > *

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1828

See Changes: -- [...truncated 566880 lines...] [Pipeline] } [Pipeline] // stage [Pipeline] } Failed in branch JDK 11 and Scala 2.13 [2023-05-08T18:03:54.224Z]

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1830

See

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1829

See

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1825

See Changes: -- [...truncated 470690 lines...] [2023-05-08T05:30:27.978Z] [2023-05-08T05:30:27.978Z] Gradle Test Run :streams:integrationTest > Gradle Test Executor 181

Re: KafkaConsumer refactor proposal

Hey Divij, Firstly, THANK YOU for reaching out and providing the feedback. At this moment, I don't have all of the answers to your questions at the moment, but I hope my responses could be helpful in moving the project forward. 1. There isn't a prioritization strategy, and the network request

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.4 #124

See

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1826

See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.4 #125

See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1831

See

Re: apply for permission to contribute to Apache Kafka

Done. Thanks. Luke On Sat, May 6, 2023 at 9:38 PM Doe John wrote: > my Jira ID: johndoe > > on email zh2725284...@gmail.com > > Thanks! >

Re: [DISCUSS] KIP-926: introducing acks=min.insync.replicas config

Hey Luke, I was taking a quick pass over the KIP and saw this line: >It looks perfect. But there's a caveat here. Like the doc said, acks=all will "wait for the *full set of in-sync replicas *to acknowledge the record", so if there's only 1 replica in in-sync replicas, it will have the same

Re: KafkaConsumer refactor proposal

Hey Philip Thank you for writing this down. Overall, the ideal of decoupling the responsibility amongst threads and communication using queues looks good. I have a few questions associated with handling failure scenarios. 1. I observed that there is no concept of prioritization in the

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1827

See

[DISCUSS] KIP-926: introducing acks=min.insync.replicas config

Hi all, I'd like to start a discussion for the KIP-926: introducing acks=min.insync.replicas config. This KIP is to introduce `acks=min.insync.replicas` config value in producer, to improve the write throughput and still guarantee high durability. Please check the link for more detail:

Re: [DISCUSS] Apache Kafka 3.5.0 release

Hi, Mickael. Would it be okay for me to merge the commit from https://github.com/apache/kafka/pull/13688 to the 3.5 branch? This brings back two methods to maintain backward compatibility to the KafkaBasedLog class (https://issues.apache.org/jira/browse/KAFKA-14974), which were refactored in Feb

[jira] [Created] (KAFKA-14980) MirrorMaker consumers don't get configs prefixed with source.cluster

Mickael Maison created KAFKA-14980: -- Summary: MirrorMaker consumers don't get configs prefixed with source.cluster Key: KAFKA-14980 URL: https://issues.apache.org/jira/browse/KAFKA-14980 Project:

[jira] [Created] (KAFKA-14979) Incorrect lag was calculated when markPartitionsForTruncation in ReplicaAlterLogDirsThread

hudeqi created KAFKA-14979: -- Summary: Incorrect lag was calculated when markPartitionsForTruncation in ReplicaAlterLogDirsThread Key: KAFKA-14979 URL: https://issues.apache.org/jira/browse/KAFKA-14979

[jira] [Created] (KAFKA-14978) ExactlyOnceWorkerSourceTask does not remove parent metrics

Daniel Urban created KAFKA-14978: Summary: ExactlyOnceWorkerSourceTask does not remove parent metrics Key: KAFKA-14978 URL: https://issues.apache.org/jira/browse/KAFKA-14978 Project: Kafka