Re: [DISCUSS] Apache Kafka 3.4.0 release

Hey all! It's officially *feature freeze for 3.4* so make sure you get that feature work merged by the end of today. After this point, only bug fixes and other work focused on stabilizing the release should be merged to the release branch. Also note that the *3.4 code freeze* will be in one week

[jira] [Created] (KAFKA-14430) optimize: -Dcom.sun.management.jmxremote.rmi.port=$JMX_PORT

jianbin.chen created KAFKA-14430: Summary: optimize: -Dcom.sun.management.jmxremote.rmi.port=$JMX_PORT Key: KAFKA-14430 URL: https://issues.apache.org/jira/browse/KAFKA-14430 Project: Kafka

Re: [DISCUSS] KIP-892: Transactional Semantics for StateStores

Nick, Thank you for the explanation, and also for the updated KIP. I am quite eager for this improvement to be released as it would greatly reduce the operational difficulties of EOS streams apps. Two questions: 10) >When reading records, we will use the WriteBatchWithIndex#getFromBatchAndDB

Re: [DISCUSS] KIP-890 Server Side Defense

Hi Justine, I think the interesting part is not in this logic (because it tries to figure out when UNKNOWN_PRODUCER_ID is retriable and if it's retryable, it's definitely not fatal), but what happens when this logic doesn't return 'true' and falls through. In the old clients it seems to be

[jira] [Created] (KAFKA-14429) Move OffsetStorageReader from storage package to source package

Greg Harris created KAFKA-14429: --- Summary: Move OffsetStorageReader from storage package to source package Key: KAFKA-14429 URL: https://issues.apache.org/jira/browse/KAFKA-14429 Project: Kafka

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1389

See Changes: -- [...truncated 513956 lines...] [2022-11-30T22:08:32.598Z] [2022-11-30T22:08:32.598Z] 3: Task failed with an exception. [2022-11-30T22:08:32.598Z]

Re: [DISCUSS] KIP-881: Rack-aware Partition Assignment for Kafka Consumers

I think it's reasonable for practical scenarios. Is it possible to turn off rack awareness in the clients in case the broker selector plugin is not compatible with rack-aware logic in the client? -Artem On Wed, Nov 30, 2022 at 2:46 AM Rajini Sivaram wrote: > Hi Artem, > > Understood your

[jira] [Created] (KAFKA-14428) Add Records, RPCs and Configs for KIP-866

David Arthur created KAFKA-14428: Summary: Add Records, RPCs and Configs for KIP-866 Key: KAFKA-14428 URL: https://issues.apache.org/jira/browse/KAFKA-14428 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-14427) Add support for ZK migration transactions

David Arthur created KAFKA-14427: Summary: Add support for ZK migration transactions Key: KAFKA-14427 URL: https://issues.apache.org/jira/browse/KAFKA-14427 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-14426) Add documentation for Kraft limtations that have open KIPs

Greg Harris created KAFKA-14426: --- Summary: Add documentation for Kraft limtations that have open KIPs Key: KAFKA-14426 URL: https://issues.apache.org/jira/browse/KAFKA-14426 Project: Kafka

Re: [DISCUSS] Apache Kafka 3.4.0 release

Sophie, KIP-866 has been accepted. Thanks! -David On Thu, Nov 17, 2022 at 12:21 AM Sophie Blee-Goldman wrote: > > Thanks for the update Rajini, I've added this to the release page since it > looks like > it will pass but of course if anything changes, just let me know. > > David, I'm fine with

Re: [VOTE] KIP-866 ZooKeeper to KRaft Migration

Hey everyone, I'm going to close out the vote. There were three +1 votes from PMC members and no committer or community votes. +1 PMC votes: * Colin McCabe * Jason Gustafson * Jun Rao With that, the vote passes. Thanks to everyone who reviewed this KIP! Cheers, David On Tue, Nov 29, 2022 at

Re: [DISCUSS] KIP-852 Optimize calculation of size for log in remote tier

Hi, Divij, Thanks for the reply. Point#2. My high level question is that is the new method needed for every implementation of remote storage or just for a specific implementation. The issues that you pointed out exist for the default implementation of RLMM as well and so far, the default

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1388

See

[GitHub] [kafka-site] bbejeck commented on pull request #462: Dream11 powered by Apache Kafka section added

bbejeck commented on PR #462: URL: https://github.com/apache/kafka-site/pull/462#issuecomment-1332641287 Merged into `asf-site` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [kafka-site] bbejeck merged pull request #462: Dream11 powered by Apache Kafka section added

bbejeck merged PR #462: URL: https://github.com/apache/kafka-site/pull/462 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [DISCUSS] KIP-892: Transactional Semantics for StateStores

Hi everyone, I've drastically reduced the scope of this KIP to no longer include the StateStore management of checkpointing. This can be added as a KIP later on to further optimize the consistency and performance of state stores. I've also added a section discussing some of the concerns around

Re: [VOTE] KIP-884: Add config to configure KafkaClientSupplier in Kafka Streams

Hi all, Thanks for the vote. The vote passed with 4 binding votes (John, Matthias, Sophie and Bruno). I'll update KIP and submit a PR for this. Thanks, Hao On Tue, Nov 22, 2022 at 11:08 PM Bruno Cadonna wrote: > Hi Hao, > > Thanks for the KIP! > > +1 (binding) > > Best, > Bruno > > On

[jira] [Resolved] (KAFKA-13731) Standalone Connect workers should not require connector configs to start

[ https://issues.apache.org/jira/browse/KAFKA-13731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-13731. --- Fix Version/s: 3.4.0 Resolution: Fixed > Standalone Connect workers should not

[jira] [Created] (KAFKA-14425) Automated protocol should support nullable structs

David Jacot created KAFKA-14425: --- Summary: Automated protocol should support nullable structs Key: KAFKA-14425 URL: https://issues.apache.org/jira/browse/KAFKA-14425 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-883: Add delete callback method to Connector API

Thanks for your feedback Chris, 1. I think the behavior should remain the same as it is today. The worker stops the connector when its configuration is updated, and if the update is a deletion, it won't start the connector again. If an error happens during stop() today, the statusListener will

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1387

See

[ANNOUNCE] Call for papers: Kafka Summit London 2023

Hi everyone, The call for papers (https://sessionize.com/kafka-summit-london-2023/) is now open for Kafka Summit London 2023, and you are all welcome to submit a talk. We are looking for the most interesting, most informative, most advanced, and most generally applicable talks on Apache Kafka®

Re: [DISCUSS] KIP-881: Rack-aware Partition Assignment for Kafka Consumers

Hi Artem, Understood your concern - brokers could use a replica selector that uses some other client metadata other than rack id to decide the preferred read replica, or just use the leader. In that case, consumers wouldn't really benefit from aligning partition assignment on rack ids. So the