Re: [DISCUSS] KIP-1004: Enforce tasks.max property in Kafka Connect

Hi Chris, Thanks for the well written and comprehensive KIP! Given that we're already past the KIP freeze deadline for 3.7.0 ( https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+3.7.0) and there may not be a 3.8.0 release before the 4.0.0 release, would we then be forced to punt the

Re: [DISCUSS] Road to Kafka 4.0

On Tue, Nov 21, 2023, at 19:30, Luke Chen wrote: > Yes, KIP-853 and disk failure support are both very important missing > features. For the disk failure support, I don't think this is a > "good-to-have-feature", it should be a "must-have" IMO. We can't announce > the 4.0 release without a good

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2409

See

Re: Apache Kafka 3.6.1 release

Hi Mickael, Is there still time to put in another fix? I'd like to propose we include https://issues.apache.org/jira/browse/KAFKA-15817. Thanks, Kirk On Fri, Nov 17, 2023, at 6:15 AM, Mickael Maison wrote: > Hi, > > Quick update on 3.6.1: > We have 1 blocker issue left: KAFKA-15802. Once it's

Re: [DISCUSS] KIP-974 Docker Image for GraalVM based Native Kafka Broker

Hi Krishna, I am still finding it difficult to evaluate this choice. A couple of things would help: 1. How much smaller is the alpine image compared to the best alternative? 2. Is there any performance impact of going with Alpine? Ismael On Wed, Nov 22, 2023, 8:42 AM Krishna Agarwal wrote:

Re: [VOTE] KIP-974: Docker Image for GraalVM based Native Kafka Broker

Hi, +1 (non binding) Thanks On Wed, Nov 22, 2023 at 3:16 PM Manikumar wrote: > > Hi Krishna, > > Thanks for KIP. +1 (binding). > > > Thanks, > Manikumar > > On Mon, Nov 20, 2023 at 11:57 AM Krishna Agarwal < > krishna0608agar...@gmail.com> wrote: > > > Hi, > > I'd like to call a vote on

[DISCUSS] KIP-996: Pre-Vote

Hey folks, Starting a discussion thread for Pre-Vote design. Appreciate your comments in advance! https://cwiki.apache.org/confluence/display/KAFKA/KIP-996%3A+Pre-Vote Best, Alyssa

[jira] [Created] (KAFKA-15888) DistributedHerder log context should not use the same client ID for each Connect worker by default

Yash Mayya created KAFKA-15888: -- Summary: DistributedHerder log context should not use the same client ID for each Connect worker by default Key: KAFKA-15888 URL: https://issues.apache.org/jira/browse/KAFKA-15888

[jira] [Created] (KAFKA-15887) Autocommit during close consistently fails with exception in background thread

Lucas Brutschy created KAFKA-15887: -- Summary: Autocommit during close consistently fails with exception in background thread Key: KAFKA-15887 URL: https://issues.apache.org/jira/browse/KAFKA-15887

Re: [DISCUSS] KIP-939: Support Participation in 2PC

Hi Justine, After thinking a bit about supporting atomic dual writes for Kafka + NoSQL database, I came to a conclusion that we do need to bump the epoch even with InitProducerId(keepPreparedTxn=true). As I described in my previous email, we wouldn't need to bump the epoch to protect from

Re: [VOTE] 3.5.2 RC1

Hi Luke, - Compiled from source (Java 17 and Scala 2.13) - Ran unit and integration tests - Ran custom client apps using staging artifacts +1 (non binding) Thanks Fede On Wed, Nov 22, 2023 at 2:44 PM Josep Prat wrote: > > Hi Luke, > > Thanks for running the release. > I did the following: > -

Re: [DISCUSS] KIP-974 Docker Image for GraalVM based Native Kafka Broker

Hi Ismael, Thanks for the feedback. The alpine image does present a few drawbacks, such as the use of musl libc instead of glibc, the absence of bash, and reliance on the less popular package manager "apk". Considering the advantage of a smaller image size and installing the missing

[jira] [Created] (KAFKA-15886) Always specify directories for new partition registrations

Igor Soarez created KAFKA-15886: --- Summary: Always specify directories for new partition registrations Key: KAFKA-15886 URL: https://issues.apache.org/jira/browse/KAFKA-15886 Project: Kafka

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.6 #118

See Changes: -- [...truncated 307496 lines...] Gradle Test Run :core:test > Gradle Test Executor 90 > KafkaZkClientTest > testDeleteTopicZNode() PASSED Gradle Test Run

Re: [DISCUSS] KIP-974 Docker Image for GraalVM based Native Kafka Broker

Hi, One question I have is regarding the choice to use alpine - it would be good to clarify if there are downsides (the upside was explained - images are smaller). Ismael On Fri, Sep 8, 2023, 12:17 AM Krishna Agarwal wrote: > Hi, > I want to submit a KIP to deliver an experimental Apache

[jira] [Created] (KAFKA-15885) Reduce lock contention when cleaning topics

Krzysztof Piecuch created KAFKA-15885: - Summary: Reduce lock contention when cleaning topics Key: KAFKA-15885 URL: https://issues.apache.org/jira/browse/KAFKA-15885 Project: Kafka Issue

[jira] [Created] (KAFKA-15884) Reduce lock contention when cleaning topics

Krzysztof Piecuch created KAFKA-15884: - Summary: Reduce lock contention when cleaning topics Key: KAFKA-15884 URL: https://issues.apache.org/jira/browse/KAFKA-15884 Project: Kafka Issue

[jira] [Resolved] (KAFKA-7631) NullPointerException when SCRAM is allowed bu ScramLoginModule is not in broker's jaas.conf

[ https://issues.apache.org/jira/browse/KAFKA-7631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson resolved KAFKA-7631. - Resolution: Fixed Marking as resolved since I believe it is. > NullPointerException when SCRAM

Re: [VOTE] KIP-974: Docker Image for GraalVM based Native Kafka Broker

Hi Krishna, Thanks for KIP. +1 (binding). Thanks, Manikumar On Mon, Nov 20, 2023 at 11:57 AM Krishna Agarwal < krishna0608agar...@gmail.com> wrote: > Hi, > I'd like to call a vote on KIP-974 which aims to publish a docker image for > GraalVM based Native Kafka Broker. > > KIP - > >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2408

See

[jira] [Created] (KAFKA-15883) Implement RemoteCopyLagBytes

Christo Lolov created KAFKA-15883: - Summary: Implement RemoteCopyLagBytes Key: KAFKA-15883 URL: https://issues.apache.org/jira/browse/KAFKA-15883 Project: Kafka Issue Type: Sub-task

Re: [VOTE] 3.5.2 RC1

Hi Luke, Thanks for running the release. I did the following: - Verified artifact's signatures and hashes - Checked JavaDoc (with navigation to Oracle JavaDoc) - Compiled source code - Run unit tests and integration tests - Run getting started with ZK and KRaft It gets a +1 from my side

[jira] [Created] (KAFKA-15882) Scheduled nightly github actions workflow for CVE reports on published docker images

Vedarth Sharma created KAFKA-15882: -- Summary: Scheduled nightly github actions workflow for CVE reports on published docker images Key: KAFKA-15882 URL: https://issues.apache.org/jira/browse/KAFKA-15882

[jira] [Created] (KAFKA-15881) Update release.py script to include docker image

Vedarth Sharma created KAFKA-15881: -- Summary: Update release.py script to include docker image Key: KAFKA-15881 URL: https://issues.apache.org/jira/browse/KAFKA-15881 Project: Kafka Issue

[jira] [Created] (KAFKA-15880) Add github actions workflow for promoting RC docker image

Vedarth Sharma created KAFKA-15880: -- Summary: Add github actions workflow for promoting RC docker image Key: KAFKA-15880 URL: https://issues.apache.org/jira/browse/KAFKA-15880 Project: Kafka

[jira] [Created] (KAFKA-15879) Add documentation for the Docker image

Vedarth Sharma created KAFKA-15879: -- Summary: Add documentation for the Docker image Key: KAFKA-15879 URL: https://issues.apache.org/jira/browse/KAFKA-15879 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-15878) KIP-768: Extend support for opaque (i.e. non-JWT) tokens in SASL/OAUTHBEARER

Anuj Sharma created KAFKA-15878: --- Summary: KIP-768: Extend support for opaque (i.e. non-JWT) tokens in SASL/OAUTHBEARER Key: KAFKA-15878 URL: https://issues.apache.org/jira/browse/KAFKA-15878 Project:

Re: How Kafka handle partition leader change?

If you want to understand how the replication protocol works, how it can be configured for consistency, how it can be configured for availability then I have written up a more formal description of the protocol and written TLA+ specifications. These should answer most of your questions and if not,

[DISCUSS] KIP-1007: Introduce Remote Storage Not Ready Exception

Hi, I would like to start a discussion to introduce a new error code for retriable remote storage errors. Please take a look at the proposal: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1007%3A+Introduce+Remote+Storage+Not+Ready+Exception

[jira] [Created] (KAFKA-15877) Support change of temporality in Java client

Apoorv Mittal created KAFKA-15877: - Summary: Support change of temporality in Java client Key: KAFKA-15877 URL: https://issues.apache.org/jira/browse/KAFKA-15877 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-15876) Introduce Remote Storage Not Ready Exception

Kamal Chandraprakash created KAFKA-15876: Summary: Introduce Remote Storage Not Ready Exception Key: KAFKA-15876 URL: https://issues.apache.org/jira/browse/KAFKA-15876 Project: Kafka

Re: [DISCUSS] KIP-974 Docker Image for GraalVM based Native Kafka Broker

Hi Justine, Thanks for the feedback. 1. I have added the name of the other image in the KIP. 2. By experimental we mean the docker image is intended for local development and testing usage. GraalVM Native-Image tool is still in maturing stage, hence the usage of this image for

[DISCUSS] KIP-956: Tiered Storage Quotas

Hi All, I have created KIP-956 for defining read and write quota for tiered storage. https://cwiki.apache.org/confluence/display/KAFKA/KIP-956+Tiered+Storage+Quotas Feedback and suggestions are welcome. Regards, Abhijeet.

Re: [DISCUSS] Should we continue to merge without a green build? No!

I think it breaks the Jenkins output otherwise. Feel free to test it via a PR. Ismael On Wed, Nov 22, 2023, 12:42 AM David Jacot wrote: > Hi Ismael, > > No, I was not aware of KAFKA-12216. My understanding is that we could still > do it without the JUnitFlakyTestDataPublisher plugin and we

[jira] [Created] (KAFKA-15875) Snapshot class is package protected but returned in public methods

Josep Prat created KAFKA-15875: -- Summary: Snapshot class is package protected but returned in public methods Key: KAFKA-15875 URL: https://issues.apache.org/jira/browse/KAFKA-15875 Project: Kafka

Re: [DISCUSS] Should we continue to merge without a green build? No!

Hi Ismael, No, I was not aware of KAFKA-12216. My understanding is that we could still do it without the JUnitFlakyTestDataPublisher plugin and we could use gradle enterprise for this. Or do you think that reporting the flaky tests in the build results is required? David On Wed, Nov 22, 2023 at

Re: [DISCUSS] Should we continue to merge without a green build? No!

Hi David, Did you take a look at https://issues.apache.org/jira/browse/KAFKA-12216? I looked into this option already (yes, there isn't much that we haven't considered in this space). Ismael On Wed, Nov 22, 2023 at 12:24 AM David Jacot wrote: > Hi all, > > Thanks for the good discussion and

Re: [DISCUSS] Should we continue to merge without a green build? No!

Hi all, Thanks for the good discussion and all the comments. Overall, it seems that we all agree on the bad state of our CI. That's a good first step! I have talked to a few folks this week about it and it seems that many folks (including me) are not comfortable with merging PRs at the moment