Re: [DISCUSS] Apache Kafka 3.3.0 Release

Hi Jose, I just found the KIP-831 is not listed in the v3.3 planned KIPs. It is completed and merged. Please help add it. Thank you. Luke On Fri, Jul 22, 2022 at 4:56 AM Randall Hauch wrote: > Hi, Jose. > > Thanks for driving the 3.3.0 release. > > Chris E and Chris S both mentioned >

[VOTE] 3.2.1 RC3

Hello Kafka users, developers and client-developers, This is the first release candidate of Apache Kafka 3.2.1. This is a bugfix release with several fixes since the release of 3.2.0. A few of the major issues include: * KAFKA-14062 OAuth client token refresh fails with SASL extensions *

Re: [DISCUSS] KIP-853: KRaft Voters Change

Hi José, Thanks for the KIP! I have not had time to fully digest it, but I had some initial questions: 1. It seems like the proposal is to have a UUID per partition directory on the voter. If I understand correctly, this is sometimes referred to as "VoterUUID" and sometimes as "ReplicaUUID."

Re: [DISCUSS] KIP-854 Separate configuration for producer ID expiry

Hi Justine, Thanks for the well written KIP, this looks like it will be a useful addition. Overall the KIP looks good to me, I have one question/comment. You mentioned that setting the `producer.id.expiration.ms` less than the delivery timeout could lead to duplicates, which makes sense. To

Re: [DISCUSS] Website changes required for Apache projects

Hi All, I've filed an issue with INFRA ( https://issues.apache.org/jira/browse/INFRA-23499) to ask about uploading the videos to the ASF YouTube channel, which would resolve the branding issue. Thanks, Bill On Thu, Jul 21, 2022 at 1:43 PM Bill Bejeck wrote: > Hi Divij, > > First of all, let

Re: [DISCUSS] Apache Kafka 3.3.0 Release

Hi, Jose. Thanks for driving the 3.3.0 release. Chris E and Chris S both mentioned https://issues.apache.org/jira/browse/KAFKA-14079 in this thread a few days ago. This was deemed a critical bug fix for 3.2, and the PR for the `3.2` branch [1] has already been merged and is in the recently-cut

[DISCUSS] KIP-854 Separate configuration for producer ID expiry

Hey all! I'd like to start a discussion on my proposal to separate time-based producer ID expiration from transactional ID expiration by introducing a new configuration. The KIP Is pretty small and simple, but will be helpful in controlling memory usage in brokers -- especially now that by

[jira] [Created] (KAFKA-14097) Separate configuration for producer ID expiry

Justine Olshan created KAFKA-14097: -- Summary: Separate configuration for producer ID expiry Key: KAFKA-14097 URL: https://issues.apache.org/jira/browse/KAFKA-14097 Project: Kafka Issue

Re: [DISCUSS] KIP-853: KRaft Voters Change

Hi Jose, Thanks for getting this started. Some comments: - Regarding the removal of voters, when a leader appends a RemoveVoterRecord to its log, it immediately switches to the new configuration. There are two cases here: 1. The voter being removed is the leader itself. The KIP documents

[jira] [Created] (KAFKA-14096) Race Condition in Log Rolling Leading to Disk Failure

Eric Azama created KAFKA-14096: -- Summary: Race Condition in Log Rolling Leading to Disk Failure Key: KAFKA-14096 URL: https://issues.apache.org/jira/browse/KAFKA-14096 Project: Kafka Issue

Re: What are best practices for hosting content on project website?

Hello Divij, from a privacy perspective (only): videos should only load from google, when the user actively gives consent. Embedding it directly would transfer data to google. Usually you can achieve this by creating an image placeholder for that video and notifying the visitor, a click on it

Re: [DISCUSS] Website changes required for Apache projects

Hi Divij, First of all, let me say thanks for taking up this task. We seem to have two options: > 1. Replace videos on the website with links to the videos OR > 2. Take a placeholder image and use JS to trigger playback after the user > clicks. > > I would suggest going with option#1 right now

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.3 #13

See Changes: -- [...truncated 485789 lines...] [2022-07-21T17:26:39.860Z] [2022-07-21T17:26:39.860Z]

Re: [DISCUSS] Website changes required for Apache projects

Thanks, Divij, I'm glad you reached out to those two groups. I'm curious to see what they say. In response to your comment: > There is still an open question about how we decide what content gets added > and what doesn't. I would propose that the model should be the same as > accepting code

Re: [DISCUSS] KIP-853: KRaft Voters Change

Hey Jose -- this seems like an important KIP! And I enjoy seeing more Uuid usage :) I was curious a bit more about the motivation here. That section seems to be missing. Thanks for sharing the KIP! Justine On Thu, Jul 21, 2022 at 10:30 AM Niket Goel wrote: > Hey Jose, > > Thanks for the KIP.

Re: [DISCUSS] KIP-853: KRaft Voters Change

Hey Jose, Thanks for the KIP. This is a good improvement and will make the KRaft implementation much more robust in the face of failures and generally make it more flexible for users. I did a first pass through the KIP and here are some comments (some of these might just be a little

[jira] [Created] (KAFKA-14095) Improve handling of sync offset failures in MirrorMaker

Mickael Maison created KAFKA-14095: -- Summary: Improve handling of sync offset failures in MirrorMaker Key: KAFKA-14095 URL: https://issues.apache.org/jira/browse/KAFKA-14095 Project: Kafka

[DISCUSS] KIP-853: KRaft Voters Change

Hi all, I would like to start the discussion on my design to support dynamically changing the set of voters in the KRaft cluster metadata topic partition. KIP URL: https://cwiki.apache.org/confluence/x/nyH1D Thanks! -José

[jira] [Created] (KAFKA-14094) KIP-853: KRaft Voters Change

José Armando García Sancio created KAFKA-14094: -- Summary: KIP-853: KRaft Voters Change Key: KAFKA-14094 URL: https://issues.apache.org/jira/browse/KAFKA-14094 Project: Kafka

Re: [DISCUSS] Apache Kafka 3.2.1 release

Viktor, seeing as it's been on trunk for a while and is a very small change, it seems fine to include in this release. I just finished building the RC, but haven't started a vote thread yet. Good timing on your part :) I'll merge this PR shortly and start a new RC build. -David On Thu, Jul 21,

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1085

See Changes: -- [...truncated 569223 lines...] [2022-07-21T15:48:31.310Z] [INFO] --- maven-archetype-plugin:2.2:integration-test (default-integration-test) @

Re: [DISCUSS] Apache Kafka 3.2.1 release

Hi David, Found an issue (tight loop in the consumer), fixed it on trunk and backported it onto the 3.2 branch. Is it possible to include this in the 3.2.1 release? https://github.com/apache/kafka/pull/12417 Thanks, Viktor On Tue, Jul 19, 2022 at 5:57 PM Randall Hauch wrote: > Hi, Chris S and

Multi Module Transactions in Apache kafka and spring boot

Hi, Can you please share the links from where I can learn multi-module transaction handling in kafka and springboot. Best Regards, Ajinkya Waghdare. (8805330993) --

[GitHub] [kafka-site] bbejeck merged pull request #425: Adding moengage in powered-by

bbejeck merged PR #425: URL: https://github.com/apache/kafka-site/pull/425 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [DISCUSS] KIP-848: The Next Generation of the Consumer Rebalance Protocol

Hi David, So excited to see the consumer protocol will be renewed! Thanks for David, Guozhang, and Jason for creating this great proposal! Some comments about the protocol: 1. Will the member reconciling jump to the latest target assignment? For example, member epoch are A:1, B:2, but now the

[jira] [Created] (KAFKA-14093) Flaky ExactlyOnceSourceIntegrationTest.testFencedLeaderRecovery

Mickael Maison created KAFKA-14093: -- Summary: Flaky ExactlyOnceSourceIntegrationTest.testFencedLeaderRecovery Key: KAFKA-14093 URL: https://issues.apache.org/jira/browse/KAFKA-14093 Project: Kafka

What are best practices for hosting content on project website?

(cc: Apache Kafka dev mailing list) Hi folks We, at Apache Kafka, are discussing the best ways to host video content that we consider beneficial to our users. Currently, the video content is hosted on YouTube and embedded on our

Hosting videos on project website

(cc: dev mailing list for Apache Kafka) Hello folks We, at Apache Kafka community, are wondering about the legal feasibility of hosting educational content videos created by third party on our project website. 1. What permissions/license do we need from the video owners to host the videos

Re: [DISCUSS] Website changes required for Apache projects

Thanks for chiming in with your opinions John/Mickael. The current set of videos are very helpful and removing them might be a disservice to our users. The most ideal solution would be to host the videos on Apache servers without any branding. Another less than ideal solution would be to host a

[jira] [Created] (KAFKA-14092) Unsafe memory access operation exception leading to Error processing append operation on partition

swathi mocharla created KAFKA-14092: --- Summary: Unsafe memory access operation exception leading to Error processing append operation on partition Key: KAFKA-14092 URL:

[GitHub] [kafka-site] amrit-moengage commented on pull request #425: Adding moengage in powered-by

amrit-moengage commented on PR #425: URL: https://github.com/apache/kafka-site/pull/425#issuecomment-1191083293 @bbejeck [bbejeck](https://github.com/bbejeck) Rebased the branch, please get this merged. Thanks -- This is an automated message from the Apache Git Service. To respond to the