Re: [DISCUSS] KIP-975 Docker Image for Apache Kafka

Hi Krishna, Looks like you sent the response to me and not the mailing list, please include the mailing list in the replies. Comments below. On Mon, Sep 25, 2023 at 11:45 AM Krishna Agarwal < krishna0608agar...@gmail.com> wrote: > Hi Ismael, > Thanks for the questions. > >1. We intend to

[GitHub] [kafka-site] tombentley commented on pull request #410: KAFKA-13882 Docker to preview docs locally

tombentley commented on PR #410: URL: https://github.com/apache/kafka-site/pull/410#issuecomment-173498 @mimaison are you happy with the latest changes which don't touch the `.htaccess`? While I think the duplication is not _ideal_, this change would make it easier docs contributors.

[GitHub] [kafka-site] tombentley commented on a diff in pull request #410: KAFKA-13882 Docker to preview docs locally

tombentley commented on code in PR #410: URL: https://github.com/apache/kafka-site/pull/410#discussion_r1336588112 ## start-preview.sh: ## @@ -0,0 +1,7 @@ +#!/usr/bin/env bash + +set -euxo pipefail + +docker build -t kafka-site-preview . + +docker run -it --rm --name mypreview

[jira] [Created] (KAFKA-15505) MM2 consumer group subscription different on target cluster

Srinivas Boga created KAFKA-15505: - Summary: MM2 consumer group subscription different on target cluster Key: KAFKA-15505 URL: https://issues.apache.org/jira/browse/KAFKA-15505 Project: Kafka

Re: [kafka-clients] [VOTE] 3.6.0 RC1

Hi Jose, Sounds good to me. Let's have further discussion in JIRA/PR, and target to v3.6.1/v3.7.0. Thanks. Luke On Tue, Sep 26, 2023 at 1:35 AM José Armando García Sancio wrote: > On Sat, Sep 23, 2023 at 3:08 AM Luke Chen wrote: > > > > Hi Satish, > > > > I found the current KRaft

[GitHub] [kafka-site] jolshan merged pull request #553: MINOR: Update Justine to add PMC member

jolshan merged PR #553: URL: https://github.com/apache/kafka-site/pull/553 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka-site] jolshan opened a new pull request, #553: MINOR: Update Justine to add PMC member

jolshan opened a new pull request, #553: URL: https://github.com/apache/kafka-site/pull/553 Updating the site to reflect the change. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [DISCUSS] KIP-966: Eligible Leader Replicas

Hi Jun Thanks for the comments. 40. If we change to None, it is not guaranteed for no data loss. For users who are not able to validate the data with external resources, manual intervention does not give a better result but a loss of availability. So practically speaking, the Balance mode would

Re: [DISCUSS] KIP-966: Eligible Leader Replicas

On Mon, Sep 25, 2023, at 15:48, Jun Rao wrote: > Hi, Calvin, > > Thanks for the updated KIP. Made another pass. A few more comments below. > > 40. unclean.leader.election.enable.false -> > unclean.recovery.strategy.Balanced: The Balanced mode could still lead to > data loss. So, I am wondering if

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.6 #68

See

Re: [DISCUSS] KIP-966: Eligible Leader Replicas

Hi, Calvin, Thanks for the updated KIP. Made another pass. A few more comments below. 40. unclean.leader.election.enable.false -> unclean.recovery.strategy.Balanced: The Balanced mode could still lead to data loss. So, I am wondering if unclean.leader.election.enable.false should map to None?

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2230

See Changes: -- [...truncated 313958 lines...] Gradle Test Run :streams:test > Gradle Test Executor 82 > TasksTest >

[jira] [Created] (KAFKA-15504) Upgrade snappy java to version 1.1.10.4

Said BOUDJELDA created KAFKA-15504: -- Summary: Upgrade snappy java to version 1.1.10.4 Key: KAFKA-15504 URL: https://issues.apache.org/jira/browse/KAFKA-15504 Project: Kafka Issue Type:

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.6 #67

See

Re: [VOTE] KIP-858: Handle JBOD broker disk failure in KRaft

Hi Ron, I think we can generalize the deconfigured directory scenario in your last question to address this situation too. When handling a broker registration request, the controller can check if OfflineLogDirs=false and any UUIDs are missing in OnlineLogDirs, compared with the previous

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2229

See Changes: -- [...truncated 314834 lines...] Gradle Test Run :streams:test > Gradle Test Executor 88 > TasksTest >

Re: [DISCUSS] KIP-975 Docker Image for Apache Kafka

Hi Viktor, Thanks for the questions. 1. While the docker image outlined in KIP-975 is designed for production environments, it is equally suitable for development and testing purposes. We will furnish the docker image, allowing users the flexibility to employ it according to their

[jira] [Created] (KAFKA-15503) CVE-2023-40167, CVE-2023-36479 - Upgrade jetty to 9.4.52, 10.0.16, 11.0.16, 12.0.1

Satish Duggana created KAFKA-15503: -- Summary: CVE-2023-40167, CVE-2023-36479 - Upgrade jetty to 9.4.52, 10.0.16, 11.0.16, 12.0.1 Key: KAFKA-15503 URL: https://issues.apache.org/jira/browse/KAFKA-15503

Re: [kafka-clients] [VOTE] 3.6.0 RC1

On Sat, Sep 23, 2023 at 3:08 AM Luke Chen wrote: > > Hi Satish, > > I found the current KRaft implementation will have "split brain" issue when > network partition happens, which will cause inconsistent metadata returned > from the controller. > Filed KAFKA-15489

[jira] [Resolved] (KAFKA-15117) SslTransportLayerTest.testValidEndpointIdentificationCN fails with Java 20 & 21

[ https://issues.apache.org/jira/browse/KAFKA-15117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-15117. Reviewer: Rajini Sivaram Resolution: Fixed >

Re: [DISCUSS] KIP-983: Full speed async processing during rebalance

Hi Viktor, Good questions! 1. Auto-commits would only work with approach 1 in the KIP. Any async solution is incompatible with auto-commits. Do you think the text will improve when this is mentioned? 2. That is entirely correct. If you use async commits you can await completion by doing a

[GitHub] [kafka-site] mimaison merged pull request #552: Add Kafka Connect book

mimaison merged PR #552: URL: https://github.com/apache/kafka-site/pull/552 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Created] (KAFKA-15502) Handle large keystores in SslEngineValidator

Manikumar created KAFKA-15502: - Summary: Handle large keystores in SslEngineValidator Key: KAFKA-15502 URL: https://issues.apache.org/jira/browse/KAFKA-15502 Project: Kafka Issue Type: Bug

Re: [kafka-clients] [VOTE] 3.6.0 RC1

Thanks Luke for reporting the High CVE issue. Ismael also confirmed that High CVEs are generally considered as release blockers. Agree with all that we should consider this CVE as a release blocker. We will include other CVE also with the next RC. ~Satish. On Mon, 25 Sept 2023 at 03:04, Luke

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2228

See

Re: [DISCUSS] KIP-983: Full speed async processing during rebalance

Hi Erik, I'm still trying to wrap my head around the KIP, however I have a few questions that weren't clear to me regarding offset commits: 1. Would auto-commits interfere with the behavior defined in your KIP or would it work the same as manual commits? 2. As I see you don't separate offset

Re: [ANNOUNCE] New Kafka PMC Member: Justine Olshan

Congratulations, Justine! Regards, Rajini On Mon, Sep 25, 2023 at 9:40 AM Lucas Brutschy wrote: > Congrats, Justine! > > On Mon, Sep 25, 2023 at 9:20 AM Bruno Cadonna wrote: > > > > Congrats, Justine! Well deserved! > > > > Best, > > Bruno > > > > On 9/25/23 5:28 AM, ziming deng wrote: > > >

[jira] [Resolved] (KAFKA-15485) Support building with Java 21 (LTS release)

[ https://issues.apache.org/jira/browse/KAFKA-15485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-15485. - Resolution: Fixed > Support building with Java 21 (LTS release) >

[jira] [Created] (KAFKA-15501) Kafka to KRaft combined mode migration v3.5

Ritvik Gupta created KAFKA-15501: Summary: Kafka to KRaft combined mode migration v3.5 Key: KAFKA-15501 URL: https://issues.apache.org/jira/browse/KAFKA-15501 Project: Kafka Issue Type:

[GitHub] [kafka-site] mimaison opened a new pull request, #552: Add Kafka Connect book

mimaison opened a new pull request, #552: URL: https://github.com/apache/kafka-site/pull/552 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[jira] [Created] (KAFKA-15500) Code bug in SslPrincipalMapper.java

Svyatoslav created KAFKA-15500: -- Summary: Code bug in SslPrincipalMapper.java Key: KAFKA-15500 URL: https://issues.apache.org/jira/browse/KAFKA-15500 Project: Kafka Issue Type: Bug

[GitHub] [kafka-site] lucasbru merged pull request #551: MINOR: Add Lucas Brutschy to committers

lucasbru merged PR #551: URL: https://github.com/apache/kafka-site/pull/551 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Created] (KAFKA-15499) Fix the flaky DeleteSegmentsDueToLogStartOffsetBreachTest

Kamal Chandraprakash created KAFKA-15499: Summary: Fix the flaky DeleteSegmentsDueToLogStartOffsetBreachTest Key: KAFKA-15499 URL: https://issues.apache.org/jira/browse/KAFKA-15499 Project:

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.6 #66

See

Re: [kafka-clients] [VOTE] 3.6.0 RC1

Hi Divij, About the system tests, it's me helping Satish working on it since our team has internal jenkins pipeline for it. Here's the result: https://drive.google.com/drive/folders/1S2XYd79f6_AeWj9f9qEkliRg7JtL04AC?usp=sharing I'm mainly focusing on the failed tests. For kraft_upgrade_test,

Re: [DISCUSS] KIP-963: Upload and delete lag metrics in Tiered Storage

Hi Christo, Thank you for writing the KIP. I recently raised a PR to add metrics for tracking remote segment deletions (https://github.com/apache/kafka/pull/14375) but realised those metrics were not mentioned in the original KIP-405 or KIP-930. Do you think these would make sense to be added to

[GitHub] [kafka-site] lucasbru opened a new pull request, #551: MINOR: Add Lucas Brutschy to committers

lucasbru opened a new pull request, #551: URL: https://github.com/apache/kafka-site/pull/551 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [ANNOUNCE] New Kafka PMC Member: Justine Olshan

Congrats, Justine! On Mon, Sep 25, 2023 at 9:20 AM Bruno Cadonna wrote: > > Congrats, Justine! Well deserved! > > Best, > Bruno > > On 9/25/23 5:28 AM, ziming deng wrote: > > Congratulations Justine! > > > > > >> On Sep 25, 2023, at 00:01, Viktor Somogyi-Vass > >> wrote: > >> > >> Congrats

[jira] [Created] (KAFKA-15498) [CVE fix] Upgrade Snappy-Java to 1.1.10.4

Divij Vaidya created KAFKA-15498: Summary: [CVE fix] Upgrade Snappy-Java to 1.1.10.4 Key: KAFKA-15498 URL: https://issues.apache.org/jira/browse/KAFKA-15498 Project: Kafka Issue Type: Bug

Re: [kafka-clients] [VOTE] 3.6.0 RC1

Correction: posted the wrong JIRA in my previous email. Instead of https://issues.apache.org/jira/browse/KAFKA-15001, please consider this https://issues.apache.org/jira/browse/KAFKA-15487 -- Divij Vaidya On Mon, Sep 25, 2023 at 10:04 AM Divij Vaidya wrote: > > Hi Satish > > 1. I agree with

Re: [kafka-clients] [VOTE] 3.6.0 RC1

Hi Satish 1. I agree with Luke. It's a "high" severity vulnerability and we should create another RC with the upgraded Snappy version. If we create another RC, we should also fix a different CVE resported in https://issues.apache.org/jira/browse/KAFKA-15001 2. I was hoping you could post the

Re: [ANNOUNCE] New Kafka PMC Member: Justine Olshan

Congrats, Justine! Well deserved! Best, Bruno On 9/25/23 5:28 AM, ziming deng wrote: Congratulations Justine! On Sep 25, 2023, at 00:01, Viktor Somogyi-Vass wrote: Congrats Justine! On Sun, Sep 24, 2023, 17:45 Kirk True wrote: Congratulations Justine! Thanks for all your great work!

Re: [kafka-clients] [VOTE] 3.6.0 RC1

Hi Satish, Snappy-java published a new vulnerability that will cause OOM error in the server. Kafka is also impacted by this vulnerability since it's like CVE-2023-34455

Re: [kafka-clients] [VOTE] 3.6.0 RC1

Thanks to everyone who voted for this release. We have 2 +1 PMC votes and 3 +1 non-binding votes. We are past the deadline. Please try RC1 and send your vote to this email thread. Thanks, Satish. On Sun, 24 Sept 2023 at 13:23, Justine Olshan wrote: > > Hi Satish, > > I've done the following: