[jira] [Created] (KAFKA-16400) Update notification settings for cve detection scheduled workflow

2024-03-21 Thread Vedarth Sharma (Jira)
Vedarth Sharma created KAFKA-16400: -- Summary: Update notification settings for cve detection scheduled workflow Key: KAFKA-16400 URL: https://issues.apache.org/jira/browse/KAFKA-16400 Project: Kafka

[DISCUSS] KIP-942: Add Power(ppc64le) support

2024-03-21 Thread Vaibhav Nazare
Hi Team, We need to add an additional job for ppc64le at https://ci-builds.apache.org/job/Kafka/job/kafka/ using a new Jenkins file created specific for ppc64le PR: https://github.com/apache/kafka/pull/13817 We have updated the Jenkinfile.ppc64le with required changes to run builds daily on

Re: [VOTE] 3.6.2 RC1

2024-03-21 Thread Chia-Ping Tsai
hi Manikumar > Pls let me know after merging the PR. I will generate RC2 later today. Sure. We will complete it ASAP > Manikumar 於 2024年3月22日 上午9:26 寫道: > > Hi, > > Thanks. Since we have merged KAFKA-16342 > , it's probably better > to

Re: [VOTE] 3.6.2 RC1

2024-03-21 Thread Manikumar
Hi, Thanks. Since we have merged KAFKA-16342 , it's probably better to take the PR for KAFKA-16341 for consistency. I am canceling the RC1 in favour of including KAFKA-16341

Re:[DISCUSS] KIP-1028: Docker Official Image for Apache Kafka

2024-03-21 Thread Hector Geraldino (BLOOMBERG/ 919 3RD A)
Hi, What is the difference between this KIP and KIP-975: Docker Image for Apache Kafka? From: dev@kafka.apache.org At: 03/21/24 07:30:07 UTC-4:00To: dev@kafka.apache.org Subject: [DISCUSS] KIP-1028: Docker Official Image for Apache Kafka Hi everyone, I would like to start the discussion on

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.6 #161

2024-03-21 Thread Apache Jenkins Server
See Changes: -- [...truncated 412488 lines...] [2024-03-21T20:39:07.833Z] [2024-03-21T20:39:07.833Z] Gradle Test Run :core:test > Gradle Test Executor 91 >

Re: [DISCUSS] KIP-853: KRaft Controller Membership Changes

2024-03-21 Thread José Armando García Sancio
Hi Jun, On Thu, Mar 14, 2024 at 3:38 PM Jun Rao wrote: > 52. Admin client: Could you provide a bit more details on the changes? I updated the KIP to include the API changes to the Admin client. Thanks, -- -José

Re: [DISCUSS] KIP-1021: Allow to get last stable offset (LSO) in kafka-get-offsets.sh

2024-03-21 Thread Justine Olshan
Hey Ahmed, Echoing Andrew's comments to clean up the public interfaces, it was unclear to me if this new flag applies to all the options or just the "latest" option. Clarifying that and showing a few examples could help. Thanks, Justine On Thu, Mar 21, 2024 at 9:43 AM Andrew Schofield <

Re: [DISCUSS] KIP-1021: Allow to get last stable offset (LSO) in kafka-get-offsets.sh

2024-03-21 Thread Andrew Schofield
Hi, Glad to hear you’re better. Re-reading the KIP, I think the changes to the public interfaces are probably only the addition of the new `--isolation` flag on the `kafka-get-offsets.sh` tool. The `KafkaAdminClient.listOffsets` parameters already have what you need I think (OffsetSpec.LATEST

Re: [DISCUSS] KIP-932: Queues for Kafka

2024-03-21 Thread Justine Olshan
Thanks Andrew, That answers some of the questions I have. With respect to the limits -- how will this be implemented? One issue we saw with producers is "short-lived" producers that send one message and disconnect. Due to how expiration works for producer state, if we have a simple limit for

Re: [VOTE] 3.6.2 RC1

2024-03-21 Thread Chia-Ping Tsai
> Is this a regression from the 3.5.0 release? I believe the bug is existent for a while, but it is not a true issue until we allowed users to fetch offset of max timestamp. > Can we update the "Affects Version/s" field on JIRA? done. I attach the tags for active branches - 3.6.1 and 3.7.0

Re: [DISCUSS] KIP-1008: ParKa - the Marriage of Parquet and Kafka

2024-03-21 Thread Andrew Schofield
Hi Xinli, Thanks for the KIP. I see that the discussion thread has died down, which is often a tricky situation with a KIP. I’ve been thinking about this KIP for a while and it was really good to be able to attend the Kafka Summit London session to get a proper understanding of it. I think it’s

Re: [VOTE] 3.6.2 RC1

2024-03-21 Thread Manikumar
Hi Chia-Ping, Thanks for letting me know. Is this a regression from the 3.5.0 release? Can we update the "Affects Version/s" field on JIRA? Thanks, On Thu, Mar 21, 2024 at 5:06 PM Chia-Ping Tsai wrote: > hi Manikumar, > > There is a bug fix which needs to be backport to 3.6 ( >

[jira] [Resolved] (KAFKA-16206) KRaftMigrationZkWriter tries to delete deleted topic configs twice

2024-03-21 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-16206. Fix Version/s: 3.8.0 Resolution: Fixed > KRaftMigrationZkWriter tries to delete

Re: [DISCUSS] KIP-932: Queues for Kafka

2024-03-21 Thread Andrew Schofield
Hi Justine, Thanks for your comment. Sorry for the delay responding. It was not my intent to leave a query unanswered. I have modified the KIP as a result of the discussion and I think perhaps I didn’t neatly close off the email thread. In summary: * The share-partition leader does not

Re: [VOTE] 3.6.2 RC1

2024-03-21 Thread Chia-Ping Tsai
hi Manikumar, There is a bug fix which needs to be backport to 3.6 ( https://issues.apache.org/jira/browse/KAFKA-16341) It fixes the incorrect offset of max timestamp in non-compress path. The other paths are already fixed by https://issues.apache.org/jira/browse/KAFKA-16342. Personally, we

[DISCUSS] KIP-1028: Docker Official Image for Apache Kafka

2024-03-21 Thread Krish Vora
Hi everyone, I would like to start the discussion on https://cwiki.apache.org/confluence/display/KAFKA/KIP-1028%3A+Docker+Official+Image+for+Apache+Kafka . This KIP aims to introduce JVM based Docker Official Image (DOI) for Apache Kafka. Regards, Krish.

[jira] [Resolved] (KAFKA-16318) Add javadoc to KafkaMetric

2024-03-21 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-16318. --- Fix Version/s: 3.8.0 Resolution: Fixed > Add javadoc to KafkaMetric >

[VOTE] 3.6.2 RC1

2024-03-21 Thread Manikumar
Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 3.6.2. This is a bugfix release with several fixes, including dependency version bumps for CVEs. Release notes for the 3.6.2 release:

Re: [DISCUSS] Different retention semantics for active segment rotation

2024-03-21 Thread Jorge Esteban Quilcate Otoya
Sure! good to know that is tracked. Thanks, Luke! On Thu, 21 Mar 2024 at 07:52, Luke Chen wrote: > Hi Jorge, > > You should check the JIRA: > https://issues.apache.org/jira/browse/KAFKA-16385 > where we had some discussion. > Welcome to provide your thoughts there. > > Thanks. > Luke > > On

[jira] [Created] (KAFKA-16399) Add JBOD support in tiered storage

2024-03-21 Thread Luke Chen (Jira)
Luke Chen created KAFKA-16399: - Summary: Add JBOD support in tiered storage Key: KAFKA-16399 URL: https://issues.apache.org/jira/browse/KAFKA-16399 Project: Kafka Issue Type: Improvement

Re: [DISCUSS] Different retention semantics for active segment rotation

2024-03-21 Thread Luke Chen
Hi Jorge, You should check the JIRA: https://issues.apache.org/jira/browse/KAFKA-16385 where we had some discussion. Welcome to provide your thoughts there. Thanks. Luke On Thu, Mar 21, 2024 at 3:33 PM Jorge Esteban Quilcate Otoya < quilcate.jo...@gmail.com> wrote: > Hi dev community, > > I'd

[DISCUSS] Different retention semantics for active segment rotation

2024-03-21 Thread Jorge Esteban Quilcate Otoya
Hi dev community, I'd like to share some findings on how rotation of active segment differ depending on whether topic retention is time- or size-based. I was (wrongly) under the assumption that active segments are only rotated when segment configs (segment.bytes (1GiB) or segment.ms (7d)) or

[jira] [Created] (KAFKA-16398) mirror-maker2 running into OOM while filtering high number of messages

2024-03-21 Thread Srivignesh (Jira)
Srivignesh created KAFKA-16398: -- Summary: mirror-maker2 running into OOM while filtering high number of messages Key: KAFKA-16398 URL: https://issues.apache.org/jira/browse/KAFKA-16398 Project: Kafka

Re: [VOTE] KIP-1025: Optionally URL-encode clientID and clientSecret in authorization header

2024-03-21 Thread Doğuşcan Namal
Hi Nelson, thanks for the KIP. >From the RFC: ``` The authorization server MUST require the use of TLS as described in Section 1.6 when sending requests using password authentication. ``` I believe we already have an enforcement for OAuth to be enabled only in SSLChannel but would be good to