[jira] [Resolved] (KAFKA-19547) Kafka Sink Improvement: Add failOnError to Control Exception Behavior

2025-08-11 Thread Ejaskhan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ejaskhan resolved KAFKA-19547. -- Resolution: Abandoned Created the issue here, https://issues.apache.org/jira/browse/FLINK-38226 > Kaf

Re: [DISCUSS] The Path Forward for Saving Cross-AZ Costs KIPs

2025-08-11 Thread Luke Chen
Hi Henry, > One of the advantage of KIP-1176 is its simpler architecture (no new component such as Batch Coordinator or new cache system to build), mostly relying on the existing building blocks (page cache, tiered storage classes, tiered storage metadata topic). We would like to see those design

Re: [DISCUSS] The Path Forward for Saving Cross-AZ Costs KIPs

2025-08-11 Thread Luke Chen
Thanks Jun I agree with the assessment. I've added it in the document: https://cwiki.apache.org/confluence/display/KAFKA/The+Path+Forward+for+Saving+Cross-AZ+Replication+Costs+KIPs Thank you. Luke On Thu, Aug 7, 2025 at 1:06 AM Jun Rao wrote: > Hi, Luke, > > Thanks for starting the discussio

Jenkins build is still unstable: Kafka » Kafka PowerPC Daily » test-powerpc #387

2025-08-11 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-1159: Large message reference based Serializer

2025-08-11 Thread Jun Rao
Hi, Omnia, Thanks for the reply. A few more comments. JR20. Could you fix the inconsistency? org.apache.kafka.common.serialization.largemessage.PayloadStore vs org.apache.kafka.common.serialization.largemessage.store.PayloadStore JR21. "Encapsulate that ID into a simple Kafka event using a struc

[jira] [Created] (KAFKA-19596) Log auto topic creation failures more visibly

2025-08-11 Thread Rob Young (Jira)
Rob Young created KAFKA-19596: - Summary: Log auto topic creation failures more visibly Key: KAFKA-19596 URL: https://issues.apache.org/jira/browse/KAFKA-19596 Project: Kafka Issue Type: Improveme

Re: [DISCUSS] KIP-1030: Change constraints and default values for various configurations

2025-08-11 Thread Jun Rao
Hi, Chia-Ping, It seems that the main issue with frequent segment rolling is the increased open file descriptors. Rolls bue to retention.ms doesn't have this issue since the rolled segment will be deleted immediately. So, we can leave the implementation of retention.ms as it is. Thanks, Jun O

Re: [DISCUSS] KIP-1161: cleanup.policy shouldn't be empty

2025-08-11 Thread Jun Rao
Hi, Jiunn-Yang, Thanks for the reply. 1 and 3. Sounds good. 2. Which bootstrap.servers are you referring to? Also, it's not clear to me why the validation fails since typically the validation happens when the config is initialized with the binding config file. Jun On Mon, Aug 11, 2025 at 6:38 

Re: KIP-1141: Simplifying MetadataQuorumCommand by Leveraging Admin API for Controller Management

2025-08-11 Thread Chia-Ping Tsai
hi Kuan-Po I'm thinking about the value of this KIP after controller.quorum.auto.join.enable is enabled. WDYT? Best, Chia-Ping Kuan Po Tseng 於 2025年8月10日 週日 下午3:36寫道: > Hi everyone, > > I've updated the KIP with the following changes: > > - Using the in-memory LeaderState and ClusterImage to >

Re: [DISCUSS] KIP-1159: Large message reference based Serializer

2025-08-11 Thread Omnia Ibrahim
Hi Jun > JR11. Do you think that we need to add key.serializers and > key.deserializers or do you think covering large messages in value is > enough? The large message issue usually is a value issue, I never saw a key that is bigger than broker message size. If I would add key.serializers and key

RE: [VOTE] KIP-1121: Compression acceleration in Kafka

2025-08-11 Thread Denloye, Olasoji
Hello all, please vote for KIP-1121. This KIP introduces a simple framework that enables the use of alternative, faster implementations of the existing compression codecs (Gzip, Snappy, Zstandard and LZ4) in Kafka. https://cwiki.apache.org/confluence/x/Xgr0Ew Thanks -Original Message

Re: [PR] MINOR: Add blog post for 4.1.0 [kafka-site]

2025-08-11 Thread via GitHub
mimaison commented on code in PR #711: URL: https://github.com/apache/kafka-site/pull/711#discussion_r2266803293 ## blog.html: ## @@ -22,6 +22,160 @@ Blog + + + +Apache Kafka 4.

Re: [PR] MINOR: Add blog post for 4.1.0 [kafka-site]

2025-08-11 Thread via GitHub
mimaison commented on code in PR #711: URL: https://github.com/apache/kafka-site/pull/711#discussion_r2266800177 ## blog.html: ## @@ -22,6 +22,160 @@ Blog + + + +Apache Kafka 4.

Re: [DISCUSS] KIP-1161: cleanup.policy shouldn't be empty

2025-08-11 Thread 黃竣陽
Hello all, I’ve started implementing this KIP, and there are a few configurations that need further discussion: 1. HeaderFrom fields This configuration should allow duplicate values. Therefore, its default value should be set to NO_DEFAULT_VALUE, and its validator should be NonEmptyListValidat

[jira] [Created] (KAFKA-19595) Add configuration validation option to Kafka server startup

2025-08-11 Thread Mikhail Fesenko (Jira)
Mikhail Fesenko created KAFKA-19595: --- Summary: Add configuration validation option to Kafka server startup Key: KAFKA-19595 URL: https://issues.apache.org/jira/browse/KAFKA-19595 Project: Kafka

[jira] [Resolved] (KAFKA-19592) testGenerateAssignmentWithBootstrapServer uses wrong JSON format

2025-08-11 Thread PoAn Yang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PoAn Yang resolved KAFKA-19592. --- Resolution: Fixed > testGenerateAssignmentWithBootstrapServer uses wrong JSON format > -

Re: [VOTE] 4.0.1 RC0

2025-08-11 Thread Christo Lolov
Hello! I am closing the vote for this release candidate and will aim to create a new release candidate following the above two discussions later today/tomorrow. Thank you for looking into it! Best, Christo On Mon, 4 Aug 2025 at 03:30, Luke Chen wrote: > Hi Christo, > > Could you take a look at