Re: [DISCUSS] KIP-932: Queues for Kafka

Hi Jun, Thanks for your reply. 147. Perhaps the easiest is to take a look at the code in o.a.k.clients.consumer.internal.MembershipManagerImpl. This class is part of the new consumer group protocol code in the client. It makes state transitions based on the heartbeat requests and responses, and

Re: [DISCUSS] KIP-1027 Add MockFixedKeyProcessorContext

Any updates on this KIP? On 3/28/24 4:11 AM, Matthias J. Sax wrote: It seems that `MockRecordMetadata` is a private class, and thus not part of the public API. If there are any changes required, we don't need to discuss on the KIP. For `CapturedPunctuator` and `CapturedForward` it's a

[jira] [Created] (KAFKA-16655) deflake ZKMigrationIntegrationTest.testDualWrite

Alyssa Huang created KAFKA-16655: Summary: deflake ZKMigrationIntegrationTest.testDualWrite Key: KAFKA-16655 URL: https://issues.apache.org/jira/browse/KAFKA-16655 Project: Kafka Issue Type:

[jira] [Resolved] (KAFKA-16647) Remove setMetadataDirectory from BrokerNode/ControllerNode

[ https://issues.apache.org/jira/browse/KAFKA-16647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16647. Fix Version/s: 3.8.0 Resolution: Fixed > Remove setMetadataDirectory from

[jira] [Resolved] (KAFKA-16614) Disallow `@ClusterTemplate("")`

[ https://issues.apache.org/jira/browse/KAFKA-16614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16614. Fix Version/s: 3.8.0 Resolution: Fixed > Disallow `@ClusterTemplate("")` >

[jira] [Created] (KAFKA-16654) Refactor kafka.test.annotation.Type and ClusterTestExtensions

Chia-Ping Tsai created KAFKA-16654: -- Summary: Refactor kafka.test.annotation.Type and ClusterTestExtensions Key: KAFKA-16654 URL: https://issues.apache.org/jira/browse/KAFKA-16654 Project: Kafka

[jira] [Created] (KAFKA-16653) Remove delayed initialization because of static voter set

José Armando García Sancio created KAFKA-16653: -- Summary: Remove delayed initialization because of static voter set Key: KAFKA-16653 URL: https://issues.apache.org/jira/browse/KAFKA-16653

Re: DISCUSS KIP-984 Add pluggable compression interface to Kafka

Hi Assane, Thanks for the update. Unfortunately, I don't think that the design changes have solved all of the previous concerns, and I feel it has raised new ones. >From my earlier email: 1. The KIP has now included Python, but this feature is still disproportionately difficult for

Re: [DISCUSS] KIP-932: Queues for Kafka

Hi, Andrew, Thanks for the reply. 147. "The measurement is certainly from the point of view of the client, but it’s driven by sending and receiving heartbeats rather than whether the client triggered the rebalance itself." Hmm, how does a client know which heartbeat response starts a rebalance?

Re: [VOTE] KIP-477: Add PATCH method for connector config in Connect REST API

Hi Ivan, Thank you for the KIP! I think PATCH using the same return type as PUT benefits the clients, even though the "created" field will always be false. +1 (binding) Thanks, Greg On Fri, Apr 12, 2024 at 4:31 AM Yash Mayya wrote: > > Hi Ivan, > > Thanks for reviving this KIP, I think it

Re: [DISCUSS] KIP-924: customizable task assignment for Streams

Jumping back to the party here :) 107: I agree with the rationale behind this, and `numProcessingThreads` looks good to me as it covers both the current and future scenarios. 117: I agree with Lucas and Bruno, and would add: * 117e: unknown taskID: fail * 117f: inconsistent task types (e.g.

Re: [ANNOUNCE] New committer: Igor Soarez

Congratulations！ On Tue, Apr 30, 2024 at 2:49 AM ziming deng wrote: > > Congrats Igor! > > > On Apr 26, 2024, at 13:53, Christo Lolov wrote: > > > > Congratulations Igor :) ! > > > > On Thu, 25 Apr 2024 at 17:07, Igor Soarez wrote: > > > >> Thanks everyone, I'm very honoured to join! > >> > >>

Re: [DISCUSS] KIP-1033: Add Kafka Streams exception handler for exceptions occuring during processing

Hi all, thanks Damien for the KIP! After looking into the KIP and comments, my only concern is aligned with one of Matthias comments, around the ImmutableHeaders introduction, with the motivation not being clear enough. The existing handlers already expose the headers (indirectly). Ex.

Re: [DISCUSS] KIP-936 Throttle number of active PIDs

Hi Omnia, Hi Claude, Thanks for putting this KIP together. This is an important unresolved issue in Kafka, which I have witnessed several times in production. Please see my questions below: 10 Given the goal is to prevent OOMs, do we also need to limit the number of KafkaPrincipals in use? 11.

Re: [DISCUSS] solutions for broker OOM caused by many producer IDs

Hi Luke and Justine. There are few updates on KIP-936 https://cwiki.apache.org/confluence/display/KAFKA/KIP-936%3A+Throttle+number+of+active+PIDs to introduce throttling on PIDs per User and would love to hear your feedback in the discussion thread

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2862

See

[jira] [Resolved] (KAFKA-16588) broker shutdown hangs when `log.segment.delete.delay.ms` is zero

[ https://issues.apache.org/jira/browse/KAFKA-16588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16588. Fix Version/s: 3.8.0 Resolution: Fixed > broker shutdown hangs when

[jira] [Created] (KAFKA-16652) add unit test for

Chia-Ping Tsai created KAFKA-16652: -- Summary: add unit test for Key: KAFKA-16652 URL: https://issues.apache.org/jira/browse/KAFKA-16652 Project: Kafka Issue Type: Improvement

[jira] [Resolved] (KAFKA-16651) KafkaProducer.send does not throw TimeoutException as documented

[ https://issues.apache.org/jira/browse/KAFKA-16651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Pedersen resolved KAFKA-16651. --- Resolution: Duplicate > KafkaProducer.send does not throw TimeoutException as documented >

[jira] [Created] (KAFKA-16651) KafkaProducer.send does not throw TimeoutException as documented

Mike Pedersen created KAFKA-16651: - Summary: KafkaProducer.send does not throw TimeoutException as documented Key: KAFKA-16651 URL: https://issues.apache.org/jira/browse/KAFKA-16651 Project: Kafka