[jira] [Created] (KAFKA-16510) java.lang.OutOfMemoryError in kafka-metadata-quorum.sh

HiroArai created KAFKA-16510: Summary: java.lang.OutOfMemoryError in kafka-metadata-quorum.sh Key: KAFKA-16510 URL: https://issues.apache.org/jira/browse/KAFKA-16510 Project: Kafka Issue Type:

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2804

See

Re: [DISCUSS] KIP-1033: Add Kafka Streams exception handler for exceptions occuring during processing

Thanks for the KIP. Great discussion. I am not sure if I understand the proposal from Bruno to hand in the processor node id? Isn't this internal (could not even find it quickly). We do have a processor name, right? Or do I mix up something? Another question is about `ProcessingContext` --

[jira] [Created] (KAFKA-16509) CurrentControllerId metric is unreliable in ZK mode

Colin McCabe created KAFKA-16509: Summary: CurrentControllerId metric is unreliable in ZK mode Key: KAFKA-16509 URL: https://issues.apache.org/jira/browse/KAFKA-16509 Project: Kafka Issue

Re: [DISCUSS] KIP-1036: Extend RecordDeserializationException exception

Thanks for the KIP Fred. Couple of nits: it's not clear from the "Public API" section what is new and what is existing API w/o going back to the code. For existing methods which are not changed, it's also best to actually omit them. -- It would also be best to only put the interface itself

Re: [DISCUSS] KIP-1036: Extend RecordDeserializationException exception

Hi Fred, Thanks for the KIP! Questions/comments: How do we handle the case where CompletedFetch.parseRecord isn’t able to construct a well-formed ConsumerRecord (i.e. the values it needs are missing/corrupted/etc.)? Please change RecordDeserializationException’s getConsumerRecord() method to

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2803

See

[jira] [Resolved] (KAFKA-16294) Add group protocol migration enabling config

[ https://issues.apache.org/jira/browse/KAFKA-16294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16294. - Fix Version/s: 3.8.0 Resolution: Fixed > Add group protocol migration enabling config >

Re: [DISCUSS] KIP-1006: Remove SecurityManager Support

Hi, It looks like some of the SecurityManager APIs are starting to be removed in JDK 23, see - https://bugs.openjdk.org/browse/JDK-8296244 - https://github.com/quarkusio/quarkus/issues/39634 JDK 23 is currently planned for September 2024. Considering the timelines and that we only drop support

Re: [VOTE] KIP-1022 Formatting and Updating Features

Hi Justine, +1 (binding) Thanks for the improvement. -- -José

Re: [DISCUSS] KIP-1022 Formatting and Updating Features

Hi Justine, On Tue, Apr 9, 2024 at 4:19 PM Justine Olshan wrote: > As for the validation criteria. It seems like one bit of code that > validates whether a version is allowed is in the method > `reasonNotSupported` which checks the range of features available for the > given feature. > For

[jira] [Created] (KAFKA-16508) Infinte loop if output topic does not exisit

Matthias J. Sax created KAFKA-16508: --- Summary: Infinte loop if output topic does not exisit Key: KAFKA-16508 URL: https://issues.apache.org/jira/browse/KAFKA-16508 Project: Kafka Issue

[DISCUSS] KIP-1036: Extend RecordDeserializationException exception

Hi everyone, To make implementation of DLQ in consumer easier, I would like to add the raw ConsumerRecord into the RecordDeserializationException. Details are in KIP-1036 . Thanks for

[jira] [Created] (KAFKA-16507) Add raw record into RecordDeserialisationException

Fred Rouleau created KAFKA-16507: Summary: Add raw record into RecordDeserialisationException Key: KAFKA-16507 URL: https://issues.apache.org/jira/browse/KAFKA-16507 Project: Kafka Issue

Re: [DISCUSS] KIP-932: Queues for Kafka

Hi Jun, Thanks for your questions. 41. 41.1. The partition leader obtains the state epoch in the response from ReadShareGroupState. When it becomes a share-partition leader, it reads the share-group state and one of the things it learns is the current state epoch. Then it uses the state epoch in

Re: the migration of command tools

Hi, if a tool already has a wrapper bash script in bin and bin/windows, then there is no need to create a redirection in Scala, as users are supposed to use the script. If there is any ST left which is using the tool directly, a bash script should be created, and the ST changed to use the script

Re: [DISCUSS] KIP-932: Queues for Kafka

Hi Andrew (and Tom) > Imagine that we do have `group.type` as a group configuration. How would > we end up with groups with > the same ID but different types on the two ends of MM2? Assuming that both > ends have KIP-932 enabled, > either the configuration was not set, and a consumer group was

[jira] [Created] (KAFKA-16506) add the scala version of tool-related class back to core module to follow KIP-906

Chia-Ping Tsai created KAFKA-16506: -- Summary: add the scala version of tool-related class back to core module to follow KIP-906 Key: KAFKA-16506 URL: https://issues.apache.org/jira/browse/KAFKA-16506

Re: [DISCUSS] KIP-1035: StateStore managed changelog offsets

Hi Bruno, Immediately after I sent my response, I looked at the codebase and came to the same conclusion. If it's possible at all, it will need to be done by creating temporary StateManagers and StateStores during rebalance. I think it is possible, and probably not too expensive, but the devil

Re: the migration of command tools

hi David thanks for quickly response!! According to KIP-906, the BC rules are 1) The old package name must be deprecated in the target release (e.g. 3.5) and redirection removed in the next major release (e.g. 4.0). 2) Existing users will get a deprecation warning when using the old package

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2802

See

Re: the migration of command tools

Hey, I think that we discussed this in this KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-906%3A+Tools+migration+guidelines. I don't remember all the details though. Best, David On Wed, Apr 10, 2024 at 2:54 PM Chia-Ping Tsai wrote: > Dear Kafka, > > Migrating command tools from

the migration of command tools

Dear Kafka, Migrating command tools from core module to tools module is not news. However, I want to make sure I don't misunderstand the BC rules. The question is "Should we keep origin class?" FeatureCommand (

Re: [DISCUSS] KIP-899: Allow clients to rebootstrap

Hi Andrew and all, I did the mentioned change. As there are no more comments, I'm letting this sit for e.g. a week and then I will call for the vote. Best, Ivan On Tue, Apr 9, 2024, at 23:51, Andrew Schofield wrote: > Hi Ivan, > I think you have to go one way or the other with the cluster

[jira] [Resolved] (KAFKA-15568) Use incrementalAlterConfigs to update the dynamic config of broker in ConfigCommand tool

[ https://issues.apache.org/jira/browse/KAFKA-15568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-15568. Resolution: Duplicate duplicate to KAFKA-16181 > Use incrementalAlterConfigs to update

Re: [DISCUSS] KIP-1035: StateStore managed changelog offsets

Hi Nick, Thanks for reacting on my comments so quickly! 2. Some thoughts on your proposal. State managers (and state stores) are parts of tasks. If the task is not assigned locally, we do not create those tasks. To get the offsets with your approach, we would need to either create kind of

Re: [DISCUSS] KIP-1024: Make the restore behavior of GlobalKTables with custom processors configureable

Hi Walker, Thanks for the updates! (1) While I like naming the methods differently, I have also to say that I do not like addIsomorphicGlobalStore() because it does not really tell what the method does. I could also not come up with a better name than

Re: [DISCUSS] KIP-1035: StateStore managed changelog offsets

Hi Bruno, Thanks for the review! 1, 4, 5. Done 3. You're right. I've removed the offending paragraph. I had originally adapted this from the guarantees outlined in KIP-892. But it's difficult to provide these guarantees without the KIP-892 transaction buffers. Instead, we'll add the guarantees

[DISCUSS] KIP-1033: Add Kafka Streams exception handler for exceptions occuring during processing

Hi, You are right, it will simplify types. We update the KIP regards Sébastien VIALE MICHELIN GROUP - InfORMATION Technology Technical Expert Kafka [cid:1f4ea9d0-bfb8-49da-b32a-05d63c7f41a6] Carmes / Bâtiment A17 4e / 63100 Clermont-Ferrand De : Bruno

[jira] [Created] (KAFKA-16505) KIP-1034: Dead letter queue in Kafka Streams

Damien Gasparina created KAFKA-16505: Summary: KIP-1034: Dead letter queue in Kafka Streams Key: KAFKA-16505 URL: https://issues.apache.org/jira/browse/KAFKA-16505 Project: Kafka Issue

[jira] [Reopened] (KAFKA-15793) Flaky test ZkMigrationIntegrationTest.testMigrateTopicDeletions

[ https://issues.apache.org/jira/browse/KAFKA-15793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Soarez reopened KAFKA-15793: - This has come up again:   {code:java} [2024-04-09T21:06:17.307Z] Gradle Test Run :core:test >

[jira] [Created] (KAFKA-16504) Flaky test org.apache.kafka.controller.QuorumControllerTest.testConfigurationOperations

Igor Soarez created KAFKA-16504: --- Summary: Flaky test org.apache.kafka.controller.QuorumControllerTest.testConfigurationOperations Key: KAFKA-16504 URL: https://issues.apache.org/jira/browse/KAFKA-16504

Re: [DISCUSS] KIP-1033: Add Kafka Streams exception handler for exceptions occuring during processing

Hi Loïc, Damien, and Sébastien, Great that we are converging! 3. Damien and Loïc, I think in your examples the handler will receive Record because an Record is passed to the processor in the following code line:

[DISCUSS] KIP-1034: Dead letter queue in Kafka Streams

Hi everyone, To continue on our effort to improve Kafka Streams error handling, we propose a new KIP to add out of the box support for Dead Letter Queue. The goal of this KIP is to provide a default implementation that should be suitable for most applications and allow users to override it if

[jira] [Created] (KAFKA-16503) getOrMaybeCreateClassicGroup should not thrown GroupIdNotFoundException

David Jacot created KAFKA-16503: --- Summary: getOrMaybeCreateClassicGroup should not thrown GroupIdNotFoundException Key: KAFKA-16503 URL: https://issues.apache.org/jira/browse/KAFKA-16503 Project: Kafka

[jira] [Reopened] (KAFKA-15538) Client support for java regex based subscription

[ https://issues.apache.org/jira/browse/KAFKA-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna reopened KAFKA-15538: --- > Client support for java regex based subscription >

Re: [VOTE] KIP-1022 Formatting and Updating Features

+1 (binding). Thanks for the KIP! On Mon, Apr 8, 2024 at 7:23 PM Andrew Schofield < andrew_schofield_j...@outlook.com> wrote: > Hi Justine, > Thanks for the KIP. > > +1 (non-binding) > > Thanks, > Andrew > > > On 8 Apr 2024, at 18:07, Justine Olshan > wrote: > > > > Hello all, > > I would like