[jira] [Resolved] (KAFKA-15724) KRaft support in OffsetFetchRequestTest

[ https://issues.apache.org/jira/browse/KAFKA-15724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivsundar R resolved KAFKA-15724. -- Resolution: Fixed Issue already resolved as part of https://github.com/apache/kafka/commit/33

How are we feeling about recent trends in distributed backend messaging?

Hi Apache Kafka developers! Recently I've been more interested in the difference between APIs and Messaging in a distributed backend? To me, it seems like event-streaming is very fast and is ideal for hooking up all of the non-public facing internal systems of a project, allowing for great deco

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #3049

See Changes: -- [...truncated 529867 lines...] [2024-06-26T03:09:29.500Z] Gradle Test Run :core:test > Gradle Test Executor 97 > ZkMigrationClientTest > testClaimAbsentCon

Re: [DISCUSS] KIP-1059: Enable the Producer flush() method to clear the latest send() error

I was also curious about this text: The new method clears the latest error produced by `send(ProducerRecord)` and transits the transaction back from the error state I agree. We should not say "latest" but "any". Is it fair to say that we expect to encounter only one send response with an e

Re: [DISCUSS] KIP-1059: Enable the Producer flush() method to clear the latest send() error

Hey there, I had a few questions about the update. Looks like we said on the KIP that the options will be of the type Map commitOptions. Would we want to define something more specific? I was also curious about this text: > The new method clears the latest error produced by `send(ProducerRecord)

Re: [DISCUSS] KIP-1014: Managing Unstable Features in Apache Kafka

Hey Colin, I made a single configuration as part of KIP-1022 called unstableFeatureVersionsEnabled. Would we want to deprecate that and use the more generic name? Unfortunately, the config as defined in KIP-1022 is already in 3.8. Thanks for taking a look at this again. This will help with a lot

[DISCUSS] KIP-1014: Managing Unstable Features in Apache Kafka

Hi all, We previously discussed this KIP for documenting how we deal with unstable MetadataVersions. At that time, we didn't bring it to a vote. Proven handed this off to me, and I've made some changes to the proposal since then: - I expanded the scope to also cover "RPCs with latestVersionUns

Re: [VOTE] 3.7.1 RC2

Hey folks, Sorry for the delay. I have done the following: 1. Checked signatures 2. Built from source 3. Inspected unit/integration test failures 4. Scanned documentation and other artifacts 5. Ran ZK and Kraft quick starts and simple workloads on staged binary for 2.13 +1 (binding) from me. Th

[jira] [Resolved] (KAFKA-17034) Tweak some descriptions in `FeatureUpdate`

[ https://issues.apache.org/jira/browse/KAFKA-17034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17034. Fix Version/s: 3.9.0 Resolution: Fixed > Tweak some descriptions in `FeatureUpdate`

[jira] [Created] (KAFKA-17040) Unknown telemetry state: TERMINATED thrown when closing AsyncKafkaConsumer

Kirk True created KAFKA-17040: - Summary: Unknown telemetry state: TERMINATED thrown when closing AsyncKafkaConsumer Key: KAFKA-17040 URL: https://issues.apache.org/jira/browse/KAFKA-17040 Project: Kafka

Re: [DISCUSS] KIP-655: Add deduplication processor in kafka-streams

Hi Matthias, Here are my updates on your points. 101. > You propose to add static methods `keySerde()` and `valueSerde()` -- > in other config classes, we use only `with(keySerde, valueSerde)` as we try > to use the "builder" pattern, and avoid too many overloads. I would > prefer to omit both me

[jira] [Resolved] (KAFKA-16990) Unrecognised flag passed to kafka-storage.sh in system test

[ https://issues.apache.org/jira/browse/KAFKA-16990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Justine Olshan resolved KAFKA-16990. Fix Version/s: 3.9.0 Resolution: Fixed > Unrecognised flag passed to kafka-storage.

[jira] [Resolved] (KAFKA-16949) System test test_dynamic_logging in connect_distributed_test is failing

[ https://issues.apache.org/jira/browse/KAFKA-16949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-16949. --- Fix Version/s: 3.9.0 Resolution: Fixed > System test test_dynamic_logging in connect_

[jira] [Resolved] (KAFKA-15466) Add KIP-919 support for some admin APIs

[ https://issues.apache.org/jira/browse/KAFKA-15466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-15466. Resolution: Fixed > Add KIP-919 support for some admin APIs >

[jira] [Resolved] (KAFKA-16551) add integration test for ClusterTool

[ https://issues.apache.org/jira/browse/KAFKA-16551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16551. Resolution: Fixed > add integration test for ClusterTool > ---

[jira] [Created] (KAFKA-17039) KIP-919 supports for `describeDelegationToken`, `describeUserScramCredentials` and `unregisterBroker`

Chia-Ping Tsai created KAFKA-17039: -- Summary: KIP-919 supports for `describeDelegationToken`, `describeUserScramCredentials` and `unregisterBroker` Key: KAFKA-17039 URL: https://issues.apache.org/jira/browse/KAFK

[jira] [Created] (KAFKA-17038) KIP-919 supports for `alterPartitionReassignments` and `listPartitionReassignments`

Chia-Ping Tsai created KAFKA-17038: -- Summary: KIP-919 supports for `alterPartitionReassignments` and `listPartitionReassignments` Key: KAFKA-17038 URL: https://issues.apache.org/jira/browse/KAFKA-17038

[jira] [Created] (KAFKA-17037) KIP-919 supports for `describeClientQuotas` and `alterClientQuotas`

Chia-Ping Tsai created KAFKA-17037: -- Summary: KIP-919 supports for `describeClientQuotas` and `alterClientQuotas` Key: KAFKA-17037 URL: https://issues.apache.org/jira/browse/KAFKA-17037 Project: Kafk

[jira] [Created] (KAFKA-17036) KIP-919 supports for `createAcls`, `deleteAcls`, `describeAcls`

Chia-Ping Tsai created KAFKA-17036: -- Summary: KIP-919 supports for `createAcls`, `deleteAcls`, `describeAcls` Key: KAFKA-17036 URL: https://issues.apache.org/jira/browse/KAFKA-17036 Project: Kafka

[jira] [Resolved] (KAFKA-16650) add integration test for Admin#abortTransaction

[ https://issues.apache.org/jira/browse/KAFKA-16650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16650. Fix Version/s: 3.9.0 Resolution: Fixed > add integration test for Admin#abortTransa

[VOTE] KIP-1059: Enable the Producer flush() method to clear the latest send() error

Hi all, I would like to open voting for KIP-1059: Enable the Producer flush() method to clear the latest send() error . Cheers, Alieh

Re: [DISCUSS] KIP-1059: Enable the Producer flush() method to clear the latest send() error

Hi all, Appreciation for maintaining the momentum of our discussion. I see kinda consensus over the main points. It seems that we agreed on the following: 1) Define the `commitTnx(commitOptions)` to clear the error. 2) Make the user explicitly call `flush()` before `commitTnx(commitOptions)`,

Re: [DISCUSS] KIP-1057: Add remote log metadata flag to the dump log tool

Hey all Seems like we have quite a lot of interest in adding this dedicated flag in addition to existing alternatives. In that case, I will cede to the majority interest here. Let's go ahead with this new flag. I have one last question about the new flag: Can you please help me understand if the

[jira] [Resolved] (KAFKA-10413) rebalancing leads to unevenly balanced connectors

[ https://issues.apache.org/jira/browse/KAFKA-10413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Rao resolved KAFKA-10413. --- Resolution: Fixed KAFKA-12495 has been fixed. > rebalancing leads to unevenly balanced connectors >

Re: [DISCUSS] KIP-1058: Txn consumer exerts pressure on remote storage when reading non-txn topic

Hi Kamal Thanks for the bump. I have been thinking about this passively for the past few days. The simplest solution is to store a state at segment level metadata. The state should specify whether the trx index is empty or not. It would be populated during segment archival. We would then iterate

Re: [DISCUSS] KIP-1058: Txn consumer exerts pressure on remote storage when reading non-txn topic

Bump. Please review this proposal. On Mon, Jun 17, 2024 at 6:55 PM Kamal Chandraprakash < kamal.chandraprak...@gmail.com> wrote: > Divij, > > Thanks for the review! Updated the KIP with 1, 2, 3, and 4 review > comments. > > > 4. Potential alternative - Instead of having an algorithm where we > t

[jira] [Created] (KAFKA-17035) Add debug log to retention cleanupLogs method to help troubleshoot issues

Luke Chen created KAFKA-17035: - Summary: Add debug log to retention cleanupLogs method to help troubleshoot issues Key: KAFKA-17035 URL: https://issues.apache.org/jira/browse/KAFKA-17035 Project: Kafka

Re: [DISCUSS] KIP-1059: Enable the Producer flush() method to clear the latest send() error

Hi Artem, Yes, I completely agree that by default, special action shouldn't be required from users to prevent transactions from being committed when one or more records can't be sent. The behavior I was suggesting was only relevant to the new API we're discussing where we allow users to intentiona

Re: [DISCUSS] Apache Kafka 3.9.0 release

Hi all, Can the KIP-1040[1] be included? It is accepted and a PR review is in progress. https://cwiki.apache.org/confluence/display/KAFKA/KIP-1040%3A+Improve+handling+of+nullable+values+in+InsertField%2C+ExtractField%2C+and+other+transformations Thanks, Mario. On Tue, Jun 25, 2024 at 8:28 AM N

Re: [VOTE] KIP-877: Mechanism for plugins and connectors to register metrics

Bumping this thread. Let me know if you have any feedback. Thanks, Mickael On Mon, Jun 10, 2024 at 1:44 PM Chris Egerton wrote: > > +1 (binding), thanks Mickael! > > On Mon, Jun 10, 2024, 04:24 Mickael Maison wrote: > > > Hi, > > > > Following the feedback in the DISCUSS thread, I made signifi

[jira] [Resolved] (KAFKA-16755) Implement lock timeout functionality in SharePartition

[ https://issues.apache.org/jira/browse/KAFKA-16755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhinav Dixit resolved KAFKA-16755. --- Fix Version/s: 4.0.0 3.9.0 Resolution: Fixed > Implement lock time