[VOTE] KIP-899: Allow producer and consumer clients to rebootstrap

Hello, The discussion [1] for KIP-899 [2] has been open for quite some time. I'd like to put the KIP up for a vote. Best, Ivan [1] https://lists.apache.org/thread/m0ncbmfxs5m87sszby2jbmtjx2bdpcdl [2]

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2060

See Changes: -- [...truncated 394084 lines...] Gradle Test Run :streams:integrationTest > Gradle Test Executor 182 > TableTableJoinIntegrationTest > [caching enabled =

Re: Flaky tests need attention (clients, Connect, Mirror Maker, Streams, etc.)

Is that right that the first one on the list ( org.apache.kafka.connect.mirror.integration.MirrorConnectorsIntegrationExactlyOnceTest) takes 20 minutes?! That's quite a test. I wonder if the length corresponds to whether it passes, but we should fix it and maybe move it out of our PR builds. I

Flaky tests need attention (clients, Connect, Mirror Maker, Streams, etc.)

Hi! According to the Gradle Enterprise statistics on our recent Kafka builds, over 90% have flaky tests [1]. We also have 106 open Jiras with the “flaky-test” label across several functional areas of the project [2]. Can I ask that those familiar with those different functional areas take a

Re: [VOTE] KIP-759: Unneeded repartition canceling

I caught up on the discussion thread and the KIP LGTM. +1(binding) On Tue, Aug 1, 2023 at 3:07 PM Walker Carlson wrote: > +1 (binding) > > On Mon, Jul 31, 2023 at 10:43 PM Matthias J. Sax wrote: > > > +1 (binding) > > > > On 7/11/23 11:16 AM, Shay Lin wrote: > > > Hi all, > > > > > > I'd like

Re: Debugging Jenkins test failures

Hi Divij, Thanks for the pointer to Gradle Enterprise! That’s exactly what I was looking for. Did we track builds before July 12? I see only tiny blips of failures on the 90-day view. Thanks, Kirk > On Jul 26, 2023, at 2:08 AM, Divij Vaidya wrote: > > Hi Kirk > > I have been using this

[jira] [Created] (KAFKA-15292) Test IdentityReplicationIntegrationTest#testReplicateSourceDefault() is flaky

Kirk True created KAFKA-15292: - Summary: Test IdentityReplicationIntegrationTest#testReplicateSourceDefault() is flaky Key: KAFKA-15292 URL: https://issues.apache.org/jira/browse/KAFKA-15292 Project:

[jira] [Created] (KAFKA-15291) Implemented Versioned interfaces in common Connect plugins

Greg Harris created KAFKA-15291: --- Summary: Implemented Versioned interfaces in common Connect plugins Key: KAFKA-15291 URL: https://issues.apache.org/jira/browse/KAFKA-15291 Project: Kafka

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2059

See Changes: -- [...truncated 393964 lines...] Gradle Test Run :streams:integrationTest > Gradle Test Executor 181 > TableTableJoinIntegrationTest > [caching enabled =

Re: [QUESTION] What is the difference between sequence and offset for a Record?

For what it's worth -- the sequence number is not calculated "baseOffset/baseSequence + offset delta" but rather by monotonically increasing for a given epoch. If the epoch is bumped, we reset back to zero. This may mean that the offset and sequence may match, but do not strictly need to be the

Re: [VOTE] KIP-759: Unneeded repartition canceling

+1 (binding) On Mon, Jul 31, 2023 at 10:43 PM Matthias J. Sax wrote: > +1 (binding) > > On 7/11/23 11:16 AM, Shay Lin wrote: > > Hi all, > > > > I'd like to call a vote on KIP-759: Unneeded repartition canceling > > The KIP has been under discussion for quite some time(two years). This > is a >

Re: [QUESTION] What is the difference between sequence and offset for a Record?

The _offset_ is the position of the record in the partition. The _sequence number_ is a unique ID that allows broker to de-duplicate messages. It requires the producer to implement the idempotency protocol (part of Kafka transactions); thus, sequence numbers are optional and as long as you

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2058

See

[jira] [Created] (KAFKA-15290) Add support to onboard existing topics to tiered storage

Kamal Chandraprakash created KAFKA-15290: Summary: Add support to onboard existing topics to tiered storage Key: KAFKA-15290 URL: https://issues.apache.org/jira/browse/KAFKA-15290 Project:

Re: [VOTE] KIP-959 Add BooleanConverter to Kafka Connect

Hi, Still missing one binding vote for this (very small) KIP to pass :) From: dev@kafka.apache.org At: 07/28/23 09:37:45 UTC-4:00To: dev@kafka.apache.org Subject: Re: [VOTE] KIP-959 Add BooleanConverter to Kafka Connect Hi everyone, Thanks everyone who has reviewed and voted for this KIP.

Re: [VOTE] KIP-949: Add flag to enable the usage of topic separator in MM2 DefaultReplicationPolicy

Thanks for the binding vote, Greg, We now need one extra binding vote to get this KIP accepted. On Tue, Jul 25, 2023 at 8:10 PM Greg Harris wrote: > Hey Omnia, > > Thanks for the KIP! > > I think that MM2 is responsible for providing an upgrade path for > users, even if it isn't

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2057

See

[QUESTION] What is the difference between sequence and offset for a Record?

Hi, I'm wringing a Kafka API Rust codec library[1] to understand how Kafka models its concepts and how the core business logic works. During implementing the codec for Records[2], I saw a twins of fields "sequence" and "offset". Both of them are calculated by baseOffset/baseSequence + offset

[jira] [Created] (KAFKA-15289) Use zkBrokerApis.clientApis instead of ApiKeys.zkBrokerApis in most cases

Deng Ziming created KAFKA-15289: --- Summary: Use zkBrokerApis.clientApis instead of ApiKeys.zkBrokerApis in most cases Key: KAFKA-15289 URL: https://issues.apache.org/jira/browse/KAFKA-15289 Project:

[jira] [Created] (KAFKA-15288) Change BrokerApiVersionsCommandTest to support kraft mode

Deng Ziming created KAFKA-15288: --- Summary: Change BrokerApiVersionsCommandTest to support kraft mode Key: KAFKA-15288 URL: https://issues.apache.org/jira/browse/KAFKA-15288 Project: Kafka

[jira] [Created] (KAFKA-15287) Change NodeApiVersions.create() to contains both apis of zk and kraft broker

Deng Ziming created KAFKA-15287: --- Summary: Change NodeApiVersions.create() to contains both apis of zk and kraft broker Key: KAFKA-15287 URL: https://issues.apache.org/jira/browse/KAFKA-15287 Project:

[jira] [Created] (KAFKA-15286) Migrate ApiVersion related code to kraft

Deng Ziming created KAFKA-15286: --- Summary: Migrate ApiVersion related code to kraft Key: KAFKA-15286 URL: https://issues.apache.org/jira/browse/KAFKA-15286 Project: Kafka Issue Type: Task