Re: Apache Kafka 3.6.0 release

Hi Greg, It seems https://issues.apache.org/jira/browse/KAFKA-14273 has been there in 3.5.x too. David/Colin, Do you think it is a blocker for 3.6.0? Thanks, Satish. On Wed, 6 Sept 2023 at 21:34, Greg Harris wrote: > > Hey all, > > A user just experienced this problem that has already been

Re: Apache Kafka 3.6.0 release

Hi David, Thanks for bringing the KAFKA-15441 to this discussion thread, it seems to be a blocker and updated the JIRA. What is the plan to address that? https://issues.apache.org/jira/browse/KAFKA-15411, which is about KRaft and delegation token related test failures. It seems to be a test env

Re: [DISCUSS] KIP-966: Eligible Leader Replicas

Hi Jack Thanks for the comment. I have updated the reassignment part. Now the reassignment can only be completed/canceled if the final ISR size is larger than min ISR. Thanks to your efforts of the TLA+! It has been a great help to the KIP! On Wed, Sep 6, 2023 at 6:32 AM Jack Vanlightly wrote:

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2180

See

[jira] [Resolved] (KAFKA-15375) When running in KRaft mode, LogManager may creates CleanShutdown file by mistake

[ https://issues.apache.org/jira/browse/KAFKA-15375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio resolved KAFKA-15375. Resolution: Fixed > When running in KRaft mode, LogManager may

Re: Unable to start the Kafka with Kraft in Windows 11

Hi Ziming, Thanks for finding that! I've mentioned that in the 3.6.0 release thread as a potential blocker since this appears to have a pretty substantial impact. Hey Sumanshu, Thank you so much for bringing this issue to our attention! It appears that your issue is caused by a bug in Kafka, so

Re: [VOTE] KIP-970: Deprecate and remove Connect's redundant task configurations endpoint

Hey Yash, +1(binding) Thanks for the KIP! Greg On Wed, Sep 6, 2023 at 6:59 AM Yash Mayya wrote: > > Hi all, > > I just wanted to bump up this vote thread. Thanks to everyone who's voted > so far - we have 1 binding +1 vote and 3 non-binding +1 votes so far. > > Thanks, > Yash > > On Wed, Aug

Re: Apache Kafka 3.6.0 release

Hey all, A user just experienced this problem that has already been reported for several versions and has an open PR: https://issues.apache.org/jira/browse/KAFKA-14273 https://github.com/apache/kafka/pull/12763 Impact: In KRaft mode on Windows, Kafka crashes on startup with an IOException. Does

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2179

See

[jira] [Reopened] (KAFKA-15411) DelegationTokenEndToEndAuthorizationWithOwnerTest is Flaky

[ https://issues.apache.org/jira/browse/KAFKA-15411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Proven Provenzano reopened KAFKA-15411: --- > DelegationTokenEndToEndAuthorizationWithOwnerTest is Flaky >

Re: Apache Kafka 3.6.0 release

Thanks, Satish! Here's another blocker https://issues.apache.org/jira/browse/KAFKA-15441 :) For the 3.6 release notes and announcement, I'd like to include a special note about ZK to KRaft migrations being GA (Generally Available). We have finished closing all the gaps from the earlier releases

[jira] [Created] (KAFKA-15441) Broker sessions can time out during ZK migration

David Arthur created KAFKA-15441: Summary: Broker sessions can time out during ZK migration Key: KAFKA-15441 URL: https://issues.apache.org/jira/browse/KAFKA-15441 Project: Kafka Issue Type:

Re: [VOTE] KIP-970: Deprecate and remove Connect's redundant task configurations endpoint

Hi all, I just wanted to bump up this vote thread. Thanks to everyone who's voted so far - we have 1 binding +1 vote and 3 non-binding +1 votes so far. Thanks, Yash On Wed, Aug 30, 2023 at 11:14 PM Sagar wrote: > +1 (non - binding). > > Thanks ! > Sagar. > > On Wed, 30 Aug 2023 at 11:09 PM,

[jira] [Resolved] (KAFKA-15411) DelegationTokenEndToEndAuthorizationWithOwnerTest is Flaky

[ https://issues.apache.org/jira/browse/KAFKA-15411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Proven Provenzano resolved KAFKA-15411. --- Resolution: Cannot Reproduce After trying for a week, I have yet to see the error

[jira] [Resolved] (KAFKA-15422) Update documentation for Delegation Tokens in Kafka with KRaft

[ https://issues.apache.org/jira/browse/KAFKA-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Proven Provenzano resolved KAFKA-15422. --- Resolution: Fixed > Update documentation for Delegation Tokens in Kafka with KRaft

Re: [DISCUSS] KIP-966: Eligible Leader Replicas

Hi Calvin, Regarding partition reassignment, I have two comments. I notice the KIP says "The AlterPartitionReassignments will not change the ELR" however, when a reassignment completes (or reverts) any replicas removed from the replica set would be removed from the ELR. Sounds obvious but I

[jira] [Created] (KAFKA-15440) Update minor dependencies in preparation for 3.6.0

Divij Vaidya created KAFKA-15440: Summary: Update minor dependencies in preparation for 3.6.0 Key: KAFKA-15440 URL: https://issues.apache.org/jira/browse/KAFKA-15440 Project: Kafka Issue

Re: KIP-976: Cluster-wide dynamic log adjustment for Kafka Connect

Hi Chris, Thanks for the clarification on the last modified timestamp tracking here and on the KIP, things look good to me now. On the persistence front, I hadn't considered the interplay between levels set by the log level REST APIs and those set by the log4j configuration files, and the user

Re: [DISCUSS] KIP-969: Support range interactive queries for versioned state stores

Hi Alieh, Thanks for the KIP! One high level comment/question: I assume you separated single key queries into two classes because versioned key queries return a single value and multi version key queries return iterators. Although, range queries always return iterators, it would make sense

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2178

See Changes: -- [...truncated 306976 lines...] Gradle Test Run :streams:test > Gradle Test Executor 72 > TasksTest > shouldDrainPendingTasksToCreate() STARTED Gradle

Re: [DISCUSS] KIP-968: Support single-key_multi-timestamp interactive queries (IQv2) for versioned state stores

Hi Alieh, Thanks for the KIP! I think from a KIP 1. I propose to throw an IllegalArgumentException or an IllegalStateException for meaningless combinations. In any case, the KIP should specify what exception is thrown. 2. Why does not specifying a range return the latest version? I would

Re: [DISCUSS] KIP-968: Support single-key_multi-timestamp interactive queries (IQv2) for versioned state stores

In my last e-mail I missed to finish a sentence. "I think from a KIP" should be "I think the KIP looks good!" On 9/6/23 1:59 PM, Bruno Cadonna wrote: Hi Alieh, Thanks for the KIP! I think from a KIP 1. I propose to throw an IllegalArgumentException or an IllegalStateException for

Re: [VOTE] KIP-910: Update Source offsets for Source Connectors without producing records

Hi All, Based on the latest discussion thread, it appears as if all open questions have been answered. Hopefully now we are in a state where we can close out on the Voting process. Thanks everyone for the great feedback. Thanks! Sagar. On Fri, Aug 18, 2023 at 9:00 AM Sagar wrote: > Hi All,

Re: [DISCUSS] KIP-910: Update Source offsets for Source Connectors without producing records

Hey All, I had an offline discussion with Yash on this and while so far there didn't seem to be a pressing need to introduce the delete offsets mechanism via the updateOffsets method, Yash had brought up an interesting point. Point being that if we don't introduce the deletion of offsets

Re: [DISCUSS] KIP-960: Support interactive queries (IQv2) for versioned state stores

Hi Alieh, I am sorry if I might repeat things that have been already said since I am not sure I got all e-mails of this discussion thread. The KIP looks good! I just have two minor comments that I think are easily resolved. 1. Why is defining latest() not needed? Is it because if I do not

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2177

See Changes: -- [...truncated 411043 lines...] Gradle Test Run :streams:test > Gradle Test Executor 84 > DefaultTaskManagerTest > shouldNotSetUncaughtExceptionsTwice()

Re: KIP-976: Cluster-wide dynamic log adjustment for Kafka Connect

Hi Chris, > I agree with Yash here: we can cross that bridge when we come to it, unless there are problems that we'd encounter then that would be better addressed by adding request forwarding now. One potential argument I can think of is that the UX would be a little strange if the semantics for

[GitHub] [kafka-site] yashmayya opened a new pull request, #539: KAFKA-14876: Add stopped state to Kafka Connect Administration docs section

yashmayya opened a new pull request, #539: URL: https://github.com/apache/kafka-site/pull/539 - See https://github.com/apache/kafka/pull/14336 and https://github.com/apache/kafka/commit/b8cf3e31747f7193024c36f3381c0dd5bd22158c -- This is an automated message from the Apache Git Service.

[jira] [Resolved] (KAFKA-15245) Improve Tiered Storage Metrics

[ https://issues.apache.org/jira/browse/KAFKA-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-15245. Resolution: Fixed > Improve Tiered Storage Metrics > -- > >

[jira] [Created] (KAFKA-15439) Add transaction tests enabled with tiered storage

Satish Duggana created KAFKA-15439: -- Summary: Add transaction tests enabled with tiered storage Key: KAFKA-15439 URL: https://issues.apache.org/jira/browse/KAFKA-15439 Project: Kafka Issue

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.6 #26

See