Build failed in Jenkins: Kafka » Kafka PowerPC Daily » test-powerpc #69

See Changes: -- [...truncated 133567 lines...] [2024-09-27T04:29:06.042Z] [2024-09-27T04:29:06.042Z] Gradle Test Run :core:test > Gradle Test Execut

Re: [DISCUSS] KIP-1092: Extend Consumer#close with an option to leave the group or not

Thanks for the KIP! Quick request for readability, can you please include the exact APIs that you're proposing to add or change under the "Public Interfaces" section? The KIP should display the actual method signature and any applicable javadocs for new public APIs. You can look at other KIPs for

[jira] [Created] (KAFKA-17631) Convert SaslApiVersionsRequestTest to kraft

PoAn Yang created KAFKA-17631: - Summary: Convert SaslApiVersionsRequestTest to kraft Key: KAFKA-17631 URL: https://issues.apache.org/jira/browse/KAFKA-17631 Project: Kafka Issue Type: Task

[jira] [Created] (KAFKA-17630) Convert ClientQuotasRequestTest#testClientQuotasForScramUsers to kraft

PoAn Yang created KAFKA-17630: - Summary: Convert ClientQuotasRequestTest#testClientQuotasForScramUsers to kraft Key: KAFKA-17630 URL: https://issues.apache.org/jira/browse/KAFKA-17630 Project: Kafka

Re: [DISCUSS] KIP-1092: Extend Consumer#close with an option to leave the group or not

> I think I’m actually OK with leaving it as leaveGroup with a lot of documentation that warns users away from changing it arbitrarily. Pardon me, I just want to ensure we are all on the same page. 1. `leaveGroup=true`: `ClassicKafkaConsumer` sends a `LeaveGroupRequest` for either the dyna

Re: [VOTE] KIP-1090 Flaky Test Management

+1 On Thu, Sep 26, 2024 at 8:08 PM Lianet M. wrote: > +1. > > Thanks David! > > > On Thu, Sep 26, 2024, 7:47 p.m. Matthias J. Sax wrote: > > > +1 > > > > On 9/26/24 3:38 PM, Chia-Ping Tsai wrote: > > > +1 > > > > > > nit: Could you please add the KIP link to KAFKA-17629 > > > > > > David Arthur

Re: [VOTE] KIP-1090 Flaky Test Management

> Could you please add the KIP link to KAFKA-17629 Done. On Thu, Sep 26, 2024 at 8:11 PM Bill Bejeck wrote: > +1 > > On Thu, Sep 26, 2024 at 8:08 PM Lianet M. wrote: > > > +1. > > > > Thanks David! > > > > > > On Thu, Sep 26, 2024, 7:47 p.m. Matthias J. Sax > wrote: > > > > > +1 > > > > > > O

Re: [VOTE] KIP-1090 Flaky Test Management

+1. Thanks David! On Thu, Sep 26, 2024, 7:47 p.m. Matthias J. Sax wrote: > +1 > > On 9/26/24 3:38 PM, Chia-Ping Tsai wrote: > > +1 > > > > nit: Could you please add the KIP link to KAFKA-17629 > > > > David Arthur 於 2024年9月27日 週五 上午6:31寫道： > > > >> I would like to call a vote for KIP-1090. Pl

Re: [VOTE] KIP-1090 Flaky Test Management

+1 On 9/26/24 3:38 PM, Chia-Ping Tsai wrote: +1 nit: Could you please add the KIP link to KAFKA-17629 David Arthur 於 2024年9月27日 週五 上午6:31寫道： I would like to call a vote for KIP-1090. Please take a moment to review the proposal and cast your vote. https://cwiki.apache.org/confluence/displa

Re: [DISCUSS] KIP-1094 Add a new constructor method with nextOffsets to ConsumerRecords

Should we deprecate the old constructor to make sure that all info gets passed in when creating a ConsumerRecords instance? On Thu, Sep 26, 2024 at 3:37 PM Bill Bejeck wrote: > Hi Alieh, > > Thanks for the KIP, it will be very useful to Kafka Streams. > I have one comment. In the "Proposed Chan

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.9 #78

See

[jira] [Resolved] (KAFKA-17277) Add version mapping and feature dependencies commands to tools (KIP-1022)

[ https://issues.apache.org/jira/browse/KAFKA-17277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Justine Olshan resolved KAFKA-17277. Resolution: Fixed > Add version mapping and feature dependencies commands to tools (KIP-10

Re: [DISCUSS] KIP-1092: Extend Consumer#close with an option to leave the group or not

Hi all, I see that leaveGroup has been renamed as releaseStaticMember. I hate to ask, but what is the behavior when a user sets this to true for a non-static member? Should it just work, log a warning, throw an error, or? I think I’m actually OK with leaving it as leaveGroup with a lot of docu

Re: [VOTE] KIP-1090 Flaky Test Management

+1 nit: Could you please add the KIP link to KAFKA-17629 David Arthur 於 2024年9月27日 週五 上午6:31寫道： > I would like to call a vote for KIP-1090. Please take a moment to review > the proposal and cast your vote. > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1090+Flaky+Test+Management >

Re: [DISCUSS] KIP-1094 Add a new constructor method with nextOffsets to ConsumerRecords

Hi Alieh, Thanks for the KIP, it will be very useful to Kafka Streams. I have one comment. In the "Proposed Changes" section, you mention the "The `nextOffsets` object contains the next offset and the last leader epoch per partition". If understand the KIP correctly, it should be something along

[VOTE] KIP-1090 Flaky Test Management

I would like to call a vote for KIP-1090. Please take a moment to review the proposal and cast your vote. https://cwiki.apache.org/confluence/display/KAFKA/KIP-1090+Flaky+Test+Management Thanks! David A

[jira] [Created] (KAFKA-17629) KIP-1090 Flaky Test Management

David Arthur created KAFKA-17629: Summary: KIP-1090 Flaky Test Management Key: KAFKA-17629 URL: https://issues.apache.org/jira/browse/KAFKA-17629 Project: Kafka Issue Type: Improvement

[jira] [Resolved] (KAFKA-17482) Make share partition initialization async

[ https://issues.apache.org/jira/browse/KAFKA-17482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal resolved KAFKA-17482. --- Resolution: Fixed > Make share partition initialization async >

[jira] [Resolved] (KAFKA-17483) Complete pending fetch request on broker shutdown

[ https://issues.apache.org/jira/browse/KAFKA-17483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal resolved KAFKA-17483. --- Resolution: Fixed > Complete pending fetch request on broker shutdown >

Re: So long, Jenkins 👋

Josep, I've filed KAFKA-17628 and submitted a PR to partially automate the workflow approval. With this change, we just need a committer to add a label one time to a PR, then it will get auto-approved. I've also wondered about a "triage" or "new" label that is automatically added to new PRs. This

Re: [DISCUSS] KIP-1090 Flaky Tests 👻

If there is no more feedback on this, I'll go ahead and move to a vote. -David On Sun, Sep 22, 2024 at 11:04 AM Chia-Ping Tsai wrote: > > > > David Arthur 於 2024年9月22日 晚上10:07 寫道： > > > > Q2: Yes, I think we should run the quarantined tests on all CI builds, > PRs > > and trunk. We can achieve

[jira] [Created] (KAFKA-17628) Automate workflow approvals for CI

David Arthur created KAFKA-17628: Summary: Automate workflow approvals for CI Key: KAFKA-17628 URL: https://issues.apache.org/jira/browse/KAFKA-17628 Project: Kafka Issue Type: Improvement

[jira] [Resolved] (KAFKA-16683) Extract security-related helpers from scala.TestUtils to java class

[ https://issues.apache.org/jira/browse/KAFKA-16683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16683. Fix Version/s: 4.0.0 Resolution: Fixed > Extract security-related helpers from scal

Re: [VOTE] KIP-1052: Enable warmup in producer performance test

hi Matt thanks for your response. +1 (binding) Best, Chia-Ping Welch, Matt 於 2024年9月27日 週五 上午2:31寫道： > Hi Chia-Ping > > Earlier in the discussion phase, Federico Valeri has also proposed the > idea of a "producer autopilot" which could switch to a steady state mode > once the p99 was acceptabl

[jira] [Created] (KAFKA-17627) ConfigProvider TTLs do not restart Tasks

Greg Harris created KAFKA-17627: --- Summary: ConfigProvider TTLs do not restart Tasks Key: KAFKA-17627 URL: https://issues.apache.org/jira/browse/KAFKA-17627 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-17626) Move common fetch related classes from storage to storage-api

Apoorv Mittal created KAFKA-17626: - Summary: Move common fetch related classes from storage to storage-api Key: KAFKA-17626 URL: https://issues.apache.org/jira/browse/KAFKA-17626 Project: Kafka

[jira] [Created] (KAFKA-17625) Remove ZK from ducktape in 4.0

Colin McCabe created KAFKA-17625: Summary: Remove ZK from ducktape in 4.0 Key: KAFKA-17625 URL: https://issues.apache.org/jira/browse/KAFKA-17625 Project: Kafka Issue Type: Sub-task

RE: [VOTE] KIP-1052: Enable warmup in producer performance test

Hi Chia-Ping Earlier in the discussion phase, Federico Valeri has also proposed the idea of a "producer autopilot" which could switch to a steady state mode once the p99 was acceptably stable. I agree with both of you that an automatic warmup would be a very useful addition to the producer pe

[jira] [Resolved] (KAFKA-17563) Move RequestConvertToJson to server module

[ https://issues.apache.org/jira/browse/KAFKA-17563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17563. Fix Version/s: 4.0.0 Resolution: Fixed > Move RequestConvertToJson to server module

Re: New release branch 3.9

Hi Colin, It has been brought to my attention that Java 23 is now GA, and Kafka clients, brokers, and connect are now experiencing UnsupportedOperationExceptions by default due our use of the deprecated-for-removal SecurityManager. This only happens upon upgrading to Java 23, so this is not a regr

[jira] [Resolved] (KAFKA-17621) Reduce logging verbosity on ConsumerGroupHeartbeat path

[ https://issues.apache.org/jira/browse/KAFKA-17621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-17621. - Fix Version/s: 4.0.0 Resolution: Fixed > Reduce logging verbosity on ConsumerGroupHeartbe

[jira] [Resolved] (KAFKA-17586) AsyncKafkaConsumer#seek should NOT wait the completion of backgound

[ https://issues.apache.org/jira/browse/KAFKA-17586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17586. Resolution: Not A Problem > AsyncKafkaConsumer#seek should NOT wait the completion of back

[jira] [Reopened] (KAFKA-17612) Remove some tests that only apply to ZK mode or migration

[ https://issues.apache.org/jira/browse/KAFKA-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe reopened KAFKA-17612: -- > Remove some tests that only apply to ZK mode or migration >

Re: New release branch 3.9

Hey Colin, KIP-1006 and the associated vote are about removing support for SecurityManager, which is a user-facing breaking change. The PR is an internal-facing, backwards-compatible change that I motivated and described in the KIP as an interim solution, and doesn't require the vote to pass in or

Re: New release branch 3.9

Hi Greg, Thank you for working on this. Isn't this work part of KIP-1006? That KIP hasn't even been approved (although it seems very likely to be so). Certainly it isn't in 3.9. The PR is also kind of large with 16 files changed. I think supporting new JDK versions that we haven't supported bef

Re: So long, Jenkins 👋

> I'm not sure caching is even that useful beyond the time > between the branch point and the .0 release (since the rate of change slows > way down after a release). I try to keep us optimistic. 🙂 With the restore keys provided by setup-gradle, CI will always find a cache to restore. While some

Re: New release branch 3.9

Hi all, I wanted to give a quick update on the 3.9.0 release. We had several fixes in the last few days (KAFKA-17459, KAFKA-17584, etc.) and uncovered two new blocker bugs which now have PRs available (KAFKA-17608, KAFKA-17604). Once those are in, I'll create a new RC. thanks, all. Colin On T

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.8 #93

See

[jira] [Created] (KAFKA-17624) Remove the E2E uses of accessing ACLs from zk

Chia-Ping Tsai created KAFKA-17624: -- Summary: Remove the E2E uses of accessing ACLs from zk Key: KAFKA-17624 URL: https://issues.apache.org/jira/browse/KAFKA-17624 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-17623) Flaky testSeekPositionAndPauseNewlyAssignedPartitionOnPartitionsAssignedCallback

Lianet Magrans created KAFKA-17623: -- Summary: Flaky testSeekPositionAndPauseNewlyAssignedPartitionOnPartitionsAssignedCallback Key: KAFKA-17623 URL: https://issues.apache.org/jira/browse/KAFKA-17623

Re: So long, Jenkins 👋

We can probably get the new CI working on older release branches, it will just take a bit of effort. As a start, we can just disable the build cache for these builds. I'm not sure caching is even that useful beyond the time between the branch point and the .0 release (since the rate of change slows

[jira] [Created] (KAFKA-17622) Kafka Streams Timeout During Partition Rebalance - Seeking Insights on NotLeaderOrFollowerException

Alieh Saeedi created KAFKA-17622: Summary: Kafka Streams Timeout During Partition Rebalance - Seeking Insights on NotLeaderOrFollowerException Key: KAFKA-17622 URL: https://issues.apache.org/jira/browse/KAFKA-1762

Re: So long, Jenkins 👋

It seems we need to promote approve-workflows.py to all committers 😀 Josep Prat 於 2024年9月26日 週四 下午9:42寫道： > I see you have the python script under "committer-tools", I guess I might > need to get used to call that script instead of going to the "pulls" page. > > Best, > > On Thu, Sep 26, 2024 at

Re: So long, Jenkins 👋

I see you have the python script under "committer-tools", I guess I might need to get used to call that script instead of going to the "pulls" page. Best, On Thu, Sep 26, 2024 at 3:36 PM Josep Prat wrote: > Hi David, > I think we need a way to flag in the PR list ( > github.com/apache/kafka/pul

Re: So long, Jenkins 👋

Hi David, I think we need a way to flag in the PR list (github.com/apache/kafka/pulls) the ones that are waiting for a committer to approve the workflows. As an example: [image: image.png] This PR has a green checkmark where the check status usually goes. But if one navigates to the PR in question,

Re: [VOTE] KIP-1034: Dead letter queue in Kafka Streams

Thanks Loïc, Sebastien, and Damien, +1 (binding) Best, Bruno On 9/26/24 3:15 AM, Sophie Blee-Goldman wrote: +1 (binding) thanks for the KIP guys! On Mon, Sep 23, 2024 at 3:38 AM Sebastien Viale < sebastien.vi...@michelin.com> wrote: Hi everyone, Just a quick reminder that the vote for KIP

Re: [VOTE] KIP-1034: Dead letter queue in Kafka Streams

Thanks for the KIP, this will be a great addition. +1(binding) Regards, Bill On Thu, Sep 26, 2024 at 9:19 AM Bruno Cadonna wrote: > Thanks Loïc, Sebastien, and Damien, > > +1 (binding) > > Best, > Bruno > > On 9/26/24 3:15 AM, Sophie Blee-Goldman wrote: > > +1 (binding) > > > > thanks for the

[jira] [Created] (KAFKA-17621) Reduce logging verbosity on ConsumerGroupHeartbeat path

David Jacot created KAFKA-17621: --- Summary: Reduce logging verbosity on ConsumerGroupHeartbeat path Key: KAFKA-17621 URL: https://issues.apache.org/jira/browse/KAFKA-17621 Project: Kafka Issue T

[jira] [Resolved] (KAFKA-17612) Remove some tests that only apply to ZK mode or migration

[ https://issues.apache.org/jira/browse/KAFKA-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17612. Fix Version/s: 4.0.0 Resolution: Fixed > Remove some tests that only apply to ZK mo

Re: [DISCUSS] KIP-1092: Extend Consumer#close with an option to leave the group or not

Dear all, The main purpose is to allow consumers to leave a group permanently, even if they have a static member ID. Additionally, we don't have insights into the use case where a dynamic member might not want to leave the group. Therefore, should we enhance the close option to support our goal

[jira] [Resolved] (KAFKA-15266) Static configs set for non primary synonyms are ignored for Log configs

[ https://issues.apache.org/jira/browse/KAFKA-15266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamal Chandraprakash resolved KAFKA-15266. -- Resolution: Duplicate > Static configs set for non primary synonyms are ignore

[jira] [Created] (KAFKA-17620) Simplify share partition acquire API

Apoorv Mittal created KAFKA-17620: - Summary: Simplify share partition acquire API Key: KAFKA-17620 URL: https://issues.apache.org/jira/browse/KAFKA-17620 Project: Kafka Issue Type: Sub-task

Re: So long, Jenkins 👋

That's what I feared On Thu, Sep 26, 2024 at 10:31 AM Chia-Ping Tsai wrote: > hi Josep > > > Do you see any potential impact if we backport the change to those? > > In my opinion, the main concern is that non-trunk PRs can't effectively > leverage the cache, meaning they require more time and re

[jira] [Created] (KAFKA-17619) Remove zk type and instance from ClusterTest

Chia-Ping Tsai created KAFKA-17619: -- Summary: Remove zk type and instance from ClusterTest Key: KAFKA-17619 URL: https://issues.apache.org/jira/browse/KAFKA-17619 Project: Kafka Issue Type:

Re: So long, Jenkins 👋

hi Josep > Do you see any potential impact if we backport the change to those? In my opinion, the main concern is that non-trunk PRs can't effectively leverage the cache, meaning they require more time and resources to run CI. Additionally, github-ci is triggered by trunk branch only, and we have

Re: So long, Jenkins 👋

Thanks to David for providing us with an improved CI! Cheers, Chia-Ping David Arthur 於 2024年9月26日 週四 上午8:51寫道： > Today, we disabled the Jenkins build on trunk. With this change, we should > now be expecting all green status checks on PRs before merging. Of course, > flaky tests still exist, but

[jira] [Created] (KAFKA-17618) group consumer heartbeat interval should be less than session timeout

PoAn Yang created KAFKA-17618: - Summary: group consumer heartbeat interval should be less than session timeout Key: KAFKA-17618 URL: https://issues.apache.org/jira/browse/KAFKA-17618 Project: Kafka

[jira] [Resolved] (KAFKA-17584) Fix incorrect synonym handling for dynamic log configurations

[ https://issues.apache.org/jira/browse/KAFKA-17584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-17584. --- Fix Version/s: 3.9.0 3.8.1 Resolution: Fixed > Fix incorrect synonym handl

[jira] [Resolved] (KAFKA-17571) Revert #17219

[ https://issues.apache.org/jira/browse/KAFKA-17571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-17571. - Fix Version/s: 4.0.0 Resolution: Fixed > Revert #17219 > - > >

[jira] [Resolved] (KAFKA-17496) Add heterogeneous configuration to TargetAssignmentBuilderBenchmark

[ https://issues.apache.org/jira/browse/KAFKA-17496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-17496. - Fix Version/s: 4.0.0 Resolution: Fixed > Add heterogeneous configuration to TargetAssignm