Re: [DISCUSS] Should we continue to merge without a green build? No!

2023-11-27 Thread David Jacot
Hi all, I am still experimenting with reducing the noise of flaky tests in build results. I should have results to share early next week. Chris, I am also for a programmatic gate. Regarding using ignoreFailures, it seems risky because the build may be green but with failed tests, no? I would

Re: [VOTE] 3.6.1 RC0

2023-11-27 Thread Kamal Chandraprakash
+1 (non-binding) 1. Built the source from 3.6.1-rc0 tag in scala 2.12 and 2.13 2. Ran all the unit and integration tests. 3. Ran quickstart and verified the produce-consume on a 3 node cluster. 4. Verified the tiered storage functionality with local-tiered storage. On Tue, Nov 28, 2023 at 12:55 

[jira] [Created] (KAFKA-15911) KRaft quorum leader should make sure the follower fetch is making progress

2023-11-27 Thread Luke Chen (Jira)
Luke Chen created KAFKA-15911: - Summary: KRaft quorum leader should make sure the follower fetch is making progress Key: KAFKA-15911 URL: https://issues.apache.org/jira/browse/KAFKA-15911 Project: Kafka

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2420

2023-11-27 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-15910) New group coordinator needs to generate snapshots while loading

2023-11-27 Thread Jeff Kim (Jira)
Jeff Kim created KAFKA-15910: Summary: New group coordinator needs to generate snapshots while loading Key: KAFKA-15910 URL: https://issues.apache.org/jira/browse/KAFKA-15910 Project: Kafka

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2419

2023-11-27 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-977: Partition-Level Throughput Metrics

2023-11-27 Thread Vahid Hashemian
Hi Qichao, Thanks for proposing this KIP. It'd be super valuable to have the ability to have those partition level metrics for Kafka topics. Sorry I'm late to the discussion. I just wanted to bring up a point for clarification and one question: Let's assume that a production cluster cannot

Re: [DISCUSS] KIP-996: Pre-Vote

2023-11-27 Thread Alyssa Huang
Thanks for the feedback Jason! 1. I might have missed it in the KIP, but could you clarify what happens > when a pre-vote fails (i.e. a majority of voters reject the potential > candidacy)? The transition descriptions only mention what happens if the > prospective leader learns of a higher epoch.

[jira] [Created] (KAFKA-15909) Remove support for empty "group.id"

2023-11-27 Thread Kirk True (Jira)
Kirk True created KAFKA-15909: - Summary: Remove support for empty "group.id" Key: KAFKA-15909 URL: https://issues.apache.org/jira/browse/KAFKA-15909 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-15908) Remove deprecated Consumer API poll(long timeout)

2023-11-27 Thread Kirk True (Jira)
Kirk True created KAFKA-15908: - Summary: Remove deprecated Consumer API poll(long timeout) Key: KAFKA-15908 URL: https://issues.apache.org/jira/browse/KAFKA-15908 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-15907) Remove previously deprecated Consumer features from 4.0

2023-11-27 Thread Kirk True (Jira)
Kirk True created KAFKA-15907: - Summary: Remove previously deprecated Consumer features from 4.0 Key: KAFKA-15907 URL: https://issues.apache.org/jira/browse/KAFKA-15907 Project: Kafka Issue

[jira] [Resolved] (KAFKA-15860) ControllerRegistration must be written out to the metadata image

2023-11-27 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-15860. -- Fix Version/s: 3.7.0 Resolution: Fixed > ControllerRegistration must be written out to

Re: [DISCUSS] KIP-996: Pre-Vote

2023-11-27 Thread Jason Gustafson
Hey Alyssa, Thanks for the KIP! I have a couple questions: 1. I might have missed it in the KIP, but could you clarify what happens when a pre-vote fails (i.e. a majority of voters reject the potential candidacy)? The transition descriptions only mention what happens if the prospective leader

Re: [VOTE] 3.6.1 RC0

2023-11-27 Thread Federico Valeri
Hi Mickael, - Build from source (Java 17, Scala 2.13) - Run unit and integration tests - Run custom client apps using staging artifacts +1 (non binding) Thanks Fede On Sun, Nov 26, 2023 at 11:34 AM Jakub Scholz wrote: > > +1 non-binding. I used the staged Scala 2.13 artifacts and the staged

[jira] [Created] (KAFKA-15906) Emit offset syncs more often than offset.lag.max for low-throughput/finite partitions

2023-11-27 Thread Greg Harris (Jira)
Greg Harris created KAFKA-15906: --- Summary: Emit offset syncs more often than offset.lag.max for low-throughput/finite partitions Key: KAFKA-15906 URL: https://issues.apache.org/jira/browse/KAFKA-15906

Re: [DISCUSS] KIP-853: KRaft Voters Change

2023-11-27 Thread José Armando García Sancio
On Mon, Nov 27, 2023 at 2:32 AM Josep Prat wrote: > I wanted to revive this thread and see if there is anything preventing it to > be voted on. Happy to help unblocking anything that might be holding this > back. Hi Josep, Thanks for reviving the thread. I need to make some changes to the

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2418

2023-11-27 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-15905) Restarts of MirrorCheckpointTask should not permanently interrupt offset translation

2023-11-27 Thread Greg Harris (Jira)
Greg Harris created KAFKA-15905: --- Summary: Restarts of MirrorCheckpointTask should not permanently interrupt offset translation Key: KAFKA-15905 URL: https://issues.apache.org/jira/browse/KAFKA-15905

[jira] [Resolved] (KAFKA-15661) KIP-951: Server side and protocol changes

2023-11-27 Thread Crispin Bernier (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Crispin Bernier resolved KAFKA-15661. - Resolution: Resolved > KIP-951: Server side and protocol changes >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2417

2023-11-27 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-15904) Downgrade tests are failing with directory.id 

2023-11-27 Thread Manikumar (Jira)
Manikumar created KAFKA-15904: - Summary: Downgrade tests are failing with directory.id  Key: KAFKA-15904 URL: https://issues.apache.org/jira/browse/KAFKA-15904 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-15903) Add github actions workflow for building and pushing RC Docker Image

2023-11-27 Thread Vedarth Sharma (Jira)
Vedarth Sharma created KAFKA-15903: -- Summary: Add github actions workflow for building and pushing RC Docker Image Key: KAFKA-15903 URL: https://issues.apache.org/jira/browse/KAFKA-15903 Project:

Re: [DISCUSS] KIP-853: KRaft Voters Change

2023-11-27 Thread Josep Prat
Hi community, I wanted to revive this thread and see if there is anything preventing it to be voted on. Happy to help unblocking anything that might be holding this back. Best, Josep Prat On 2022/07/27 15:08:24 José Armando García Sancio wrote: > Hi all, > > Community members Jason Gustafson,

[jira] [Resolved] (KAFKA-14624) State restoration is broken with standby tasks and cache-enabled stores in processor API

2023-11-27 Thread Lucas Brutschy (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucas Brutschy resolved KAFKA-14624. Resolution: Fixed > State restoration is broken with standby tasks and cache-enabled

Re: [DISCUSS] Road to Kafka 4.0

2023-11-27 Thread Colin McCabe
On Fri, Nov 24, 2023, at 03:47, Anton Agestam wrote: > In your last message you wrote: > > > But, on the KRaft side, I still maintain that nothing is missing except > > JBOD, which we already have a plan for. > > But earlier in this thread you mentioned an issue with "torn writes", > possibly

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2416

2023-11-27 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-15798) Flaky Test NamedTopologyIntegrationTest.shouldAddAndRemoveNamedTopologiesBeforeStartingAndRouteQueriesToCorrectTopology()

2023-11-27 Thread Lucas Brutschy (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucas Brutschy resolved KAFKA-15798. Resolution: Fixed Test disabled in https://github.com/apache/kafka/pull/14830 since

[jira] [Resolved] (KAFKA-14014) Flaky test NamedTopologyIntegrationTest.shouldAllowRemovingAndAddingNamedTopologyToRunningApplicationWithMultipleNodesAndResetsOffsets()

2023-11-27 Thread Lucas Brutschy (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucas Brutschy resolved KAFKA-14014. Resolution: Fixed Test disabled since feature will be removed. > Flaky test >

[jira] [Resolved] (KAFKA-13531) Flaky test NamedTopologyIntegrationTest

2023-11-27 Thread Lucas Brutschy (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucas Brutschy resolved KAFKA-13531. Resolution: Fixed Test disabled since feature will be removed. > Flaky test

Re: [DISCUSS] KIP-896: Remove old client protocol API versions in Kafka 4.0

2023-11-27 Thread Anton Agestam
Sorry, the underscore was meant to refer to the https://github.com/apache/kafka/tree/trunk/clients/src/main/resources/common/message directory in the previous message. Den fre 24 nov. 2023 kl 14:30 skrev Anton Agestam : > Hi Ismael, > > This looks like a healthy KIP for Kafka  > > As the