[GitHub] [kafka-site] VictorParkM opened a new pull request, #515: adding spitha on powered-by

2023-05-24 Thread via GitHub
VictorParkM opened a new pull request, #515: URL: https://github.com/apache/kafka-site/pull/515 adding spitha on powered-by -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [VOTE] 3.5.0 RC0

2023-05-24 Thread Ismael Juma
I agree the migration should be functional - it wasn't obvious if the migration issues are edge cases or not. If they are edge cases, I think 3.5.1 would be fine given the preview status. I understand that a new RC is needed, but that doesn't mean we should let everything in. Each change carries

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1868

2023-05-24 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-15019) Improve handling of overload situations in the kcontroller

2023-05-24 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-15019: Summary: Improve handling of overload situations in the kcontroller Key: KAFKA-15019 URL: https://issues.apache.org/jira/browse/KAFKA-15019 Project: Kafka

[jira] [Resolved] (KAFKA-14658) When listening on fixed ports, defer port opening until we're ready

2023-05-24 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-14658. -- Resolution: Fixed > When listening on fixed ports, defer port opening until we're ready >

[jira] [Resolved] (KAFKA-14835) Create ControllerServerMetricsPublisher

2023-05-24 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-14835. -- Resolution: Fixed > Create ControllerServerMetricsPublisher >

[jira] [Resolved] (KAFKA-14857) Fix some MetadataLoader bugs

2023-05-24 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-14857. -- Resolution: Fixed > Fix some MetadataLoader bugs > > >

[jira] [Resolved] (KAFKA-14943) Fix ClientQuotaControlManager validation

2023-05-24 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-14943. -- Fix Version/s: 3.5.0 Resolution: Fixed > Fix ClientQuotaControlManager validation >

Re: [VOTE] 3.5.0 RC0

2023-05-24 Thread Colin McCabe
Hi Ismael, I do personally think they are blockers. But just as importantly, KAFKA-14996 is not related to zk to kraft migration, and is a blocker. So we will need another RC in any case. best, Colin On Wed, May 24, 2023, at 11:50, Ismael Juma wrote: > Are all these blockers? For example, zk

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1867

2023-05-24 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-15009) New ACLs are not written to ZK during migration

2023-05-24 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-15009. -- Fix Version/s: 3.5.0 Resolution: Fixed > New ACLs are not written to ZK during

Re: [DISCUSS] KIP-923: Add A Grace Period to Stream Table Join

2023-05-24 Thread Victoria Xia
Thanks for the updates, Walker! Looks great, though I do have a couple questions about the latest updates: 1. The new example says that without stream-side buffering, "ex" and "fy" are possible join results. How could those join results happen? The example versioned table suggests that

[VOTE] KIP-923: Add A Grace Period to Stream Table Join

2023-05-24 Thread Walker Carlson
Hello everybody, I'm opening the vote on KIP-923 here . If we have more to discus please continue the discussion on the existing thread https://www.mail-archive.com/dev@kafka.apache.org/msg130657.html best, Walker

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1866

2023-05-24 Thread Apache Jenkins Server
See

Re: [VOTE] 3.5.0 RC0

2023-05-24 Thread Josep Prat
Hi there, Is the plan described in KIP-833[1] still valid? In there it states that 3.5.0 should aim at deprecation of Zookeeper, so conceptually, the path to migrate to Kraft should be somewhat functional (in my opinion). If we don't want to deprecate Zookeeper in 3.5.0, then I share Ismael's

Re: [VOTE] 3.4.1 RC2

2023-05-24 Thread Josep Prat
Hi Luke, Thanks for your patience during this release. I ran the following validation steps: - Built from source with Java 11 and Scala 2.13 - Signatures and hashes of the artifacts generated - Navigated through Javadoc including links to JDK classes - Run the unit tests - Run integration tests

Re: [VOTE] 3.5.0 RC0

2023-05-24 Thread Ismael Juma
Are all these blockers? For example, zk to kraft migration are is still in preview - can we fix some of these in 3.5.1? Ismael On Wed, May 24, 2023, 10:22 AM Colin McCabe wrote: > Hi Mickael, > > Thanks for putting together this RC. Unfortunately, we've identified > several blocker issues in

Re: [VOTE] 3.5.0 RC0

2023-05-24 Thread Colin McCabe
Hi Mickael, Thanks for putting together this RC. Unfortunately, we've identified several blocker issues in this release candidate. KAFKA-15009: New ACLs are not written to ZK during migration KAFKA-15007: MV is not set correctly in the MetadataPropagator in migration. KAFKA-15004: Topic config

Re: [VOTE] 3.4.1 RC2

2023-05-24 Thread Federico Valeri
Hi Luke, these are the things I checked: - Source signature, checksum and license file - Build from source with Java 17 and Scala 2.13 - Unit and integration test suites - Java app with staging Maven artifacts +1 (non binding) Thanks Fede On Wed, May 24, 2023 at 6:36 PM Chris Egerton wrote:

Re: [VOTE] 3.4.1 RC2

2023-05-24 Thread Chris Egerton
Hi Luke, Thanks again for running this release! Echoing your hopes that this will be the final 3.4.1 release candidate :) To verify, I: - Built from source with Java 11 with both: - - the 3.4.1-rc2 tag on GitHub - - the kafka-3.4.1-src.tgz artifact from

Re: [DISCUSS] Adding non-committers as Github collaborators

2023-05-24 Thread Justine Olshan
Hey Yash, I'm not sure how it used to be for sure, but I do remember we used to have a different build system. I wonder if this used to work with the old build system and not any more. I'd be curious if other projects have something similar and how it works. Thanks, Justine On Wed, May 24, 2023

Re: [DISCUSS] Adding non-committers as Github collaborators

2023-05-24 Thread Yash Mayya
Hi Justine, Thanks for the response. Non-committers don't have Apache accounts; are you suggesting that there wasn't a need to sign in earlier and a change in this policy is restricting collaborators from triggering Jenkins builds? Thanks, Yash On Wed, May 24, 2023 at 9:30 PM Justine Olshan

Re: [DISCUSS] Adding non-committers as Github collaborators

2023-05-24 Thread Justine Olshan
Yash, When I rebuild, I go to the CloudBees CI page and I have to log in with my apache account. Not sure if the change in the build system or the need to sign in is part of the problem. On Wed, May 24, 2023 at 4:54 AM Federico Valeri wrote: > +1 on Divij suggestions > > > On Wed, May 24,

Re: [DISCUSS] KIP-932: Queues for Kafka

2023-05-24 Thread Andrew Schofield
Hi Stanislav, Thanks for your email. You bring up some interesting points. 1) Tiered storage I think the situation here for fetching historical data is equivalent to what happens if a user resets the committed offset for a consumer group back to an earlier point in time. So, I will mention this

[jira] [Resolved] (KAFKA-15016) LICENSE-binary file contains dependencies not included anymore

2023-05-24 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-15016. Fix Version/s: 3.6.0 Resolution: Fixed > LICENSE-binary file contains dependencies

Re: [DISCUSS] KIP-921 OpenJDK CRaC support

2023-05-24 Thread Divij Vaidya
Hey Radim After reading the KIP, I am still not sure about the motivation for this change. The bottleneck in starting a producer on Kafka is setup of the network connection with the broker (since it performs SSL + AuthN). From what I understand, checkpoint and restore is not going to help with

Re: [DISCUSS] KIP-858: Handle JBOD broker disk failure in KRaft

2023-05-24 Thread Divij Vaidya
Hey Igor Just calling out that Monday, 29th May is a bank holiday in lots of EU countries (including the UK) which may restrict attendance?! -- Divij Vaidya On Tue, May 23, 2023 at 6:59 PM Igor Soarez wrote: > Hi everyone, > > Someone suggested at the recent Kafka Summit that it may be

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1865

2023-05-24 Thread Apache Jenkins Server
See

Re: KafkaConsumer refactor proposal

2023-05-24 Thread Divij Vaidya
Thank you Philip for the response. I will post more comments about this in the upcoming days but meanwhile here are my initial thoughts. Please let me know what you think about them. Addition to terminology Let's divide the API calls from the consumer into two categories. System API calls and

Re: [VOTE] 3.5.0 RC0

2023-05-24 Thread Mickael Maison
Hi David, We're already quite a bit behind schedule. If you think these fixes are really important and can be ready in the next couple of days, I'm open to backport them and build another release candidate. Let me know once you've investigated the severity of KAFKA-15010. Thanks, Mickael On

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.4 #140

2023-05-24 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1864

2023-05-24 Thread Apache Jenkins Server
See Changes: -- [...truncated 568902 lines...] [2023-05-24T11:42:09.856Z] Gradle Test Run :streams:integrationTest > Gradle Test Executor 179 >

Re: [DISCUSS] Adding non-committers as Github collaborators

2023-05-24 Thread Federico Valeri
+1 on Divij suggestions On Wed, May 24, 2023 at 12:04 PM Divij Vaidya wrote: > > Hey folks > > A week into this experiment, I am finding the ability to add labels, > request for reviewers and ability to close PRs very useful. > > 1. May I suggest an improvement to the process by requesting for

[jira] [Resolved] (KAFKA-12384) Flaky Test ListOffsetsRequestTest.testResponseIncludesLeaderEpoch

2023-05-24 Thread Viktor Somogyi-Vass (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viktor Somogyi-Vass resolved KAFKA-12384. - Fix Version/s: 3.6.0 Resolution: Fixed > Flaky Test

Re: [DISCUSS] Adding non-committers as Github collaborators

2023-05-24 Thread Yash Mayya
Hey folks, Are there any additional steps required in order to be able to trigger Jenkins builds on pull requests? The seemingly relevant link in the asf.yaml file appears to be a dead one - https://github.com/apache/kafka/blob/5b3b385881d5518ef1b2c63cb55244cf80a80da2/.asf.yaml#L25 (else it's a

[VOTE] 3.4.1 RC2

2023-05-24 Thread Luke Chen
Hello Kafka users, developers and client-developers, This is the 3rd candidate for release of Apache Kafka 3.4.1. This is a bugfix release with several fixes since the release of 3.4.0. A few of the major issues include: - core KAFKA-14644

Re: [DISCUSS] Adding non-committers as Github collaborators

2023-05-24 Thread Divij Vaidya
Hey folks A week into this experiment, I am finding the ability to add labels, request for reviewers and ability to close PRs very useful. 1. May I suggest an improvement to the process by requesting for some guidance on the interest areas for various committers. This would help us request for

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.4 #139

2023-05-24 Thread Apache Jenkins Server
See Changes: -- [...truncated 522816 lines...] [2023-05-24T09:33:57.790Z] Gradle Test Run :core:integrationTest > Gradle Test Executor 167 > KafkaZkClientTest >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.5 #5

2023-05-24 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.4 #138

2023-05-24 Thread Apache Jenkins Server
See Changes: -- [...truncated 519365 lines...] [2023-05-24T06:40:22.738Z] [Checks API] No suitable checks publisher found. [Pipeline] echo [2023-05-24T06:40:22.740Z] Skipping