Re: [DISCUSS] Apache Kafka 3.8.0 release

Hi Josep, See my comments below. On Wed, May 29, 2024 at 10:52 AM Josep Prat wrote: > So I would propose to leave the deadlines as they are and manually cherry > pick the commits related to KIP-853 and KIP-966. Your proposal sounds good to me. I suspect that will be doing feature development

Re: [DISCUSS] Apache Kafka 3.8.0 release

Makes sense to me. On Fri, May 31, 2024 at 2:05 AM Luke Chen wrote: > Hi Justine, > > In the KIP-1012 discussion thread > , our > conclusion should be having an "automatic" unclean leader election in > KRaft, even if KIP-966

Re: [DISCUSS] Apache Kafka 3.8.0 release

Hi Justine, In the KIP-1012 discussion thread , our conclusion should be having an "automatic" unclean leader election in KRaft, even if KIP-966 cannot complete in time. > We should specify in KIP-1012 that we need to have some

Re: [DISCUSS] Apache Kafka 3.8.0 release

My understanding is on Kraft, automatic unclean leadership election is disabled, but it can be manually triggered. See this note from Colin on another email thread: > We do have the concept of unclean leader election in KRaft, but it has to be triggered by the leader election tool currently.

Re: [DISCUSS] Apache Kafka 3.8.0 release

Hi Mickael, Part 1 adds the ELR and enables the leader election improvements related to ELR. It does not change unclean leader election behavior which I think is hard-coded to be disabled. Part 2 should replace the current unclean leader election with the unclean recovery. Colin McCabe will help

Re: [DISCUSS] Apache Kafka 3.8.0 release

Hi Calvin, What's not clear from your reply is whether "KIP-966 Part 1" contains the ability to perform unclean leader elections with KRaft? Hopefully we have committers already looking at these. If you need additional help, please shout (well ping!) Thanks, Mickael On Thu, May 30, 2024 at 6:05 

Re: [DISCUSS] Apache Kafka 3.8.0 release

Sounds good, thanks Josep! Ismael On Wed, May 29, 2024 at 7:51 AM Josep Prat wrote: > Hi Ismael, > > I think your proposal makes more sense than mine. The end goal is to try to > get these 2 KIPs in 3.8.0 if possible. I think we can also achieve this by > not delaying the general feature

Re: [DISCUSS] Apache Kafka 3.8.0 release

same manner as with KIP-853 > > and KIP-966. > > regards, > > > > De : Josep Prat > > Envoyé : mercredi 29 mai 2024 16:51 > > À : dev@kafka.apache.org > > Objet : [EXT] Re: [DISCUSS] Apache Kafka 3.8.0 release > > > > Warning External

Re: [DISCUSS] Apache Kafka 3.8.0 release

pache.org > Objet : [EXT] Re: [DISCUSS] Apache Kafka 3.8.0 release > > Warning External sender Do not click on any links or open any attachments > unless you trust the sender and know the content is safe. > > Hi Ismael, > > I think your proposal makes more sense than mine. Th

Re: [DISCUSS] Apache Kafka 3.8.0 release

: [DISCUSS] Apache Kafka 3.8.0 release Warning External sender Do not click on any links or open any attachments unless you trust the sender and know the content is safe. Hi Ismael, I think your proposal makes more sense than mine. The end goal is to try to get these 2 KIPs in 3.8.0 if possible

Re: [DISCUSS] Apache Kafka 3.8.0 release

Hi Ismael, I think your proposal makes more sense than mine. The end goal is to try to get these 2 KIPs in 3.8.0 if possible. I think we can also achieve this by not delaying the general feature freeze, but rather by cherry picking the future commits on these features to the 3.8 branch. So I

Re: [DISCUSS] Apache Kafka 3.8.0 release

Hi Josep, It's generally a bad idea to push these dates because the scope keeps increasing then. If there are features that need more time and we believe they are essential for 3.8 due to its special nature as the last release before 4.0, we should allow them to be cherry-picked to the release

Re: [DISCUSS] Apache Kafka 3.8.0 release

Hi Mickael, I'd need some help from @José Armando García Sancio and Calvin Liu (explicitly added to the email) to have a better estimation on how much effort is left. Regarding KIP-853, it seems a good deal of tasks are assigned and some seem to be in progress (regardless of what the status

Re: [DISCUSS] Apache Kafka 3.8.0 release

Hi Josep, The point of the 3.8.0 release was to bridge feature gaps we identified between ZooKeeper and KRaft based Kafka clusters. In KIP-1012, we had identified 2 features we needed before 4.0: KIP-853 and unclean leader elections (KIP-966?). Can we have a status update on both of these

Re: [DISCUSS] Apache Kafka 3.8.0 release

A correction on the dates as they should be: - Feature freeze is on June 12th (you wrote May before) - code freeze is on June 26th So these are the new proposed deadlines. Best, On Wed, May 29, 2024 at 12:48 PM Luke Chen wrote: > Hi Josep, > > Thanks for raising this. > I'm +1 for delaying

Re: [DISCUSS] Apache Kafka 3.8.0 release

Hi Josep, Thanks for raising this. I'm +1 for delaying some time to have features completed. But I think we might need to make it clear, what's the updated feature freeze date/code freeze date? Is this correct? - Feature freeze is on May 12th - Code freeze is June 26th Thanks. Luke On Wed,

Re: [DISCUSS] Apache Kafka 3.8.0 release

Hi Kafka developers, Given the fact we have a couple of KIPs that are halfway through their implementation and it seems it's a matter of days (1 or 2 weeks) to have them completed. What would you think if we delay feature freeze and code freeze by 2 weeks? Let me know your thoughts. Best, On

Re: [DISCUSS] Apache Kafka 3.8.0 release

Hi Kafka developers, This is a reminder about the upcoming deadlines: - Feature freeze is on May 29th - Code freeze is June 12th I'll cut the new branch during morning hours (CEST) on May 30th. Thanks all! On Thu, May 16, 2024 at 8:34 AM Josep Prat wrote: > Hi all, > > We are now officially

Re: [DISCUSS] Apache Kafka 3.8.0 release

Hi all, We are now officially past the KIP freeze deadline. KIPs that are approved after this point in time shouldn't be adopted in the 3.8.x release (except the 2 already mentioned KIPS 989 and 1028 assuming no vetoes occur). Reminder of the upcoming deadlines: - Feature freeze is on May 29th -

Re: [DISCUSS] Apache Kafka 3.8.0 release

Hi Nick, If nobody comes up with concerns or pushback until the time of closing the vote, I think we can take it for 3.8. Best, - Josep Prat Open Source Engineering Director, aivenjosep.p...@aiven.io | +491715557497 | aiven.io Aiven Deutschland GmbH Alexanderufer 3-7, 10117

Re: [DISCUSS] Apache Kafka 3.8.0 release

Hi Josep, Would it be possible to sneak KIP-989 into 3.8? Just as with 1028, it's currently being voted on and has already received the requisite votes. The only thing holding it back is the 72 hour voting window. Vote thread here: https://lists.apache.org/thread/nhr65h4784z49jbsyt5nx8ys81q90k6s

Re: [DISCUSS] Apache Kafka 3.8.0 release

And my maths are wrong! I added 24 hours more to all the numbers in there. If after 72 hours no vetoes appear, I have no objections on adding this specific KIP as it shouldn't have a big blast radius of affectation. Best, On Wed, May 15, 2024 at 6:44 PM Josep Prat wrote: > Ah, I see Chris was

Re: [DISCUSS] Apache Kafka 3.8.0 release

Ah, I see Chris was faster writing this than me. On Wed, May 15, 2024 at 6:43 PM Josep Prat wrote: > Hi all, > You still have the full day of today (independently for the timezone) to > get KIPs approved. Tomorrow morning (CEST timezone) I'll send another email > asking developers to assign

Re: [DISCUSS] Apache Kafka 3.8.0 release

Hi all, You still have the full day of today (independently for the timezone) to get KIPs approved. Tomorrow morning (CEST timezone) I'll send another email asking developers to assign future approved KIPs to another version that is not 3.8. So, the only problem I see with KIP-1028 is that it

Re: [DISCUSS] Apache Kafka 3.8.0 release

The KIP isn't officially accepted until its vote thread closes after being open for at least three days. KIP-1028 won't make that deadline. On Wed, May 15, 2024, 12:36 Ismael Juma wrote: > The KIP freeze is just about having the KIP accepted. Not sure why we would > need an exception for that.

Re: [DISCUSS] Apache Kafka 3.8.0 release

The KIP freeze is just about having the KIP accepted. Not sure why we would need an exception for that. Ismael On Wed, May 15, 2024 at 9:20 AM Chris Egerton wrote: > FWIW I think that the low blast radius for KIP-1028 should allow it to > proceed without adhering to the usual KIP and feature

Re: [DISCUSS] Apache Kafka 3.8.0 release

FWIW I think that the low blast radius for KIP-1028 should allow it to proceed without adhering to the usual KIP and feature freeze dates. Code freeze is probably worth still respecting, at least if changes are required to the docker/jvm/Dockerfile. But I defer to Josep's judgement as the release

Re: [DISCUSS] Apache Kafka 3.8.0 release

Hey Josep! The KIP 1028 has received the required votes. Voting thread:- https://lists.apache.org/thread/cdq4wfv5v1gpqlxnf46ycwtcwk5wos4q But we are keeping the vote open for 72 hours as per the process. I would like to request you to please consider it for the 3.8.0 release. Thanks and

Re: [DISCUSS] Apache Kafka 3.8.0 release

Hi Kafka developers! Today is the KIP freeze deadline. All KIPs should be accepted by EOD today. Tomorrow morning (CEST timezone) I'll start summarizing all KIPs that have been approved. Please any KIP approved after tomorrow should be adopted in a future release version, not 3.8. Other relevant

Re: [DISCUSS] Apache Kafka 3.8.0 release

Hi Kafka developers! I just wanted to remind you all of the upcoming relevant dates for Kafka 3.8.0: - KIP freeze is on May 15th (this is in a little less than 2 weeks) - Feature freeze is on May 29th (this is in a little more than 25 days). If there is a KIP you really want to have in the 3.8

Re: [DISCUSS] Apache Kafka 3.8.0 release

Hi all, Thanks for your support. I updated the skeleton release plan created by Colin. You can find it here: https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+3.8.0 Our last release stumbled upon some problems while releasing and was delayed by several weeks, so I won't try to shave

Re: [DISCUSS] Apache Kafka 3.8.0 release

Thanks Josep, +1. On Tue, 27 Feb 2024 at 17:29, Divij Vaidya wrote: > > Thank you for volunteering Josep. +1 from me. > > -- > Divij Vaidya > > > > On Tue, Feb 27, 2024 at 9:35 AM Bruno Cadonna wrote: > > > Thanks Josep! > > > > +1 > > > > Best, > > Bruno > > > > On 2/26/24 9:53 PM, Chris

Re: [DISCUSS] Apache Kafka 3.8.0 release

Thank you for volunteering Josep. +1 from me. -- Divij Vaidya On Tue, Feb 27, 2024 at 9:35 AM Bruno Cadonna wrote: > Thanks Josep! > > +1 > > Best, > Bruno > > On 2/26/24 9:53 PM, Chris Egerton wrote: > > Thanks Josep, I'm +1 as well. > > > > On Mon, Feb 26, 2024 at 12:32 PM Justine Olshan >

Re: [DISCUSS] Apache Kafka 3.8.0 release

Thanks Josep! +1 Best, Bruno On 2/26/24 9:53 PM, Chris Egerton wrote: Thanks Josep, I'm +1 as well. On Mon, Feb 26, 2024 at 12:32 PM Justine Olshan wrote: Thanks Joesp. +1 from me. On Mon, Feb 26, 2024 at 3:37 AM Josep Prat wrote: Hi all, I'd like to volunteer as release manager for

Re: [DISCUSS] Apache Kafka 3.8.0 release

Thanks Josep, I'm +1 as well. On Mon, Feb 26, 2024 at 12:32 PM Justine Olshan wrote: > Thanks Joesp. +1 from me. > > On Mon, Feb 26, 2024 at 3:37 AM Josep Prat > wrote: > > > Hi all, > > > > I'd like to volunteer as release manager for the Apache Kafka 3.8.0 > > release. > > If there are no

Re: [DISCUSS] Apache Kafka 3.8.0 release

Thanks Joesp. +1 from me. On Mon, Feb 26, 2024 at 3:37 AM Josep Prat wrote: > Hi all, > > I'd like to volunteer as release manager for the Apache Kafka 3.8.0 > release. > If there are no objections, I'll start building a release plan (or adapting > the one Colin made some weeks ago) in the wiki

[DISCUSS] Apache Kafka 3.8.0 release

Hi all, I'd like to volunteer as release manager for the Apache Kafka 3.8.0 release. If there are no objections, I'll start building a release plan (or adapting the one Colin made some weeks ago) in the wiki in the next days. Thank you. -- [image: Aiven] *Josep Prat*