Re: Request permissions to contribute to Apache Kafka

2023-12-21 Thread Josep Prat
Hi Jiao, Your accounts are now all set. The Jira one was already properly set up. Let me know if you have any problems with the accounts. Thanks for showing your interest in Apache Kafka, Best, On Fri, Dec 22, 2023 at 5:50 AM Jiao Zhang wrote: > Hi team, > > May I request permissions? > My

[jira] [Resolved] (KAFKA-16035) add integration test for ExpiresPerSec and RemoteLogSizeComputationTime metrics

2023-12-21 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-16035. --- Fix Version/s: 3.7.0 Resolution: Fixed > add integration test for ExpiresPerSec and

Re: DISCUSS KIP-1011: Use incrementalAlterConfigs when updating broker configs by kafka-configs.sh

2023-12-21 Thread ziming deng
+1 for adding them to rejected alternatives, These kafka-ui tools should also evolve with the iterations of Kafka. > On Dec 21, 2023, at 16:58, Николай Ижиков wrote: > >> In fact alterConfig and incrementalAlterConfig have different semantics, we >> should pass all configs when using

Request permissions to contribute to Apache Kafka

2023-12-21 Thread Jiao Zhang
Hi team, May I request permissions? My wiki ID is "zhangjiao.thu" My jira ID is "Jiao-zhang" Thank you! -- Jiao Zhang

Re: [DISCUSS] Road to Kafka 4.0

2023-12-21 Thread Luke Chen
For release 3.8, I think we should also include the unclean leader election support in KRaft. But we can discuss more details in the KIP. Thank you, Josep! And thank you all for the comments! Luke On Fri, Dec 22, 2023 at 1:14 AM Ismael Juma wrote: > Thank you Josep! > > Ismael > > On Thu, Dec

Re: [DISCUSS] KIP-954: expand default DSL store configuration to custom types

2023-12-21 Thread Almog Gavra
Hello Everyone! I updated the KIP once more as a result of a bug investigation - I added DslWindowParams#isTimestamped to the public API as a result of https://issues.apache.org/jira/browse/KAFKA-16046. Please let me know if there's any concerns with this addition. On Thu, Dec 14, 2023 at 5:40 PM

[jira] [Created] (KAFKA-16046) Stream Stream Joins fail after restoration with deserialization exceptions

2023-12-21 Thread Almog Gavra (Jira)
Almog Gavra created KAFKA-16046: --- Summary: Stream Stream Joins fail after restoration with deserialization exceptions Key: KAFKA-16046 URL: https://issues.apache.org/jira/browse/KAFKA-16046 Project:

Re: Kafka trunk test & build stability

2023-12-21 Thread Philip Nee
Hey Sophie - I've gotten 2 inflight PRs each with more than 15 retries... Namely: https://github.com/apache/kafka/pull/15023 and https://github.com/apache/kafka/pull/15035 justin filed a flaky test report here though: https://issues.apache.org/jira/browse/KAFKA-16045 P On Thu, Dec 21, 2023 at

Re: Kafka trunk test & build stability

2023-12-21 Thread Sophie Blee-Goldman
On a related note, has anyone else had trouble getting even a single run with no build failures lately? I've had multiple pure-docs PRs blocked for days or even weeks because of miscellaneous infra, test, and timeout failures. I know we just had a discussion about whether it's acceptable to ever

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.7 #29

2023-12-21 Thread Apache Jenkins Server
See Changes: -- [...truncated 3007 lines...] > Task :core:compileTestScala > Task :clients:check > Task :core:compileScala [Warn]

[jira] [Resolved] (KAFKA-16040) Rename `Generic` to `Classic`

2023-12-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16040. - Resolution: Fixed > Rename `Generic` to `Classic` > - > >

[jira] [Created] (KAFKA-16045) ZkMigrationIntegrationTest.testMigrateTopicDeletion flaky

2023-12-21 Thread Justine Olshan (Jira)
Justine Olshan created KAFKA-16045: -- Summary: ZkMigrationIntegrationTest.testMigrateTopicDeletion flaky Key: KAFKA-16045 URL: https://issues.apache.org/jira/browse/KAFKA-16045 Project: Kafka

Re: [DISCUSS] Road to Kafka 4.0

2023-12-21 Thread Ismael Juma
Thank you Josep! Ismael On Thu, Dec 21, 2023, 9:09 AM Josep Prat wrote: > Hi Ismael, > > I can volunteer to write the KIP. Unless somebody else has any objections, > I'll get to write it by the end of this week. > > Best, > > Josep Prat > Open Source Engineering Director,

Re: [DISCUSS] Road to Kafka 4.0

2023-12-21 Thread Josep Prat
Hi Ismael, I can volunteer to write the KIP. Unless somebody else has any objections, I'll get to write it by the end of this week. Best, Josep Prat Open Source Engineering Director, aivenjosep.p...@aiven.io | +491715557497 | aiven.io Aiven Deutschland GmbH Alexanderufer 3-7, 10117 Berlin

Re: [DISCUSS] Road to Kafka 4.0

2023-12-21 Thread David Jacot
Thanks, Ismael. The proposal makes sense. +1 David On Thu, Dec 21, 2023 at 5:59 PM Ismael Juma wrote: > Hi all, > > After understanding the use case Josep and Anton described in more detail, > I think it's fair to say that quorum reconfiguration is necessary for > migration of Apache Kafka

Re: [DISCUSS] Road to Kafka 4.0

2023-12-21 Thread Ismael Juma
Hi all, After understanding the use case Josep and Anton described in more detail, I think it's fair to say that quorum reconfiguration is necessary for migration of Apache Kafka users who follow this pattern. Given that, I think we should have a 3.8 release before the 4.0 release. The next

[jira] [Created] (KAFKA-16044) Throttling using Topic Partition Quota

2023-12-21 Thread Afshin Moazami (Jira)
Afshin Moazami created KAFKA-16044: -- Summary: Throttling using Topic Partition Quota Key: KAFKA-16044 URL: https://issues.apache.org/jira/browse/KAFKA-16044 Project: Kafka Issue Type: New

[jira] [Created] (KAFKA-16043) Add Quota configuration for topics

2023-12-21 Thread Afshin Moazami (Jira)
Afshin Moazami created KAFKA-16043: -- Summary: Add Quota configuration for topics Key: KAFKA-16043 URL: https://issues.apache.org/jira/browse/KAFKA-16043 Project: Kafka Issue Type: New

[jira] [Created] (KAFKA-16042) Quota Metrics based on per topic-partition produce/fetch byte rate

2023-12-21 Thread Afshin Moazami (Jira)
Afshin Moazami created KAFKA-16042: -- Summary: Quota Metrics based on per topic-partition produce/fetch byte rate Key: KAFKA-16042 URL: https://issues.apache.org/jira/browse/KAFKA-16042 Project:

Re: [DISCUSS] Road to Kafka 4.0

2023-12-21 Thread Justine Olshan
Hey all, While I understand your points Divij, I am also not in favor of having two official release branches being developed at the same time. If we are really concerned about the metrics change or any other JIRA ticket, we can have a separate branch for that, rather than a new release branch. I

Re: [DISCUSS] Road to Kafka 4.0

2023-12-21 Thread Divij Vaidya
Fair point David. The point of experimental release was to allow users to test the initial major version and allow for developers to start working on the major version. Even if we don't release, I think that there is value in starting a 4.x branch (separate from trunk). Having a 4.x branch will

Re: [DISCUSS] Road to Kafka 4.0

2023-12-21 Thread Ismael Juma
Hi Divij, Comments inline. On Thu, Dec 21, 2023 at 7:00 AM Divij Vaidya wrote: > 1\ Durability/availability bugs in kraft - Even though kraft has been > around for a while, we keep finding bugs that impact availability and data > durability in it almost with every release [1] [2]. It's a

[jira] [Created] (KAFKA-16041) Replace Afterburn module with Blackbird

2023-12-21 Thread Mario Fiore Vitale (Jira)
Mario Fiore Vitale created KAFKA-16041: -- Summary: Replace Afterburn module with Blackbird Key: KAFKA-16041 URL: https://issues.apache.org/jira/browse/KAFKA-16041 Project: Kafka Issue

Re: [DISCUSS] Road to Kafka 4.0

2023-12-21 Thread David Jacot
Hi Divij, > Release 4.0 as an "experimental" release I don't think that this is something that we should do. If we need more time, we should just do a 3.8 release and then release 4.0 when we are ready. An experimental major release will be more confusing than anything else. We should also keep

Re: [DISCUSS] Road to Kafka 4.0

2023-12-21 Thread Divij Vaidya
Hi folks I am late to the conversation but I would like to add my point of view here. I have three main concerns: 1\ Durability/availability bugs in kraft - Even though kraft has been around for a while, we keep finding bugs that impact availability and data durability in it almost with every

[jira] [Resolved] (KAFKA-15456) Add support for OffsetFetch version 9 in consumer

2023-12-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15456. - Resolution: Fixed > Add support for OffsetFetch version 9 in consumer >

[jira] [Resolved] (KAFKA-16030) new group coordinator should check if partition goes offline during load

2023-12-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16030. - Fix Version/s: 3.7.0 Resolution: Fixed > new group coordinator should check if partition

[jira] [Created] (KAFKA-16040) Rename `Generic` to `Classic`

2023-12-21 Thread David Jacot (Jira)
David Jacot created KAFKA-16040: --- Summary: Rename `Generic` to `Classic` Key: KAFKA-16040 URL: https://issues.apache.org/jira/browse/KAFKA-16040 Project: Kafka Issue Type: Sub-task

[jira] [Resolved] (KAFKA-16036) Add `group.coordinator.rebalance.protocols` and publish all new configs

2023-12-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16036. - Resolution: Fixed > Add `group.coordinator.rebalance.protocols` and publish all new configs >

Re: [VOTE] KIP-1007: Introduce Remote Storage Not Ready Exception

2023-12-21 Thread Luke Chen
Hi Kamal, Thanks for the KIP. +1 (binding) from me. Luke On Thu, Dec 21, 2023 at 4:51 PM Christo Lolov wrote: > Heya Kamal, > > The proposed change makes sense to me as it will be a more explicit > behaviour than what Kafka does today - I am happy with it! > > +1 (non-binding) from me > >

Re: DISCUSS KIP-1011: Use incrementalAlterConfigs when updating broker configs by kafka-configs.sh

2023-12-21 Thread Николай Ижиков
> In fact alterConfig and incrementalAlterConfig have different semantics, we > should pass all configs when using alterConfig and we can update config > incrementally using incrementalAlterConfigs, and is’t not worth doing so > since alterConfig has been deprecated for a long time. There can

[VOTE] KIP-1005: Expose EarliestLocalOffset and TieredOffset

2023-12-21 Thread Christo Lolov
Heya all! KIP-1005 ( https://cwiki.apache.org/confluence/display/KAFKA/KIP-1005%3A+Expose+EarliestLocalOffset+and+TieredOffset) has been open for around a month with no further comments - I would like to start a voting round on it! Best, Christo

Re: [VOTE] KIP-1007: Introduce Remote Storage Not Ready Exception

2023-12-21 Thread Christo Lolov
Heya Kamal, The proposed change makes sense to me as it will be a more explicit behaviour than what Kafka does today - I am happy with it! +1 (non-binding) from me Best, Christo On Tue, 12 Dec 2023 at 09:01, Kamal Chandraprakash < kamal.chandraprak...@gmail.com> wrote: > Hi, > > I would like