Re: CI on Kafka seems to be failing even on trunk branch

You can help to solve this bug first if you are free, https://issues.apache.org/jira/browse/KAFKA-13907 , since this bug can be reproduced locally, it won't be hard to investigated. > On May 17, 2022, at 12:34 AM, Lim Qingwei wrote: > > Hi,

[jira] [Created] (KAFKA-13907) Fix hanging ServerShutdownTest.testCleanShutdownWithKRaftControllerUnavailable

dengziming created KAFKA-13907: -- Summary: Fix hanging ServerShutdownTest.testCleanShutdownWithKRaftControllerUnavailable Key: KAFKA-13907 URL: https://issues.apache.org/jira/browse/KAFKA-13907 Project:

Re: CI on Kafka seems to be failing even on trunk branch

Thanks for Divij's answer. One thing I'd like to add is that it'd be better if you can help investigate and fix those flaky tests. :) Thank you. Luke On Tue, May 17, 2022 at 4:14 AM Divij Vaidya wrote: > Hi Lim > > We have quite a few tests which are flaky and fail stochastically from time >

Re: [DISCUSS] KIP-836: Addition of Information in DescribeQuorumResponse about Voter Lag

Thanks for the call out David. We will populate these fields for the Observers as well. I will clarify this in the KIP. On Mon, May 16, 2022 at 1:50 PM David Arthur wrote: > Niket, thanks for the KIP! > > Sorry for the late feedback on this, but I just had a quick question. The > KIP indicates

[jira] [Resolved] (KAFKA-13899) Inconsistent error codes returned from AlterConfig APIs

[ https://issues.apache.org/jira/browse/KAFKA-13899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-13899. - Fix Version/s: 3.2.1 Resolution: Fixed > Inconsistent error codes returned from

Re: [DISCUSS] KIP-835: Monitor KRaft Controller Quorum Health

Hi, Jose, Thanks for the KIP. Just a couple of minor comments. 20. For the metric type and name, we use the camel names in some cases and dashed lower names in some other cases. Should we make them consistent? 21. Could you document the meaning of load-processing-time? Thanks, Jun On Mon,

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #935

See Changes: -- [...truncated 627753 lines...] [2022-05-16T18:20:37.719Z] org.apache.kafka.streams.integration.StreamsUncaughtExceptionHandlerIntegrationTest >

Re: [VOTE] KIP-835: Monitor KRaft Controller Quorum Health

Hello José, Could you elaborate a bit on what does "load-processing-time-us" measure? I looked through the discussion thread and the KIP / JIRA but cannot find its definitions. Guozhang On Mon, May 16, 2022 at 1:30 PM David Arthur wrote: > Thanks José, the KIP looks good to me! > > +1

Re: [DISCUSS] KIP-836: Addition of Information in DescribeQuorumResponse about Voter Lag

Niket, thanks for the KIP! Sorry for the late feedback on this, but I just had a quick question. The KIP indicates the two new fields will be set for voters only, however this ReplicaState struct is also used by the Observers in DescribeQuorumResponse. Will we simply fill in -1 for these values,

Re: [DISCUSS] KIP-787 - MM2 Interface to manage Kafka resources

On Mon, May 16, 2022, at 10:24, Omnia Ibrahim wrote: > Hi Colin, > > Thanks for your reply. > > This KIP doesn’t aim to solve any security concerns, but rather a conflict > of responsibilities within any Kafka ecosystem that includes MM2 and any > resource management solution. I’m not sure that

Re: [VOTE] KIP-835: Monitor KRaft Controller Quorum Health

Thanks José, the KIP looks good to me! +1 binding -David On Mon, May 16, 2022 at 11:59 AM José Armando García Sancio wrote: > Hi all, > > I would like to start a vote for KIP-835: > https://cwiki.apache.org/confluence/x/0xShD > > Thanks you, > -José > -- David Arthur

Re: CI on Kafka seems to be failing even on trunk branch

Hi Lim We have quite a few tests which are flaky and fail stochastically from time to time. I would recommend that you check the tests which are failing for your PR. Search for JIRA for the test failures. If you spot a flaky test JIRA for the failure associated with your PR and the stack trace

Re: [DISCUSS] KIP-838 Simulate batching and compression

Hi Divij, First of all thanks for your time and dedication. About point one: You are right, the idea is to have "in real time" visibility of the way the clients are using the service as that is translated into a lot of money saving. I agree with the further vision although I think we are still

Re: [DISCUSS] KIP-836: Addition of Information in DescribeQuorumResponse about Voter Lag

Hi all, Thank you for the feedback on this. I have started a voting thread for this KIP here: https://lists.apache.org/thread/bkb7gsbxpljh5qh014ztffq7bldjrb2x Thanks Niket Goel From: Niket Goel Date: Thursday, May 12, 2022 at 5:25 PM To: dev@kafka.apache.org Subject: Re: [DISCUSS] KIP-836:

Re: [DISCUSS] KIP-787 - MM2 Interface to manage Kafka resources

Hi Colin, Thanks for your reply. This KIP doesn’t aim to solve any security concerns, but rather a conflict of responsibilities within any Kafka ecosystem that includes MM2 and any resource management solution. I’m not sure that was clear, so I’m concerned about the motivation for your

[VOTE] KIP-836: Addition of Information in DescribeQuorumResponse about Voter Lag

Hi all, I would like to start a vote for KIP-836: https://cwiki.apache.org/confluence/display/KAFKA/KIP-836%3A+Addition+of+Information+in+DescribeQuorumResponse+about+Voter+Lag Thanks Niket Goel

CI on Kafka seems to be failing even on trunk branch

Hi, I am a newbie. I noticed Jenkins builds are failing, is this expected? My PR has some failures, but I don't think they are relevant, how should I proceed? Can I still request for reviews? Kind regards

Re: [DISCUSS] KIP-835: Monitor KRaft Controller Quorum Health

Hi all, Thanks for your feedback. I started a voting thread here: https://lists.apache.org/thread/x1cy5otpf7mj9ytghnktr5hog27hdf7k

[VOTE] KIP-835: Monitor KRaft Controller Quorum Health

Hi all, I would like to start a vote for KIP-835: https://cwiki.apache.org/confluence/x/0xShD Thanks you, -José

[jira] [Resolved] (KAFKA-12635) Mirrormaker 2 offset sync is incorrect if the target partition is empty

[ https://issues.apache.org/jira/browse/KAFKA-12635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-12635. Fix Version/s: 3.3.0 Assignee: Mickael Maison (was: Ning Zhang)

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #934

See

Re: [VOTE] KIP-834: Pause / Resume KafkaStreams Topologies

Hi all, With 5 binding votes (John, Bruno, Sophie, Matthias, Bill) and 4 non-binding votes (Guozhang, Luke, Leah, Walker), the vote for KIP-834 passes! Thanks all for the great discussion. I have a PR up here: https://github.com/apache/kafka/pull/12161 Thanks in advance for feedback on the

[jira] [Created] (KAFKA-13906) Invalid replica state transition

Igor Soarez created KAFKA-13906: --- Summary: Invalid replica state transition Key: KAFKA-13906 URL: https://issues.apache.org/jira/browse/KAFKA-13906 Project: Kafka Issue Type: Bug

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #933

See

Re: [kafka-clients] Re: [VOTE] 3.2.0 RC1

Hi Divij, The documentation that is shipped with Apache Kafka 3.2.0 cannot be changed anymore. To change that we would need to create a new release candidate which would be disproportionate for such a document change. The PR you linked will be shipped in the docs of the next release. If

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #932

See

Re: [VOTE] KIP-831: Add metric for log recovery progress

Hello Luke, thanks for this KIP, +1 (non-binding) -- Best, Ziming > On May 16, 2022, at 3:59 PM, Divij Vaidya wrote: > > +1 (non-binding) > > > Divij Vaidya > > > > On Mon, May 16, 2022 at 10:12 AM Luke Chen wrote: > >> Hi all, >> >> I'd like to start a vote on KIP to expose metrics

Re: [kafka-clients] Re: [VOTE] 3.2.0 RC1

Perhaps, we want to merge in https://github.com/apache/kafka/pull/12164 before this release? Divij Vaidya On Mon, May 16, 2022 at 11:30 AM Bruno Cadonna wrote: > Mickael, > > Thanks a lot! > > Totally, missed that! > > Best, > Bruno > > On 16.05.22 10:13, Mickael Maison wrote: > > Hi Bruno,

Re: [ANNOUNCE] Apache Kafka 3.1.1

Thanks Tom! On Mon, May 16, 2022 at 4:31 PM Bruno Cadonna wrote: > Thanks Tom! > > On 16.05.22 10:25, David Jacot wrote: > > Thanks for driving this release, Tom! > > > > On Fri, May 13, 2022 at 12:50 PM Tom Bentley > wrote: > >> > >> The Apache Kafka community is pleased to announce the

[jira] [Created] (KAFKA-13905) Fix failing ServerShutdownTest.testCleanShutdownAfterFailedStartupDueToCorruptLogs

Luke Chen created KAFKA-13905: - Summary: Fix failing ServerShutdownTest.testCleanShutdownAfterFailedStartupDueToCorruptLogs Key: KAFKA-13905 URL: https://issues.apache.org/jira/browse/KAFKA-13905

Re: [DISCUSS] KIP-827: Expose logdirs total and usable space via Kafka API

Thanks for addressing my comments Mickael. No more comments/suggestions from my side. LGTM. Divij Vaidya On Tue, May 10, 2022 at 6:10 PM Mickael Maison wrote: > Hi Colin, > > Thanks for the suggestion. > > I guess there are pros and cons with both methods. In my mind I'm > expecting these

Re: [DISCUSS] KIP-838 Simulate batching and compression

Thank you for the KIP Sergio. High level thoughts: 1\ I understand that the idea here is to provide better visibility to the admins about potential improvements using compression and modifying batch size. I would take it a step further and say that we should be providing this visibility in a

Re: [ANNOUNCE] Apache Kafka 3.1.1

Thanks Tom! On 16.05.22 10:25, David Jacot wrote: Thanks for driving this release, Tom! On Fri, May 13, 2022 at 12:50 PM Tom Bentley wrote: The Apache Kafka community is pleased to announce the release for Apache Kafka 3.1.1 Apache Kafka 3.1.1 is a bugfix release and 30 issues have been

Re: [kafka-clients] Re: [VOTE] 3.2.0 RC1

Mickael, Thanks a lot! Totally, missed that! Best, Bruno On 16.05.22 10:13, Mickael Maison wrote: Hi Bruno, The blog post looks good. I just spotted a typo in the description of KIP-769, the endpoint is "/connector-plugins" instead of "/connect-plugins" (3 times). Thanks, Mickael On Sat,

Re: [ANNOUNCE] Apache Kafka 3.1.1

Thanks for driving this release, Tom! On Fri, May 13, 2022 at 12:50 PM Tom Bentley wrote: > > The Apache Kafka community is pleased to announce the release for > Apache Kafka 3.1.1 > > Apache Kafka 3.1.1 is a bugfix release and 30 issues have been fixed > since 3.1.0. > > All of the changes in

Re: [kafka-clients] Re: [VOTE] 3.2.0 RC1

Hi Bruno, The blog post looks good. I just spotted a typo in the description of KIP-769, the endpoint is "/connector-plugins" instead of "/connect-plugins" (3 times). Thanks, Mickael On Sat, May 14, 2022 at 5:45 PM Federico Valeri wrote: > > Hi Bruno, > > +1 (non binding) > > - Checked

Re: [VOTE] KIP-831: Add metric for log recovery progress

+1 (non-binding) Divij Vaidya On Mon, May 16, 2022 at 10:12 AM Luke Chen wrote: > Hi all, > > I'd like to start a vote on KIP to expose metrics for log recovery > progress. These metrics would let the admins have a way to monitor the log > recovery progress. > > Details can be found here: >

[jira] [Resolved] (KAFKA-12703) Allow unencrypted private keys when using PEM files

[ https://issues.apache.org/jira/browse/KAFKA-12703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-12703. - Fix Version/s: 3.3.0 Resolution: Fixed > Allow unencrypted private keys when using PEM

[VOTE] KIP-831: Add metric for log recovery progress

Hi all, I'd like to start a vote on KIP to expose metrics for log recovery progress. These metrics would let the admins have a way to monitor the log recovery progress. Details can be found here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-831%3A+Add+metric+for+log+recovery+progress