Re: [DISCUSS] KIP-838 Simulate batching and compression

I’ll start with the code if you consider this feature could be useful, what do you think ? Regarding to the code I’ll use the same classes dump-logs uses for reading records and add the logic on top of it. Best regards Sergio Troiano Sent from my iPhone > On 16 May 2022, at 20:48, Sergio Da

Re: [VOTE] KIP-831: Add metric for log recovery progress

+1 (non-binding) -James Sent from my iPhone > On May 16, 2022, at 12:12 AM, Luke Chen wrote: > > Hi all, > > I'd like to start a vote on KIP to expose metrics for log recovery > progress. These metrics would let the admins have a way to monitor the log > recovery progress. > > Details can b

Re: [ANNOUNCE] Apache Kafka 3.2.0

Thanks Bruno! Sagar. On Wed, May 18, 2022 at 8:27 AM Luke Chen wrote: > Thank you, Bruno! > > On Wed, May 18, 2022 at 2:16 AM Guozhang Wang wrote: > > > Congrats to everyone who's contributed to 3.2.0, and special thank you to > > Bruno for running the release! > > > > Guozhang > > > > On Tue,

[jira] [Created] (KAFKA-13910) Test metadata refresh for Kraft admin client

dengziming created KAFKA-13910: -- Summary: Test metadata refresh for Kraft admin client Key: KAFKA-13910 URL: https://issues.apache.org/jira/browse/KAFKA-13910 Project: Kafka Issue Type: Test

Re: [ANNOUNCE] Apache Kafka 3.2.0

Thank you, Bruno! On Wed, May 18, 2022 at 2:16 AM Guozhang Wang wrote: > Congrats to everyone who's contributed to 3.2.0, and special thank you to > Bruno for running the release! > > Guozhang > > On Tue, May 17, 2022 at 9:52 AM Bill Bejeck wrote: > > > Thanks for running the release Bruno! > >

Re: [DISCUSS] KIP-836: Addition of Information in DescribeQuorumResponse about Voter Lag

Hello Niket, 1. I find the DescribeQuorumResult still contains an DescribeQuorumResponseData, which is not allowed as Jose commented, have you forgot to change it? 2. You only add an Handle in AdminClient, can you also add an `kafka-metadata-quorum.sh` tool to help this? > On May 17, 2022,

Re: Permission request to contribute

Thanks Bill! @Austin, your wiki permission is set now. Thank you. Luke On Wed, May 18, 2022 at 6:40 AM Bill Bejeck wrote: > Hi Austin, > > You're all set with Jira, but at the moment it seems like there's a > connection issue with the wiki and I haven't been able to add you there > yet. > I'll

Jenkins build is back to normal : Kafka » Kafka Branch Builder » trunk #939

See

Re: Permission request to contribute

Hi Austin, You're all set with Jira, but at the moment it seems like there's a connection issue with the wiki and I haven't been able to add you there yet. I'll try again later on. Thanks for your interest in the Apache Kafka project! -Bill On Tue, May 17, 2022 at 5:18 PM Austin Heyne wrote:

Permission request to contribute

I'd like to request permission to contribute to Kafka Wiki ID: aheyne Jira ID: aheyne Thanks, Austin

Data Engineering Track at ApacheCon (October 3-6, New Orleans) - CFP ends 23/05

Hello, ApacheCon North America is back in person this year in October. https://apachecon.com/acna2022/ Together with Jarek Potiuk, we are organizing for the first time a Data Engineering Track as part of ApacheCon. You might be wondering why a different track if we already have the Big Data trac

Re: [VOTE] KIP-836: Addition of Information in DescribeQuorumResponse about Voter Lag

+1 Thanks for the KIP! On Mon, May 16, 2022 at 10:14 AM Niket Goel wrote: > Hi all, > > I would like to start a vote for KIP-836: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-836%3A+Addition+of+Information+in+DescribeQuorumResponse+about+Voter+Lag > > Thanks > Niket Goel >

Re: [ANNOUNCE] Apache Kafka 3.2.0

Congrats to everyone who's contributed to 3.2.0, and special thank you to Bruno for running the release! Guozhang On Tue, May 17, 2022 at 9:52 AM Bill Bejeck wrote: > Thanks for running the release Bruno! > > On Tue, May 17, 2022 at 12:02 PM Bruno Cadonna wrote: > > > The Apache Kafka communit

[VOTE] KIP-833: Mark KRaft as Production Ready

Hi, I'd like to start the vote on KIP-833: Mark KRaft as Production Ready. https://cwiki.apache.org/confluence/x/8xKhD thanks, Colin

Re: [ANNOUNCE] Apache Kafka 3.2.0

Thanks for running the release Bruno! On Tue, May 17, 2022 at 12:02 PM Bruno Cadonna wrote: > The Apache Kafka community is pleased to announce the release for Apache > Kafka 3.2.0 > > * log4j 1.x is replaced with reload4j (KAFKA-9366) > * StandardAuthorizer for KRaft (KIP-801) > * Send a hint t

Re: [ANNOUNCE] Apache Kafka 3.2.0

Thanks Bruno for running this release! On Tue, May 17, 2022 at 6:02 PM Bruno Cadonna wrote: > > The Apache Kafka community is pleased to announce the release for Apache > Kafka 3.2.0 > > * log4j 1.x is replaced with reload4j (KAFKA-9366) > * StandardAuthorizer for KRaft (KIP-801) > * Send a hint

Re: [VOTE] KIP-827: Expose logdirs total and usable space via Kafka API

Thanks for this KIP Mickael. +1 non binding -- Igor On Tue, May 17, 2022, at 2:48 PM, Luke Chen wrote: > Hi Mickael, > > +1 (binding) from me. > Thanks for the KIP! > > Luke > > On Tue, May 17, 2022 at 9:30 PM Mickael Maison > wrote: > >> Hi, >> >> I'd like to start a vote on KIP-827. It propos

[ANNOUNCE] Apache Kafka 3.2.0

The Apache Kafka community is pleased to announce the release for Apache Kafka 3.2.0 * log4j 1.x is replaced with reload4j (KAFKA-9366) * StandardAuthorizer for KRaft (KIP-801) * Send a hint to the partition leader to recover the partition (KIP-704) * Top-level error code field in DescribeLogDir

Re: [DISCUSS] KIP-827: Expose logdirs total and usable space via Kafka API

Hi Mickael, Thanks for the KIP. Two questions: 1. Is `space` redundant? is `totalBytes` and `usableBytes` a more concise description of the same thing? 2. Is usable space a property of the log directory? What if you have multiple log directories in the same underlying OS partition? Ismael On T

Re: CI on Kafka seems to be failing even on trunk branch

I think I have a fix for this in https://github.com/apache/kafka/pull/12174 Please take a look -- Igor On Tue, May 17, 2022, at 9:00 AM, Lim Qingwei wrote: > Thanks for all the tips, I'll look into KAFKA-13907. > > On Tue, May 17, 2022 at 3:40 AM deng ziming > wrote: > >> You can help to solve t

Re: [kafka-clients] Re: [VOTE] 3.2.0 RC1

Hi Ismael, Thank you for the clarification! With "next release" I meant the release after 3.2.0, i.e., 3.3.0 or also 3.2.1 if we backport the doc change to 3.2. I admit that this was not entirely clear from my earlier e-mail. Best, Bruno On 17.05.22 16:21, Ismael Juma wrote: Hi Bruno, On

Re: [kafka-clients] Re: [VOTE] 3.2.0 RC1

Hi Bruno, One clarification, the documentation that was updated is not shipped with the release - it's only on the website. As you said, the website can be updated at any time. Ismael On Mon, May 16, 2022 at 4:16 AM Bruno Cadonna wrote: > Hi Divij, > > The documentation that is shipped with Ap

Re: [VOTE] KIP-830: Allow disabling JMX Reporter

+1 (non binding) Thanks. On Tue, May 17, 2022 at 3:47 PM Mickael Maison wrote: > > Hi, > > I'd like to start a vote on KIP-830 which proposes a method for a > method for disabling JMXReporter and making JMXReporter behave like > other reporters in the next major release when it will need to be >

Re: [VOTE] KIP-830: Allow disabling JMX Reporter

Thanks Mickael. Quick question: "When set to true, a warning will be printed to indicate this setting is deprecated and recommend using metric.reporters instead." The config defaults to true, so I think we should be a bit clearer when the warning is printed. I was thinking we would print the warn

Re: [VOTE] KIP-827: Expose logdirs total and usable space via Kafka API

Hi Mickael, +1 (binding) from me. Thanks for the KIP! Luke On Tue, May 17, 2022 at 9:30 PM Mickael Maison wrote: > Hi, > > I'd like to start a vote on KIP-827. It proposes exposing the total > and usable space of logdirs > via the DescribeLogDirs API: > > https://cwiki.apache.org/confluence/di

[VOTE] KIP-830: Allow disabling JMX Reporter

Hi, I'd like to start a vote on KIP-830 which proposes a method for a method for disabling JMXReporter and making JMXReporter behave like other reporters in the next major release when it will need to be explicitly listed in metric.reporters to be enabled. https://cwiki.apache.org/confluence/disp

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #938

See Changes: -- [...truncated 627271 lines...] [2022-05-17T13:25:52.058Z] > Task :streams:javadoc [2022-05-17T13:25:52.058Z] /home/jenkins/jenkins-agent/workspace/Kafka_kaf

[VOTE] KIP-827: Expose logdirs total and usable space via Kafka API

Hi, I'd like to start a vote on KIP-827. It proposes exposing the total and usable space of logdirs via the DescribeLogDirs API: https://cwiki.apache.org/confluence/display/KAFKA/KIP-827%3A+Expose+logdirs+total+and+usable+space+via+Kafka+API Thanks, Mickael

Re: [VOTE] KIP-714: Client Metrics and Observability

Hey all, It's that time of year again where we re-restart this vote thread after some additional discussions on the disco thread and minor adjustments&clarifications to the KIP. We're currently at +5 (non-binding) and -1 (non-binding) votes. Please cast your votes, people. Thanks, Magnus Den

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #937

See

[GitHub] [kafka-site] milindmantri opened a new pull request, #412: MINOR: Fix DSL typo in streams docs

milindmantri opened a new pull request, #412: URL: https://github.com/apache/kafka-site/pull/412 Reference: apache/kafka#12152 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Created] (KAFKA-13909) Restart Kafka in KRaft mode with ACLs ends in a RuntimeException

Florian Blumenstein created KAFKA-13909: --- Summary: Restart Kafka in KRaft mode with ACLs ends in a RuntimeException Key: KAFKA-13909 URL: https://issues.apache.org/jira/browse/KAFKA-13909 Projec

[jira] [Created] (KAFKA-13908) RuntimeException will be thrown in BrokerServer.startup, not the cause of exception

Luke Chen created KAFKA-13908: - Summary: RuntimeException will be thrown in BrokerServer.startup, not the cause of exception Key: KAFKA-13908 URL: https://issues.apache.org/jira/browse/KAFKA-13908 Project

[jira] [Resolved] (KAFKA-13905) Fix failing ServerShutdownTest.testCleanShutdownAfterFailedStartupDueToCorruptLogs

[ https://issues.apache.org/jira/browse/KAFKA-13905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-13905. --- Fix Version/s: 3.3.0 Resolution: Fixed > Fix failing > ServerShutdownTest.testCleanShutdownA

Re: CI on Kafka seems to be failing even on trunk branch

Thanks for all the tips, I'll look into KAFKA-13907. On Tue, May 17, 2022 at 3:40 AM deng ziming wrote: > You can help to solve this bug first if you are free, > https://issues.apache.org/jira/browse/KAFKA-13907 < > https://issues.apache.org/jira/browse/KAFKA-13907>, since this bug can be > repr

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #936

See Changes: -- [...truncated 547120 lines...] [2022-05-17T02:22:57.968Z] [INFO] --- maven-gpg-plugin:1.6:sign (sign-artifacts) @ streams-quickstart --- [2022-05-17T02:22:5