Re: [VOTE] KIP-859: Add Metadata Log Processing Error Related Metrics

2022-08-02 Thread Niket Goel
Thanks for taking the time to go over the KIP Colin. While I agree with both your points about error handling, I think this KIP focuses on just exposing these errors via the proposed metrics and does not alter the error handling behavior on either the brokers or the controllers. The metrics

Re: [ANNOUNCE] New Kafka PMC Member: A. Sophie Blee-Goldman

2022-08-02 Thread Jorge Esteban Quilcate Otoya
Congratulations, Sophie! On Tue, 2 Aug 2022, 23:26 Colin McCabe, wrote: > Congratulations! > > best, > Colin > > > On Tue, Aug 2, 2022, at 12:09, Matthew Benedict de Detrich wrote: > > Congratulations Sophie! > > > > -- > > Matthew de Detrich > > Aiven Deutschland GmbH > > Immanuelkirchstraße

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1115

2022-08-02 Thread Apache Jenkins Server
See Changes: -- [...truncated 497135 lines...] [2022-08-02T22:49:58.495Z] StreamsAssignmentScaleTest > testStickyTaskAssignorLargePartitionCount STARTED

Re: [VOTE] KIP-859: Add Metadata Log Processing Error Related Metrics

2022-08-02 Thread Colin McCabe
Hi Niket, Thanks for the KIP -- much appreciated! The new metrics look very useful. I agree with the proposed error handling for errors on standby controllers and brokers. For active controllers, I think we should establish two points: 1. the active controller replays metadata before

Re: [ANNOUNCE] New Kafka PMC Member: A. Sophie Blee-Goldman

2022-08-02 Thread Colin McCabe
Congratulations! best, Colin On Tue, Aug 2, 2022, at 12:09, Matthew Benedict de Detrich wrote: > Congratulations Sophie! > > -- > Matthew de Detrich > Aiven Deutschland GmbH > Immanuelkirchstraße 26, 10405 Berlin > Amtsgericht Charlottenburg, HRB 209739 B > > Geschäftsführer: Oskari Saarenmaa &

Re: [DISCUSS] KIP-854 Separate configuration for producer ID expiry

2022-08-02 Thread Justine Olshan
I've updated the KIP to make the new minimum value 1 and remove the -1 configuration. I've also added the low priority to the configuration and edited the description as Ismael mentioned. I'm thinking about bringing this KIP to a vote soon! Let me know if there are any other comments or

Re: Recent commit causes Gradle to load significantly slowly?

2022-08-02 Thread Ismael Juma
Does this happen consistently? Ismael On Tue, Aug 2, 2022 at 4:00 AM Matthew Benedict de Detrich wrote: > After syncing my fork with upstream Kafka at some point in time in the > past I noticed that Gradle takes significantly longer to load, i.e. > spending 5+ minutes in the configuration

Re: Hosting Kafka Videos on ASF YouTube channel

2022-08-02 Thread Bill Bejeck
Hi Joe, Yes, that is correct. Sorry, I should have mentioned that in the original email. That is the only video where Tim says that. The Kafka Streams videos do not mention Confluent. We're currently pursuing editing the video to remove the "from Confluent" part. Note that the site also uses

Re: Hosting Kafka Videos on ASF YouTube channel

2022-08-02 Thread Joe Brockmeier
Hi Bill, I'm not sure changing hosting would quite solve the problem. The first video I see on this page: https://kafka.apache.org/intro Starts with "Hi, I'm Bill Berglund from *Confluent*" rather than "Hi, I'm Bill from Apache Kafka" -- so moving to the ASF Youtube channel wouldn't completely

Re: [ANNOUNCE] New Kafka PMC Member: A. Sophie Blee-Goldman

2022-08-02 Thread Matthew Benedict de Detrich
Congratulations Sophie! -- Matthew de Detrich Aiven Deutschland GmbH Immanuelkirchstraße 26, 10405 Berlin Amtsgericht Charlottenburg, HRB 209739 B Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen m: +491603708037 w: aiven.io e: matthew.dedetr...@aiven.io On 2. Aug 2022, 01:42 +0200, Guozhang

Re: [ANNOUNCE] Apache Kafka 3.2.1

2022-08-02 Thread Matthew Benedict de Detrich
Thanks for organising the release! -- Matthew de Detrich Aiven Deutschland GmbH Immanuelkirchstraße 26, 10405 Berlin Amtsgericht Charlottenburg, HRB 209739 B Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen m: +491603708037 w: aiven.io e: matthew.dedetr...@aiven.io On 2. Aug 2022, 01:46 +0200,

Hosting Kafka Videos on ASF YouTube channel

2022-08-02 Thread Bill Bejeck
Hi, I am an Apache Kafka® committer and PMC member, and I'm working on our site to address some issues around our embedded videos and branding. The Kafka site has six embedded videos: https://kafka.apache.org/intro, https://kafka.apache.org/quickstart, and four videos on

[DISCUSS] KIP-862: Implement self-join optimization

2022-08-02 Thread Vasiliki Papavasileiou
Hello everyone, I would like to start the discussion for KIP-862: Implement self-join optimization The KIP can be found here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-862%3A+Self-join Any suggestions are more than welcome. Many thanks, Vicky

[jira] [Resolved] (KAFKA-14122) Flaky test DynamicBrokerReconfigurationTest.testKeyStoreAlter

2022-08-02 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-14122. Resolution: Fixed > Flaky test DynamicBrokerReconfigurationTest.testKeyStoreAlter >

Re: [DISCUSS] KIP-854 Separate configuration for producer ID expiry

2022-08-02 Thread Jason Gustafson
I agree with Ismael that we should remove -1. I think we tend to view the coupling of these behaviors into a single configuration as a mistake, so it's a little odd to keep it (even if in a weakened form). -Jason On Sat, Jul 30, 2022 at 7:37 AM Ismael Juma wrote: > I would remove -1

Re: [ANNOUNCE] Apache Kafka 3.2.1

2022-08-02 Thread Bill Bejeck
Thanks for running the release David! -Bill On Tue, Aug 2, 2022 at 4:34 AM Mickael Maison wrote: > Thanks David for driving this release! > > On Tue, Aug 2, 2022 at 1:46 AM David Arthur > wrote: > > > > The Apache Kafka community is pleased to announce the release for > > Apache Kafka 3.2.1 >

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1114

2022-08-02 Thread Apache Jenkins Server
See Changes: -- [...truncated 563821 lines...] [2022-08-02T15:12:05.074Z] AdjustStreamThreadCountTest > shouldRemoveStreamThread() STARTED [2022-08-02T15:12:11.147Z]

[GitHub] [kafka-site] bbejeck merged pull request #430: MINOR: Add clickable images to load iframe videos

2022-08-02 Thread GitBox
bbejeck merged PR #430: URL: https://github.com/apache/kafka-site/pull/430 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

KAFKA-13648: KRaft ClusterInstance does not allow for deferred start

2022-08-02 Thread Sayed Mohammad Hossein Torabi
Dear Commiters, Could you please Review this PR? https://github.com/apache/kafka/pull/12400 This PR, fixes the bug regarding Cluster Annotation in the tests and helps the migration to Cluster annotation. Kind regards, Hossein Torabi

[GitHub] [kafka-site] divijvaidya commented on pull request #430: MINOR: Add clickable images to load iframe videos

2022-08-02 Thread GitBox
divijvaidya commented on PR #430: URL: https://github.com/apache/kafka-site/pull/430#issuecomment-1202677727 > Updated to include a warning about loading a video from a third party @bbejeck you might have forgotten to push the commit?  -- This is an automated message from the

[GitHub] [kafka-site] bbejeck commented on pull request #430: MINOR: Add clickable images to load iframe videos

2022-08-02 Thread GitBox
bbejeck commented on PR #430: URL: https://github.com/apache/kafka-site/pull/430#issuecomment-1202658336 Updated to include a warning about loading a video from a third party -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [ANNOUNCE] New Kafka PMC Member: A. Sophie Blee-Goldman

2022-08-02 Thread Chris Egerton
Congrats, Sophie! On Mon, Aug 1, 2022 at 9:21 PM Luke Chen wrote: > Congrats Sophie! :) > > Luke > > On Tue, Aug 2, 2022 at 7:56 AM Adam Bellemare > wrote: > > > Congratulations Sophie! I’m glad to see you made as a PMC member! Well > > earned. > > > > > On Aug 1, 2022, at 6:42 PM, Guozhang

Re: [ANNOUNCE] New Kafka PMC Member: A. Sophie Blee-Goldman

2022-08-02 Thread Randall Hauch
Congratulations, Sophie! On Tue, Aug 2, 2022 at 8:09 AM Bill Bejeck wrote: > Congrats Sophie! > > -Bill > > On Tue, Aug 2, 2022 at 7:12 AM Tom Bentley wrote: > > > Congratulations Sophie! > > > > On Tue, 2 Aug 2022 at 11:54, Robin Moffatt > > wrote: > > > > > Congrats Sophie, great news! > >

Re: [ANNOUNCE] New Kafka PMC Member: A. Sophie Blee-Goldman

2022-08-02 Thread Bill Bejeck
Congrats Sophie! -Bill On Tue, Aug 2, 2022 at 7:12 AM Tom Bentley wrote: > Congratulations Sophie! > > On Tue, 2 Aug 2022 at 11:54, Robin Moffatt > wrote: > > > Congrats Sophie, great news! > > > > > > -- > > > > Robin Moffatt | Principal Developer Advocate | ro...@confluent.io | > @rmoff > >

[jira] [Created] (KAFKA-14134) Replace EasyMock with Mockito for WorkerConnectorTest

2022-08-02 Thread Yash Mayya (Jira)
Yash Mayya created KAFKA-14134: -- Summary: Replace EasyMock with Mockito for WorkerConnectorTest Key: KAFKA-14134 URL: https://issues.apache.org/jira/browse/KAFKA-14134 Project: Kafka Issue

[jira] [Created] (KAFKA-14133) Remaining EasyMock to Mockito tests

2022-08-02 Thread Christo Lolov (Jira)
Christo Lolov created KAFKA-14133: - Summary: Remaining EasyMock to Mockito tests Key: KAFKA-14133 URL: https://issues.apache.org/jira/browse/KAFKA-14133 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-14132) Remaining PowerMock to Mockito tests

2022-08-02 Thread Christo Lolov (Jira)
Christo Lolov created KAFKA-14132: - Summary: Remaining PowerMock to Mockito tests Key: KAFKA-14132 URL: https://issues.apache.org/jira/browse/KAFKA-14132 Project: Kafka Issue Type: Sub-task

Re: [ANNOUNCE] New Kafka PMC Member: A. Sophie Blee-Goldman

2022-08-02 Thread Tom Bentley
Congratulations Sophie! On Tue, 2 Aug 2022 at 11:54, Robin Moffatt wrote: > Congrats Sophie, great news! > > > -- > > Robin Moffatt | Principal Developer Advocate | ro...@confluent.io | @rmoff > > > On Tue, 2 Aug 2022 at 00:42, Guozhang Wang wrote: > > > Hi everyone, > > > > I'd like to

Kafka : Round Robin strategy config is not working for consumers

2022-08-02 Thread Anil Pradhan
hi there, I'm not sure whether this is the correct group to post this, but pls suggest if there is any other channel which can guide me on this. I understand that kafka consumer group concept enables us to come up with parallel processing of partitions by the underlying consumers within the same

Recent commit causes Gradle to load significantly slowly?

2022-08-02 Thread Matthew Benedict de Detrich
After syncing my fork with upstream Kafka at some point in time in the past I noticed that Gradle takes significantly longer to load, i.e. spending 5+ minutes in the configuration phase when the Gradle runner starts. Is anyone else experiencing this problem? -- Matthew de Detrich Aiven

Re: [ANNOUNCE] New Kafka PMC Member: A. Sophie Blee-Goldman

2022-08-02 Thread Robin Moffatt
Congrats Sophie, great news! -- Robin Moffatt | Principal Developer Advocate | ro...@confluent.io | @rmoff On Tue, 2 Aug 2022 at 00:42, Guozhang Wang wrote: > Hi everyone, > > I'd like to introduce our new Kafka PMC member, Sophie. She has been a > committer since Oct. 2020 and has been

Re: [DISCUSS] KIP-858: Handle JBOD broker disk failure in KRaft

2022-08-02 Thread Igor Soarez
Hi José, Thanks for having a look at this KIP and thanks for pointing this out, I've had a look at KIP-856. It's good to see there's some overlap in our proposals. we're both proposing: - Identifying log directories with a UUID - Extending the storage tool to ensure each log directory has a

Re: [ANNOUNCE] Apache Kafka 3.2.1

2022-08-02 Thread Mickael Maison
Thanks David for driving this release! On Tue, Aug 2, 2022 at 1:46 AM David Arthur wrote: > > The Apache Kafka community is pleased to announce the release for > Apache Kafka 3.2.1 > > This is a bugfix release with several fixes since the release of > 3.2.0. A few of the major issues include: >

Re: [ANNOUNCE] New Kafka PMC Member: A. Sophie Blee-Goldman

2022-08-02 Thread Mickael Maison
Congratulations Sophie! On Tue, Aug 2, 2022 at 8:52 AM Josep Prat wrote: > > Congrats Sophie! > > On Tue, Aug 2, 2022 at 5:36 AM pengyh wrote: > > > > > congrats! > > > > > Congrats Sophie!  > > > > > -- > [image: Aiven] > > *Josep Prat* > Open Source Engineering