Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1863

2023-05-23 Thread Apache Jenkins Server
See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.4 #137

2023-05-23 Thread Apache Jenkins Server
See

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.5 #4

2023-05-23 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-15015) Binaries contain 2 versions of reload4j

2023-05-23 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-15015. --- Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed > Binaries contain 2

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1862

2023-05-23 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1861

2023-05-23 Thread Apache Jenkins Server
See Changes: -- [...truncated 476726 lines...] [2023-05-23T20:01:56.855Z] [2023-05-23T20:01:56.855Z] Gradle Test Run :streams:integrationTest > Gradle Test Executor 179

Re: [DISCUSS] KIP-925: rack aware task assignment in Kafka Streams

2023-05-23 Thread Hao Li
Thanks John! Yeah. The ConvergenceTest looks very helpful. I will add it to the test plan. I will also add tests to verify the new optimizer will produce a balanced assignment which has no worse cross AZ cost than the existing assignor. Hao On Mon, May 22, 2023 at 3:39 PM John Roesler wrote: >

[jira] [Created] (KAFKA-15018) Potential tombstone offsets corruption for exactly-once source connectors

2023-05-23 Thread Chris Egerton (Jira)
Chris Egerton created KAFKA-15018: - Summary: Potential tombstone offsets corruption for exactly-once source connectors Key: KAFKA-15018 URL: https://issues.apache.org/jira/browse/KAFKA-15018 Project:

Re: [DISCUSS] KIP-858: Handle JBOD broker disk failure in KRaft

2023-05-23 Thread Igor Soarez
Hi everyone, Someone suggested at the recent Kafka Summit that it may be useful to have a video call to discuss remaining concerns. I'm proposing we have a video call Monday 29th May 16:30-17:00 UTC. If you'd like to join, please reply to the thread or to me directly so I can send you a link.

Re: KafkaConsumer refactor proposal

2023-05-23 Thread Philip Nee
Hi all! I've added the "KIP-848" and "ctr" tags to the relevant PRs. see: https://github.com/apache/kafka/pulls?q=label%3Actr+sort%3Acreated-asc On Tue, May 9, 2023 at 10:29 AM Philip Nee wrote: > Hey Divij, > > Firstly, THANK YOU for reaching out and providing the feedback. At this >

Re: [VOTE] 3.5.0 RC0

2023-05-23 Thread David Arthur
Mickael, we have some migration fixes on trunk, is it okay to cherry-pick these to 3.5? KAFKA-15007 Use the correct MetadataVersion in MigrationPropagator KAFKA-15009 Handle new ACLs in KRaft snapshot during migration There is another issue KAFKA-15010 that I'm also investigating to determine

Re: [DISCUSS] KIP-932: Queues for Kafka

2023-05-23 Thread Ashish Chhabria
This is such a great proposal. Parallel/Cooperative consumption is a long missing pattern in Apache Kafka and it is a viable solution for the common head-of-line-blocking problem. Developers have long attempted to solve this with bespoke consumer proxies that state manage the inflight payloads, so

Re: [DISCUSS] KIP-858: Handle JBOD broker disk failure in KRaft

2023-05-23 Thread Igor Soarez
Hi Christo, Thank you for your interest in this KIP. Indeed, I'd like to open up voting ASAP. I'm hoping there will still be a bit more feedback, but if not I'll probably request a vote next week or so. Do you have any concerns or suggestions regarding this KIP? I'll have a look at your KIP

Re: [DISCUSS] KIP-916: MM2 distributed mode flow log context

2023-05-23 Thread Dániel Urbán
Hi Chris, Thank you for your comments! 1. This approach is OK for me. I thought that the "sample" configs in the repo do not fall into the same category as the default of a new config. Adding a commented line instead should be ok, and the future opt-out change sounds good to me. 2. Besides the

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.5 #2

2023-05-23 Thread Apache Jenkins Server
See

[GitHub] [kafka-site] mimaison merged pull request #514: MINOR: Fix version in 35 docs

2023-05-23 Thread via GitHub
mimaison merged PR #514: URL: https://github.com/apache/kafka-site/pull/514 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Created] (KAFKA-15017) New ClientQuotas are not written to ZK from snapshot

2023-05-23 Thread David Arthur (Jira)
David Arthur created KAFKA-15017: Summary: New ClientQuotas are not written to ZK from snapshot Key: KAFKA-15017 URL: https://issues.apache.org/jira/browse/KAFKA-15017 Project: Kafka Issue

Re: [VOTE] 3.5.0 RC0

2023-05-23 Thread Mickael Maison
Hi Christo, Yes this is expected. This happens when nested fields also accept optional tagged fields. The tables list all fields, so they may include _tagged_fields multiple times. Clearly the layout of this page could be improved, if you have ideas how to describe the protocol in a better way,

Re: [VOTE] 3.5.0 RC0

2023-05-23 Thread Mickael Maison
Hi Josep, Good catch! I opened a PR to fix this: https://github.com/apache/kafka-site/pull/514 Thanks, Mickael On Tue, May 23, 2023 at 3:36 PM Christo Lolov wrote: > > Hey Mickael! > > I am giving a +1 (non-binding) for this candidate release. > > * Built from the binary tar.gz source with

Re: [VOTE] 3.5.0 RC0

2023-05-23 Thread Christo Lolov
Hey Mickael! I am giving a +1 (non-binding) for this candidate release. * Built from the binary tar.gz source with Java 17 and Scala 2.13 on Intel (m5.4xlarge) and ARM (m6g.4xlarge) machines. * Ran unit and integration tests on Intel and ARM machines. * Ran the Quickstart in both Zookeeper and

[GitHub] [kafka-site] mimaison commented on a diff in pull request #513: MINOR: Add Kafka 3.5 documentation and javadoc

2023-05-23 Thread via GitHub
mimaison commented on code in PR #513: URL: https://github.com/apache/kafka-site/pull/513#discussion_r1202345570 ## 35/documentation.html: ## @@ -0,0 +1,111 @@ + + + + + + + + + + + + + + + + + + + +

[GitHub] [kafka-site] mimaison opened a new pull request, #514: MINOR: Fix version in 35 docs

2023-05-23 Thread via GitHub
mimaison opened a new pull request, #514: URL: https://github.com/apache/kafka-site/pull/514 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.4 #136

2023-05-23 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-934: Add DeleteTopicPolicy

2023-05-23 Thread Jorge Esteban Quilcate Otoya
Thanks Christo! On Tue, 23 May 2023 at 13:02, Christo Lolov wrote: > Heya Jorge, > > Thank you for the KIP! > > This feature sounds great to me since I have encountered problems with > this, so I am supporting it. Do you have any idea why the previous KIPs > were abandoned - I went through the

Re: [VOTE] 3.4.1 RC1

2023-05-23 Thread Luke Chen
Hi Mickael, Thanks for pointing this out. Yes, I forgot to update the LICENSE-binary file. I'll create another RC build to patch it. Thanks Chris and Greg for pointing out these 2 issues. I've backported into v3.4 branch. Will include them in next RC build. Thanks Fede and Josep for helping

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.5 #1

2023-05-23 Thread Apache Jenkins Server
See

Re: [VOTE] 3.4.1 RC1

2023-05-23 Thread Mickael Maison
Hi Luke, I've had to update the LICENSE-binary file when running the 3.5.0 release and I noticed the file also needs updates in 3.4. If I run the validation logic described in https://issues.apache.org/jira/browse/KAFKA-12622, I get the following: audience-annotations-0.13.0 is missing in license

[jira] [Resolved] (KAFKA-7497) Kafka Streams should support self-join on streams

2023-05-23 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-7497. Resolution: Fixed > Kafka Streams should support self-join on streams >

[jira] [Resolved] (KAFKA-14173) TopologyTestDriver does not use mock wall clock time when sending test records

2023-05-23 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14173. - Resolution: Not A Problem > TopologyTestDriver does not use mock wall clock time when

Re: [VOTE] 3.5.0 RC0

2023-05-23 Thread Josep Prat
Hi Mickael, I just wanted to point out that I think the documentation you recently merged on Kafka site regarding the 3.5.0 version has a problem when it states the version number and the sub-menu that links to previous versions. Left a comment here:

[jira] [Resolved] (KAFKA-10575) StateRestoreListener#onRestoreEnd should always be triggered

2023-05-23 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-10575. - Fix Version/s: 3.5.0 Resolution: Fixed > StateRestoreListener#onRestoreEnd

Re: [DISCUSS] KIP-935: Extend AlterConfigPolicy with existing configurations

2023-05-23 Thread Christo Lolov
Hello! This proposal will address problems with configuration dependencies which I run into very frequently, so I am fully supporting the development of this feature! Best, Christo On Mon, 22 May 2023 at 17:18, Jorge Esteban Quilcate Otoya < quilcate.jo...@gmail.com> wrote: > Hi everyone, > >

Re: [DISCUSS] KIP-934: Add DeleteTopicPolicy

2023-05-23 Thread Christo Lolov
Heya Jorge, Thank you for the KIP! This feature sounds great to me since I have encountered problems with this, so I am supporting it. Do you have any idea why the previous KIPs were abandoned - I went through the email conversations and pull requests, but I didn't find a good reason? Best,

[GitHub] [kafka-site] jlprat commented on a diff in pull request #513: MINOR: Add Kafka 3.5 documentation and javadoc

2023-05-23 Thread via GitHub
jlprat commented on code in PR #513: URL: https://github.com/apache/kafka-site/pull/513#discussion_r1201740082 ## 35/documentation.html: ## @@ -0,0 +1,111 @@ + + + + + + + + + + + + + + + + + + + +

[GitHub] [kafka-site] mimaison merged pull request #513: MINOR: Add Kafka 3.5 documentation and javadoc

2023-05-23 Thread via GitHub
mimaison merged PR #513: URL: https://github.com/apache/kafka-site/pull/513 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [VOTE] 3.5.0 RC0

2023-05-23 Thread Josep Prat
Hi Mickael, I can +1 this candidate. I verified the following: - Built from source with Java 17 and Scala 2.13 - Signatures and hashes of the artifacts generated - Navigated through Javadoc including links to JDK classes - Run the unit tests - Run integration tests - Run the quickstart in KRaft