Re: Re: Re: Kafka 3.2.1 performance issue with JDK 11

2023-05-22 Thread Luke Chen
Hi Vic, Yes, JDK 8 is still supported in kafka 3.x.x. It'll become unsupported after kafka 4.0.0. Thanks. Luke On Tue, May 23, 2023 at 9:56 AM Vic Xu wrote: > Hi Greg > > I know JDK 8 will solve the problem certainly, but I wondering if JDK8 has > been deprecated after Kafka 3? Can I use JDK

RE: Re: Re: Kafka 3.2.1 performance issue with JDK 11

2023-05-22 Thread Vic Xu
Hi Greg I know JDK 8 will solve the problem certainly, but I wondering if JDK8 has been deprecated after Kafka 3? Can I use JDK 8 with Kafka 3.2.1? Thank you. On 2023/05/22 20:55:01 Greg Harris wrote: > Vic, > > While you can certainly try that, I don't know if that will solve the problem. >

Re: Data Stream Processing applications testing

2023-05-22 Thread Brebner, Paul
Hi Alexandre, looks interesting. Would you consider submitting something (related to performance) to the Community over Code Performance Engineering track please? https://www.linkedin.com/pulse/call-papers-2nd-performance-engineering-track-over-code-brebner/ Thanks, Paul From: Alexandre

Data Stream Processing applications testing

2023-05-22 Thread Alexandre Strapacao Guedes Vianna
Hey everyone, I wanted to share my latest paper, "A Grey Literature Review on Data Stream Processing Applications Testing," in the Journal of Systems and Software (JSS), Elsevier. This paper provides unique industry insights, addresses the challenges faced in Data Stream Processing (DSP)

Re: [VOTE] 3.4.1 RC1

2023-05-22 Thread Greg Harris
Also I'll point it out here so that everyone is aware, but I don't think it necessarily warrants a new RC on it's own: This patch: https://github.com/apache/kafka/pull/13005 is present on trunk/3.5.0, but is not present in 3.4.0/3.4.1-RC1. It is not a regression strictly, since it was already a

Re: Re: Kafka 3.2.1 performance issue with JDK 11

2023-05-22 Thread Greg Harris
Vic, While you can certainly try that, I don't know if that will solve the problem. The reason why JDK11 appears relevant in this context is that a class was removed between JDK8 and JDK11. I don't know if a replacement stack inspector with better performance was added to JDK17 and used within

Re: [VOTE] 3.4.1 RC1

2023-05-22 Thread Greg Harris
Hi Luke, I performed a test upgrade of MM2 from 3.4.0 to 3.4.1-RC1, and verified that the new offset translation logic worked as intended. Steps I took to verify: - Downloaded 3.4.0_2.13 from the Kafka website - Formatted and started two 3.4.0 1-node clusters, and configured MM2 to mirror data

Re: [VOTE] 3.4.1 RC1

2023-05-22 Thread Josep Prat
Hi Luke, I can confirm the *org.apache.kafka.common.utils.UtilsTest.testToLogDateTimeFormat* consistent failure when not running on a system set on UTC-0 timezone. I verified: - Built from source with Java 11 and Scala 2.13 - Checked signatures and hashes - Check Javadoc and checked links to JDK

Re: [VOTE] 3.4.1 RC1

2023-05-22 Thread Chris Egerton
Hi Luke, Thanks for running the release! Steps I took to verify: - Built from source with Java 11 - Checked signatures and checksums - Ran the quickstart with Java 11 in KRaft mode - Ran all unit tests - - The org.apache.kafka.common.utils.UtilsTest.testToLogDateTimeDormat test case failed

[VOTE] 3.5.0 RC0

2023-05-22 Thread Mickael Maison
Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 3.5.0. Some of the major features include: - KIP-710: Full support for distributed mode in dedicated MirrorMaker 2.0 clusters - KIP-881: Rack-aware Partition Assignment for Kafka Consumers

Re: [VOTE] 3.4.1 RC1

2023-05-22 Thread Federico Valeri
Hi Luke, - Source signature and checksum - Build from source with Java 17 and Scala 2.13 - Full unit and integration test suite - Java app with staging Maven artifacts +1 (non binding) Thanks Fede PS: Links still point to RC0, but I checked and RC1 artifacts are there, including Maven. The

[VOTE] 3.4.1 RC1

2023-05-22 Thread Luke Chen
Hello Kafka users, developers and client-developers, This is the 2nd candidate for release of Apache Kafka 3.4.1. This is a bugfix release with several fixes since the release of 3.4.0. A few of the major issues include: - core KAFKA-14644

Re: [VOTE] 3.4.1 RC0

2023-05-22 Thread Matthias J. Sax
Thanks a lot! -Matthias On 5/21/23 7:27 PM, Luke Chen wrote: Hi Matthias, Yes, I agree we should get this hotfix into 3.4.1. I've backported into the 3.4 branch. I'll create a new RC for 3.4.1. Thanks. Luke On Mon, May 22, 2023 at 5:13 AM Matthias J. Sax wrote: Hi Luke, RC0 for 3.4.1

RE: Re: Kafka 3.2.1 performance issue with JDK 11

2023-05-22 Thread Vic Xu
Hi Greg, I found another possible solution that is upgrade JDK from 11 to 17. Do you recommend this solution? On 2023/05/21 17:58:42 Greg Harris wrote: > Vic, > > I found an open JIRA issue that previously reported this problem: > https://issues.apache.org/jira/browse/KAFKA-10877 . > I

Re: Kafka 3.2.1 performance issue with JDK 11

2023-05-22 Thread Vic Xu
Hi Greg, I found another possible solution that is upgrade JDK from 11 to 17. Do you recommend this solution? Greg Harris 於 2023年5月22日 週一 上午1:59寫道: > Vic, > > I found an open JIRA issue that previously reported this problem: > https://issues.apache.org/jira/browse/KAFKA-10877 . > I believe one