Re: Apache Kafka 3.6.0 release

Thanks Colov/Divij for adding the KIP-952. I do not think it is a blocker for 3.6.0. We can discuss the KIP in the respective thread. ~Satish. On Sun, 23 Jul 2023 at 07:21, Satish Duggana wrote: > > Thanks ShunKang for the update. I added both the KIPs to the wiki. > Please feel free to update

Re: Apache Kafka 3.6.0 release

Thanks ShunKang for the update. I added both the KIPs to the wiki. Please feel free to update the wiki with the latest. ~Satish. On Sat, 22 Jul 2023 at 22:50, ShunKang Lin wrote: > > Hi Satish, > > Could we add "KIP-863: Reduce CompletedFetch#parseRecord() memory copy" [1] > and "KIP-872: Add

Re: Apache Kafka 3.6.0 release

Thanks Divij for adding the KIPs to the wiki. On Sat, 22 Jul 2023 at 17:36, Divij Vaidya wrote: > > Hi Satish > > I have added the following accepted KIPs to the release plan. Please let me > know if something requires a change. > > Accepted KIPs - > > 1. >

Re: [VOTE] KIP-944 Support async runtimes in consumer, votes needed!

Hi Erik, Thanks for the KIP. I would like to better understand the motivation of this KIP. I am not familiar with async runtimes so please excuse me if I ask stupid questions. Could you elaborate a bit more on why the callbacks must be ran in another thread vs in the invoker thread? This is not

[jira] [Created] (KAFKA-15236) Rename Remote Storage metrics to remove ambiguity

Abhijeet Kumar created KAFKA-15236: -- Summary: Rename Remote Storage metrics to remove ambiguity Key: KAFKA-15236 URL: https://issues.apache.org/jira/browse/KAFKA-15236 Project: Kafka Issue

[jira] [Created] (KAFKA-15235) No test coverage reports for Java due to settings for Jacoco being incompatible with Gradle 8.x

Eike Thaden created KAFKA-15235: --- Summary: No test coverage reports for Java due to settings for Jacoco being incompatible with Gradle 8.x Key: KAFKA-15235 URL: https://issues.apache.org/jira/browse/KAFKA-15235

[DISCUSS] KIP-957 Support async runtimes in consumer

Hello developers of the Java consumer, This is a simpler alternative to KIP-944 as proposed by Chris Egerton. In this proposal we make method acquire and release of the KafkaConsumer class protected. This allows anyone to implement these methods as appropriate for their environment. The

Re: Apache Kafka 3.6.0 release

Hi Satish, Could we add "KIP-863: Reduce CompletedFetch#parseRecord() memory copy" [1] and "KIP-872: Add Serializer#serializeToByteBuffer() to reduce memory copying" [2] to the release plan? Thanks! [1] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=225152035 [2]

Re: [VOTE] KIP-944 Support async runtimes in consumer, votes needed!

Colin, Matthias, Chris, I have expanded the use case description in KIP-944. I hope it is more clear what we're trying to achieve. https://cwiki.apache.org/confluence/x/chw0Dw Kind regards,     Erik. Op 22-07-2023 om 17:23 schreef Erik van Oosten: Hello Chris, Thanks for elaborating

Re: [VOTE] KIP-944 Support async runtimes in consumer, votes needed!

Hi Erik, I'm glad that this alternative is agreeable to you! Just to be clear though, it does still technically require a KIP since it's still a change to public API (just a much smaller one). And if we do decide to pursue this approach, we'll have to define the expected contract for this method

Re: [VOTE] KIP-944 Support async runtimes in consumer, votes needed!

Hi all, I have created https://github.com/apache/kafka/pull/14071 to implement Chris' idea. Kind regards,     Erik. Op 22-07-2023 om 16:39 schreef Chris Egerton: Hi Erik, I don't think Matthias is bringing FUD to the discussion. Many of the people who maintain Kafka are familiar with

Re: [VOTE] KIP-944 Support async runtimes in consumer, votes needed!

Hello Chris, Thanks for elaborating Matthias' words. Apparently the use case description is too terse. Indeed, that is not FUD and that is something I can work with. > It's also worth mentioning that what's proposed in the KIP is only blocked by the private access modifier on the

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2029

See Changes: -- [...truncated 393204 lines...] Gradle Test Run :streams:integrationTest > Gradle Test Executor 182 > RestoreIntegrationTest >

Re: [VOTE] KIP-944 Support async runtimes in consumer, votes needed!

Hi Erik, I don't think Matthias is bringing FUD to the discussion. Many of the people who maintain Kafka are familiar with Kafka client internals and the Java programming language, but not necessarily other JVM languages or asynchronous runtimes. I think it's reasonable to ask for a code snippet

Re: Apache Kafka 3.6.0 release

Hi Satish I have added the following accepted KIPs to the release plan. Please let me know if something requires a change. Accepted KIPs - 1. https://cwiki.apache.org/confluence/display/KAFKA/KIP-852%3A+Optimize+calculation+of+size+for+log+in+remote+tier 2.

[jira] [Resolved] (KAFKA-15194) Rename local tiered storage segment with offset as prefix for easy navigation

[ https://issues.apache.org/jira/browse/KAFKA-15194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divij Vaidya resolved KAFKA-15194. -- Resolution: Fixed > Rename local tiered storage segment with offset as prefix for easy

[GitHub] [kafka-site] divijvaidya commented on pull request #533: MINOR: Website changes for 3.5.1 release

divijvaidya commented on PR #533: URL: https://github.com/apache/kafka-site/pull/533#issuecomment-1646564445 @mimaison please take a look when you get a chance. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [kafka-site] divijvaidya opened a new pull request, #533: MINOR: Website changes for 3.5.1 release

divijvaidya opened a new pull request, #533: URL: https://github.com/apache/kafka-site/pull/533 ## Changes: 1. Modify the download section to add links to new version 2. Modify the download section to move prior versions to archive links. 3. Modify the upgrade section to add

Re: [VOTE] KIP-944 Support async runtimes in consumer, votes needed!

Hi Matthias, I am getting a bit frustrated here. All the concerns and questions I have seen so far are addressed in KIP-944. Please let me know if they are not clear enough, but please do not come with FUD. Kind regards,     Erik. Op 21-07-2023 om 21:13 schreef Matthias J. Sax: I am not

[jira] [Created] (KAFKA-15234) Automate adding version to system tests

Divij Vaidya created KAFKA-15234: Summary: Automate adding version to system tests Key: KAFKA-15234 URL: https://issues.apache.org/jira/browse/KAFKA-15234 Project: Kafka Issue Type: Sub-task

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2028

See Changes: -- [...truncated 393925 lines...] Gradle Test Run :streams:integrationTest > Gradle Test Executor 184 > TableTableJoinIntegrationTest > [caching enabled =

Re: Request contributor permissions to kafka

Thank you so much Best regards and have a great weekend On Sat 22 Jul 2023 at 08:56, Luke Chen wrote: > Hi, > > Your account is all set. > > Thanks. > Luke > > On Sat, Jul 22, 2023 at 2:17 AM Boudjelda Mohamed Said > wrote: > > > Hi > > I would like to have a contributor permission to

Re: Request contributor permissions to kafka

Hi, Your account is all set. Thanks. Luke On Sat, Jul 22, 2023 at 2:17 AM Boudjelda Mohamed Said wrote: > Hi > I would like to have a contributor permission to kafka, this is my jira > id: *bmscomp* > > > Best regards >