Re: [VOTE] KIP-863: Reduce Fetcher#parseRecord() memory copy

2022-10-11 Thread Luke Chen
+1 from me. Thanks for the KIP. Luke On Fri, Sep 23, 2022 at 1:50 AM Guozhang Wang wrote: > +1, thanks ShunKang. > > Though its proposed motivation is on consumer fetcher's deserialization, I > think adding an overloaded method with ByteBuffer would help with other > serde places on the client

[jira] [Created] (KAFKA-14292) KRaft broker controlled shutdown can be delayed indefinitely

2022-10-11 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-14292: --- Summary: KRaft broker controlled shutdown can be delayed indefinitely Key: KAFKA-14292 URL: https://issues.apache.org/jira/browse/KAFKA-14292 Project: Kafka

[jira] [Created] (KAFKA-14291) KRaft: ApiVersionsResponse doesn't have finalizedFeatures and finalizedFeatureEpoch in KRaft mode

2022-10-11 Thread Akhilesh Chaganti (Jira)
Akhilesh Chaganti created KAFKA-14291: - Summary: KRaft: ApiVersionsResponse doesn't have finalizedFeatures and finalizedFeatureEpoch in KRaft mode Key: KAFKA-14291 URL: https://issues.apache.org/jira/browse/KA

[jira] [Created] (KAFKA-14290) Fix bugs that could block KRaft controlled shutdown indefinitely

2022-10-11 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-14290: Summary: Fix bugs that could block KRaft controlled shutdown indefinitely Key: KAFKA-14290 URL: https://issues.apache.org/jira/browse/KAFKA-14290 Project: Kafka

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1285

2022-10-11 Thread Apache Jenkins Server
See Changes: -- [...truncated 339668 lines...] [2022-10-11T21:31:20.604Z] [2022-10-11T21:31:20.604Z] Gradle Test Run :streams:integrationTest > Gradle Test Executor 165 >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.3 #100

2022-10-11 Thread Apache Jenkins Server
See

[DISCUSS] KIP-876: Time based cluster metadata snapshots

2022-10-11 Thread José Armando García Sancio
Hey all, I am interested in allowing brokers and controllers in KRaft to generate snapshots for the cluster metadata partition on a timely basis. This would better allow Kafka users to use cluster metadata snapshots as a solution for backing up the cluster's metadata. Let's use this thread to dis

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1284

2022-10-11 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-874: TopicRoundRobinAssignor

2022-10-11 Thread Mathieu Amblard
Hi Hector, First, thank you for your questions ! *If the goal is to do the partition assignments at a topic level, wouldn't having single-partition topics solve this problem?* We are in a microservices environment; therefore, we can have multiple containers running the same application. U

[GitHub] [kafka-site] jsancio merged pull request #459: MINOR; Fix TOC to include missing sections

2022-10-11 Thread GitBox
jsancio merged PR #459: URL: https://github.com/apache/kafka-site/pull/459 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@kafka.apache.

[GitHub] [kafka-site] jsancio commented on pull request #459: MINOR; Fix TOC to include missing sections

2022-10-11 Thread GitBox
jsancio commented on PR #459: URL: https://github.com/apache/kafka-site/pull/459#issuecomment-1275005214 @showuon I took the liberty to just merge this PR after your review of https://github.com/apache/kafka/pull/12726 -- This is an automated message from the Apache Git Service. To re

[jira] [Resolved] (KAFKA-14275) KRaft Controllers should crash after failing to apply any metadata record

2022-10-11 Thread Niket Goel (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niket Goel resolved KAFKA-14275. Fix Version/s: 3.3 Reviewer: Jason Gustafson Resolution: Fixed > KRaft Controllers

Re: [ANNOUNCE] New committer: Deng Ziming

2022-10-11 Thread José Armando García Sancio
Congratulations Ziming. Well deserved and I much appreciate your contributions to the project. -- -José

Re: [DISCUSS] KIP-863: Reduce Fetcher#parseRecord() memory copy

2022-10-11 Thread Chris Egerton
Hi ShunKang, Thanks for the KIP! I have a couple thoughts: 1. If we pass the ByteBuffer that we're using internally for the record key/value to the deserializer, it may be mutated by writing new bytes or altering the position. Should we permit this, or would it make sense to provide deserializers

[jira] [Resolved] (KAFKA-14266) MirrorSourceTask will stop mirroring when get corrupt record

2022-10-11 Thread Yu Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Wang resolved KAFKA-14266. - Resolution: Works for Me > MirrorSourceTask will stop mirroring when get corrupt record > --

[jira] [Created] (KAFKA-14289) Use non zero status code in Kafka CLI when the command failed

2022-10-11 Thread Nicolas Guyomar (Jira)
Nicolas Guyomar created KAFKA-14289: --- Summary: Use non zero status code in Kafka CLI when the command failed Key: KAFKA-14289 URL: https://issues.apache.org/jira/browse/KAFKA-14289 Project: Kafka

Re: [DISCUSS] KIP-863: Reduce Fetcher#parseRecord() memory copy

2022-10-11 Thread Luke Chen
Hi ShunKang, Had a quick look, I think It's a good idea. I'll check it again tomorrow, and let you know if I have any questions. Luke On Sun, Sep 25, 2022 at 3:35 PM ShunKang Lin wrote: > Hi Guozhang, > > When I try add method `default ByteBuffer serializeToByteBuffer(String > topic, Headers h

Re: [DISCUSS] KIP-869: Improve Streams State Restoration Visibility

2022-10-11 Thread Nick Telford
Hi Guozhang, What you propose sounds good to me. Having the more detailed Task-level metrics at DEBUG makes sense. Regards, Nick

[jira] [Created] (KAFKA-14288) Processor topology in tasks is updated with internal intermediate topics without application ID prefix

2022-10-11 Thread Bruno Cadonna (Jira)
Bruno Cadonna created KAFKA-14288: - Summary: Processor topology in tasks is updated with internal intermediate topics without application ID prefix Key: KAFKA-14288 URL: https://issues.apache.org/jira/browse/KAFKA

[jira] [Created] (KAFKA-14287) Multi noded with kraft combined mode will fail shutdown

2022-10-11 Thread Luke Chen (Jira)
Luke Chen created KAFKA-14287: - Summary: Multi noded with kraft combined mode will fail shutdown Key: KAFKA-14287 URL: https://issues.apache.org/jira/browse/KAFKA-14287 Project: Kafka Issue Type:

Re: [ANNOUNCE] New committer: Deng Ziming

2022-10-11 Thread Rajini Sivaram
Congratulations Ziming! Regards, Rajini On Tue, Oct 11, 2022 at 9:15 AM Mickael Maison wrote: > Congrats Ziming! > > Thanks for all your contributions! > > On Tue, Oct 11, 2022 at 6:46 AM deng ziming > wrote: > > > > Thank you all! > > > > -- > > Best, > > Ziming > > > > On Tue, Oct 11, 2022

Re: [ANNOUNCE] New committer: Deng Ziming

2022-10-11 Thread Mickael Maison
Congrats Ziming! Thanks for all your contributions! On Tue, Oct 11, 2022 at 6:46 AM deng ziming wrote: > > Thank you all! > > -- > Best, > Ziming > > On Tue, Oct 11, 2022 at 9:43 AM Luke Chen wrote: > > > Congratulations Ziming!! > > Very well deserved! > > 恭喜! :) > > > > Luke > > > > On Tue, O