Re: [ANNOUNCE] New committer: Igor Soarez

2024-04-25 Thread Christo Lolov
Congratulations Igor :) ! On Thu, 25 Apr 2024 at 17:07, Igor Soarez wrote: > Thanks everyone, I'm very honoured to join! > > -- > Igor >

Re: Confluence edit access

2024-04-25 Thread Claude Warren
My Confluence ID is "claude" On Thu, Apr 25, 2024 at 8:40 PM Matthias J. Sax wrote: > What's your wiki ID? We can grant write access on our side if you have > already an account. > > -Matthias > > On 4/25/24 4:06 AM, Claude Warren wrote: > > I would like to get edit access to the Kafka

[VOTE] KIP-1023: Follower fetch from tiered offset

2024-04-25 Thread Abhijeet Kumar
Hi All, I would like to start the vote for KIP-1023 - Follower fetch from tiered offset The KIP is here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1023%3A+Follower+fetch+from+tiered+offset Regards. Abhijeet.

Re: [DISCUSS] KIP-1023: Follower fetch from tiered offset

2024-04-25 Thread Abhijeet Kumar
Thank you all for your comments. As all the comments in the thread are addressed, I am starting a Vote thread for the KIP. Please have a look. Regards. Abhijeet. On Thu, Apr 25, 2024 at 6:08 PM Luke Chen wrote: > Hi, Abhijeet, > > Thanks for the update. > > I have no more comments. > > Luke

Re: [DISCUSS] KIP-932: Queues for Kafka

2024-04-25 Thread Jun Rao
Hi, Andrew, Thanks for the reply. 123. "Rather than add the group epoch to the ShareGroupHeartbeat, I have decided to go for TopicPartitions in ShareGroupHeartbeatRequest which mirrors ConsumerGroupHeartbeatRequest." ShareGroupHeartbeat.MemberEpoch is the group epoch, right? Is that enough for

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2847

2024-04-25 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-924: customizable task assignment for Streams

2024-04-25 Thread Matthias J. Sax
Thanks for the details! 107: I like `numProcessingThreads()` proposal. 108(a): it was not really a concern, but it was rather a question if we could/should simplify it, so it's easier to implement a custom task assignor. But if we believe that it's an integral component, I am fine with

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2846

2024-04-25 Thread Apache Jenkins Server
See Changes: -- [...truncated 460306 lines...] [2024-04-25T20:32:08.431Z] Gradle Test Run :streams:test > Gradle Test Executor 94 > DefaultTaskExecutorTest >

[jira] [Created] (KAFKA-16626) Uuid to String for subscribed topic names in assignment spec

2024-04-25 Thread Ritika Reddy (Jira)
Ritika Reddy created KAFKA-16626: Summary: Uuid to String for subscribed topic names in assignment spec Key: KAFKA-16626 URL: https://issues.apache.org/jira/browse/KAFKA-16626 Project: Kafka

Re: [DISCUSS] KIP-924: customizable task assignment for Streams

2024-04-25 Thread Sophie Blee-Goldman
104. Fair enough -- also happy to defer to Rohan on this (or Bruno if he feels super strongly) 107. That's a good point . Ultimately the task load should reflect the processing capacity, and that's something that will exist in both the new and old threading model. I like #processingCapacity for

[jira] [Created] (KAFKA-16625) Reverse Lookup Partition to Member in Assignors

2024-04-25 Thread Ritika Reddy (Jira)
Ritika Reddy created KAFKA-16625: Summary: Reverse Lookup Partition to Member in Assignors Key: KAFKA-16625 URL: https://issues.apache.org/jira/browse/KAFKA-16625 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-1038: Add Custom Error Handler to Producer

2024-04-25 Thread Kirk True
Hi Alieh, Thanks for the updates! Comments inline... > On Apr 25, 2024, at 1:10 PM, Alieh Saeedi > wrote: > > Hi all, > > Thanks a lot for the constructive feedbacks! > > > > Addressing some of the main concerns: > > > - The `RecordTooLargeException` can be thrown by broker, producer

[jira] [Created] (KAFKA-16624) Don't generate useless PartitionChangeRecord on older MV

2024-04-25 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-16624: Summary: Don't generate useless PartitionChangeRecord on older MV Key: KAFKA-16624 URL: https://issues.apache.org/jira/browse/KAFKA-16624 Project: Kafka

Re: [DISCUSS] KIP-1038: Add Custom Error Handler to Producer

2024-04-25 Thread Alieh Saeedi
Hi all, Thanks a lot for the constructive feedbacks! Addressing some of the main concerns: - The `RecordTooLargeException` can be thrown by broker, producer and consumer. Of course, the `ProducerExceptionHandler` interface is introduced to affect only the exceptions thrown from the producer.

Re: Confluence edit access

2024-04-25 Thread Matthias J. Sax
What's your wiki ID? We can grant write access on our side if you have already an account. -Matthias On 4/25/24 4:06 AM, Claude Warren wrote: I would like to get edit access to the Kafka confluence so that I can work on KIP-936. Can someone here do that or do I need to go through Infra?

[jira] [Created] (KAFKA-16623) KafkaAsyncConsumer system tests warn about revoking partitions that weren't previously assigned

2024-04-25 Thread Kirk True (Jira)
Kirk True created KAFKA-16623: - Summary: KafkaAsyncConsumer system tests warn about revoking partitions that weren't previously assigned Key: KAFKA-16623 URL: https://issues.apache.org/jira/browse/KAFKA-16623

Re: [ANNOUNCE] New committer: Igor Soarez

2024-04-25 Thread Igor Soarez
Thanks everyone, I'm very honoured to join! -- Igor

[jira] [Created] (KAFKA-16622) Mirromaker2 first Checkpoint not emitted until consumer group fully catches up once

2024-04-25 Thread Edoardo Comar (Jira)
Edoardo Comar created KAFKA-16622: - Summary: Mirromaker2 first Checkpoint not emitted until consumer group fully catches up once Key: KAFKA-16622 URL: https://issues.apache.org/jira/browse/KAFKA-16622

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2845

2024-04-25 Thread Apache Jenkins Server
See

Re: [PR] MINOR: remove reference to IRC channel [kafka-site]

2024-04-25 Thread via GitHub
mimaison merged PR #599: URL: https://github.com/apache/kafka-site/pull/599 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Resolved] (KAFKA-16568) Add JMH Benchmarks for assignor performance testing

2024-04-25 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16568. - Fix Version/s: 3.8.0 Resolution: Fixed > Add JMH Benchmarks for assignor performance

[PR] MINOR: remove reference to IRC channel [kafka-site]

2024-04-25 Thread via GitHub
raboof opened a new pull request, #599: URL: https://github.com/apache/kafka-site/pull/599 The channel on freenode seems abandoned (6 users, no topic). The channel on libera.chat is explicitly unofficial. -- This is an automated message from the Apache Git Service. To respond to

Re: [DISCUSS] KIP-932: Queues for Kafka

2024-04-25 Thread David Jacot
Hi Andrew, Thanks for your responses and sorry for my late reply. 001: Makes sense. One thing that we could consider here is to allow converting an empty classic or consumer group to a share group. If already do this between empty classic and consumer groups. 004: I see. It would be great to

[jira] [Created] (KAFKA-16621) Alter MirrorSourceConnector offsets dont work

2024-04-25 Thread yuzhou (Jira)
yuzhou created KAFKA-16621: -- Summary: Alter MirrorSourceConnector offsets dont work Key: KAFKA-16621 URL: https://issues.apache.org/jira/browse/KAFKA-16621 Project: Kafka Issue Type: Bug

Re: [DISCUSS] KIP-877: Mechanism for plugins and connectors to register metrics

2024-04-25 Thread Mickael Maison
Hi Greg, Thanks for taking a close look at the KIP. 1/2) I understand your concern about leaking resources. I've played a bit more with the code and I think we should be able to handle the closing of the metrics internally rather than delegating it to the user code. I built a small PoC inspired

[jira] [Created] (KAFKA-16620) Kraft quorum cannot be formed if all controllers are restarted at the same time

2024-04-25 Thread Gantigmaa Selenge (Jira)
Gantigmaa Selenge created KAFKA-16620: - Summary: Kraft quorum cannot be formed if all controllers are restarted at the same time Key: KAFKA-16620 URL: https://issues.apache.org/jira/browse/KAFKA-16620

[jira] [Created] (KAFKA-16619) Unnecessary warning : "Loaded ZK migration state of NONE"

2024-04-25 Thread Jira
F Méthot created KAFKA-16619: Summary: Unnecessary warning : "Loaded ZK migration state of NONE" Key: KAFKA-16619 URL: https://issues.apache.org/jira/browse/KAFKA-16619 Project: Kafka Issue

Re: [DISCUSS] KIP-1033: Add Kafka Streams exception handler for exceptions occuring during processing

2024-04-25 Thread Loic Greffier
Hi Matthias, I have updated the KIP regarding points 103 and 108. 103. I have suggested a new `ImmutableHeaders` interface to deal with the immutability concern of the headers, which is basically the `Headers` interface without the write accesses. public interface ImmutableHeaders { Header

Re: [DISCUSS] KIP-1023: Follower fetch from tiered offset

2024-04-25 Thread Luke Chen
Hi, Abhijeet, Thanks for the update. I have no more comments. Luke On Thu, Apr 25, 2024 at 4:21 AM Jun Rao wrote: > Hi, Abhijeet, > > Thanks for the updated KIP. It looks good to me. > > Jun > > On Mon, Apr 22, 2024 at 12:08 PM Abhijeet Kumar < > abhijeet.cse@gmail.com> > wrote: > > > Hi

Re: Permissions to contribute to Apache Kafka

2024-04-25 Thread Mickael Maison
Hi, I've granted you contributor permissions in Jira and Confluence. Thanks for your interest in Kafka! Mickael On Thu, Apr 25, 2024 at 5:47 AM Rajdeep Sahoo wrote: > > Hi team , > Please find my wiki id and jira id mentioned below. Requesting you to grant > access so that I will be able to

Re: [ANNOUNCE] New committer: Igor Soarez

2024-04-25 Thread Randall Hauch
Congratulations, Igor! Randall On Thu, Apr 25, 2024 at 12:51 AM Viktor Somogyi-Vass wrote: > Congrats Igor! > > On Thu, Apr 25, 2024, 07:01 Bruno Cadonna wrote: > > > Congrats! > > > > Best, > > Bruno > > > > Am 25. April 2024 05:18:19 MESZ schrieb Yash Mayya >: > > >Congratulations Igor! >

Re: [VOTE] KIP-910: Update Source offsets for Source Connectors without producing records

2024-04-25 Thread Sagar
Hey All, Bumping the vote thread after a long time! Thanks! Sagar. On Fri, Feb 2, 2024 at 4:24 PM Sagar wrote: > Thanks Yash! > > I am hoping to have this released in 3.8 so it would be good to get the > remaining 2 votes. > > Thanks! > Sagar. > > > On Tue, Jan 30, 2024 at 3:18 PM Yash Mayya

Re: [DISCUSS] KIP-932: Queues for Kafka

2024-04-25 Thread Andrew Schofield
Hi Jun, Thanks for the response. 123. Of course, ShareGroupHearbeat started off as ConsumerGroupHeartbeat and then unnecessary fields were removed. In the network issue case, there is not currently enough state being exchanged to be sure an assignment was received. Rather than add the group

Confluence edit access

2024-04-25 Thread Claude Warren
I would like to get edit access to the Kafka confluence so that I can work on KIP-936. Can someone here do that or do I need to go through Infra? Claude

Re: [VOTE] KIP-1037: Allow WriteTxnMarkers API with Alter Cluster Permission

2024-04-25 Thread Nikhil Ramakrishnan
Thank you Justine, Christo, Andrew, and Luke for the vote! I will keep this vote open for about 3 more days in case there are any more comments or suggestions. Thanks, Nikhil On Wed, Apr 24, 2024 at 1:01 PM Luke Chen wrote: > > Hi Nikhil, > Thanks for the KIP. > > +1 from me. > > Luke > > On

[DISCUSS] Apache Kafka 3.7.1 release

2024-04-25 Thread Igor Soarez
Hi everyone, I'd like to volunteer to be the release manager for a 3.7.1 release. Please keep in mind, this would be my first release, so I might have some questions, and it might also take me a bit longer to work through the release process. So I'm thinking a good target would be toward the

[jira] [Created] (KAFKA-16618) Update the RPC for ConsumerGroupHeartbeatRequest and ConsumerGroupHeartbeatResponse

2024-04-25 Thread Phuc Hong Tran (Jira)
Phuc Hong Tran created KAFKA-16618: -- Summary: Update the RPC for ConsumerGroupHeartbeatRequest and ConsumerGroupHeartbeatResponse Key: KAFKA-16618 URL: https://issues.apache.org/jira/browse/KAFKA-16618