Re: [ANNOUNCE] New committer: Igor Soarez

2024-04-24 Thread Viktor Somogyi-Vass
Congrats Igor! On Thu, Apr 25, 2024, 07:01 Bruno Cadonna wrote: > Congrats! > > Best, > Bruno > > Am 25. April 2024 05:18:19 MESZ schrieb Yash Mayya : > >Congratulations Igor! > > > >On Wed, 24 Apr, 2024, 23:36 Colin McCabe, wrote: > > > >> Hi all, > >> > >> The PMC of Apache Kafka is pleased

Re: [Confluence] Request for an account

2024-04-24 Thread Luke Chen
Hi Arpit, You should be able to check the status in https://issues.apache.org/jira/browse/INFRA-25451 . It's infra's issue, not ours. Thanks. Luke On Thu, Apr 25, 2024 at 12:49 PM Arpit Goyal wrote: > Hi All, > Is this issue resolved ? > Thanks and Regards > Arpit Goyal > 8861094754 > > > On

Re: [DISCUSS] KIP-924: customizable task assignment for Streams

2024-04-24 Thread Matthias J. Sax
104: I also don't feel super strong about it. Not sure if `onAssignment()` might overload the name in a confusing way? In the end, when the method is called, we don't assign anything? -- Guess, I am fine with whatever Rohan picks as a name from the suggestions we have so far. 107: Did not

Re: [ANNOUNCE] New committer: Igor Soarez

2024-04-24 Thread Bruno Cadonna
Congrats! Best, Bruno Am 25. April 2024 05:18:19 MESZ schrieb Yash Mayya : >Congratulations Igor! > >On Wed, 24 Apr, 2024, 23:36 Colin McCabe, wrote: > >> Hi all, >> >> The PMC of Apache Kafka is pleased to announce a new Kafka committer, Igor >> Soarez. >> >> Igor has been a Kafka contributor

Re: [Confluence] Request for an account

2024-04-24 Thread Arpit Goyal
Hi All, Is this issue resolved ? Thanks and Regards Arpit Goyal 8861094754 On Tue, Mar 26, 2024 at 9:11 AM Luke Chen wrote: > Hi Johnny, > > Currently, there is an infra issue about this: > https://issues.apache.org/jira/browse/INFRA-25451 , and unfortunately it's > not fixed, yet. > I think

Permissions to contribute to Apache Kafka

2024-04-24 Thread Rajdeep Sahoo
Hi team , Please find my wiki id and jira id mentioned below. Requesting you to grant access so that I will be able to contribute to apache kafka. *wiki id*: rajdeepsahoo2012 *jira id*: rajdeep_sahoo Thanks , Rajdeep sahoo

Re: [ANNOUNCE] New committer: Igor Soarez

2024-04-24 Thread Yash Mayya
Congratulations Igor! On Wed, 24 Apr, 2024, 23:36 Colin McCabe, wrote: > Hi all, > > The PMC of Apache Kafka is pleased to announce a new Kafka committer, Igor > Soarez. > > Igor has been a Kafka contributor since 2019. In addition to being a > regular contributor and reviewer, he has made

Re: [ANNOUNCE] New committer: Igor Soarez

2024-04-24 Thread Kamal Chandraprakash
Congratulations, Igor! On Thu, Apr 25, 2024, 06:11 Luke Chen wrote: > Congrats, Igor! > > On Thu, Apr 25, 2024 at 6:10 AM Matthias J. Sax wrote: > > > Congrats! > > > > On 4/24/24 2:29 PM, Bill Bejeck wrote: > > > Congrats Igor! > > > > > > -Bill > > > > > > On Wed, Apr 24, 2024 at 2:37 PM Tom

[jira] [Resolved] (KAFKA-16610) Replace "Map#entrySet#forEach" by "Map#forEach"

2024-04-24 Thread Igor Soarez (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Soarez resolved KAFKA-16610. - Resolution: Resolved > Replace "Map#entrySet#forEach" by "Map#forEach" >

[jira] [Created] (KAFKA-16617) Add KRaft info for the `advertised.listeners` doc description

2024-04-24 Thread Luke Chen (Jira)
Luke Chen created KAFKA-16617: - Summary: Add KRaft info for the `advertised.listeners` doc description Key: KAFKA-16617 URL: https://issues.apache.org/jira/browse/KAFKA-16617 Project: Kafka

Re: [ANNOUNCE] New committer: Igor Soarez

2024-04-24 Thread Luke Chen
Congrats, Igor! On Thu, Apr 25, 2024 at 6:10 AM Matthias J. Sax wrote: > Congrats! > > On 4/24/24 2:29 PM, Bill Bejeck wrote: > > Congrats Igor! > > > > -Bill > > > > On Wed, Apr 24, 2024 at 2:37 PM Tom Bentley wrote: > > > >> Congratulations Igor! > >> > >> On Thu, 25 Apr 2024 at 6:27 AM,

Re: [DISCUSS] KIP-924: customizable task assignment for Streams

2024-04-24 Thread Sophie Blee-Goldman
Now to respond to Matthias: FYI, I'm following the numbering scheme from your email but added to mark responses with further questions or feedback and/or aren't yet addressed in the KIP and need to be followed up on. You can more or less just skip over the ones without stars to save time

RE:DISCUSS KIP-984 Add pluggable compression interface to Kafka

2024-04-24 Thread Diop, Assane
Hi, I would like to bring back attention to https://cwiki.apache.org/confluence/display/KAFKA/KIP-984%3A+Add+pluggable+compression+interface+to+Kafka I have made significant changes to the design to accommodate the concerns and would like some feedback from the community and engage

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.7 #146

2024-04-24 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-16616) refactor mergeWith in MetadataSnapshot

2024-04-24 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-16616: Summary: refactor mergeWith in MetadataSnapshot Key: KAFKA-16616 URL: https://issues.apache.org/jira/browse/KAFKA-16616 Project: Kafka Issue Type:

Re: [ANNOUNCE] New committer: Igor Soarez

2024-04-24 Thread Matthias J. Sax
Congrats! On 4/24/24 2:29 PM, Bill Bejeck wrote: Congrats Igor! -Bill On Wed, Apr 24, 2024 at 2:37 PM Tom Bentley wrote: Congratulations Igor! On Thu, 25 Apr 2024 at 6:27 AM, Chia-Ping Tsai wrote: Congratulations, Igor! you are one of the best Kafka developers!!! Mickael Maison 於

Re: [DISCUSS] KIP-924: customizable task assignment for Streams

2024-04-24 Thread Sophie Blee-Goldman
Responding to Bruno first: (1) I actually think "KafkaStreams" is exactly right here -- for the reason you said, ultimately this is describing a literal instance of the "KafkaStreams" class. Glad we hashed this out! (I saw that Rohan went with StreamsClient but i also prefer KafkaStreams) (4)

Re: [ANNOUNCE] New committer: Igor Soarez

2024-04-24 Thread Bill Bejeck
Congrats Igor! -Bill On Wed, Apr 24, 2024 at 2:37 PM Tom Bentley wrote: > Congratulations Igor! > > On Thu, 25 Apr 2024 at 6:27 AM, Chia-Ping Tsai wrote: > > > Congratulations, Igor! you are one of the best Kafka developers!!! > > > > Mickael Maison 於 2024年4月25日 週四 上午2:16寫道: > > > > >

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2842

2024-04-24 Thread Apache Jenkins Server
See Changes: -- [...truncated 352470 lines...] [2024-04-24T20:25:36.475Z] > Task :connect:json:testSrcJar [2024-04-24T20:25:36.475Z] > Task

Re: [DISCUSS] KIP-1023: Follower fetch from tiered offset

2024-04-24 Thread Jun Rao
Hi, Abhijeet, Thanks for the updated KIP. It looks good to me. Jun On Mon, Apr 22, 2024 at 12:08 PM Abhijeet Kumar wrote: > Hi Jun, > > Please find my comments inline. > > > On Thu, Apr 18, 2024 at 3:26 AM Jun Rao wrote: > > > Hi, Abhijeet, > > > > Thanks for the reply. > > > > 1. I am

[jira] [Created] (KAFKA-16615) JoinGroup API for upgrading ConsumerGroup

2024-04-24 Thread Dongnuo Lyu (Jira)
Dongnuo Lyu created KAFKA-16615: --- Summary: JoinGroup API for upgrading ConsumerGroup Key: KAFKA-16615 URL: https://issues.apache.org/jira/browse/KAFKA-16615 Project: Kafka Issue Type: Sub-task

Re: [DISCUSS] KIP-877: Mechanism for plugins and connectors to register metrics

2024-04-24 Thread Mickael Maison
Hi Matthias, I'm not sure making the Monitorable interface Closeable really solves the issue. Ultimately you need to understand the lifecycle of a plugin to determine when it make sense to close it and which part of the code is responsible for doing it. I'd rather have this described properly in

[jira] [Created] (KAFKA-16614) Disallow `@ClusterTemplate("")`

2024-04-24 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16614: -- Summary: Disallow `@ClusterTemplate("")` Key: KAFKA-16614 URL: https://issues.apache.org/jira/browse/KAFKA-16614 Project: Kafka Issue Type: Improvement

Re: [ANNOUNCE] New committer: Igor Soarez

2024-04-24 Thread Gaurav Narula
Congrats Igor! > On 24 Apr 2024, at 19:37, Tom Bentley wrote: > > Congratulations Igor! > >> On Thu, 25 Apr 2024 at 6:27 AM, Chia-Ping Tsai wrote: >> >> Congratulations, Igor! you are one of the best Kafka developers!!! >> >> Mickael Maison 於 2024年4月25日 週四 上午2:16寫道: >> >>>

Re: [ANNOUNCE] New committer: Igor Soarez

2024-04-24 Thread Tom Bentley
Congratulations Igor! On Thu, 25 Apr 2024 at 6:27 AM, Chia-Ping Tsai wrote: > Congratulations, Igor! you are one of the best Kafka developers!!! > > Mickael Maison 於 2024年4月25日 週四 上午2:16寫道: > > > Congratulations Igor! > > > > On Wed, Apr 24, 2024 at 8:06 PM Colin McCabe wrote: > > > > > > Hi

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.7 #145

2024-04-24 Thread Apache Jenkins Server
See

Re: [ANNOUNCE] New committer: Igor Soarez

2024-04-24 Thread Chia-Ping Tsai
Congratulations, Igor! you are one of the best Kafka developers!!! Mickael Maison 於 2024年4月25日 週四 上午2:16寫道: > Congratulations Igor! > > On Wed, Apr 24, 2024 at 8:06 PM Colin McCabe wrote: > > > > Hi all, > > > > The PMC of Apache Kafka is pleased to announce a new Kafka committer, > Igor

[jira] [Resolved] (KAFKA-16613) Remove TestUtils#subscribeAndWaitForRecords

2024-04-24 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16613. Fix Version/s: 3.8.0 Resolution: Fixed > Remove

Re: [ANNOUNCE] New committer: Igor Soarez

2024-04-24 Thread Mickael Maison
Congratulations Igor! On Wed, Apr 24, 2024 at 8:06 PM Colin McCabe wrote: > > Hi all, > > The PMC of Apache Kafka is pleased to announce a new Kafka committer, Igor > Soarez. > > Igor has been a Kafka contributor since 2019. In addition to being a regular > contributor and reviewer, he has

Re: [DISCUSS] KIP-932: Queues for Kafka

2024-04-24 Thread Jun Rao
Hi, Andrew, Thanks for the response. 123. I thought the network issue can be covered with the group epoch. Basically, if the assignment is to be changed, GC bumps up the epoch first, but doesn't expose the new epoch to members until the assignment is complete (including initializing the

[ANNOUNCE] New committer: Igor Soarez

2024-04-24 Thread Colin McCabe
Hi all, The PMC of Apache Kafka is pleased to announce a new Kafka committer, Igor Soarez. Igor has been a Kafka contributor since 2019. In addition to being a regular contributor and reviewer, he has made significant contributions to improving Kafka's JBOD support in KRaft mode. He has also

Re: [PR] [MINOR] Add youtube to content security policy [kafka-site]

2024-04-24 Thread via GitHub
raboof commented on PR #597: URL: https://github.com/apache/kafka-site/pull/597#issuecomment-2075421541 unfortunately it seems https://w3c.github.io/webappsec-csp/#meta-element is correct that the meta element can only further restrict the policy, not widen it. I wonder if you could

[jira] [Reopened] (KAFKA-15743) KRaft support in ReplicationQuotasTest

2024-04-24 Thread Proven Provenzano (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Proven Provenzano reopened KAFKA-15743: --- The {{registerBroker}} function in this test file needs to use the directory UUIDs

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2841

2024-04-24 Thread Apache Jenkins Server
See

[jira] [Reopened] (KAFKA-16606) JBOD support in KRaft does not seem to be gated by the metadata version

2024-04-24 Thread Igor Soarez (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Soarez reopened KAFKA-16606: - Assignee: Igor Soarez > JBOD support in KRaft does not seem to be gated by the metadata

Re: [VOTE] KIP-1031: Control offset translation in MirrorSourceConnector

2024-04-24 Thread Omnia Ibrahim
Thanks Igor, I’ll conclude the vote with 3 binding votes from Mickael Maison, Chris Egerton and Igor Soarez. Thanks everyone > On 24 Apr 2024, at 15:11, Igor Soarez wrote: > > Hi Omnia, > > Thanks for your answers, and I see you've updated the KIP so thanks for the > changes too. > > +1

Re: [DISCUSS] KIP-932: Queues for Kafka

2024-04-24 Thread Andrew Schofield
Hi Jun, Thanks for your reply. 123. The GC only sends the assignment in ShareGroupHeartbeat response if the member has just joined, or the assignment has been recalculated. This latter condition is met when the GC fails over. With a consumer group, it works a little differently. The heartbeating

Re: [VOTE] KIP-1031: Control offset translation in MirrorSourceConnector

2024-04-24 Thread Igor Soarez
Hi Omnia, Thanks for your answers, and I see you've updated the KIP so thanks for the changes too. +1 (binding), thanks for the KIP -- Igor

Re: [DISCUSS] KIP-936 Throttle number of active PIDs

2024-04-24 Thread Omnia Ibrahim
Hi Glaude sorry that it took me a while to respond. I finally had time to look into your implementation here https://github.com/Claudenw/kafka/blob/KIP-936/storage/src/main/java/org/apache/kafka/storage/internals/log/ProducerIDQuotaManager.java#L121 and so far it make sense. > So an early PID

[jira] [Resolved] (KAFKA-16592) ConfigKey constructor update can break clients using it

2024-04-24 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16592. Fix Version/s: 3.8.0 Resolution: Fixed > ConfigKey constructor update can break

Re: [DISCUSS] KIP-1036: Extend RecordDeserializationException exception

2024-04-24 Thread Frédérik Rouleau
Hi, I have updated the KIP now and the latest version of PR is available. About Kirk's questions: K11: Yes, both can have a deserialization exception but we deserialize the key first, so if an error occurs then, we do not try to deserialize the value. So the exception raised is always for key

Re: [VOTE] KIP-1037: Allow WriteTxnMarkers API with Alter Cluster Permission

2024-04-24 Thread Luke Chen
Hi Nikhil, Thanks for the KIP. +1 from me. Luke On Mon, Apr 22, 2024 at 7:41 PM Andrew Schofield wrote: > Hi Nikhil, > Thanks for the KIP. Looks good to me. > > +1 (non-binding) > > Thanks, > Andrew > > > On 22 Apr 2024, at 09:17, Christo Lolov wrote: > > > > Heya Nikhil, > > > > Thanks for

[jira] [Created] (KAFKA-16613) Remove TestUtils#subscribeAndWaitForRecords

2024-04-24 Thread PoAn Yang (Jira)
PoAn Yang created KAFKA-16613: - Summary: Remove TestUtils#subscribeAndWaitForRecords Key: KAFKA-16613 URL: https://issues.apache.org/jira/browse/KAFKA-16613 Project: Kafka Issue Type: Test

[jira] [Created] (KAFKA-16612) Talking to controllers via AdminClient requires reconfiguring controller listener

2024-04-24 Thread Gantigmaa Selenge (Jira)
Gantigmaa Selenge created KAFKA-16612: - Summary: Talking to controllers via AdminClient requires reconfiguring controller listener Key: KAFKA-16612 URL: https://issues.apache.org/jira/browse/KAFKA-16612

[jira] [Resolved] (KAFKA-16483) Apply `ClusterTestExtensions` to DeleteOffsetsConsumerGroupCommandIntegrationTest

2024-04-24 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16483. Fix Version/s: 3.8.0 Resolution: Fixed > Apply `ClusterTestExtensions` to >

Re: [VOTE] KIP-1031: Control offset translation in MirrorSourceConnector

2024-04-24 Thread Omnia Ibrahim
I updated the KIP as well to briefly explain how offset.lag.max would help latency. Please let me know if the KIP now looks better? > On 24 Apr 2024, at 11:49, Omnia Ibrahim wrote: > > Thanks Igor for the suggestions. I updated the KIP with some of them. > >> s/recored's offset/recorded

[jira] [Created] (KAFKA-16611) Consider adding test name to "client.id" of Admin in testing

2024-04-24 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16611: -- Summary: Consider adding test name to "client.id" of Admin in testing Key: KAFKA-16611 URL: https://issues.apache.org/jira/browse/KAFKA-16611 Project: Kafka

Re: [VOTE] KIP-1031: Control offset translation in MirrorSourceConnector

2024-04-24 Thread Omnia Ibrahim
Thanks Igor for the suggestions. I updated the KIP with some of them. > s/recored's offset/recorded offsets I actually mean record’s offset and not recorded offset. MirrorSourceConnector store the offset of the committed record on the destination cluster in an internal topic. > 12. The use

[jira] [Created] (KAFKA-16610) Replace "Map#entrySet#forEach" by "Map#forEach"

2024-04-24 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16610: -- Summary: Replace "Map#entrySet#forEach" by "Map#forEach" Key: KAFKA-16610 URL: https://issues.apache.org/jira/browse/KAFKA-16610 Project: Kafka Issue

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2840

2024-04-24 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-16424) truncated logs will be left undeleted after alter dir completion

2024-04-24 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-16424. --- Fix Version/s: 3.8.0 Resolution: Fixed > truncated logs will be left undeleted after alter

Re: [PR] MINOR: Add Igor to committers [kafka-site]

2024-04-24 Thread via GitHub
soarez commented on PR #598: URL: https://github.com/apache/kafka-site/pull/598#issuecomment-2074419156 Thank you all  -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] MINOR: Add Igor to committers [kafka-site]

2024-04-24 Thread via GitHub
soarez merged PR #598: URL: https://github.com/apache/kafka-site/pull/598 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] MINOR: Add Igor to committers [kafka-site]

2024-04-24 Thread via GitHub
dajac commented on PR #598: URL: https://github.com/apache/kafka-site/pull/598#issuecomment-2074387386 Congrats, Igor! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To