Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2711

2024-03-08 Thread Apache Jenkins Server
See

[DISCUSS] KIP-1026: Handling producer snapshot when upgrading from < v2.8.0 for Tiered Storage

2024-03-08 Thread Arpit Goyal
Hi All, I have created KIP-1026 for handling producerSnapshot empty scenarios when the topic is upgraded from the kafka < 2.8 version. https://cwiki.apache.org/confluence/display/KAFKA/KIP-1026%3A+Handling+producer+snapshot+when+upgrading+from+%3C+v2.8.0+for+Tiered+Storage Feedback and

Re: [DISCUSS] KIP-955: Add stream-table join on foreign key

2024-03-08 Thread Matthias J. Sax
Igor, I did drop the ball on this discussion. Sorry about this. Too many things are happening at the same time. Also I do not think that emitting multiple records from the stream-table FK join is a 'weird' behaviour because this is exactly how the standard SQL behaves and many stream

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.7 #107

2024-03-08 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-990: Capability to SUSPEND Tasks on DeserializationException

2024-03-08 Thread Matthias J. Sax
Hey Nick, I am sorry that I have to say that I am not a fan of this KIP. I see way too many food-guns and complications that can be introduced. I am also not sure if I understand the motivation. You say, CONTINUE and FAIL is not good enough, but don't describe in detail why? If we

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2710

2024-03-08 Thread Apache Jenkins Server
See Changes: -- [...truncated 440673 lines...] [2024-03-09T00:11:03.244Z] at

Re: [VOTE] KIP-956: Tiered Storage Quotas

2024-03-08 Thread Kamal Chandraprakash
+1 (non-binding), Thanks for the KIP, Abhijeet! -- Kamal On Fri, Mar 8, 2024 at 11:02 PM Jun Rao wrote: > Hi, Abhijeet, > > Thanks for the KIP. +1 > > Jun > > On Fri, Mar 8, 2024 at 3:44 AM Abhijeet Kumar > wrote: > > > Hi All, > > > > I would like to start the vote for KIP-956 - Tiered

Re: [DISCUSS] KIP-1022 Formatting and Updating Features

2024-03-08 Thread Artem Livshits
Hi Justine, > Are you suggesting it should be called "transaction protocol version" or "TPV"? I don't mind that, but just wanted to clarify if we want to include protocol or if simply "transaction version" is enough. My understanding is that "metadata version" is the version of metadata

[jira] [Created] (KAFKA-16358) Update Connect Transformation documentation

2024-03-08 Thread Hector Geraldino (Jira)
Hector Geraldino created KAFKA-16358: Summary: Update Connect Transformation documentation Key: KAFKA-16358 URL: https://issues.apache.org/jira/browse/KAFKA-16358 Project: Kafka Issue

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.7 #106

2024-03-08 Thread Apache Jenkins Server
See

Re: Requesting Feedback for a backup solution

2024-03-08 Thread Ralph Weires
Hi Karthick, To share a few thoughts on this - I guess a lot depends on your actual setup / requirements, such as: - The sort of potential outages you really need to tackle with this - The volume of data you have to continuously process - Constraints you may have in terms of messages

Re: Requesting Feedback for a backup solution

2024-03-08 Thread Karthick
Hi guys, I'm still seeking for a solution, I hope many face this problem in production. Any working solutions will help us. On Sat, Feb 17, 2024 at 2:16 PM Karthick wrote: > Dear Kafka Community, > > I am reaching out to seek your valuable feedback and insights on a > proposed solution we are

Re: [VOTE] KIP-956: Tiered Storage Quotas

2024-03-08 Thread Jun Rao
Hi, Abhijeet, Thanks for the KIP. +1 Jun On Fri, Mar 8, 2024 at 3:44 AM Abhijeet Kumar wrote: > Hi All, > > I would like to start the vote for KIP-956 - Tiered Storage Quotas > > The KIP is here: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-956+Tiered+Storage+Quotas > > Regards.

[jira] [Created] (KAFKA-16357) Kafka Client JAR manifest breaks javac linting

2024-03-08 Thread Jacek Wojciechowski (Jira)
Jacek Wojciechowski created KAFKA-16357: --- Summary: Kafka Client JAR manifest breaks javac linting Key: KAFKA-16357 URL: https://issues.apache.org/jira/browse/KAFKA-16357 Project: Kafka

[jira] [Created] (KAFKA-16356) Remove class-name dispatch in RemoteLogMetadataSerde

2024-03-08 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16356: --- Summary: Remove class-name dispatch in RemoteLogMetadataSerde Key: KAFKA-16356 URL: https://issues.apache.org/jira/browse/KAFKA-16356 Project: Kafka Issue

[jira] [Resolved] (KAFKA-16126) Kcontroller dynamic configurations may fail to apply at startup

2024-03-08 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divij Vaidya resolved KAFKA-16126. -- Resolution: Fixed > Kcontroller dynamic configurations may fail to apply at startup >

[jira] [Created] (KAFKA-16355) ConcurrentModificationException in InMemoryTimeOrderedKeyValueBuffer.evictWhile

2024-03-08 Thread Mickael Maison (Jira)
Mickael Maison created KAFKA-16355: -- Summary: ConcurrentModificationException in InMemoryTimeOrderedKeyValueBuffer.evictWhile Key: KAFKA-16355 URL: https://issues.apache.org/jira/browse/KAFKA-16355

[VOTE] KIP-956: Tiered Storage Quotas

2024-03-08 Thread Abhijeet Kumar
Hi All, I would like to start the vote for KIP-956 - Tiered Storage Quotas The KIP is here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-956+Tiered+Storage+Quotas Regards. Abhijeet.

Re: [DISCUSS] KIP-956: Tiered Storage Quotas

2024-03-08 Thread Abhijeet Kumar
Thank you all for your comments. As all the comments in the thread are addressed, I am starting a Vote thread for the KIP. Please have a look. Regards. On Thu, Mar 7, 2024 at 12:34 PM Luke Chen wrote: > Hi Abhijeet, > > Thanks for the update and the explanation. > I had another look, and it

Re: [DISCUSS] KIP-932: Queues for Kafka

2024-03-08 Thread Andrew Schofield
Hi Manikumar, Thanks for your queries. 1) Delivery count is added to the ConsumerRecord class so that a consumer can tell how often a record has been processed. I imagine that some applications might want to take different actions based on whether a record has previously failed. This enables