Re: [DISCUSS] KIP-1033: Add Kafka Streams exception handler for exceptions occuring during processing

2024-05-10 Thread Sophie Blee-Goldman
Whoops, just noticed there is already a voting thread for this. Hard to keep track with all the KIPs going on right now! In that case I'll just wait for the SerializationExceptionOrigin thing to be added and then I'll vote. Should definitely be able to make 3.8 in this case :D On Fri, May 10,

Re: [DISCUSS] KIP-1033: Add Kafka Streams exception handler for exceptions occuring during processing

2024-05-10 Thread Sophie Blee-Goldman
Sounds like we're more or less in agreement here. I think the KIP just needs one small update still, which is the SerializationExceptionOrigin enum. As discussed there are a few options for this and we're all happy to defer to the preference of the KIP authors, but if we keep the KIP as-is with

[jira] [Created] (KAFKA-16704) Fix flaky kafka.log.remote.RemoteIndexCacheTest#testIndexFileAlreadyExistOnDiskButNotInCache

2024-05-10 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16704: -- Summary: Fix flaky kafka.log.remote.RemoteIndexCacheTest#testIndexFileAlreadyExistOnDiskButNotInCache Key: KAFKA-16704 URL: https://issues.apache.org/jira/browse/KAFKA-16704

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2892

2024-05-10 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-16703) SocketServer leaks ServerSocketChannel when port is already in-use

2024-05-10 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16703: --- Summary: SocketServer leaks ServerSocketChannel when port is already in-use Key: KAFKA-16703 URL: https://issues.apache.org/jira/browse/KAFKA-16703 Project: Kafka

[jira] [Created] (KAFKA-16702) KafkaLog4jAppenderTest leaks producer instances

2024-05-10 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16702: --- Summary: KafkaLog4jAppenderTest leaks producer instances Key: KAFKA-16702 URL: https://issues.apache.org/jira/browse/KAFKA-16702 Project: Kafka Issue Type:

[jira] [Resolved] (KAFKA-16513) Allow WriteTxnMarkers API with Alter Cluster Permission

2024-05-10 Thread Justine Olshan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Justine Olshan resolved KAFKA-16513. Resolution: Fixed > Allow WriteTxnMarkers API with Alter Cluster Permission >

[jira] [Created] (KAFKA-16701) Some SocketServerTest buffered close tests flaky failing locally

2024-05-10 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16701: --- Summary: Some SocketServerTest buffered close tests flaky failing locally Key: KAFKA-16701 URL: https://issues.apache.org/jira/browse/KAFKA-16701 Project: Kafka

[jira] [Created] (KAFKA-16700) Kafka Streams: possible message loss on KTable-KTable FK Left Join

2024-05-10 Thread Jira
Karsten Stöckmann created KAFKA-16700: - Summary: Kafka Streams: possible message loss on KTable-KTable FK Left Join Key: KAFKA-16700 URL: https://issues.apache.org/jira/browse/KAFKA-16700

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2891

2024-05-10 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-1033: Add Kafka Streams exception handler for exceptions occuring during processing

2024-05-10 Thread Bill Bejeck
Great KIP discussion so far by everyone. At this point, I'm in agreement with the direction and current state of the KIP. As for having two separate callbacks for the ProductionExceptionHandler, I'm somewhat split in that I agree with points raised by Sophie and Matthias with my final position

[jira] [Created] (KAFKA-16699) Have Streams treat InvalidPidMappingException like a ProducerFencedException

2024-05-10 Thread Walker Carlson (Jira)
Walker Carlson created KAFKA-16699: -- Summary: Have Streams treat InvalidPidMappingException like a ProducerFencedException Key: KAFKA-16699 URL: https://issues.apache.org/jira/browse/KAFKA-16699

[jira] [Created] (KAFKA-16698) Fix flaky kafka.network.DynamicConnectionQuotaTest#testDynamicIpConnectionRateQuota

2024-05-10 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16698: -- Summary: Fix flaky kafka.network.DynamicConnectionQuotaTest#testDynamicIpConnectionRateQuota Key: KAFKA-16698 URL: https://issues.apache.org/jira/browse/KAFKA-16698

[jira] [Created] (KAFKA-16697) Fix flaky kafka.api.SaslGssapiSslEndToEndAuthorizationTest#testProduceConsumeWithWildcardAcls

2024-05-10 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16697: -- Summary: Fix flaky kafka.api.SaslGssapiSslEndToEndAuthorizationTest#testProduceConsumeWithWildcardAcls Key: KAFKA-16697 URL: https://issues.apache.org/jira/browse/KAFKA-16697

Re: [DISCUSS] KIP-891: Running multiple versions of Connector plugins

2024-05-10 Thread Greg Harris
Hey Snehashis, I'm glad to hear you're still interested in this KIP! I'm happy to let you drive this, and I apologize for increasing the scope of work so drastically. To make up for that, I'll volunteer to be the primary PR reviewer to help get this done quickly once the KIP is approved. Thanks,

[jira] [Resolved] (KAFKA-16688) SystemTimer leaks resources on close

2024-05-10 Thread Igor Soarez (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Soarez resolved KAFKA-16688. - Resolution: Fixed > SystemTimer leaks resources on close >

Re: KIP-1040: Improve handling of nullable values in InsertField/ExtractField transformations

2024-05-10 Thread Chris Egerton
 Done On Fri, May 10, 2024, 10:55 Mario Fiore Vitale wrote: > Thanks a lot! I have just a minor comment, should we also update the title > to be more generic since now it's also related to other SMTs? > > On Fri, May 10, 2024 at 4:44 PM Chris Egerton > wrote: > > > I've finished updating the

Re: KIP-1040: Improve handling of nullable values in InsertField/ExtractField transformations

2024-05-10 Thread Mario Fiore Vitale
Thanks a lot! I have just a minor comment, should we also update the title to be more generic since now it's also related to other SMTs? On Fri, May 10, 2024 at 4:44 PM Chris Egerton wrote: > I've finished updating the KIP; @Mario, please let me know what you think. > > On Fri, May 10, 2024 at

Re: KIP-1040: Improve handling of nullable values in InsertField/ExtractField transformations

2024-05-10 Thread Chris Egerton
I've finished updating the KIP; @Mario, please let me know what you think. On Fri, May 10, 2024 at 10:26 AM Chris Egerton wrote: > I can do it :) > > On Fri, May 10, 2024 at 10:02 AM Mario Fiore Vitale > wrote: > >> Yes, I agree. Unfortunately due to the issue of the creation of a new >>

Re: KIP-1040: Improve handling of nullable values in InsertField/ExtractField transformations

2024-05-10 Thread Chris Egerton
I can do it :) On Fri, May 10, 2024 at 10:02 AM Mario Fiore Vitale wrote: > Yes, I agree. Unfortunately due to the issue of the creation of a new > account for the WIKI, I asked Mickael Maison to create the KIP for me. > > I'll ask him to update the KIP. Do you have other alternatives? > >

Re: [DISCUSS] KIP-1028: Docker Official Image for Apache Kafka

2024-05-10 Thread Chris Egerton
Hi Krish and Prabha, Thanks for your replies. I still have some follow-up questions: 1) I read https://docs.docker.com/trusted-content/official-images/ and didn't find anything on that page or immediately around it that explains what compliance requirements might be satisfied by a DOI that

Re: KIP-1040: Improve handling of nullable values in InsertField/ExtractField transformations

2024-05-10 Thread Mario Fiore Vitale
Yes, I agree. Unfortunately due to the issue of the creation of a new account for the WIKI, I asked Mickael Maison to create the KIP for me. I'll ask him to update the KIP. Do you have other alternatives? Thanks, Mario. On Fri, May 10, 2024 at 3:40 PM Chris Egerton wrote: > Yes, I think we

Re: KIP-1040: Improve handling of nullable values in InsertField/ExtractField transformations

2024-05-10 Thread Chris Egerton
Yes, I think we should just do one KIP for all the SMTs. You don't have to implement everything all at once or by yourself, but I don't see why we should require one or more follow-up KIPs to apply the exact same changes to the SMTs we missed the first time. On Fri, May 10, 2024 at 5:20 AM Mario

Re: [DISCUSS] KIP-1028: Docker Official Image for Apache Kafka

2024-05-10 Thread Krish Vora
Hey Chris, We have responded to the initial round of queries. And as you mentioned in your comment, you may have more questions related to this KIP. Please let us know if you have any. We want to start the voting for this KIP soon, as we intend to include it in the 3.8.0 release. Thanks.

Re: [DISCUSS] KIP-891: Running multiple versions of Connector plugins

2024-05-10 Thread Snehashis
Hi Greg, Thanks for the follow up to my original KIP, I am in favour of the additions made to expand its scope, the addition of range versions specifically make a lot of sense. Apologies if I have not publicly worked on this KIP for a long time. The original work was done when the move to

Re: [DISCUSS] KIP-950: Tiered Storage Disablement

2024-05-10 Thread Luke Chen
Hi Christo, > 1. I am not certain I follow the question. From DISABLED you can only go to ENABLED regardless of whether your cluster is backed by Zookeeper or KRaft. Am I misunderstanding your point? Yes, you're right. > 4. I was thinking that if there is a mismatch we will just fail accepting

Re: KIP-1040: Improve handling of nullable values in InsertField/ExtractField transformations

2024-05-10 Thread Mario Fiore Vitale
Hi Chris, Thanks for the survey. Do you think I need to update the KIP to put all of these? On Thu, May 9, 2024 at 4:14 PM Chris Egerton wrote: > After doing a brief survey of the SMTs that ship with Connect, it seems > like these would also benefit: > > - HeaderFrom, which populates record

[PR] Add Skillsoft to "Powered By" [kafka-site]

2024-05-10 Thread via GitHub
brandon-powers opened a new pull request, #601: URL: https://github.com/apache/kafka-site/pull/601  This PR adds [Skillsoft](https://www.skillsoft.com/) to the _**Powered By**_ page with a brief usage description & logo. We've been utilizing Apache Kafka in production for

[jira] [Resolved] (KAFKA-16445) PATCH method for connector configuration

2024-05-10 Thread Ivan Yurchenko (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Yurchenko resolved KAFKA-16445. Resolution: Fixed > PATCH method for connector configuration >

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2889

2024-05-10 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-16660) reduce the check interval to speedup DelegationTokenRequestsTest

2024-05-10 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16660. Fix Version/s: 3.8.0 Resolution: Fixed > reduce the check interval to speedup