[jira] [Created] (KAFKA-16917) Align the returned map type of KafkaAdminClient

2024-06-07 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16917: -- Summary: Align the returned map type of KafkaAdminClient Key: KAFKA-16917 URL: https://issues.apache.org/jira/browse/KAFKA-16917 Project: Kafka Issue

Re: Build hanging

2024-06-07 Thread Apoorv Mittal
Hi Sophie, Yes the PR should also fix the tests in other class you mentioned. I have validated locally and attached details in the PR for successful run on local. - Regards, Apoorv Mittal > On 8 Jun 2024, at 02:24, Sophie Blee-Goldman wrote: > > Thanks for the quick fix! > > By the way, I

Re: Build hanging

2024-06-07 Thread Sophie Blee-Goldman
Thanks for the quick fix! By the way, I took a quick look at the output for some aborted builds and can confirm that this test is also hanging: SaslClientsWithInvalidCre dentialsTest.testKafkaAdminClientWithAuthenticationFailure It sounds like it probably has the same root cause as the test we

Re: Build hanging

2024-06-07 Thread Haruki Okada
Oh, thank you for identifying the root cause quickly Apoorv. I changed the assignee of KAFKA-16916 to you. Thanks, 2024年6月8日(土) 10:13 Apoorv Mittal : > Hi, > Please find the fix for the issue: > https://github.com/apache/kafka/pull/16249 > > Regards, > Apoorv Mittal > +44 7721681581 > > > On

Re: Build hanging

2024-06-07 Thread Apoorv Mittal
Hi, Please find the fix for the issue: https://github.com/apache/kafka/pull/16249 Regards, Apoorv Mittal +44 7721681581 On Sat, Jun 8, 2024 at 2:09 AM Sophie Blee-Goldman wrote: > Thanks for jumping on this guys, and nice find Haruki > > I agree with Luke that we should disable the offending

Re: Build hanging

2024-06-07 Thread Sophie Blee-Goldman
Thanks for jumping on this guys, and nice find Haruki I agree with Luke that we should disable the offending tests ASAP to unblock other things, and file a 3.8 blocker to investigate this further. Thanks for the PR Haruki and thanks for filing the ticket Luke -- I marked it as a blocker for 3.8.0

Re: Build hanging

2024-06-07 Thread Haruki Okada
Opened the PR h(ttps://github.com/apache/kafka/pull/16248) Let's see if CI runs properly. Thanks, 2024年6月8日(土) 10:01 Luke Chen : > > Let's disable for now to unblock builds, and revert later if we can't > solve > it until code freeze? > > That's exactly what I meant to do. > I've opened

Re: Build hanging

2024-06-07 Thread Luke Chen
> Let's disable for now to unblock builds, and revert later if we can't solve it until code freeze? That's exactly what I meant to do. I've opened KAFKA-16916 for this issue and assigned to you. Welcome to unassign yourselves if you don't have

Re: Build hanging

2024-06-07 Thread Haruki Okada
Hi Luke, I see, but since this is likely due to AdminClient's behavior change, we need to fix it anyways not only disabling test before 3.8 release. Let's disable for now to unblock builds, and revert later if we can't solve it until code freeze? 2024年6月8日(土) 9:31 Luke Chen : > Hi Haruki, > >

[jira] [Created] (KAFKA-16916) ClientAuthenticationFailureTest.testAdminClientWithInvalidCredentials will run forever

2024-06-07 Thread Luke Chen (Jira)
Luke Chen created KAFKA-16916: - Summary: ClientAuthenticationFailureTest.testAdminClientWithInvalidCredentials will run forever Key: KAFKA-16916 URL: https://issues.apache.org/jira/browse/KAFKA-16916

Re: Build hanging

2024-06-07 Thread Luke Chen
Hi Haruki, Thanks for identifying this blocking test. Could you help quickly open a PR to disable this test to unblock the CI build? Thanks. Luke On Sat, Jun 8, 2024 at 8:20 AM Haruki Okada wrote: > Hi > > I found that the hanging can be reproduced locally. > The blocking test is > >

Re: Build hanging

2024-06-07 Thread Haruki Okada
Hi I found that the hanging can be reproduced locally. The blocking test is "org.apache.kafka.common.security.authenticator.ClientAuthenticationFailureTest.testAdminClientWithInvalidCredentials". It started to block after this commit (

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.8 #22

2024-06-07 Thread Apache Jenkins Server
See

Build hanging

2024-06-07 Thread Sophie Blee-Goldman
Seems like the build is currently broken -- specifically, a test is hanging and causing it to abort after 7+ hours. There are many examples in the current PRs, such as Timed out after almost 8 hours: 1.

Re: [DISCUSS] KIP-1054: Support external schemas in JSONConverter

2024-06-07 Thread Hector Geraldino (BLOOMBERG/ 919 3RD A)
Hi, Is this KIP focusing on Sink connectors? Meaning, is the idea to be able to decode JSON messages into Connect records using a schema read from disk? If I look at this from the perspective of a source connector, not including the schema contents - or the ID of a schema from a schema

[DISCUSS] KIP-1053: Align the naming convention for config and default variables in *Config classes

2024-06-07 Thread Eric Lu
Hi, I think that my last attempt at creating a discussion thread half-worked. I wanted to open a discussion thread to discuss KIP-1053 about renaming the constants to fit the naming convention. The idea is to deprecate the old variables and introduce the new ones. The main dilemma is whether it

Re: [DISCUSS] KIP-1054: Support external schemas in JSONConverter

2024-06-07 Thread Greg Harris
Hi Priyanka, Thanks for the KIP! I think you captured the motivation well: The Converter interface on its own implies a fairly large raw message size, and the ecosystem's strategies for deduplicating schema information are complex. I did have some questions/concerns. 1. Have you done a

[jira] [Resolved] (KAFKA-16911) Kafka Streams topology optimization docs incomplete

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-16911. - Fix Version/s: 3.8.0 Resolution: Fixed > Kafka Streams topology optimization

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.8 #21

2024-06-07 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-1017: A health check endpoint for Kafka Connect

2024-06-07 Thread Andrew Schofield
Hi Chris, This KIP looks good to me. I particularly like the explanation of how the result will specifically check the worker health in ways that have previously caused trouble. Thanks, Andrew > On 7 Jun 2024, at 16:18, Mickael Maison wrote: > > Hi Chris, > > Happy Friday! The KIP looks good

Re: [DISCUSS] KIP-1054: Support external schemas in JSONConverter

2024-06-07 Thread Fan Yang
Hi Priyanka, My suggestion is that the we can place schema file at any location, such as file location, network location, etc. So, the new option could be just schema.location Best, Fan From: Priyanka K U Sent: Friday, June 7, 2024 16:22 To:

Re: [DISCUSS] KIP-1017: A health check endpoint for Kafka Connect

2024-06-07 Thread Mickael Maison
Hi Chris, Happy Friday! The KIP looks good to me. +1 Thanks, Mickael On Fri, Jan 26, 2024 at 8:41 PM Chris Egerton wrote: > > Hi all, > > Happy Friday! I'd like to kick off discussion for KIP-1017, which (as the > title suggests) proposes adding a health check endpoint for Kafka Connect: >

[jira] [Created] (KAFKA-16915) Update leader change message

2024-06-07 Thread Jira
José Armando García Sancio created KAFKA-16915: -- Summary: Update leader change message Key: KAFKA-16915 URL: https://issues.apache.org/jira/browse/KAFKA-16915 Project: Kafka

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.8 #20

2024-06-07 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-1050: Consistent error handling for Transactions

2024-06-07 Thread Kaushik Raina
Thank you Andrew for feedback 1. We are suggesting to only update subclasses of o.a.k.common.errors.ApiException, which are used in transactions. All such subclasses are mentioned in Exception table

[jira] [Resolved] (KAFKA-5261) Performance improvement of SimpleAclAuthorizer

2024-06-07 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-5261. --- Resolution: Won't Do > Performance improvement of SimpleAclAuthorizer >

[jira] [Created] (KAFKA-16914) Add Shage Group dynamic and broker configs

2024-06-07 Thread Apoorv Mittal (Jira)
Apoorv Mittal created KAFKA-16914: - Summary: Add Shage Group dynamic and broker configs Key: KAFKA-16914 URL: https://issues.apache.org/jira/browse/KAFKA-16914 Project: Kafka Issue Type:

[DISCUSS] KIP-1054: Support external schemas in JSONConverter

2024-06-07 Thread Priyanka K U
Hi everyone, I'd like to start a discussion of KIP-1054, which aims to Support external schemas in JSONConverter to Kafka Connect: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1054%3A+Support+external+schemas+in+JSONConverter Looking forward for your feedback. Regards, Priyanka

[jira] [Created] (KAFKA-16913) Support external schemas in JSONConverter

2024-06-07 Thread Priyanka K U (Jira)
Priyanka K U created KAFKA-16913: Summary: Support external schemas in JSONConverter Key: KAFKA-16913 URL: https://issues.apache.org/jira/browse/KAFKA-16913 Project: Kafka Issue Type:

[jira] [Resolved] (KAFKA-16912) Migrate ConsumerNetworkThreadTest.testPollResultTimer() to NetworkClientDelegateTest

2024-06-07 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16912. Fix Version/s: 3.9.0 Resolution: Fixed > Migrate