Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2088

2023-08-10 Thread Apache Jenkins Server
See

Re: What are the biggest issues with Apache Kafka?

2023-08-10 Thread ziming deng
Hi Liam, The Apache Kafka project has several modules, I think you should firstly select a module you are interested in. For example, we are currently working on KIP-500 related features, which includes 1. KIP-856: KRaft Disk Failure Recovery, 2. KIP-642: Dynamic quorum reassignment, 3.

[jira] [Resolved] (KAFKA-15287) Change NodeApiVersions.create() to contains both apis of zk and kraft broker

2023-08-10 Thread Deng Ziming (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deng Ziming resolved KAFKA-15287. - Resolution: Fixed > Change NodeApiVersions.create() to contains both apis of zk and kraft

[GitHub] [kafka-site] lbradstreet commented on pull request #537: MINOR: Add Lucas Bradstreet to committers

2023-08-10 Thread via GitHub
lbradstreet commented on PR #537: URL: https://github.com/apache/kafka-site/pull/537#issuecomment-1674136550 @jolshan if you or someone else is able to merge this it’d be helpful. This PR is what should get me the ability to merge :) -- This is an automated message from the Apache Git

Re: What are the biggest issues with Apache Kafka?

2023-08-10 Thread Philip Nee
Hey Liam, I think apache jira would be a great place to find lower hanging fruits. We also have lots of flaky tests to resolve. What is you familiarity with Kafka? If you are new, i would suggest looking at the demos and examples in the repo, and maybe try to improve them. There is also a lot

What are the biggest issues with Apache Kafka?

2023-08-10 Thread Liam Hodges
I'm working with a small team of engineers looking to contribute to the open source tools for Apache Kafka. What is missing in the Kafka community right now? Are there any problems an open source project could solve for it's developers? Appreciate all feedback.

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.3 #186

2023-08-10 Thread Apache Jenkins Server
See Changes: -- [...truncated 420679 lines...] org.apache.kafka.streams.integration.TimeWindowedKStreamIntegrationTest >

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.4 #159

2023-08-10 Thread Apache Jenkins Server
See Changes: -- [...truncated 524853 lines...] Gradle Test Run :core:integrationTest > Gradle Test Executor 171 > KafkaZkClientTest > testLogDirEventNotificationsDeletion()

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2087

2023-08-10 Thread Apache Jenkins Server
See Changes: -- [...truncated 406314 lines...] streams-5: SMOKE-TEST-CLIENT-CLOSED streams-5: SMOKE-TEST-CLIENT-CLOSED streams-1: SMOKE-TEST-CLIENT-CLOSED streams-4:

Re: [DISCUSS] KIP-955: Add stream-table join on foreign key

2023-08-10 Thread Matthias J. Sax
Thanks. Seems we are on the same page now what the requirement are? That's good progress! This solution was considered when in KIP-213 for the existing table-table FK join. There is a discussion on disadvantages of using this approach in the article related to KIP-213 and I think the same

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.5 #57

2023-08-10 Thread Apache Jenkins Server
See Changes: -- [...truncated 281691 lines...] > Task :core:integrationTest Gradle Test Run :core:integrationTest > Gradle Test Executor 182 >

[jira] [Reopened] (KAFKA-14598) Fix flaky ConnectRestApiTest

2023-08-10 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris reopened KAFKA-14598: - Assignee: (was: Ashwin Pankaj) > Fix flaky ConnectRestApiTest >

Re: [VOTE] KIP-962 Relax non-null key requirement in Kafka Streams

2023-08-10 Thread Matthias J. Sax
+1 (binding) On 8/10/23 12:31 PM, Florin Akermann wrote: https://cwiki.apache.org/confluence/display/KAFKA/KIP-962%3A+Relax+non-null+key+requirement+in+Kafka+Streams

[DISCUSS] KIP-966: Eligible Leader Replicas

2023-08-10 Thread Calvin Liu
Hi everyone, I'd like to discuss a series of enhancement to the replication protocol. A partition replica can experience local data loss in unclean shutdown scenarios where unflushed data in the OS page cache is lost - such as an availability zone power outage or a server error. The Kafka

[jira] [Resolved] (KAFKA-15239) producerPerformance system test for old client failed after v3.5.0

2023-08-10 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-15239. - Fix Version/s: 3.6.0 Reviewer: Greg Harris Resolution: Fixed >

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2086

2023-08-10 Thread Apache Jenkins Server
See Changes: -- [...truncated 403180 lines...] streams-3: SMOKE-TEST-CLIENT-CLOSED streams-0: SMOKE-TEST-CLIENT-CLOSED FAILURE: Build failed with an exception. * What

[jira] [Resolved] (KAFKA-13187) Replace EasyMock and PowerMock with Mockito for DistributedHerderTest

2023-08-10 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-13187. --- Fix Version/s: 3.6.0 Resolution: Done > Replace EasyMock and PowerMock with Mockito

[VOTE] KIP-962 Relax non-null key requirement in Kafka Streams

2023-08-10 Thread Florin Akermann
https://cwiki.apache.org/confluence/display/KAFKA/KIP-962%3A+Relax+non-null+key+requirement+in+Kafka+Streams

Re: [DISCUSS] KIP-962 Relax non-null key requirement in Kafka Streams

2023-08-10 Thread Florin Akermann
Thanks. Here is the PR for this catch: https://github.com/apache/kafka/pull/14187 On Thu, 10 Aug 2023 at 19:04, Matthias J. Sax wrote: > Good catch about the JavaDocs. > > Seems we missed to update them when we did K10277. Would you like to do > a PR to fix them right away for upcoming 3.6

Re: [DISCUSS] KIP-955: Add stream-table join on foreign key

2023-08-10 Thread Igor Fomenko
I don't mind you being a bit picky. I think it is a great discussion and it helps me too. For example I clearly see now that the problem of aggregation still needs to be solved for this use case. Please see my answers below. I used an example of OrderEvents to OrderItems relationship as 1:1 just

[jira] [Created] (KAFKA-15333) Flaky build failure throwing Connect Exception: Could not connect to server....

2023-08-10 Thread Philip Nee (Jira)
Philip Nee created KAFKA-15333: -- Summary: Flaky build failure throwing Connect Exception: Could not connect to server Key: KAFKA-15333 URL: https://issues.apache.org/jira/browse/KAFKA-15333 Project:

[jira] [Created] (KAFKA-15332) Eligible Leader Replicas

2023-08-10 Thread Calvin Liu (Jira)
Calvin Liu created KAFKA-15332: -- Summary: Eligible Leader Replicas Key: KAFKA-15332 URL: https://issues.apache.org/jira/browse/KAFKA-15332 Project: Kafka Issue Type: New Feature

[jira] [Resolved] (KAFKA-15291) Implement Versioned interfaces in common Connect plugins

2023-08-10 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-15291. - Resolution: Fixed > Implement Versioned interfaces in common Connect plugins >

Re: [DISCUSS] KIP-962 Relax non-null key requirement in Kafka Streams

2023-08-10 Thread Matthias J. Sax
Good catch about the JavaDocs. Seems we missed to update them when we did K10277. Would you like to do a PR to fix them right away for upcoming 3.6 release? If there is no more other comments, I think you can start a VOTE thread. -Matthias On 8/10/23 4:22 AM, Florin Akermann wrote: Thank

Re: [VOTE] KIP-959 Add BooleanConverter to Kafka Connect

2023-08-10 Thread Hector Geraldino (BLOOMBERG/ 919 3RD A)
Thanks Mickael! The KIP has passed with 3 binding votes (Chris Egerton, Greg Harris, Mickael Maison) and 3 non-binding votes (Andrew Schofield, Yash Mayya, Kamal Chandraprakash). I'll update the KIP status, meanwhile the PR is still pending: https://github.com/apache/kafka/pull/14093 From:

[jira] [Created] (KAFKA-15331) Handle remote log enabled topic deletion when leader is not available

2023-08-10 Thread Kamal Chandraprakash (Jira)
Kamal Chandraprakash created KAFKA-15331: Summary: Handle remote log enabled topic deletion when leader is not available Key: KAFKA-15331 URL: https://issues.apache.org/jira/browse/KAFKA-15331

Re: [VOTE] KIP-858: Handle JBOD broker disk failure in KRaft

2023-08-10 Thread Igor Soarez
Hi Mickael, Thanks for voting, and for pointing out the mistake. I've corrected it in the KIP now. The proposed name is "QueuedReplicaToDirAssignments". Best, -- Igor

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2085

2023-08-10 Thread Apache Jenkins Server
See Changes: -- [...truncated 400994 lines...] Gradle Test Run :streams:integrationTest > Gradle Test Executor 181 > TableTableJoinIntegrationTest > [caching enabled =

Re: [DISCUSS] KIP-962 Relax non-null key requirement in Kafka Streams

2023-08-10 Thread Florin Akermann
Thank you for the feedback. > Not sure if this is the right phrasing? You are right. I adjusted the phrasing accordingly. Given your description of the current behavior, do I understand correctly that the current documentation for the left join KStream-GlobalKtable is out of date?

[jira] [Created] (KAFKA-15330) Migration from ZK to KRaft works with 3.4 but fails from 3.5 upwards

2023-08-10 Thread Roland Sommer (Jira)
Roland Sommer created KAFKA-15330: - Summary: Migration from ZK to KRaft works with 3.4 but fails from 3.5 upwards Key: KAFKA-15330 URL: https://issues.apache.org/jira/browse/KAFKA-15330 Project:

[jira] [Created] (KAFKA-15329) Make default `remote.log.metadata.manager.class.name` as topic based RLMM

2023-08-10 Thread Luke Chen (Jira)
Luke Chen created KAFKA-15329: - Summary: Make default `remote.log.metadata.manager.class.name` as topic based RLMM Key: KAFKA-15329 URL: https://issues.apache.org/jira/browse/KAFKA-15329 Project: Kafka

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2084

2023-08-10 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-15328) Inter broker partition reassignment triggers offline log dirs randomly

2023-08-10 Thread dgiri (Jira)
dgiri created KAFKA-15328: - Summary: Inter broker partition reassignment triggers offline log dirs randomly Key: KAFKA-15328 URL: https://issues.apache.org/jira/browse/KAFKA-15328 Project: Kafka

[jira] [Resolved] (KAFKA-14421) OffsetFetchRequest throws NPE Exception

2023-08-10 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-14421. --- Resolution: Resolved Resolved in the later release. > OffsetFetchRequest throws NPE Exception >

[jira] [Resolved] (KAFKA-15288) Change BrokerApiVersionsCommandTest to support kraft mode

2023-08-10 Thread Deng Ziming (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deng Ziming resolved KAFKA-15288. - Resolution: Fixed > Change BrokerApiVersionsCommandTest to support kraft mode >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2083

2023-08-10 Thread Apache Jenkins Server
See

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.4 #158

2023-08-10 Thread Apache Jenkins Server
See