Re: [DISCUSS] KIP-939: Support Participation in 2PC

2023-08-24 Thread Artem Livshits
Hi Guy, You raise a very good point. Supporting XA sounds like a good way to integrate Kafka and it's something that I think we should support at some point in the future. For this KIP, though, we thought we focus on a more basic functionality keeping the following in mind: 1. XA is not univers

[jira] [Resolved] (KAFKA-15391) Delete topic may lead to directory offline

2023-08-24 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divij Vaidya resolved KAFKA-15391. -- Reviewer: Divij Vaidya Resolution: Fixed > Delete topic may lead to directory offline >

Re: [DISCUSS] KIP-892: Transactional Semantics for StateStores

2023-08-24 Thread Nick Telford
Hi Bruno, Thanks for taking the time to review the KIP. I'm back from leave now and intend to move this forwards as quickly as I can. Addressing your points: 1. Because flush() is part of the StateStore API, it's exposed to custom Processors, which might be making calls to flush(). This was actu

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2134

2023-08-24 Thread Apache Jenkins Server
See Changes: -- [...truncated 305768 lines...] Gradle Test Run :streams:test > Gradle Test Executor 86 > DefaultTaskManagerTest > shouldAssignTaskThatCanBeProcessed() STA

[jira] [Resolved] (KAFKA-15400) Fix flaky RemoteIndexCache test

2023-08-24 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divij Vaidya resolved KAFKA-15400. -- Resolution: Fixed > Fix flaky RemoteIndexCache test > --- > >

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.5 #62

2023-08-24 Thread Apache Jenkins Server
See Changes: -- [...truncated 282368 lines...] > Task :connect:json:testJar > Task :raft:compileTestJava UP-TO-DATE > Task :raft:testClasses UP-TO-DATE > Task :clients:generate

[jira] [Resolved] (KAFKA-14991) Improving Producer's record timestamp validation

2023-08-24 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divij Vaidya resolved KAFKA-14991. -- Resolution: Fixed > Improving Producer's record timestamp validation > ---

[DISCUSS] KAFKA-4169: KafkaProducer max.request.size message wrong when using compression

2023-08-24 Thread Pere Urbón Bayes
Hi, my name is Pere, Software Engineer turned Consultant for the last few years, :-/ , but keep doing Kafka quite a lot of my day-to-day. I know not a sexy issue, but last few days, I worked with customers who again hit https://issues.apache.org/jira/browse/KAFKA-4169 when using producing w

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2135

2023-08-24 Thread Apache Jenkins Server
See Changes: -- [...truncated 306126 lines...] Gradle Test Run :streams:test > Gradle Test Executor 84 > TasksTest > shouldDrainPendingTasksToCreate() STARTED Gradle Tes

[jira] [Created] (KAFKA-15401) Segment with corrupted index should not be uploaded to remote storage

2023-08-24 Thread Viktor Nikitash (Jira)
Viktor Nikitash created KAFKA-15401: --- Summary: Segment with corrupted index should not be uploaded to remote storage Key: KAFKA-15401 URL: https://issues.apache.org/jira/browse/KAFKA-15401 Project:

[jira] [Created] (KAFKA-15402) Performance Regression after Upgrading to 3.5.0

2023-08-24 Thread Benoit Delbosc (Jira)
Benoit Delbosc created KAFKA-15402: -- Summary: Performance Regression after Upgrading to 3.5.0 Key: KAFKA-15402 URL: https://issues.apache.org/jira/browse/KAFKA-15402 Project: Kafka Issue Typ

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.6 #1

2023-08-24 Thread Apache Jenkins Server
See

Re: Apache Kafka 3.6.0 release

2023-08-24 Thread Justine Olshan
Hey Satish, Does it make sense to include KIP-890 part 1? It prevents hanging transactions for older clients. (An optimization and stronger EOS guarantees will be included in part 2) Thanks, Justine On Mon, Aug 21, 2023 at 3:29 AM Satish Duggana wrote: > Hi, > 3.6 branch is created. Please make

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2136

2023-08-24 Thread Apache Jenkins Server
See Changes: -- [...truncated 306068 lines...] Gradle Test Run :streams:test > Gradle Test Executor 86 > DefaultTaskManagerTest > shouldRemoveTask() PASSED Gradle Test R

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.6 #2

2023-08-24 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-939: Support Participation in 2PC

2023-08-24 Thread Artem Livshits
Hi Roger, Thank you for summarizing the cons. I agree and I'm curious what would be the alternatives to solve these problems better and if they can be incorporated into this proposal (or built independently in addition to or on top of this proposal). E.g. one potential extension we discussed ear

Re: [DISCUSS] KIP-960: Support interactive queries (IQv2) for versioned state stores

2023-08-24 Thread Victoria Xia
Hi Alieh, Thanks for the updates!  Some questions on the new limited-scope KIP: 1. The example in the "Examples" section shows the query type as `KeyQuery>` and the result type as `StateQueryResult>`. Should those have `VersionedRecord` instead of `ValueAndTimestamp`? Also, the request type is

RE: Re: [DISCUSS] KIP-968: Support single-key_multi-timestamp interactive queries (IQv2) for versioned state stores

2023-08-24 Thread Victoria Xia
Hi Alieh, Thanks for the KIP! 1. As mentioned in the discussion thread for KIP-960, I think it'd be good to add a new method to the VersionedKeyValueStore interface for supporting single-key, multi-timestamp lookups, as part of implementing these new interactive queries so that the IQ implemen

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2137

2023-08-24 Thread Apache Jenkins Server
See Changes: -- [...truncated 306018 lines...] Gradle Test Run :streams:test > Gradle Test Executor 86 > TasksTest > onlyRemovePendingTaskToRecycleShouldRemoveTaskFromPend

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.4 #161

2023-08-24 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.3 #188

2023-08-24 Thread Apache Jenkins Server
See Changes: -- [...truncated 421311 lines...] > Task :connect:api:testSrcJar > Task :connect:api:publishMavenJavaPublicationToMavenLocal > Task :connect:api:publishToMavenLoc

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.6 #3

2023-08-24 Thread Apache Jenkins Server
See Changes: -- [...truncated 407295 lines...] Gradle Test Run :streams:test > Gradle Test Executor 84 > TasksTest > shouldAddAndRemovePendingTaskToCloseClean() PASSED Gradle

[jira] [Resolved] (KAFKA-14901) Flaky test ExactlyOnceSourceIntegrationTest.testConnectorReconfiguration

2023-08-24 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-14901. - Resolution: Cannot Reproduce > Flaky test ExactlyOnceSourceIntegrationTest.testConnectorReconfig

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.5 #63

2023-08-24 Thread Apache Jenkins Server
See Changes: -- [...truncated 283483 lines...] Gradle Test Run :streams:integrationTest > Gradle Test Executor 180 > VersionedKeyValueStoreIntegrationTest > shouldRestore PASS

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2138

2023-08-24 Thread Apache Jenkins Server
See Changes: -- [...truncated 305968 lines...] Gradle Test Run :streams:test > Gradle Test Executor 84 > TasksTest > shouldDrainPendingTasksToCreate() PASSED Gradle Test

[jira] [Created] (KAFKA-15403) Refactor @Test(expected) annotation with assertThrows

2023-08-24 Thread Taher Ghaleb (Jira)
Taher Ghaleb created KAFKA-15403: Summary: Refactor @Test(expected) annotation with assertThrows Key: KAFKA-15403 URL: https://issues.apache.org/jira/browse/KAFKA-15403 Project: Kafka Issue T

[jira] [Created] (KAFKA-15404) Failing Test DynamicBrokerReconfigurationTest#testThreadPoolResize

2023-08-24 Thread Justine Olshan (Jira)
Justine Olshan created KAFKA-15404: -- Summary: Failing Test DynamicBrokerReconfigurationTest#testThreadPoolResize Key: KAFKA-15404 URL: https://issues.apache.org/jira/browse/KAFKA-15404 Project: Kafka

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.6 #4

2023-08-24 Thread Apache Jenkins Server
See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.4 #162

2023-08-24 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.5 #64

2023-08-24 Thread Apache Jenkins Server
See Changes: -- [...truncated 266387 lines...] Gradle Test Run :core:integrationTest > Gradle Test Executor 179 > ZooKeeperClientTest > testZNodeChangeHandlerForDeletion() PAS

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2139

2023-08-24 Thread Apache Jenkins Server
See Changes: -- [...truncated 305832 lines...] Gradle Test Run :streams:test > Gradle Test Executor 84 > TasksTest > onlyRemovePendingTaskToCloseCleanShouldRemoveTaskFromP

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.6 #5

2023-08-24 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2140

2023-08-24 Thread Apache Jenkins Server
See Changes: -- [...truncated 205108 lines...] Gradle Test Run :streams:test > Gradle Test Executor 86 > DefaultTaskManagerTest > shouldNotAssignTasksForPunctuationIfPunc

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.6 #6

2023-08-24 Thread Apache Jenkins Server
See