Re: [PR] MINOR: Add public documentation for metrics introduced in KIP-963 [kafka]

2024-01-04 Thread via GitHub
clolov commented on PR #15131: URL: https://github.com/apache/kafka/pull/15131#issuecomment-1878268696 Heya @showuon and thanks for the review! I will make the changes in a couple of hours -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] KAFKA-16016: Add docker wrapper in core and remove docker utility script [kafka]

2024-01-04 Thread via GitHub
VedarthConfluent commented on code in PR #15048: URL: https://github.com/apache/kafka/pull/15048#discussion_r1442527460 ## core/src/main/scala/kafka/docker/KafkaDockerWrapper.scala: ## @@ -0,0 +1,218 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more

Re: [PR] KAFKA-16016: Add docker wrapper in core and remove docker utility script [kafka]

2024-01-04 Thread via GitHub
VedarthConfluent commented on code in PR #15048: URL: https://github.com/apache/kafka/pull/15048#discussion_r1442527460 ## core/src/main/scala/kafka/docker/KafkaDockerWrapper.scala: ## @@ -0,0 +1,218 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more

[jira] [Commented] (KAFKA-15341) Enabling TS for a topic during rolling restart causes problems

2024-01-04 Thread Phuc Hong Tran (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17803405#comment-17803405 ] Phuc Hong Tran commented on KAFKA-15341: [~divijvaidya], broker feature is just the IBP version,

Re: [PR] KAFKA-16059: close more kafkaApis instances [kafka]

2024-01-04 Thread via GitHub
showuon commented on PR #15132: URL: https://github.com/apache/kafka/pull/15132#issuecomment-1878091765 @divijvaidya , this should be the last fix for kafkaApisTest. (Hope so!) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] KAFKA-16059: close more kafkaApis instances [kafka]

2024-01-04 Thread via GitHub
showuon commented on code in PR #15132: URL: https://github.com/apache/kafka/pull/15132#discussion_r1442473158 ## core/src/test/scala/unit/kafka/server/KafkaApisTest.scala: ## @@ -2061,20 +2071,24 @@ class KafkaApisTest extends Logging { responseCallback.capture(),

Re: [PR] KAFKA-16059: close more kafkaApis instances [kafka]

2024-01-04 Thread via GitHub
showuon commented on code in PR #15132: URL: https://github.com/apache/kafka/pull/15132#discussion_r1442472935 ## core/src/test/scala/unit/kafka/server/KafkaApisTest.scala: ## @@ -1669,12 +1671,16 @@ class KafkaApisTest extends Logging { val request =

[PR] KAFKA-16059: close more kafkaApis instances [kafka]

2024-01-04 Thread via GitHub
showuon opened a new pull request, #15132: URL: https://github.com/apache/kafka/pull/15132 I thought we've closed all kafkaApis instances in KafkaApisTest, but there are more... ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ]

Re: [PR] MINOR: Move Raft io thread implementation to Java [kafka]

2024-01-04 Thread via GitHub
hachikuji commented on code in PR #15119: URL: https://github.com/apache/kafka/pull/15119#discussion_r1442435868 ## raft/src/main/java/org/apache/kafka/raft/KafkaRaftClientDriver.java: ## @@ -0,0 +1,114 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

Re: [PR] MINOR: Move Raft io thread implementation to Java [kafka]

2024-01-04 Thread via GitHub
hachikuji commented on code in PR #15119: URL: https://github.com/apache/kafka/pull/15119#discussion_r1442426943 ## raft/src/main/java/org/apache/kafka/raft/KafkaRaftClientDriver.java: ## @@ -0,0 +1,114 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

[jira] [Resolved] (KAFKA-16079) Fix leak in LocalLeaderEndPointTest/FinalizedFeatureChangeListenerTest/KafkaApisTest/ReplicaManagerConcurrencyTest

2024-01-04 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-16079. --- Fix Version/s: 3.7.0 Resolution: Fixed > Fix leak in >

Re: [PR] KAFKA-16079: fix threads leak threads in LocalLeaderEndPointTest and other tests [kafka]

2024-01-04 Thread via GitHub
showuon merged PR #15122: URL: https://github.com/apache/kafka/pull/15122 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] KAFKA-16079: fix threads leak threads in LocalLeaderEndPointTest and other tests [kafka]

2024-01-04 Thread via GitHub
showuon commented on PR #15122: URL: https://github.com/apache/kafka/pull/15122#issuecomment-1877995119 Failed tests are unrelated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] MINOR: Move Raft io thread implementation to Java [kafka]

2024-01-04 Thread via GitHub
jsancio commented on code in PR #15119: URL: https://github.com/apache/kafka/pull/15119#discussion_r1442414085 ## raft/src/main/java/org/apache/kafka/raft/KafkaRaftClientDriver.java: ## @@ -0,0 +1,114 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more

Re: [PR] KAFKA-14483 Move/Rewrite of LocalLog to storage module. [kafka]

2024-01-04 Thread via GitHub
satishd commented on code in PR #14034: URL: https://github.com/apache/kafka/pull/14034#discussion_r1442403275 ## gradle/spotbugs-exclude.xml: ## @@ -162,8 +162,7 @@ For a detailed description of spotbugs bug categories, see https://spotbugs.read on the compiler

Re: [PR] KAFKA-14483 Move/Rewrite of LocalLog to storage module. [kafka]

2024-01-04 Thread via GitHub
satishd commented on code in PR #14034: URL: https://github.com/apache/kafka/pull/14034#discussion_r1440213705 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -2265,11 +2268,12 @@ object UnifiedLog extends Logging { def deleteProducerSnapshots(): Unit = {

Re: [PR] KAFKA-14483 Move/Rewrite of LocalLog to storage module. [kafka]

2024-01-04 Thread via GitHub
satishd commented on code in PR #14034: URL: https://github.com/apache/kafka/pull/14034#discussion_r1442402745 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -1245,7 +1246,7 @@ class UnifiedLog(@volatile var logStartOffset: Long, } private[log] def

Re: [PR] KAFKA-14483 Move/Rewrite of LocalLog to storage module. [kafka]

2024-01-04 Thread via GitHub
satishd commented on code in PR #14034: URL: https://github.com/apache/kafka/pull/14034#discussion_r1442402573 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -1441,9 +1442,9 @@ class UnifiedLog(@volatile var logStartOffset: Long, * (if there is

Re: [PR] KAFKA-14483 Move/Rewrite of LocalLog to storage module. [kafka]

2024-01-04 Thread via GitHub
satishd commented on code in PR #14034: URL: https://github.com/apache/kafka/pull/14034#discussion_r1442402667 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -1511,7 +1512,7 @@ class UnifiedLog(@volatile var logStartOffset: Long, }

Re: [PR] KAFKA-14483 Move/Rewrite of LocalLog to storage module. [kafka]

2024-01-04 Thread via GitHub
satishd commented on code in PR #14034: URL: https://github.com/apache/kafka/pull/14034#discussion_r1442402484 ## storage/src/main/java/org/apache/kafka/storage/internals/log/LocalLog.java: ## @@ -0,0 +1,1146 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one

Re: [PR] KAFKA-14483 Move/Rewrite of LocalLog to storage module. [kafka]

2024-01-04 Thread via GitHub
satishd commented on code in PR #14034: URL: https://github.com/apache/kafka/pull/14034#discussion_r1442402411 ## checkstyle/import-control-core.xml: ## @@ -37,6 +37,8 @@ + + Review Comment: Right, it is not needed. I guess it was needed when that class was

[jira] [Updated] (KAFKA-16073) Kafka Tiered Storage Bug: Consumer Fetch Error Due to Delayed localLogStartOffset Update During Segment Deletion

2024-01-04 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-16073: --- Fix Version/s: 3.8.0 > Kafka Tiered Storage Bug: Consumer Fetch Error Due to Delayed >

Re: [PR] MINOR: Move Raft io thread implementation to Java [kafka]

2024-01-04 Thread via GitHub
hachikuji commented on code in PR #15119: URL: https://github.com/apache/kafka/pull/15119#discussion_r1442350821 ## raft/src/main/java/org/apache/kafka/raft/KafkaRaftClientDriver.java: ## @@ -0,0 +1,114 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

Re: [PR] MINOR: Move Raft io thread implementation to Java [kafka]

2024-01-04 Thread via GitHub
ijuma commented on code in PR #15119: URL: https://github.com/apache/kafka/pull/15119#discussion_r1440877890 ## checkstyle/import-control.xml: ## @@ -443,6 +443,7 @@ + Review Comment: Should this be a line above? -- This is an automated message

Re: [PR] MINOR: Move Raft io thread implementation to Java [kafka]

2024-01-04 Thread via GitHub
jsancio commented on code in PR #15119: URL: https://github.com/apache/kafka/pull/15119#discussion_r1442310315 ## raft/src/main/java/org/apache/kafka/raft/KafkaRaftClientDriver.java: ## @@ -0,0 +1,114 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more

Re: [PR] MINOR: Fixing shadow jar publish [kafka]

2024-01-04 Thread via GitHub
apoorvmittal10 commented on PR #15127: URL: https://github.com/apache/kafka/pull/15127#issuecomment-1877809786 > I tested the publish again and confirmed it works! Awesome! > Who is a good person to ask about this? Maybe some of the original reviewers of the shadow PR?

Re: [PR] MINOR: Add reviewers GitHub action [kafka]

2024-01-04 Thread via GitHub
mumrah commented on code in PR #15115: URL: https://github.com/apache/kafka/pull/15115#discussion_r1442270635 ## .github/workflows/pr_reviews.yml: ## @@ -0,0 +1,46 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license agreements. See

Re: [PR] MINOR: Prevent java.lang.UnsupportedOperationException in MockAdminClient [kafka]

2024-01-04 Thread via GitHub
divijvaidya merged PR #14955: URL: https://github.com/apache/kafka/pull/14955 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] MINOR: Prevent java.lang.UnsupportedOperationException in MockAdminClient [kafka]

2024-01-04 Thread via GitHub
divijvaidya commented on PR #14955: URL: https://github.com/apache/kafka/pull/14955#issuecomment-1877769128 JDK 8 tests are all successful and other failing tests don't look related -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] KAFKA-14133: Migrate remaining mocks in StoreChangelogReaderTest to Mockito [kafka]

2024-01-04 Thread via GitHub
divijvaidya merged PR #15125: URL: https://github.com/apache/kafka/pull/15125 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] KAFKA-14133: Migrate remaining mocks in StoreChangelogReaderTest to Mockito [kafka]

2024-01-04 Thread via GitHub
divijvaidya commented on PR #15125: URL: https://github.com/apache/kafka/pull/15125#issuecomment-1877746515 The modified test is successful https://ci-builds.apache.org/job/Kafka/job/kafka-pr/job/PR-15125/1/testReport/org.apache.kafka.streams.processor.internals/StoreChangelogReaderTest/

Re: [PR] MINOR: Small cleanups in Connect [kafka]

2024-01-04 Thread via GitHub
divijvaidya commented on code in PR #15128: URL: https://github.com/apache/kafka/pull/15128#discussion_r1442237669 ## connect/basic-auth-extension/src/main/java/org/apache/kafka/connect/rest/basic/auth/extension/JaasBasicAuthFilter.java: ## @@ -119,16 +117,16 @@ private boolean

Re: [PR] MINOR: New year code clean up - misc [kafka]

2024-01-04 Thread via GitHub
divijvaidya commented on code in PR #15071: URL: https://github.com/apache/kafka/pull/15071#discussion_r1442225284 ## trogdor/src/main/java/org/apache/kafka/trogdor/workload/TopicsSpec.java: ## @@ -67,8 +67,7 @@ public void set(String name, PartitionsSpec value) { }

Re: [PR] MINOR: New year code clean up - misc [kafka]

2024-01-04 Thread via GitHub
divijvaidya commented on code in PR #15071: URL: https://github.com/apache/kafka/pull/15071#discussion_r1442224965 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/CommitRequestManager.java: ## @@ -1079,8 +1077,7 @@ private void clearAll() { }

Re: [PR] Minor: Add KIP-923 to upgrade-guide.html and dsl-api.html [kafka]

2024-01-04 Thread via GitHub
wcarlson5 commented on PR #14725: URL: https://github.com/apache/kafka/pull/14725#issuecomment-1877692107 @mjsax Finally got around to your comments. I think we need to pick this back to 3.6 and 3.7 as well -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] Minor: Add KIP-923 to upgrade-guide.html and dsl-api.html [kafka]

2024-01-04 Thread via GitHub
wcarlson5 commented on code in PR #14725: URL: https://github.com/apache/kafka/pull/14725#discussion_r1442198505 ## docs/streams/developer-guide/dsl-api.html: ## @@ -2849,6 +2851,12 @@ KTable-KTable Foreign-Key When the table is

[PR] MINOR: Add public documentation for metrics introduced in KIP-963 [kafka]

2024-01-04 Thread via GitHub
clolov opened a new pull request, #15131: URL: https://github.com/apache/kafka/pull/15131 Adding the public documentation for metrics introduced in [KIP-963](https://cwiki.apache.org/confluence/display/KAFKA/KIP-963%3A+Additional+metrics+in+Tiered+Storage) -- This is an automated message

Re: [PR] KAFKA-16051: Fixed deadlock in StandaloneHerder [kafka]

2024-01-04 Thread via GitHub
gharris1727 commented on code in PR #15080: URL: https://github.com/apache/kafka/pull/15080#discussion_r1442146732 ## connect/runtime/src/test/java/org/apache/kafka/connect/runtime/standalone/StandaloneHerderTest.java: ## @@ -1001,6 +1001,48 @@ public void

[jira] [Created] (KAFKA-16084) Simplify and deduplicate StandaloneHerderTest mocking

2024-01-04 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16084: --- Summary: Simplify and deduplicate StandaloneHerderTest mocking Key: KAFKA-16084 URL: https://issues.apache.org/jira/browse/KAFKA-16084 Project: Kafka Issue

[PR] KAFKA-16083: Exclude throttle time when expiring inflight requests on a connection [kafka]

2024-01-04 Thread via GitHub
ditac opened a new pull request, #15130: URL: https://github.com/apache/kafka/pull/15130 When expiring inflight requests, the network client does not take throttle time into account. If a connection has multiple inflight requests (default of 5) and each request is throttled then some of

Re: [PR] Quotav2handler [DRAFT] [kafka]

2024-01-04 Thread via GitHub
nickgarvey closed pull request #15129: Quotav2handler [DRAFT] URL: https://github.com/apache/kafka/pull/15129 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[PR] Quotav2handler [DRAFT] [kafka]

2024-01-04 Thread via GitHub
nickgarvey opened a new pull request, #15129: URL: https://github.com/apache/kafka/pull/15129 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.* *Summary of

[jira] [Updated] (KAFKA-16082) JBOD: Possible dataloss when moving leader partition

2024-01-04 Thread Stanislav Kozlovski (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stanislav Kozlovski updated KAFKA-16082: Fix Version/s: 3.7.0 > JBOD: Possible dataloss when moving leader partition >

[jira] [Updated] (KAFKA-16082) JBOD: Possible dataloss when moving leader partition

2024-01-04 Thread Stanislav Kozlovski (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stanislav Kozlovski updated KAFKA-16082: Fix Version/s: (was: 3.7.0) > JBOD: Possible dataloss when moving leader

Re: [PR] KAFKA-15388: Handling remote segment read in case of log compaction [kafka]

2024-01-04 Thread via GitHub
iit2009060 commented on PR #15060: URL: https://github.com/apache/kafka/pull/15060#issuecomment-1877542832 > @iit2009060 You may have mistyped as controller but it does not have any role in the fetch path here. Remote fetch is executed through a specific purgatory with DelayedRemoteFetch

Re: [PR] KAFKA-15388: Handling remote segment read in case of log compaction [kafka]

2024-01-04 Thread via GitHub
iit2009060 commented on PR #15060: URL: https://github.com/apache/kafka/pull/15060#issuecomment-1877528171 > Thanks @iit2009060 for the PR. > > Let us say there are two segments in remote storage and subsequents segments in local storage. remote-seg-10[10, 20], remote-seg-21[21, 30]

Re: [PR] KAFKA-16077: Streams with state updater fails to close task upon fencing [kafka]

2024-01-04 Thread via GitHub
cadonna commented on PR #15117: URL: https://github.com/apache/kafka/pull/15117#issuecomment-1877517561 @lucasbru What do you think about my previous question? > Should we also add a integration test that tests the scenario? -- This is an automated message from the Apache Git

[jira] [Commented] (KAFKA-14404) Fix & update docs on client configs controlled by Streams

2024-01-04 Thread Ayoub Omari (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17803252#comment-17803252 ] Ayoub Omari commented on KAFKA-14404: - Hi [~ableegoldman] & [~sujayopensource]  I see that this

[jira] [Created] (KAFKA-16083) Exclude throttle time when expiring inflight requests on a connection

2024-01-04 Thread Adithya Chandra (Jira)
Adithya Chandra created KAFKA-16083: --- Summary: Exclude throttle time when expiring inflight requests on a connection Key: KAFKA-16083 URL: https://issues.apache.org/jira/browse/KAFKA-16083 Project:

Re: [PR] KAFKA-15942: Implement ConsumerInterceptors in the async consumer [kafka]

2024-01-04 Thread via GitHub
philipnee commented on PR #15000: URL: https://github.com/apache/kafka/pull/15000#issuecomment-1877478293 hi @lucasbru - thanks. i personally prefer to make consumer interceptor thread safe because firstly, (i think) it simplifies the code quite a bit and secondly, it is possible to miss

Re: [PR] MINOR: New year code clean up - misc [kafka]

2024-01-04 Thread via GitHub
mimaison commented on code in PR #15071: URL: https://github.com/apache/kafka/pull/15071#discussion_r1442027962 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/CommitRequestManager.java: ## @@ -1079,8 +1077,7 @@ private void clearAll() { }

[jira] [Updated] (KAFKA-16081) Limit number of ssl connections in brokers

2024-01-04 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison updated KAFKA-16081: --- Labels: need-kip (was: ) > Limit number of ssl connections in brokers >

Re: [PR] KAFKA-16081 Limit number of ssl connections in brokers [kafka]

2024-01-04 Thread via GitHub
mimaison commented on PR #15126: URL: https://github.com/apache/kafka/pull/15126#issuecomment-1877414085 Thanks for the PR. Since this is adding new configurations, this change requires a KIP to be voted by the community. See the [Kafka Improvement

[PR] MINOR: Small cleanups in Connect [kafka]

2024-01-04 Thread via GitHub
mimaison opened a new pull request, #15128: URL: https://github.com/apache/kafka/pull/15128 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including

Re: [PR] KAFKA-14822: Allow restricting File and Directory ConfigProviders to specific paths [kafka]

2024-01-04 Thread via GitHub
gharris1727 commented on code in PR #14995: URL: https://github.com/apache/kafka/pull/14995#discussion_r1441959148 ## clients/src/test/java/org/apache/kafka/common/config/provider/FileConfigProviderTest.java: ## @@ -98,8 +117,91 @@ public void testServiceLoaderDiscovery() {

Re: [PR] KAFKA-15062: Adding ppc64le build stage [kafka]

2024-01-04 Thread via GitHub
mimaison commented on PR #13817: URL: https://github.com/apache/kafka/pull/13817#issuecomment-1877357358 Sorry for the delay. I tried to build this but it fails in the CI with the following error: ``` WorkflowScript: 91: unexpected token: % @ line 91, column 82. InMillis() /

[PR] MINOR: Fixing shadow jar publish [kafka]

2024-01-04 Thread via GitHub
apoorvmittal10 opened a new pull request, #15127: URL: https://github.com/apache/kafka/pull/15127 ## What The PR fixes the publishing of `kafka-clients` artifact to remote maven. The `kafka-clients` jar is recently been shadowed which does publish the artifacts to local maven

Re: [PR] KAFKA-15388: Handling remote segment read in case of log compaction [kafka]

2024-01-04 Thread via GitHub
satishd commented on PR #15060: URL: https://github.com/apache/kafka/pull/15060#issuecomment-1877333095 @iit2009060 You may have mistyped as controller but it does not have any role in the fetch path here. Remote fetch is executed through a specific purgatory with DelayedRemoteFetch

Re: [PR] KAFKA-14822: Allow restricting File and Directory ConfigProviders to specific paths [kafka]

2024-01-04 Thread via GitHub
mimaison commented on code in PR #14995: URL: https://github.com/apache/kafka/pull/14995#discussion_r1441931015 ## clients/src/main/java/org/apache/kafka/common/config/internals/ConfigProviderUtils.java: ## @@ -0,0 +1,62 @@ +/* + * Licensed to the Apache Software Foundation

Re: [PR] KAFKA-16003: Always create the /config/topics ZNode even for topics w… [kafka]

2024-01-04 Thread via GitHub
mimaison commented on PR #15022: URL: https://github.com/apache/kafka/pull/15022#issuecomment-1877305934 @mumrah can you take a look? Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] KAFKA-16051: Fixed deadlock in StandaloneHerder [kafka]

2024-01-04 Thread via GitHub
developster commented on PR #15080: URL: https://github.com/apache/kafka/pull/15080#issuecomment-1877282686 @gharris1727 , I've added the test. It first starts the connector, then updates both the connector and task at the same time. The reason for this is that task reconfiguration will

[jira] [Commented] (KAFKA-16082) JBOD: Possible dataloss when moving leader partition

2024-01-04 Thread Gaurav Narula (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17803205#comment-17803205 ] Gaurav Narula commented on KAFKA-16082: --- We tried to analyse the failure scenarios further,

Re: [PR] KAFKA-16077: Streams with state updater fails to close task upon fencing [kafka]

2024-01-04 Thread via GitHub
lucasbru commented on code in PR #15117: URL: https://github.com/apache/kafka/pull/15117#discussion_r1441867884 ## streams/src/test/java/org/apache/kafka/streams/processor/internals/TaskManagerTest.java: ## @@ -1164,9 +1243,12 @@ public void

Re: [PR] KAFKA-16077: Streams with state updater fails to close task upon fencing [kafka]

2024-01-04 Thread via GitHub
cadonna commented on code in PR #15117: URL: https://github.com/apache/kafka/pull/15117#discussion_r1441848969 ## streams/src/test/java/org/apache/kafka/streams/processor/internals/TaskManagerTest.java: ## @@ -1164,9 +1243,12 @@ public void

Re: [PR] MINOR: Add reviewers GitHub action [kafka]

2024-01-04 Thread via GitHub
viktorsomogyi commented on PR #15115: URL: https://github.com/apache/kafka/pull/15115#issuecomment-1877217071 @mumrah @divijvaidya, the script just edits the PR body, it won't touch the commit itself. I discovered yesterday that this PR also already runs the action, however it

Re: [PR] KAFKA-15556: Remove NetworkClientDelegate methods isUnavailable, maybeThrowAuthFailure, and tryConnect [kafka]

2024-01-04 Thread via GitHub
Phuc-Hong-Tran commented on PR #15020: URL: https://github.com/apache/kafka/pull/15020#issuecomment-1877214088 @philipnee, PTAL, thanks in advance. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Updated] (KAFKA-16082) JBOD: Possible dataloss when moving leader partition

2024-01-04 Thread Proven Provenzano (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Proven Provenzano updated KAFKA-16082: -- Priority: Blocker (was: Critical) > JBOD: Possible dataloss when moving leader

Re: [PR] KAFKA-14588 ConfigEntityName move to server-common [kafka]

2024-01-04 Thread via GitHub
ijuma commented on PR #14868: URL: https://github.com/apache/kafka/pull/14868#issuecomment-1877205588 Sounds good. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Created] (KAFKA-16082) JBOD: Possible dataloss when moving leader partition

2024-01-04 Thread Proven Provenzano (Jira)
Proven Provenzano created KAFKA-16082: - Summary: JBOD: Possible dataloss when moving leader partition Key: KAFKA-16082 URL: https://issues.apache.org/jira/browse/KAFKA-16082 Project: Kafka

Re: [PR] KAFKA-14588 ConfigEntityName move to server-common [kafka]

2024-01-04 Thread via GitHub
mimaison commented on PR #14868: URL: https://github.com/apache/kafka/pull/14868#issuecomment-1877201295 Yes I expect we'll be able to remove that when we remove ZooKeeper. In the meantime, these PRs are helpful to move the commands to the tools module. -- This is an automated message

Re: [PR] KAFKA-15942: Implement ConsumerInterceptors in the async consumer [kafka]

2024-01-04 Thread via GitHub
lucasbru commented on PR #15000: URL: https://github.com/apache/kafka/pull/15000#issuecomment-1877184050 @philipnee Good point about auto-commits, I missed that. It's a pity that auto-commits aren't triggered from the main thread (I wonder if we could do that? Would be another

Re: [PR] MINOR: Add reviewers GitHub action [kafka]

2024-01-04 Thread via GitHub
viktorsomogyi commented on code in PR #15115: URL: https://github.com/apache/kafka/pull/15115#discussion_r1441813320 ## .github/workflows/pr_reviews.yml: ## @@ -0,0 +1,46 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license agreements.

Re: [PR] MINOR: Add reviewers GitHub action [kafka]

2024-01-04 Thread via GitHub
viktorsomogyi commented on code in PR #15115: URL: https://github.com/apache/kafka/pull/15115#discussion_r1441800052 ## .github/workflows/pr_reviews.yml: ## @@ -0,0 +1,46 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license agreements.

Re: [PR] KAFKA-14588 ConfigEntityName move to server-common [kafka]

2024-01-04 Thread via GitHub
ijuma commented on PR #14868: URL: https://github.com/apache/kafka/pull/14868#issuecomment-1877150309 You're right. The weird part is actually the fact that `ConfigCommand` relies on this detail instead of using the relevant public apis. I guess it's partly due to the remaining zk code.

[PR] KAFKA-16081 Limit number of ssl connections in brokers [kafka]

2024-01-04 Thread via GitHub
JimmyWang6 opened a new pull request, #15126: URL: https://github.com/apache/kafka/pull/15126 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.* *Summary of

[jira] [Created] (KAFKA-16081) Limit number of ssl connections in brokers

2024-01-04 Thread Jimmy Wang (Jira)
Jimmy Wang created KAFKA-16081: -- Summary: Limit number of ssl connections in brokers Key: KAFKA-16081 URL: https://issues.apache.org/jira/browse/KAFKA-16081 Project: Kafka Issue Type: New

Re: [PR] KAFKA-14588 ConfigEntityName move to server-common [kafka]

2024-01-04 Thread via GitHub
nizhikov commented on PR #14868: URL: https://github.com/apache/kafka/pull/14868#issuecomment-1877129273 @ijuma > Is this used by anything outside of tools? AFAICS yes. `DymamicConfig`, `ClientQuotaMetadataManager`, `DynamicConfigPublisher` to name a few. These

Re: [PR] KAFKA-14588 ConfigEntityName move to server-common [kafka]

2024-01-04 Thread via GitHub
ijuma commented on PR #14868: URL: https://github.com/apache/kafka/pull/14868#issuecomment-1877112384 It's a bit weird to move stuff like this to `server-common`. Is this used by anything outside of `tools`? -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] KAFKA-15817: Avoid reconnecting to the same IP address (#14813) [kafka]

2024-01-04 Thread via GitHub
cadonna merged PR #14980: URL: https://github.com/apache/kafka/pull/14980 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] KAFKA-15817: Avoid reconnecting to the same IP address (#14813) [kafka]

2024-01-04 Thread via GitHub
cadonna commented on PR #14980: URL: https://github.com/apache/kafka/pull/14980#issuecomment-1877111288 Failed tests are unrelated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] KAFKA-14588 ConfigEntityName move to server-common [kafka]

2024-01-04 Thread via GitHub
nizhikov commented on PR #14868: URL: https://github.com/apache/kafka/pull/14868#issuecomment-1877093884 Test failure was fixed by #417338ad77d15cad2534d7cff436c8776e717255 I merged latest trunk to PR so this must be OK now. -- This is an automated message from the Apache Git Service.

Re: [PR] KAFKA-14133: Migrate remaining mocks in StoreChangelogReaderTest to Mockito [kafka]

2024-01-04 Thread via GitHub
clolov commented on code in PR #15125: URL: https://github.com/apache/kafka/pull/15125#discussion_r1441743303 ## streams/src/test/java/org/apache/kafka/streams/processor/internals/StoreChangelogReaderTest.java: ## @@ -1335,9 +1299,6 @@ public void

[PR] KAFKA-14133: Migrate remaining mocks in StoreChangelogReaderTest to Mockito [kafka]

2024-01-04 Thread via GitHub
clolov opened a new pull request, #15125: URL: https://github.com/apache/kafka/pull/15125 This pull request takes a similar approach to how TaskManagerTest is being migrated to Mockito mock by mock for easier reviews. -- This is an automated message from the Apache Git Service. To

Re: [PR] KAFKA-16016: Add docker wrapper in core and remove docker utility script [kafka]

2024-01-04 Thread via GitHub
kagarwal06 commented on PR #15048: URL: https://github.com/apache/kafka/pull/15048#issuecomment-1877080323 > I saw that but the action only allows me to pick a branch or tag. Ideally I'd like to run it on the pull request. Hi @mimaison , thanks for the feedback. The

Re: [PR] KAFKA-16077: Streams with state updater fails to close task upon fencing [kafka]

2024-01-04 Thread via GitHub
lucasbru commented on code in PR #15117: URL: https://github.com/apache/kafka/pull/15117#discussion_r1441719248 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java: ## @@ -950,6 +963,12 @@ private void handleRestoredTasksFromStateUpdater(final

Re: [PR] KAFKA-14133: Migrate storeMetadata mock in StoreChangelogReaderTest to Mockito [kafka]

2024-01-04 Thread via GitHub
clolov commented on PR #15116: URL: https://github.com/apache/kafka/pull/15116#issuecomment-1877054383 Okay @lucasbru, I will look into it -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] KAFKA-14133: Migrate storeMetadata mock in StoreChangelogReaderTest to Mockito [kafka]

2024-01-04 Thread via GitHub
lucasbru commented on PR #15116: URL: https://github.com/apache/kafka/pull/15116#issuecomment-1877052454 @clolov I do believe that the flaky test @divijvaidya mentioned started with another mockito migration PR on 4th of december, #13932. Maybe you could give it a look even if it's not

Re: [PR] KAFKA-14133: Migrate storeMetadata mock in StoreChangelogReaderTest to Mockito [kafka]

2024-01-04 Thread via GitHub
divijvaidya merged PR #15116: URL: https://github.com/apache/kafka/pull/15116 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] KAFKA-14133: Migrate storeMetadata mock in StoreChangelogReaderTest to Mockito [kafka]

2024-01-04 Thread via GitHub
divijvaidya commented on PR #15116: URL: https://github.com/apache/kafka/pull/15116#issuecomment-1877045252 My bad! the test failure I notes above is known to be flaky as per

Re: [PR] KAFKA-16016: Add docker wrapper in core and remove docker utility script [kafka]

2024-01-04 Thread via GitHub
mimaison commented on PR #15048: URL: https://github.com/apache/kafka/pull/15048#issuecomment-1877012641 I saw that but the action only allows me to pick a branch or tag. Ideally I'd like to run it on the pull request. -- This is an automated message from the Apache Git Service. To

Re: [PR] KAFKA-14133: Migrate storeMetadata mock in StoreChangelogReaderTest to Mockito [kafka]

2024-01-04 Thread via GitHub
divijvaidya commented on PR #15116: URL: https://github.com/apache/kafka/pull/15116#issuecomment-1876978251 @clolov we have test failures related to this PR. Can you please fix them:

[jira] [Created] (KAFKA-16080) partiton not retention after execute ALTER_REPLICA_LOG_DIRS and LEADER_AND_ISR request at the same time

2024-01-04 Thread wangliucheng (Jira)
wangliucheng created KAFKA-16080: Summary: partiton not retention after execute ALTER_REPLICA_LOG_DIRS and LEADER_AND_ISR request at the same time Key: KAFKA-16080 URL:

Re: [PR] KAFKA-14822: Allow restricting File and Directory ConfigProviders to specific paths [kafka]

2024-01-04 Thread via GitHub
tinaselenge commented on code in PR #14995: URL: https://github.com/apache/kafka/pull/14995#discussion_r1441652042 ## clients/src/main/java/org/apache/kafka/common/config/internals/ConfigProviderUtils.java: ## @@ -0,0 +1,62 @@ +/* + * Licensed to the Apache Software Foundation

Re: [PR] KAFKA-16077: Streams with state updater fails to close task upon fencing [kafka]

2024-01-04 Thread via GitHub
cadonna commented on code in PR #15117: URL: https://github.com/apache/kafka/pull/15117#discussion_r1441615070 ## streams/src/test/java/org/apache/kafka/streams/processor/internals/TaskManagerTest.java: ## @@ -1164,9 +1243,12 @@ public void

Re: [PR] KAFKA-16016: Add docker wrapper in core and remove docker utility script [kafka]

2024-01-04 Thread via GitHub
VedarthConfluent commented on PR #15048: URL: https://github.com/apache/kafka/pull/15048#issuecomment-1876954982 @mimaison There is a GitHub Actions Workflow added for just that! You can check it out [here](https://github.com/apache/kafka/actions/workflows/docker_build_and_test.yml). Also

Re: [PR] KAFKA-16079: fix threads leak threads in LocalLeaderEndPointTest and other tests [kafka]

2024-01-04 Thread via GitHub
showuon commented on code in PR #15122: URL: https://github.com/apache/kafka/pull/15122#discussion_r1441641932 ## core/src/test/scala/unit/kafka/server/ReplicaManagerConcurrencyTest.scala: ## @@ -50,12 +51,15 @@ import scala.collection.{immutable, mutable} import

Re: [PR] KAFKA-15720: KRaft support in DeleteTopicTest [kafka]

2024-01-04 Thread via GitHub
tinaselenge commented on code in PR #14846: URL: https://github.com/apache/kafka/pull/14846#discussion_r1441637951 ## core/src/test/scala/unit/kafka/admin/DeleteTopicTest.scala: ## @@ -187,164 +197,233 @@ class DeleteTopicTest extends QuorumTestHarness { }.toSet } -

[jira] [Updated] (KAFKA-16077) Streams fails to close task after restoration when input partitions are updated

2024-01-04 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16077: Priority: Blocker (was: Critical) > Streams fails to close task after restoration when

Re: [PR] KAFKA-12399: Deprecate Log4J Appender [kafka]

2024-01-04 Thread via GitHub
mimaison commented on PR #10244: URL: https://github.com/apache/kafka/pull/10244#issuecomment-1876911687 @dongjinleekr Following up on this. If I don't hear back in the next couple of weeks I'll try to complete this task (and keep you as co-author) -- This is an automated message from

[jira] [Assigned] (KAFKA-16077) Streams fails to close task after restoration when input partitions are updated

2024-01-04 Thread Lucas Brutschy (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucas Brutschy reassigned KAFKA-16077: -- Assignee: Lucas Brutschy > Streams fails to close task after restoration when input

  1   2   >