[GitHub] [kafka] satishd commented on a diff in pull request #13561: KAFKA-14888: Added remote log segments retention functionality based on time and size.

2023-08-09 Thread via GitHub
satishd commented on code in PR #13561: URL: https://github.com/apache/kafka/pull/13561#discussion_r1289577612 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -1464,12 +1513,12 @@ class UnifiedLog(@volatile var logStartOffset: Long, } } -

[GitHub] [kafka] satishd commented on a diff in pull request #13561: KAFKA-14888: Added remote log segments retention functionality based on time and size.

2023-08-09 Thread via GitHub
satishd commented on code in PR #13561: URL: https://github.com/apache/kafka/pull/13561#discussion_r1289577043 ## core/src/main/java/kafka/log/remote/RemoteLogManager.java: ## @@ -696,11 +704,327 @@ public void run() { } } +public void

[GitHub] [kafka] mehbey commented on a diff in pull request #14135: KAFKA-14991: Implementation of KIP-937 which improves message timesta…

2023-08-09 Thread via GitHub
mehbey commented on code in PR #14135: URL: https://github.com/apache/kafka/pull/14135#discussion_r1289574391 ## storage/src/main/java/org/apache/kafka/storage/internals/log/LogConfig.java: ## @@ -186,6 +191,12 @@ public Optional serverConfigName(String configName) {

[GitHub] [kafka] mehbey commented on a diff in pull request #14135: KAFKA-14991: Implementation of KIP-937 which improves message timesta…

2023-08-09 Thread via GitHub
mehbey commented on code in PR #14135: URL: https://github.com/apache/kafka/pull/14135#discussion_r1289574103 ## core/src/test/scala/unit/kafka/log/LogValidatorTest.scala: ## @@ -1398,6 +1437,73 @@ class LogValidatorTest { assertEquals(6, e.recordErrors.size) } +

[GitHub] [kafka] mehbey commented on a diff in pull request #14135: KAFKA-14991: Implementation of KIP-937 which improves message timesta…

2023-08-09 Thread via GitHub
mehbey commented on code in PR #14135: URL: https://github.com/apache/kafka/pull/14135#discussion_r1289573699 ## core/src/test/scala/unit/kafka/log/LogValidatorTest.scala: ## @@ -1398,6 +1437,73 @@ class LogValidatorTest { assertEquals(6, e.recordErrors.size) } +

[GitHub] [kafka] mehbey commented on a diff in pull request #14135: KAFKA-14991: Implementation of KIP-937 which improves message timesta…

2023-08-09 Thread via GitHub
mehbey commented on code in PR #14135: URL: https://github.com/apache/kafka/pull/14135#discussion_r1289573138 ## core/src/test/scala/integration/kafka/api/PlaintextProducerSendTest.scala: ## @@ -120,17 +121,17 @@ class PlaintextProducerSendTest extends BaseProducerSendTest {

[GitHub] [kafka] satishd commented on a diff in pull request #13561: KAFKA-14888: Added remote log segments retention functionality based on time and size.

2023-08-09 Thread via GitHub
satishd commented on code in PR #13561: URL: https://github.com/apache/kafka/pull/13561#discussion_r1289566534 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -1390,7 +1424,15 @@ class UnifiedLog(@volatile var logStartOffset: Long, private def

[GitHub] [kafka] mehbey commented on a diff in pull request #14135: KAFKA-14991: Implementation of KIP-937 which improves message timesta…

2023-08-09 Thread via GitHub
mehbey commented on code in PR #14135: URL: https://github.com/apache/kafka/pull/14135#discussion_r1289521270 ## core/src/main/scala/kafka/server/KafkaConfig.scala: ## @@ -1862,7 +1884,35 @@ class KafkaConfig private(doLog: Boolean, val props: java.util.Map[_, _], dynami

[jira] [Commented] (KAFKA-15240) BrokerToControllerChannelManager cache activeController error cause DefaultAlterPartitionManager send AlterPartition request failed

2023-08-09 Thread shilin Lu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17752604#comment-17752604 ] shilin Lu commented on KAFKA-15240: --- [~cmccabe] [~hachikuji] please take a look at this issue,thks >

[GitHub] [kafka] satishd commented on a diff in pull request #13561: KAFKA-14888: Added remote log segments retention functionality based on time and size.

2023-08-09 Thread via GitHub
satishd commented on code in PR #13561: URL: https://github.com/apache/kafka/pull/13561#discussion_r1289488513 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -1390,7 +1424,15 @@ class UnifiedLog(@volatile var logStartOffset: Long, private def

[jira] [Commented] (KAFKA-9199) Improve handling of out of sequence errors lower than last acked sequence

2023-08-09 Thread Fei Xie (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17752596#comment-17752596 ] Fei Xie commented on KAFKA-9199: Hi [~hachikuji] , is this issue still open? You've mentioned that this

[GitHub] [kafka] mjsax merged pull request #14178: KAFKA-15022: [9/N] use RackAwareTaskAssignor in StickyTaskAssignor

2023-08-09 Thread via GitHub
mjsax merged PR #14178: URL: https://github.com/apache/kafka/pull/14178 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] showuon commented on pull request #14078: KAFKA-14780: Fix flaky test 'testSecondaryRefreshAfterElapsedDelay'

2023-08-09 Thread via GitHub
showuon commented on PR #14078: URL: https://github.com/apache/kafka/pull/14078#issuecomment-1672467423 The failed tests are listed here: https://ci-builds.apache.org/job/Kafka/job/kafka-pr/job/PR-14078/2/ They are all unrelated to your change. I'll review this PR later. Thanks for the

[GitHub] [kafka] dengziming merged pull request #14110: MINOR: Add test for describe topic with ID

2023-08-09 Thread via GitHub
dengziming merged PR #14110: URL: https://github.com/apache/kafka/pull/14110 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] olalamichelle commented on pull request #14078: KAFKA-14780: Fix flaky test 'testSecondaryRefreshAfterElapsedDelay'

2023-08-09 Thread via GitHub
olalamichelle commented on PR #14078: URL: https://github.com/apache/kafka/pull/14078#issuecomment-1672436566 Hi Divij, It is stating that "all checks have failed and this commit has test failures". But upon checking the merge details, I was not able to find the exact failure info.

[GitHub] [kafka] ex172000 commented on pull request #14110: MINOR: Add test for describe topic with ID

2023-08-09 Thread via GitHub
ex172000 commented on PR #14110: URL: https://github.com/apache/kafka/pull/14110#issuecomment-1672429558 @satishd can you help to review? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] mjsax commented on a diff in pull request #14149: HOTFIX: avoid placement of unnecessary transient standby tasks

2023-08-09 Thread via GitHub
mjsax commented on code in PR #14149: URL: https://github.com/apache/kafka/pull/14149#discussion_r1289372985 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamsPartitionAssignor.java: ## @@ -1063,9 +1071,13 @@ private Map> buildStandbyTaskMap(final

[GitHub] [kafka] mjsax commented on a diff in pull request #14149: HOTFIX: avoid placement of unnecessary transient standby tasks

2023-08-09 Thread via GitHub
mjsax commented on code in PR #14149: URL: https://github.com/apache/kafka/pull/14149#discussion_r1289369350 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamsPartitionAssignor.java: ## @@ -1063,9 +1071,13 @@ private Map> buildStandbyTaskMap(final

[GitHub] [kafka] mjsax merged pull request #14164: KAFKA-15022: [8/N] more tests for HAAssignor

2023-08-09 Thread via GitHub
mjsax merged PR #14164: URL: https://github.com/apache/kafka/pull/14164 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] junrao commented on pull request #13947: KAFKA-15130: Delete remote segments when delete a topic

2023-08-09 Thread via GitHub
junrao commented on PR #13947: URL: https://github.com/apache/kafka/pull/13947#issuecomment-1672284941 > I didn't follow previous changes, but I think current implementation also works for KRaft mode, right? I can see ReplicaManager#applyDelta is invoking stopPartitions, which will do what

[GitHub] [kafka] junrao commented on a diff in pull request #13947: KAFKA-15130: Delete remote segments when delete a topic

2023-08-09 Thread via GitHub
junrao commented on code in PR #13947: URL: https://github.com/apache/kafka/pull/13947#discussion_r1289212842 ## core/src/main/scala/kafka/server/ReplicaManager.scala: ## @@ -526,25 +530,37 @@ class ReplicaManager(val config: KafkaConfig, /** * Stop the given partitions.

[GitHub] [kafka] lucasbru opened a new pull request, #14180: Kafka Streams Threading: Non-busy wait for processable tasks

2023-08-09 Thread via GitHub
lucasbru opened a new pull request, #14180: URL: https://github.com/apache/kafka/pull/14180 Avoid busy waiting for processable tasks. We need to be a bit careful here to not have the task executors to sleep when work is available. We have to make sure to signal on the condition variable

[GitHub] [kafka] philipnee opened a new pull request, #14179: MINOR: CommitRequestManager should only poll when the coordinator node is known

2023-08-09 Thread via GitHub
philipnee opened a new pull request, #14179: URL: https://github.com/apache/kafka/pull/14179 As title, we discovered a flaky bug during testing that it would seldomly thrown a NOT_COORDINATOR exception, which means the request was routed to a non-coordinator node. We discovered that if we

[jira] [Commented] (KAFKA-14049) Relax Non Null Requirement for KStreamGlobalKTable Left Join

2023-08-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17752522#comment-17752522 ] Matthias J. Sax commented on KAFKA-14049: - I am still not sure if I understand this ticket? – Or

[jira] [Updated] (KAFKA-14049) Relax Non Null Requirement for KStreamGlobalKTable Left Join

2023-08-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14049: Labels: (was: kip) > Relax Non Null Requirement for KStreamGlobalKTable Left Join >

[GitHub] [kafka] lihaosky commented on a diff in pull request #14178: KAFKA-15022: [9/N] use RackAwareTaskAssignor in StickyTaskAssignor

2023-08-09 Thread via GitHub
lihaosky commented on code in PR #14178: URL: https://github.com/apache/kafka/pull/14178#discussion_r1289205241 ## streams/src/test/java/org/apache/kafka/streams/processor/internals/assignment/AssignmentTestUtils.java: ## @@ -617,21 +652,23 @@ static Map>>

[jira] [Updated] (KAFKA-14049) Relax Non Null Requirement for KStreamGlobalKTable Left Join

2023-08-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14049: Labels: kip (was: beginner newbie) > Relax Non Null Requirement for KStreamGlobalKTable

[jira] [Updated] (KAFKA-14748) Relax non-null FK left-join requirement

2023-08-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14748: Description: Kafka Streams enforces a strict non-null-key policy in the DSL across all

[jira] [Updated] (KAFKA-14748) Relax non-null FK left-join requirement

2023-08-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14748: Labels: kip (was: ) > Relax non-null FK left-join requirement >

[jira] [Updated] (KAFKA-12317) Relax non-null key requirement for left/outer KStream joins

2023-08-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-12317: Description: Currently, for a stream-streams and stream-table/globalTable join

[jira] [Updated] (KAFKA-12317) Relax non-null key requirement for left/outer KStream joins

2023-08-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-12317: Labels: kip (was: ) > Relax non-null key requirement for left/outer KStream joins >

[jira] [Commented] (KAFKA-12317) Relax non-null key requirement for left/outer KStream joins

2023-08-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17752519#comment-17752519 ] Matthias J. Sax commented on KAFKA-12317: - Just catching on of comments... {quote}KAFKA-12845 is

[GitHub] [kafka] aindriu-aiven commented on a diff in pull request #14159: Kafka 15291 connect plugins implement versioned

2023-08-09 Thread via GitHub
aindriu-aiven commented on code in PR #14159: URL: https://github.com/apache/kafka/pull/14159#discussion_r1289206301 ## connect/runtime/src/test/java/org/apache/kafka/connect/runtime/isolation/PluginScannerTest.java: ## @@ -145,10 +148,28 @@ public void

[GitHub] [kafka] mjsax commented on a diff in pull request #14178: KAFKA-15022: [9/N] use RackAwareTaskAssignor in StickyTaskAssignor

2023-08-09 Thread via GitHub
mjsax commented on code in PR #14178: URL: https://github.com/apache/kafka/pull/14178#discussion_r1289147669 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/assignment/ClientState.java: ## @@ -505,4 +505,15 @@ private void assertNotAssigned(final TaskId

[jira] [Resolved] (KAFKA-14831) Illegal state errors should be fatal in transactional producer

2023-08-09 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True resolved KAFKA-14831. --- Resolution: Fixed > Illegal state errors should be fatal in transactional producer >

[GitHub] [kafka] mumrah commented on a diff in pull request #14083: KAFKA-15219: KRaft support for DelegationTokens

2023-08-09 Thread via GitHub
mumrah commented on code in PR #14083: URL: https://github.com/apache/kafka/pull/14083#discussion_r1289141277 ## metadata/src/main/java/org/apache/kafka/controller/QuorumController.java: ## @@ -1498,6 +1543,30 @@ private void cancelNextWriteNoOpRecord() {

[jira] [Commented] (KAFKA-15224) Automate version change to snapshot

2023-08-09 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17752510#comment-17752510 ] Divij Vaidya commented on KAFKA-15224: -- > can we include new python packages? Sure. Currently the

[GitHub] [kafka] lihaosky opened a new pull request, #14178: KAFKA-15022: [9/N] use RackAwareTaskAssignor in StickyTaskAssignor

2023-08-09 Thread via GitHub
lihaosky opened a new pull request, #14178: URL: https://github.com/apache/kafka/pull/14178 ## Description Use rack aware assignor in `StickyTaskAssignor`. This PR is on top of https://github.com/apache/kafka/pull/14164. ## Test Update existing unit test -- This is an

[jira] [Comment Edited] (KAFKA-15224) Automate version change to snapshot

2023-08-09 Thread Tanay Karmarkar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17752504#comment-17752504 ] Tanay Karmarkar edited comment on KAFKA-15224 at 8/9/23 7:46 PM: -

[jira] [Commented] (KAFKA-15224) Automate version change to snapshot

2023-08-09 Thread Tanay Karmarkar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17752504#comment-17752504 ] Tanay Karmarkar commented on KAFKA-15224: - Another clarification needed, in the example PR,

[GitHub] [kafka] omkreddy commented on a diff in pull request #14083: KAFKA-15219: KRaft support for DelegationTokens

2023-08-09 Thread via GitHub
omkreddy commented on code in PR #14083: URL: https://github.com/apache/kafka/pull/14083#discussion_r1289107179 ## core/src/main/scala/kafka/server/DelegationTokenManager.scala: ## @@ -165,10 +112,11 @@ object DelegationTokenManager { class DelegationTokenManager(val config:

[jira] [Commented] (KAFKA-15042) Clarify documentation on Tagged fields

2023-08-09 Thread Adrian Preston (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17752503#comment-17752503 ] Adrian Preston commented on KAFKA-15042: [~smashingquasar], Looking at the hex dump of your

[GitHub] [kafka] omkreddy commented on a diff in pull request #14083: KAFKA-15219: KRaft support for DelegationTokens

2023-08-09 Thread via GitHub
omkreddy commented on code in PR #14083: URL: https://github.com/apache/kafka/pull/14083#discussion_r1289096459 ## core/src/test/scala/integration/kafka/api/DelegationTokenEndToEndAuthorizationTest.scala: ## @@ -145,12 +163,12 @@ class DelegationTokenEndToEndAuthorizationTest

[GitHub] [kafka] gharris1727 commented on a diff in pull request #14156: KAFKA-15202: Fix MM2 offset translation when syncs are variably spaced

2023-08-09 Thread via GitHub
gharris1727 commented on code in PR #14156: URL: https://github.com/apache/kafka/pull/14156#discussion_r1289079347 ## connect/mirror/src/main/java/org/apache/kafka/connect/mirror/OffsetSyncStore.java: ## @@ -227,7 +227,7 @@ private void clearSyncArray(OffsetSync[] syncs,

[jira] [Created] (KAFKA-15327) Async consumer should commit offsets on close

2023-08-09 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-15327: -- Summary: Async consumer should commit offsets on close Key: KAFKA-15327 URL: https://issues.apache.org/jira/browse/KAFKA-15327 Project: Kafka Issue

[GitHub] [kafka] gharris1727 commented on a diff in pull request #14159: Kafka 15291 connect plugins implement versioned

2023-08-09 Thread via GitHub
gharris1727 commented on code in PR #14159: URL: https://github.com/apache/kafka/pull/14159#discussion_r1289026069 ## connect/runtime/src/test/java/org/apache/kafka/connect/runtime/isolation/PluginScannerTest.java: ## @@ -145,10 +148,28 @@ public void

[GitHub] [kafka] gharris1727 opened a new pull request, #14177: MINOR: Fix SynchronizationTest Classloaders sometimes not being parallel capable

2023-08-09 Thread via GitHub
gharris1727 opened a new pull request, #14177: URL: https://github.com/apache/kafka/pull/14177 The `Classloader.registerAsParallelCapable()` call is intended to be called during static initialization. It must be called prior to the `Classloader` superconstructor, because there it is

[GitHub] [kafka] junrao commented on a diff in pull request #14111: KAFKA-9800: Exponential backoff for Kafka clients - KIP-580

2023-08-09 Thread via GitHub
junrao commented on code in PR #14111: URL: https://github.com/apache/kafka/pull/14111#discussion_r1288946333 ## clients/src/main/java/org/apache/kafka/clients/Metadata.java: ## @@ -144,13 +159,25 @@ public long metadataExpireMs() { */ public synchronized int

[GitHub] [kafka] divijvaidya commented on a diff in pull request #14161: KAFKA-15267: Do not allow Tiered Storage to be disabled while topics have remote.storage.enable property

2023-08-09 Thread via GitHub
divijvaidya commented on code in PR #14161: URL: https://github.com/apache/kafka/pull/14161#discussion_r1288939068 ## core/src/main/scala/kafka/server/ConfigHandler.scala: ## @@ -62,6 +62,12 @@ class TopicConfigHandler(private val logManager: LogManager, kafkaConfig: KafkaC

[GitHub] [kafka] divijvaidya commented on a diff in pull request #14176: KAFKA-15295: Add config validation when remote storage is enabled on a topic

2023-08-09 Thread via GitHub
divijvaidya commented on code in PR #14176: URL: https://github.com/apache/kafka/pull/14176#discussion_r1288894765 ## storage/src/main/java/org/apache/kafka/storage/internals/log/LogConfig.java: ## @@ -459,49 +463,53 @@ public static void validateValues(Map props) {

[GitHub] [kafka] junrao commented on a diff in pull request #13561: KAFKA-14888: Added remote log segments retention functionality based on time and size.

2023-08-09 Thread via GitHub
junrao commented on code in PR #13561: URL: https://github.com/apache/kafka/pull/13561#discussion_r1287764297 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -956,6 +981,15 @@ class UnifiedLog(@volatile var logStartOffset: Long, } } + private def

[GitHub] [kafka] C0urante commented on a diff in pull request #14156: KAFKA-15202: Fix MM2 offset translation when syncs are variably spaced

2023-08-09 Thread via GitHub
C0urante commented on code in PR #14156: URL: https://github.com/apache/kafka/pull/14156#discussion_r1287870397 ## connect/mirror/src/main/java/org/apache/kafka/connect/mirror/OffsetSyncStore.java: ## @@ -227,7 +227,7 @@ private void clearSyncArray(OffsetSync[] syncs,

[GitHub] [kafka] cmccabe commented on a diff in pull request #14169: KAFKA-15318: Update the Authorizer via AclPublisher

2023-08-09 Thread via GitHub
cmccabe commented on code in PR #14169: URL: https://github.com/apache/kafka/pull/14169#discussion_r1288918541 ## core/src/main/scala/kafka/server/metadata/AclPublisher.scala: ## @@ -0,0 +1,99 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or more + *

[jira] [Updated] (KAFKA-15319) Upgrade rocksdb to fix CVE-2022-37434

2023-08-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-15319: Priority: Critical (was: Major) > Upgrade rocksdb to fix CVE-2022-37434 >

[jira] [Updated] (KAFKA-15319) Upgrade rocksdb to fix CVE-2022-37434

2023-08-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-15319: Component/s: streams > Upgrade rocksdb to fix CVE-2022-37434 >

[GitHub] [kafka] gharris1727 commented on pull request #14064: KAFKA-15030: Add connect-plugin-path command-line tool.

2023-08-09 Thread via GitHub
gharris1727 commented on PR #14064: URL: https://github.com/apache/kafka/pull/14064#issuecomment-1671793380 Looking forward at the `sync-manifests` implementation, I realized that I had some duplication. The `ManifestEntry`, `findManifests` function, and the exclude behavior I added in

[GitHub] [kafka] OmniaGM commented on a diff in pull request #13204: KAFKA-14593: Move LeaderElectionCommand to tools

2023-08-09 Thread via GitHub
OmniaGM commented on code in PR #13204: URL: https://github.com/apache/kafka/pull/13204#discussion_r128079 ## tools/src/main/java/org/apache/kafka/tools/LeaderElectionCommand.java: ## @@ -0,0 +1,378 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] [kafka] OmniaGM commented on a diff in pull request #13204: KAFKA-14593: Move LeaderElectionCommand to tools

2023-08-09 Thread via GitHub
OmniaGM commented on code in PR #13204: URL: https://github.com/apache/kafka/pull/13204#discussion_r127858 ## tools/src/main/java/org/apache/kafka/tools/LeaderElectionCommand.java: ## @@ -0,0 +1,378 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] [kafka] OmniaGM commented on a diff in pull request #13204: KAFKA-14593: Move LeaderElectionCommand to tools

2023-08-09 Thread via GitHub
OmniaGM commented on code in PR #13204: URL: https://github.com/apache/kafka/pull/13204#discussion_r127595 ## tools/src/main/java/org/apache/kafka/tools/LeaderElectionCommand.java: ## @@ -0,0 +1,378 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] [kafka] OmniaGM commented on a diff in pull request #13204: KAFKA-14593: Move LeaderElectionCommand to tools

2023-08-09 Thread via GitHub
OmniaGM commented on code in PR #13204: URL: https://github.com/apache/kafka/pull/13204#discussion_r126617 ## tools/src/main/java/org/apache/kafka/tools/LeaderElectionCommand.java: ## @@ -0,0 +1,378 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] [kafka] OmniaGM commented on a diff in pull request #13204: KAFKA-14593: Move LeaderElectionCommand to tools

2023-08-09 Thread via GitHub
OmniaGM commented on code in PR #13204: URL: https://github.com/apache/kafka/pull/13204#discussion_r126278 ## tools/src/test/java/org/apache/kafka/tools/LeaderElectionCommandErrorTest.java: ## @@ -0,0 +1,100 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] [kafka] OmniaGM commented on a diff in pull request #13204: KAFKA-14593: Move LeaderElectionCommand to tools

2023-08-09 Thread via GitHub
OmniaGM commented on code in PR #13204: URL: https://github.com/apache/kafka/pull/13204#discussion_r1288877172 ## tools/src/main/java/org/apache/kafka/tools/LeaderElectionCommand.java: ## @@ -0,0 +1,378 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

[jira] [Created] (KAFKA-15326) Decouple Processing Thread from Polling Thread

2023-08-09 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-15326: -- Summary: Decouple Processing Thread from Polling Thread Key: KAFKA-15326 URL: https://issues.apache.org/jira/browse/KAFKA-15326 Project: Kafka Issue

[GitHub] [kafka] cmccabe commented on a diff in pull request #14169: KAFKA-15318: Update the Authorizer via AclPublisher

2023-08-09 Thread via GitHub
cmccabe commented on code in PR #14169: URL: https://github.com/apache/kafka/pull/14169#discussion_r1288849218 ## metadata/src/main/java/org/apache/kafka/controller/AclControlManager.java: ## @@ -256,11 +224,6 @@ public void replay( throw new

[GitHub] [kafka] cmccabe commented on a diff in pull request #14169: KAFKA-15318: Update the Authorizer via AclPublisher

2023-08-09 Thread via GitHub
cmccabe commented on code in PR #14169: URL: https://github.com/apache/kafka/pull/14169#discussion_r1288848313 ## metadata/src/main/java/org/apache/kafka/controller/QuorumController.java: ## @@ -1112,35 +1102,12 @@ private void appendRaftEvent(String name, Runnable runnable) {

[GitHub] [kafka] OmniaGM commented on a diff in pull request #14082: KAFKA-15102: Mirror Maker 2 - KIP690 backward compatibility

2023-08-09 Thread via GitHub
OmniaGM commented on code in PR #14082: URL: https://github.com/apache/kafka/pull/14082#discussion_r1288843685 ## connect/mirror/src/test/java/org/apache/kafka/connect/mirror/integration/MirrorConnectorsIntegrationBaseTest.java: ## @@ -406,7 +406,6 @@ public void

[GitHub] [kafka] OmniaGM commented on a diff in pull request #14082: KAFKA-15102: Mirror Maker 2 - KIP690 backward compatibility

2023-08-09 Thread via GitHub
OmniaGM commented on code in PR #14082: URL: https://github.com/apache/kafka/pull/14082#discussion_r1288843344 ## connect/mirror-client/src/main/java/org/apache/kafka/connect/mirror/DefaultReplicationPolicy.java: ## @@ -43,6 +47,11 @@ public void configure(Map props) {

[GitHub] [kafka] OmniaGM commented on a diff in pull request #14082: KAFKA-15102: Mirror Maker 2 - KIP690 backward compatibility

2023-08-09 Thread via GitHub
OmniaGM commented on code in PR #14082: URL: https://github.com/apache/kafka/pull/14082#discussion_r1288843014 ## connect/mirror/src/test/java/org/apache/kafka/connect/mirror/integration/DefaultReplicationIntegrationTest.java: ## @@ -0,0 +1,324 @@ +/* Review Comment: I

[jira] [Resolved] (KAFKA-15298) Disable DeleteRecords on Tiered Storage topics

2023-08-09 Thread Christo Lolov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christo Lolov resolved KAFKA-15298. --- Resolution: Won't Fix > Disable DeleteRecords on Tiered Storage topics >

[jira] [Commented] (KAFKA-15302) Stale value returned when using store.all() in punctuation function.

2023-08-09 Thread Jinyong Choi (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17752451#comment-17752451 ] Jinyong Choi commented on KAFKA-15302: -- [~mjsax] , [~guozhang]    If you perform a delete() within

[GitHub] [kafka] kamalcph commented on a diff in pull request #14114: KAFKA-12969: Add broker level config synonyms for topic level tiered storage configs

2023-08-09 Thread via GitHub
kamalcph commented on code in PR #14114: URL: https://github.com/apache/kafka/pull/14114#discussion_r1288729452 ## storage/src/main/java/org/apache/kafka/storage/internals/log/LogConfig.java: ## @@ -102,49 +102,14 @@ public String topicWarningMessage(String topicName) {

[GitHub] [kafka] kamalcph opened a new pull request, #14176: KAFKA-15295: Add config validation when remote storage is enabled on a topic

2023-08-09 Thread via GitHub
kamalcph opened a new pull request, #14176: URL: https://github.com/apache/kafka/pull/14176 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.* *Summary of

[jira] [Resolved] (KAFKA-15100) Unsafe to call tryCompleteFetchResponse on request timeout

2023-08-09 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-15100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio resolved KAFKA-15100. Resolution: Fixed > Unsafe to call tryCompleteFetchResponse on

[jira] [Updated] (KAFKA-15100) Unsafe to call tryCompleteFetchResponse on request timeout

2023-08-09 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-15100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio updated KAFKA-15100: --- Fix Version/s: 3.4.2 > Unsafe to call tryCompleteFetchResponse on

[GitHub] [kafka] jeqo commented on a diff in pull request #14127: KAFKA-15181: Wait for RemoteLogMetadataCache to initialize after assigning partitions

2023-08-09 Thread via GitHub
jeqo commented on code in PR #14127: URL: https://github.com/apache/kafka/pull/14127#discussion_r1288620620 ## storage/src/main/java/org/apache/kafka/server/log/remote/metadata/storage/ConsumerTask.java: ## @@ -64,302 +65,393 @@ class ConsumerTask implements Runnable,

[GitHub] [kafka] vveicc commented on pull request #14175: KAFKA-15288: Change BrokerApiVersionsCommandTest to support kraft mode

2023-08-09 Thread via GitHub
vveicc commented on PR #14175: URL: https://github.com/apache/kafka/pull/14175#issuecomment-1671596827 Thank you for your advice @dengziming, this is very helpful to me. I have made some changes, PTAL. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [kafka] clolov commented on a diff in pull request #14136: Add metadatacache into RemoteLogManager, and refactor all relevant codes

2023-08-09 Thread via GitHub
clolov commented on code in PR #14136: URL: https://github.com/apache/kafka/pull/14136#discussion_r1288687969 ## core/src/main/java/kafka/log/remote/RemoteLogManager.java: ## @@ -347,15 +353,16 @@ public void onLeadershipChange(Set partitionsBecomeLeader, public void

[jira] [Updated] (KAFKA-15100) Unsafe to call tryCompleteFetchResponse on request timeout

2023-08-09 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-15100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio updated KAFKA-15100: --- Fix Version/s: 3.5.2 > Unsafe to call tryCompleteFetchResponse on

[GitHub] [kafka] AndrewJSchofield commented on a diff in pull request #14111: KAFKA-9800: Exponential backoff for Kafka clients - KIP-580

2023-08-09 Thread via GitHub
AndrewJSchofield commented on code in PR #14111: URL: https://github.com/apache/kafka/pull/14111#discussion_r1288667079 ## clients/src/main/java/org/apache/kafka/clients/Metadata.java: ## @@ -119,20 +130,24 @@ public synchronized Cluster fetch() { * @return remaining time

[GitHub] [kafka] clolov commented on a diff in pull request #14127: KAFKA-15181: Wait for RemoteLogMetadataCache to initialize after assigning partitions

2023-08-09 Thread via GitHub
clolov commented on code in PR #14127: URL: https://github.com/apache/kafka/pull/14127#discussion_r1288608136 ## storage/src/test/java/org/apache/kafka/server/log/remote/metadata/storage/TopicBasedRemoteLogMetadataManagerMultipleSubscriptionsTest.java: ## @@ -0,0 +1,176 @@ +/*

[GitHub] [kafka] jeffkbkim commented on pull request #14124: Kafka-14509; [1/2] Define ConsumerGroupDescribe API request and response schemas and classes.

2023-08-09 Thread via GitHub
jeffkbkim commented on PR #14124: URL: https://github.com/apache/kafka/pull/14124#issuecomment-1671432782 Thanks @riedelmax! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [kafka] jsancio merged pull request #14141: KAFKA-15100; KRaft data race with the expiration service

2023-08-09 Thread via GitHub
jsancio merged PR #14141: URL: https://github.com/apache/kafka/pull/14141 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] prestona commented on pull request #14173: KAFKA-15042: Improve TAGGED_FIELDS protocol documentation

2023-08-09 Thread via GitHub
prestona commented on PR #14173: URL: https://github.com/apache/kafka/pull/14173#issuecomment-1671409792 For context, any API message description that has a TAG_BUFFER field will be changed as follows https://github.com/apache/kafka/assets/10883734/108fd5a9-cf6c-4698-8311-ea6845bf7886;>

[GitHub] [kafka] divijvaidya commented on pull request #14168: MINOR; Fix nanosecond elapsed time

2023-08-09 Thread via GitHub
divijvaidya commented on PR #14168: URL: https://github.com/apache/kafka/pull/14168#issuecomment-1671384884 Wow! This is news to me. BTW there is a JIRA tracking this test failure at https://issues.apache.org/jira/browse/KAFKA-15052 and you might want to associate this PR with that JIRA.

[GitHub] [kafka] mumrah commented on a diff in pull request #14169: KAFKA-15318: Update the Authorizer via AclPublisher

2023-08-09 Thread via GitHub
mumrah commented on code in PR #14169: URL: https://github.com/apache/kafka/pull/14169#discussion_r1288505525 ## metadata/src/main/java/org/apache/kafka/controller/AclControlManager.java: ## @@ -256,11 +224,6 @@ public void replay( throw new

[GitHub] [kafka] dengziming commented on a diff in pull request #14175: KAFKA-15288: Change BrokerApiVersionsCommandTest to support kraft mode

2023-08-09 Thread via GitHub
dengziming commented on code in PR #14175: URL: https://github.com/apache/kafka/pull/14175#discussion_r1288503732 ## core/src/test/scala/integration/kafka/admin/BrokerApiVersionsCommandTest.scala: ## @@ -56,21 +66,30 @@ class BrokerApiVersionsCommandTest extends

[jira] [Created] (KAFKA-15325) Integrate topicId in OffsetFetch and OffsetCommit async consumer calls

2023-08-09 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-15325: -- Summary: Integrate topicId in OffsetFetch and OffsetCommit async consumer calls Key: KAFKA-15325 URL: https://issues.apache.org/jira/browse/KAFKA-15325 Project:

[GitHub] [kafka] kamalcph commented on a diff in pull request #14161: KAFKA-15267: Do not allow Tiered Storage to be disabled while topics have remote.storage.enable property

2023-08-09 Thread via GitHub
kamalcph commented on code in PR #14161: URL: https://github.com/apache/kafka/pull/14161#discussion_r1288449342 ## core/src/main/scala/kafka/server/ConfigHandler.scala: ## @@ -62,6 +62,12 @@ class TopicConfigHandler(private val logManager: LogManager, kafkaConfig: KafkaC

[jira] [Assigned] (KAFKA-15295) Add config validation when remote storage is enabled on a topic

2023-08-09 Thread Kamal Chandraprakash (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamal Chandraprakash reassigned KAFKA-15295: Assignee: Kamal Chandraprakash (was: Luke Chen) > Add config validation

[GitHub] [kafka] nizhikov commented on a diff in pull request #14172: KAFKA-14595 Java version of ReassignPartitionsCommand POJOs

2023-08-09 Thread via GitHub
nizhikov commented on code in PR #14172: URL: https://github.com/apache/kafka/pull/14172#discussion_r1288443925 ## tools/src/main/java/org/apache/kafka/tools/reassign/ActiveMoveState.java: ## @@ -0,0 +1,60 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

[jira] [Commented] (KAFKA-12317) Relax non-null key requirement for left/outer KStream joins

2023-08-09 Thread Florin Akermann (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17752407#comment-17752407 ] Florin Akermann commented on KAFKA-12317: - Drafted a PR:

[GitHub] [kafka] vveicc opened a new pull request, #14175: KAFKA-15288: Change BrokerApiVersionsCommandTest to support kraft mode

2023-08-09 Thread via GitHub
vveicc opened a new pull request, #14175: URL: https://github.com/apache/kafka/pull/14175 Change BrokerApiVersionsCommandTest to support kraft mode. ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI

[GitHub] [kafka] yashmayya commented on a diff in pull request #14102: KAFKA-13187: Replace EasyMock / PowerMock with Mockito in DistributedHerderTest

2023-08-09 Thread via GitHub
yashmayya commented on code in PR #14102: URL: https://github.com/apache/kafka/pull/14102#discussion_r1288239604 ## connect/runtime/src/test/java/org/apache/kafka/connect/runtime/distributed/DistributedHerderTest.java: ## @@ -3724,62 +2818,54 @@ public void

[GitHub] [kafka] florin-akermann opened a new pull request, #14174: Kafka 12317: Relax non-null key requirement in Kafka Streams

2023-08-09 Thread via GitHub
florin-akermann opened a new pull request, #14174: URL: https://github.com/apache/kafka/pull/14174 https://cwiki.apache.org/confluence/display/KAFKA/KIP-962%3A+Relax+non-null+key+requirement+in+Kafka+Streams Test Strategy: Basic tests on minimal topologies with call to

[GitHub] [kafka] mimaison commented on a diff in pull request #14172: KAFKA-14595 Java version of ReassignPartitionsCommand POJOs

2023-08-09 Thread via GitHub
mimaison commented on code in PR #14172: URL: https://github.com/apache/kafka/pull/14172#discussion_r1288390063 ## tools/src/main/java/org/apache/kafka/tools/reassign/ActiveMoveState.java: ## @@ -0,0 +1,60 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

[jira] [Commented] (KAFKA-15172) Allow exact mirroring of ACLs between clusters

2023-08-09 Thread hudeqi (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17752398#comment-17752398 ] hudeqi commented on KAFKA-15172: Hi, I have initiated a kip discussion:

[GitHub] [kafka] riedelmax commented on pull request #14124: Kafka-14509; [1/2] Define ConsumerGroupDescribe API request and response schemas and classes.

2023-08-09 Thread via GitHub
riedelmax commented on PR #14124: URL: https://github.com/apache/kafka/pull/14124#issuecomment-1671187508 I will find time in the next days to fix those. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Commented] (KAFKA-15259) Kafka Streams does not continue processing due to rollback despite ProductionExceptionHandlerResponse.CONTINUE if using exactly_once

2023-08-09 Thread Tomonari Yamashita (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17752396#comment-17752396 ] Tomonari Yamashita commented on KAFKA-15259: My opinion is neutral on whether it should be

[GitHub] [kafka] divijvaidya commented on pull request #14153: KAFKA-14132: Replace Easymock & Powermock with Mockito in KafkaBasedLogTest

2023-08-09 Thread via GitHub
divijvaidya commented on PR #14153: URL: https://github.com/apache/kafka/pull/14153#issuecomment-1671124312 Thank you for reviewing @yashmayya. The CI is still flaky with large number of failures and I am restarting it. -- This is an automated message from the Apache Git Service. To

[GitHub] [kafka] divijvaidya commented on a diff in pull request #14161: KAFKA-15267: Do not allow Tiered Storage to be disabled while topics have remote.storage.enable property

2023-08-09 Thread via GitHub
divijvaidya commented on code in PR #14161: URL: https://github.com/apache/kafka/pull/14161#discussion_r1288309828 ## core/src/main/scala/kafka/server/ConfigHandler.scala: ## @@ -62,6 +62,12 @@ class TopicConfigHandler(private val logManager: LogManager, kafkaConfig: KafkaC

  1   2   >