[GitHub] [kafka] lmr3796 opened a new pull request, #13187: MINOR: Log lastCaughtUpTime on ISR shrinkage

2023-02-02 Thread via GitHub
lmr3796 opened a new pull request, #13187: URL: https://github.com/apache/kafka/pull/13187 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.* This is for better obse

[GitHub] [kafka] lmr3796 commented on pull request #13187: MINOR: Log lastCaughtUpTime on ISR shrinkage

2023-02-02 Thread via GitHub
lmr3796 commented on PR #13187: URL: https://github.com/apache/kafka/pull/13187#issuecomment-1413356998 Hi @jsancio wondering if you can take a look at this change. We found it helpful for us to understand such URP issues. -- This is an automated message from the Apache Git Service.

[jira] [Commented] (KAFKA-14595) Move ReassignPartitionsCommand to tools

2023-02-02 Thread Nikolay Izhikov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17683291#comment-17683291 ] Nikolay Izhikov commented on KAFKA-14595: - Hello [~omnia_h_ibrahim]  Can I assi

[GitHub] [kafka] fvaleri commented on a diff in pull request #13158: KAFKA-14647: Moving TopicFilter to server-common/utils

2023-02-02 Thread via GitHub
fvaleri commented on code in PR #13158: URL: https://github.com/apache/kafka/pull/13158#discussion_r1094209610 ## checkstyle/import-control.xml: ## @@ -351,6 +351,7 @@ + Review Comment: Is this related to the above comment? If not please move it above right

[GitHub] [kafka] fvaleri commented on a diff in pull request #13158: KAFKA-14647: Moving TopicFilter to server-common/utils

2023-02-02 Thread via GitHub
fvaleri commented on code in PR #13158: URL: https://github.com/apache/kafka/pull/13158#discussion_r1094301822 ## server-common/src/main/java/org/apache/kafka/server/util/TopicPartitionFilter.java: ## @@ -0,0 +1,71 @@ +/* + * Licensed to the Apache Software Foundation (ASF) unde

[GitHub] [kafka] clolov commented on a diff in pull request #13177: [KAFKA-14441] Benchmark performance impact of metrics library

2023-02-02 Thread via GitHub
clolov commented on code in PR #13177: URL: https://github.com/apache/kafka/pull/13177#discussion_r1094319881 ## jmh-benchmarks/src/main/java/org/apache/kafka/jmh/common/metrics/SensorBenchmark.java: ## @@ -0,0 +1,145 @@ +package org.apache.kafka.jmh.common.metrics; + +import or

[GitHub] [kafka] mimaison merged pull request #13136: KAFKA-14582: Move JmxTool to tools

2023-02-02 Thread via GitHub
mimaison merged PR #13136: URL: https://github.com/apache/kafka/pull/13136 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[GitHub] [kafka] clolov commented on a diff in pull request #13180: MINOR: Add a summary of the metadata migration

2023-02-02 Thread via GitHub
clolov commented on code in PR #13180: URL: https://github.com/apache/kafka/pull/13180#discussion_r1094398310 ## metadata/src/main/java/org/apache/kafka/metadata/migration/KRaftMigrationDriver.java: ## @@ -415,7 +416,7 @@ public void run() throws Exception {

[GitHub] [kafka] Hangleton commented on a diff in pull request #13176: MINOR: some ZK migration code cleanups.

2023-02-02 Thread via GitHub
Hangleton commented on code in PR #13176: URL: https://github.com/apache/kafka/pull/13176#discussion_r1094408921 ## core/src/main/scala/kafka/migration/MigrationPropagator.scala: ## @@ -79,6 +81,18 @@ class MigrationPropagator( _image = image } + /** + * A very expe

[GitHub] [kafka] clolov commented on pull request #13184: KAFKA-14671: Refactor PredicatedTransformation to not implement Transformation

2023-02-02 Thread via GitHub
clolov commented on PR #13184: URL: https://github.com/apache/kafka/pull/13184#issuecomment-1413610633 To be honest, when I read this code a class which is "kind of" like a Transformation but throws because some methods are not implemented made more sense than wrapping Transformations in a

[jira] [Commented] (KAFKA-14595) Move ReassignPartitionsCommand to tools

2023-02-02 Thread Omnia Ibrahim (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17683377#comment-17683377 ] Omnia Ibrahim commented on KAFKA-14595: --- [~nizhikov] sure > Move ReassignPartitio

[jira] [Assigned] (KAFKA-14595) Move ReassignPartitionsCommand to tools

2023-02-02 Thread Nikolay Izhikov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikolay Izhikov reassigned KAFKA-14595: --- Assignee: Nikolay Izhikov (was: Omnia Ibrahim) > Move ReassignPartitionsCommand to

[GitHub] [kafka] Hangleton commented on a diff in pull request #13183: KAFKA-14668 Avoid unnecessary UMR during ZK migration

2023-02-02 Thread via GitHub
Hangleton commented on code in PR #13183: URL: https://github.com/apache/kafka/pull/13183#discussion_r1094454976 ## metadata/src/main/java/org/apache/kafka/metadata/migration/KRaftMigrationDriver.java: ## @@ -474,6 +472,7 @@ class MetadataChangeEvent extends MigrationEvent {

[GitHub] [kafka] beardt commented on a diff in pull request #13168: Kafka 14565: Interceptor Resource Leak

2023-02-02 Thread via GitHub
beardt commented on code in PR #13168: URL: https://github.com/apache/kafka/pull/13168#discussion_r1093403718 ## clients/src/test/java/org/apache/kafka/common/config/AbstractConfigTest.java: ## @@ -54,6 +58,12 @@ public void testConfiguredInstances() { testInvalidInput

[GitHub] [kafka] clolov commented on pull request #12607: KAFKA-14133: Replace EasyMock with Mockito in streams tests

2023-02-02 Thread via GitHub
clolov commented on PR #12607: URL: https://github.com/apache/kafka/pull/12607#issuecomment-1413735823 @cadonna I have rebased this on the latest trunk. Is it possible to get a review? This pull requests is one of the last remaining ones for completing the Mockito migration for streams. -

[GitHub] [kafka] Hangleton commented on a diff in pull request #13046: KAFKA-14551 Move/Rewrite LeaderEpochFileCache and its dependencies to the storage module.

2023-02-02 Thread via GitHub
Hangleton commented on code in PR #13046: URL: https://github.com/apache/kafka/pull/13046#discussion_r1094474509 ## storage/src/main/java/org/apache/kafka/storage/internals/checkpoint/LeaderEpochCheckpointFile.java: ## @@ -0,0 +1,83 @@ +/* + * Licensed to the Apache Software Fou

[GitHub] [kafka] clolov commented on pull request #12777: Replace EasyMock and PowerMock with Mockito - TimeOrderedWindowStoreTest

2023-02-02 Thread via GitHub
clolov commented on PR #12777: URL: https://github.com/apache/kafka/pull/12777#issuecomment-1413738931 @cadonna is it possible get a review here as well? @shekhar-rajak, if there are any comments is it possible for you to address them. I will circle back in a week's time and if there are st

[GitHub] [kafka] clolov commented on pull request #12739: Replace EasyMock and PowerMock with Mockito | TimeOrderedCachingPersistentWindowStoreTest

2023-02-02 Thread via GitHub
clolov commented on PR #12739: URL: https://github.com/apache/kafka/pull/12739#issuecomment-1413740025 @shekhar-rajak, I would quite like to complete the migration for streams, so I will wait for a response for another week. Afterwards I will open a separate pull request based on this one i

[GitHub] [kafka] clolov commented on pull request #12524: KAFKA-14133: Replace EasyMock with Mockito in streams test

2023-02-02 Thread via GitHub
clolov commented on PR #12524: URL: https://github.com/apache/kafka/pull/12524#issuecomment-1413742398 Hello @mdedetrich and @cadonna! Is there something still remaining for this pull request or are we ready to merge it? There are around 4 pull requests remaining of this migration and I wou

[jira] [Assigned] (KAFKA-14667) Delayed leader election operation gets stuck in purgatory

2023-02-02 Thread Viktor Somogyi-Vass (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viktor Somogyi-Vass reassigned KAFKA-14667: --- Assignee: Viktor Somogyi-Vass > Delayed leader election operation gets stuc

[GitHub] [kafka] clolov commented on pull request #12449: KAFKA-12947: Replace EasyMock and PowerMock with Mockito for StreamsMetricsImplTest

2023-02-02 Thread via GitHub
clolov commented on PR #12449: URL: https://github.com/apache/kafka/pull/12449#issuecomment-1413745195 Hello @dplavcic and @cadonna, how is this pull request fairing? Is there something outstanding as a review or comments to be addressed? -- This is an automated message from the Apache Gi

[GitHub] [kafka] beardt commented on pull request #13168: Kafka 14565: Interceptor Resource Leak

2023-02-02 Thread via GitHub
beardt commented on PR #13168: URL: https://github.com/apache/kafka/pull/13168#issuecomment-1413758244 I went ahead and reintroduced the InterceptorTestConfig as I do not think it adds anymore complexity than `TestConfig` and `ClassTestConfig` while also making `testConfiguredInstancesClo

[jira] [Commented] (KAFKA-14060) Replace EasyMock and PowerMock with Mockito in AbstractWorkerSourceTaskTest

2023-02-02 Thread Hector Geraldino (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17683418#comment-17683418 ] Hector Geraldino commented on KAFKA-14060: -- Hey [~ChrisEgerton], I wrote a pa

[GitHub] [kafka] Hangleton commented on a diff in pull request #13177: [KAFKA-14441] Benchmark performance impact of metrics library

2023-02-02 Thread via GitHub
Hangleton commented on code in PR #13177: URL: https://github.com/apache/kafka/pull/13177#discussion_r1094530705 ## jmh-benchmarks/src/main/java/org/apache/kafka/jmh/common/metrics/SensorBenchmark.java: ## @@ -0,0 +1,145 @@ +package org.apache.kafka.jmh.common.metrics; + +import

[GitHub] [kafka] ijuma commented on a diff in pull request #13046: KAFKA-14551 Move/Rewrite LeaderEpochFileCache and its dependencies to the storage module.

2023-02-02 Thread via GitHub
ijuma commented on code in PR #13046: URL: https://github.com/apache/kafka/pull/13046#discussion_r1080718765 ## storage/src/main/java/org/apache/kafka/server/log/internals/LeaderEpochFileCache.java: ## @@ -0,0 +1,385 @@ +/* + * Licensed to the Apache Software Foundation (ASF) un

[jira] [Created] (KAFKA-14673) High watermark listener

2023-02-02 Thread David Jacot (Jira)
David Jacot created KAFKA-14673: --- Summary: High watermark listener Key: KAFKA-14673 URL: https://issues.apache.org/jira/browse/KAFKA-14673 Project: Kafka Issue Type: Sub-task Report

[GitHub] [kafka] ijuma commented on a diff in pull request #13046: KAFKA-14551 Move/Rewrite LeaderEpochFileCache and its dependencies to the storage module.

2023-02-02 Thread via GitHub
ijuma commented on code in PR #13046: URL: https://github.com/apache/kafka/pull/13046#discussion_r1094564674 ## storage/src/main/java/org/apache/kafka/storage/internals/checkpoint/LeaderEpochCheckpoint.java: ## @@ -0,0 +1,29 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] ijuma commented on a diff in pull request #13046: KAFKA-14551 Move/Rewrite LeaderEpochFileCache and its dependencies to the storage module.

2023-02-02 Thread via GitHub
ijuma commented on code in PR #13046: URL: https://github.com/apache/kafka/pull/13046#discussion_r1094564674 ## storage/src/main/java/org/apache/kafka/storage/internals/checkpoint/LeaderEpochCheckpoint.java: ## @@ -0,0 +1,29 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] mumrah commented on a diff in pull request #13183: KAFKA-14668 Avoid unnecessary UMR during ZK migration

2023-02-02 Thread via GitHub
mumrah commented on code in PR #13183: URL: https://github.com/apache/kafka/pull/13183#discussion_r1094614887 ## server-common/src/main/java/org/apache/kafka/queue/KafkaEventQueue.java: ## @@ -250,7 +250,7 @@ private void handleEvents() throws InterruptedException {

[GitHub] [kafka] mumrah commented on a diff in pull request #13183: KAFKA-14668 Avoid unnecessary UMR during ZK migration

2023-02-02 Thread via GitHub
mumrah commented on code in PR #13183: URL: https://github.com/apache/kafka/pull/13183#discussion_r1094617299 ## metadata/src/main/java/org/apache/kafka/metadata/migration/KRaftMigrationDriver.java: ## @@ -474,6 +472,7 @@ class MetadataChangeEvent extends MigrationEvent {

[GitHub] [kafka] clolov commented on a diff in pull request #13171: KAFKA-14584: Move StateChangeLogMerger tool

2023-02-02 Thread via GitHub
clolov commented on code in PR #13171: URL: https://github.com/apache/kafka/pull/13171#discussion_r1094628589 ## build.gradle: ## @@ -1763,6 +1763,7 @@ project(':tools') { implementation libs.jacksonJDK8Datatypes implementation libs.slf4jApi implementation libs.lo

[GitHub] [kafka] mimaison commented on a diff in pull request #13171: KAFKA-14584: Move StateChangeLogMerger tool

2023-02-02 Thread via GitHub
mimaison commented on code in PR #13171: URL: https://github.com/apache/kafka/pull/13171#discussion_r1094636765 ## build.gradle: ## @@ -1763,6 +1763,7 @@ project(':tools') { implementation libs.jacksonJDK8Datatypes implementation libs.slf4jApi implementation libs.

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094656127 ## build.gradle: ## @@ -1763,6 +1763,7 @@ project(':tools') { implementation libs.jacksonJDK8Datatypes implementation libs.slf4jApi implementation libs.lo

[jira] [Assigned] (KAFKA-14059) Replace EasyMock and PowerMock with Mockito in WorkerSourceTaskTest

2023-02-02 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton reassigned KAFKA-14059: - Assignee: (was: Chris Egerton) > Replace EasyMock and PowerMock with Mockito in Wor

[jira] [Commented] (KAFKA-14060) Replace EasyMock and PowerMock with Mockito in AbstractWorkerSourceTaskTest

2023-02-02 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17683465#comment-17683465 ] Chris Egerton commented on KAFKA-14060: --- [~hgeraldino] that's fine, thanks for the

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094680573 ## tools/src/main/java/org/apache/kafka/tools/DelegationTokenCommand.java: ## @@ -0,0 +1,306 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or mor

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094680573 ## tools/src/main/java/org/apache/kafka/tools/DelegationTokenCommand.java: ## @@ -0,0 +1,306 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or mor

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094680573 ## tools/src/main/java/org/apache/kafka/tools/DelegationTokenCommand.java: ## @@ -0,0 +1,306 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or mor

[GitHub] [kafka] mumrah commented on a diff in pull request #13180: MINOR: Add a summary of the metadata migration

2023-02-02 Thread via GitHub
mumrah commented on code in PR #13180: URL: https://github.com/apache/kafka/pull/13180#discussion_r1094683166 ## metadata/src/main/java/org/apache/kafka/metadata/migration/KRaftMigrationDriver.java: ## @@ -415,7 +416,7 @@ public void run() throws Exception {

[GitHub] [kafka] mumrah commented on a diff in pull request #13180: MINOR: Add a summary of the metadata migration

2023-02-02 Thread via GitHub
mumrah commented on code in PR #13180: URL: https://github.com/apache/kafka/pull/13180#discussion_r1094684342 ## metadata/src/main/java/org/apache/kafka/metadata/migration/MigrationSummary.java: ## @@ -0,0 +1,71 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under o

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094685504 ## tools/src/main/java/org/apache/kafka/tools/DelegationTokenCommand.java: ## @@ -0,0 +1,306 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or mor

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094686108 ## tools/src/main/java/org/apache/kafka/tools/DelegationTokenCommand.java: ## @@ -0,0 +1,306 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or mor

[GitHub] [kafka] C0urante commented on a diff in pull request #12984: KAFKA-14455: Kafka Connect create and update REST APIs should surface failures while writing to the config topic

2023-02-02 Thread via GitHub
C0urante commented on code in PR #12984: URL: https://github.com/apache/kafka/pull/12984#discussion_r1094686354 ## connect/runtime/src/main/java/org/apache/kafka/connect/storage/KafkaConfigBackingStore.java: ## @@ -711,9 +768,35 @@ KafkaBasedLog setupAndCreateKafkaBasedLog(Stri

[GitHub] [kafka] fvaleri commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
fvaleri commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094601295 ## tools/src/main/java/org/apache/kafka/tools/DelegationTokenCommand.java: ## @@ -0,0 +1,306 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or mo

[GitHub] [kafka] mumrah commented on pull request #13183: KAFKA-14668 Avoid unnecessary UMR during ZK migration

2023-02-02 Thread via GitHub
mumrah commented on PR #13183: URL: https://github.com/apache/kafka/pull/13183#issuecomment-1413948935 Updates: * Factored out the CompletableFuture from the MetadataChangeEvent so it's only used in the unit test * Removed QueueClosingException, replaced with RejectedExecutionException

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094714174 ## tools/src/test/java/org/apache/kafka/tools/DelegationTokenCommandTest.java: ## @@ -0,0 +1,105 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094720518 ## tools/src/test/java/org/apache/kafka/tools/DelegationTokenCommandTest.java: ## @@ -0,0 +1,105 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] [kafka] fvaleri commented on pull request #13171: KAFKA-14584: Move StateChangeLogMerger tool

2023-02-02 Thread via GitHub
fvaleri commented on PR #13171: URL: https://github.com/apache/kafka/pull/13171#issuecomment-1413963412 Rebased. Thanks @clolov and @mimaison. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Created] (KAFKA-14674) Backport fix for KAFKA-14455 to 3.3 and 3.4 branches

2023-02-02 Thread Chris Egerton (Jira)
Chris Egerton created KAFKA-14674: - Summary: Backport fix for KAFKA-14455 to 3.3 and 3.4 branches Key: KAFKA-14674 URL: https://issues.apache.org/jira/browse/KAFKA-14674 Project: Kafka Issue

[GitHub] [kafka] C0urante merged pull request #12984: KAFKA-14455: Kafka Connect create and update REST APIs should surface failures while writing to the config topic

2023-02-02 Thread via GitHub
C0urante merged PR #12984: URL: https://github.com/apache/kafka/pull/12984 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[GitHub] [kafka] gharris1727 commented on pull request #13184: KAFKA-14671: Refactor PredicatedTransformation to not implement Transformation

2023-02-02 Thread via GitHub
gharris1727 commented on PR #13184: URL: https://github.com/apache/kafka/pull/13184#issuecomment-1414001178 @clolov Perhaps that's where a name change would help. If this was named `TransformationStage`, with a `TransformationChain` made up of multiple `TransformationStage`s and a `Transfor

[GitHub] [kafka] yashmayya commented on pull request #12984: KAFKA-14455: Kafka Connect create and update REST APIs should surface failures while writing to the config topic

2023-02-02 Thread via GitHub
yashmayya commented on PR #12984: URL: https://github.com/apache/kafka/pull/12984#issuecomment-1414002141 Thanks Greg and Chris for the great reviews on this one! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094780253 ## tools/src/main/java/org/apache/kafka/tools/DelegationTokenCommand.java: ## @@ -0,0 +1,306 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or mor

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094781664 ## tools/src/main/java/org/apache/kafka/tools/DelegationTokenCommand.java: ## @@ -0,0 +1,306 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or mor

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094781236 ## tools/src/main/java/org/apache/kafka/tools/DelegationTokenCommand.java: ## @@ -0,0 +1,306 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or mor

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094783703 ## clients/src/test/java/org/apache/kafka/clients/admin/MockAdminClient.java: ## @@ -596,22 +604,89 @@ synchronized public DeleteRecordsResult deleteRecords(Map future

[jira] [Updated] (KAFKA-14671) Refactor PredicatedTransformation to not implement Transformation

2023-02-02 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris updated KAFKA-14671: Description: The PredicatedTransformation [https://github.com/apache/kafka/blob/trunk/connect/run

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094783958 ## clients/src/test/java/org/apache/kafka/clients/admin/MockAdminClient.java: ## @@ -596,22 +604,89 @@ synchronized public DeleteRecordsResult deleteRecords(Map future

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094784273 ## clients/src/test/java/org/apache/kafka/clients/admin/MockAdminClient.java: ## @@ -94,6 +100,8 @@ public class MockAdminClient extends AdminClient { private Map

[jira] [Comment Edited] (KAFKA-14582) Move JmxTool to tools

2023-02-02 Thread Federico Valeri (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17682641#comment-17682641 ] Federico Valeri edited comment on KAFKA-14582 at 2/2/23 4:37 PM: -

[jira] [Comment Edited] (KAFKA-14584) Move StateChangeLogMerger to tools

2023-02-02 Thread Federico Valeri (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17682643#comment-17682643 ] Federico Valeri edited comment on KAFKA-14584 at 2/2/23 4:37 PM: -

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094788715 ## tools/src/main/java/org/apache/kafka/tools/DelegationTokenCommand.java: ## @@ -0,0 +1,306 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or mor

[GitHub] [kafka] mumrah commented on pull request #13180: MINOR: Add a summary of the metadata migration

2023-02-02 Thread via GitHub
mumrah commented on PR #13180: URL: https://github.com/apache/kafka/pull/13180#issuecomment-1414048688 @cmccabe, here's the new metadata summary format: > [2023-02-02 11:21:52,175] TRACE Sending RPCs to broker before moving to dual-write mode. Metadata at offset 122 and epoch 1 in

[GitHub] [kafka] clolov commented on a diff in pull request #13180: MINOR: Add a summary of the metadata migration

2023-02-02 Thread via GitHub
clolov commented on code in PR #13180: URL: https://github.com/apache/kafka/pull/13180#discussion_r1094798424 ## metadata/src/main/java/org/apache/kafka/metadata/migration/KRaftMigrationDriver.java: ## @@ -415,7 +416,7 @@ public void run() throws Exception {

[GitHub] [kafka] shekhar-rajak commented on pull request #12777: Replace EasyMock and PowerMock with Mockito - TimeOrderedWindowStoreTest

2023-02-02 Thread via GitHub
shekhar-rajak commented on PR #12777: URL: https://github.com/apache/kafka/pull/12777#issuecomment-1414050155 Hi, This PR already have one approval and ready to merge. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[GitHub] [kafka] AndrefcBarber commented on pull request #6329: KAFKA-1194: Fix renaming open files on Windows

2023-02-02 Thread via GitHub
AndrefcBarber commented on PR #6329: URL: https://github.com/apache/kafka/pull/6329#issuecomment-1414061654 Hi, trying to sell this great product to our company to resolve streaming. I followed the comments and proposed solutions from Kafka-1194(2016) to present. @robertbraeutigam & @kobihi

[GitHub] [kafka] shekhar-rajak commented on pull request #12739: Replace EasyMock and PowerMock with Mockito | TimeOrderedCachingPersistentWindowStoreTest

2023-02-02 Thread via GitHub
shekhar-rajak commented on PR #12739: URL: https://github.com/apache/kafka/pull/12739#issuecomment-1414078362 Ack. Let me update the PR -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[jira] [Commented] (KAFKA-14139) Replaced disk can lead to loss of committed data even with non-empty ISR

2023-02-02 Thread Calvin Liu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17683497#comment-17683497 ] Calvin Liu commented on KAFKA-14139: Hi Alex, I am not aware of such simulation fram

[GitHub] [kafka] OneCricketeer commented on a diff in pull request #12992: KIP-887: Add ConfigProvider to make use of environment variables

2023-02-02 Thread via GitHub
OneCricketeer commented on code in PR #12992: URL: https://github.com/apache/kafka/pull/12992#discussion_r1094853715 ## clients/src/main/java/org/apache/kafka/common/config/provider/EnvVarConfigProvider.java: ## @@ -0,0 +1,94 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] OneCricketeer commented on a diff in pull request #12992: KIP-887: Add ConfigProvider to make use of environment variables

2023-02-02 Thread via GitHub
OneCricketeer commented on code in PR #12992: URL: https://github.com/apache/kafka/pull/12992#discussion_r1094853715 ## clients/src/main/java/org/apache/kafka/common/config/provider/EnvVarConfigProvider.java: ## @@ -0,0 +1,94 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] mdedetrich commented on pull request #12524: KAFKA-14133: Replace EasyMock with Mockito in streams test

2023-02-02 Thread via GitHub
mdedetrich commented on PR #12524: URL: https://github.com/apache/kafka/pull/12524#issuecomment-1414149629 Sorry I have just been busy with other things, will look into it next week -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [kafka] cmccabe commented on a diff in pull request #13183: KAFKA-14668 Avoid unnecessary UMR during ZK migration

2023-02-02 Thread via GitHub
cmccabe commented on code in PR #13183: URL: https://github.com/apache/kafka/pull/13183#discussion_r1094915210 ## metadata/src/test/java/org/apache/kafka/metadata/migration/KRaftMigrationDriverTest.java: ## @@ -0,0 +1,315 @@ +/* + * Licensed to the Apache Software Foundation (AS

[GitHub] [kafka] cmccabe commented on a diff in pull request #13183: KAFKA-14668 Avoid unnecessary UMR during ZK migration

2023-02-02 Thread via GitHub
cmccabe commented on code in PR #13183: URL: https://github.com/apache/kafka/pull/13183#discussion_r1094918202 ## metadata/src/main/java/org/apache/kafka/metadata/migration/KRaftMigrationDriver.java: ## @@ -538,12 +553,23 @@ public void run() throws Exception {

[GitHub] [kafka] cmccabe commented on a diff in pull request #13183: KAFKA-14668 Avoid unnecessary UMR during ZK migration

2023-02-02 Thread via GitHub
cmccabe commented on code in PR #13183: URL: https://github.com/apache/kafka/pull/13183#discussion_r1094922008 ## metadata/src/test/java/org/apache/kafka/metadata/migration/KRaftMigrationDriverTest.java: ## @@ -0,0 +1,315 @@ +/* + * Licensed to the Apache Software Foundation (AS

[GitHub] [kafka] cmccabe commented on a diff in pull request #13183: KAFKA-14668 Avoid unnecessary UMR during ZK migration

2023-02-02 Thread via GitHub
cmccabe commented on code in PR #13183: URL: https://github.com/apache/kafka/pull/13183#discussion_r1094928271 ## metadata/src/main/java/org/apache/kafka/metadata/migration/KRaftMigrationDriver.java: ## @@ -474,6 +472,7 @@ class MetadataChangeEvent extends MigrationEvent {

[GitHub] [kafka] cmccabe commented on a diff in pull request #13183: KAFKA-14668 Avoid unnecessary UMR during ZK migration

2023-02-02 Thread via GitHub
cmccabe commented on code in PR #13183: URL: https://github.com/apache/kafka/pull/13183#discussion_r1094930020 ## server-common/src/main/java/org/apache/kafka/queue/KafkaEventQueue.java: ## @@ -250,7 +250,7 @@ private void handleEvents() throws InterruptedException {

[jira] [Commented] (KAFKA-12639) AbstractCoordinator ignores backoff timeout when joining the consumer group

2023-02-02 Thread Philip Nee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17683545#comment-17683545 ] Philip Nee commented on KAFKA-12639: Hey [~matiss.gutmanis] - I'm arriving at the sa

[jira] [Comment Edited] (KAFKA-12639) AbstractCoordinator ignores backoff timeout when joining the consumer group

2023-02-02 Thread Philip Nee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17683545#comment-17683545 ] Philip Nee edited comment on KAFKA-12639 at 2/2/23 7:16 PM:

[GitHub] [kafka] vcrfxia opened a new pull request, #13188: KAFKA-14491: [5/N] Support basic operations for RocksDB versioned store

2023-02-02 Thread via GitHub
vcrfxia opened a new pull request, #13188: URL: https://github.com/apache/kafka/pull/13188 (This PR is stacked on https://github.com/apache/kafka/pull/13143; the first commit does not need to be reviewed separately.) Introduces the VersionedKeyValueStore interface proposed in KIP-889,

[GitHub] [kafka] vcrfxia opened a new pull request, #13189: KAFKA-14491: [6/N] Support restoring RocksDB versioned store from changelog

2023-02-02 Thread via GitHub
vcrfxia opened a new pull request, #13189: URL: https://github.com/apache/kafka/pull/13189 (This PR is stacked on https://github.com/apache/kafka/pull/13188, which in turn is stacked on https://github.com/apache/kafka/pull/13143. Only the last commit (`add restore`) needs to be reviewed as

[GitHub] [kafka] Hangleton commented on pull request #13078: KAFKA-13999: Add ProducerCount metrics (KIP-847)

2023-02-02 Thread via GitHub
Hangleton commented on PR #13078: URL: https://github.com/apache/kafka/pull/13078#issuecomment-1414321689 Thanks @anatasiavela for the PR. Apologies for any repeat, just wanted to ask if you would plan to have this merged before or after [PR-13040](https://github.com/apache/kafka/pull/13040

[GitHub] [kafka] philipnee opened a new pull request, #13190: KAFKA-12539: exit upon expired timer to prevent tight looping

2023-02-02 Thread via GitHub
philipnee opened a new pull request, #13190: URL: https://github.com/apache/kafka/pull/13190 In AbstractCoordinator#joinGroupIfNeeded - joinGroup request will be retried without proper backoff, due to the expired timer. This is an uncommon scenario and possibly only appears during the testi

[jira] [Updated] (KAFKA-14490) Consider using UncheckedIOException instead of IOException in the log layer

2023-02-02 Thread Alexandre Dupriez (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexandre Dupriez updated KAFKA-14490: -- Summary: Consider using UncheckedIOException instead of IOException in the log layer

[GitHub] [kafka] Hangleton commented on pull request #12399: KAFKA-14063: Prevent malicious tiny payloads from causing OOMs with variably sized collections

2023-02-02 Thread via GitHub
Hangleton commented on PR #12399: URL: https://github.com/apache/kafka/pull/12399#issuecomment-1414383920 The vulnerability has been addressed by the following commits. - [Apache Kafka 2.8](https://github.com/apache/kafka/commit/14951a83e3fdead212156e5532359500d72f68bc) - [Apache K

[GitHub] [kafka] Hangleton commented on a diff in pull request #13040: KAFKA-14480 Move/Rewrite ProducerStateManager to storage module.

2023-02-02 Thread via GitHub
Hangleton commented on code in PR #13040: URL: https://github.com/apache/kafka/pull/13040#discussion_r1095052846 ## storage/src/main/java/org/apache/kafka/server/log/internals/ProducerStateManager.java: ## @@ -0,0 +1,671 @@ +/* + * Licensed to the Apache Software Foundation (ASF

[GitHub] [kafka] guozhangwang merged pull request #12777: Replace EasyMock and PowerMock with Mockito - TimeOrderedWindowStoreTest

2023-02-02 Thread via GitHub
guozhangwang merged PR #12777: URL: https://github.com/apache/kafka/pull/12777 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.ap

[GitHub] [kafka] guozhangwang commented on pull request #12739: Replace EasyMock and PowerMock with Mockito | TimeOrderedCachingPersistentWindowStoreTest

2023-02-02 Thread via GitHub
guozhangwang commented on PR #12739: URL: https://github.com/apache/kafka/pull/12739#issuecomment-1414532246 @shekhar-rajak please let me know after you've updated the PR incorporating previous comments. -- This is an automated message from the Apache Git Service. To respond to the messag

[jira] [Reopened] (KAFKA-14660) Divide by zero security vulnerability (sonatype-2019-0422)

2023-02-02 Thread Andy Coates (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Coates reopened KAFKA-14660: - The issue here is more the SonaType security vulnerability report than any impossible to reach divi

[jira] [Commented] (KAFKA-14660) Divide by zero security vulnerability (sonatype-2019-0422)

2023-02-02 Thread Andy Coates (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17683597#comment-17683597 ] Andy Coates commented on KAFKA-14660: - [~mjsax] can you provide a link to the PR tha

[jira] [Created] (KAFKA-14675) Extract metadata-related tasks from Fetcher into MetadataFetcher

2023-02-02 Thread Kirk True (Jira)
Kirk True created KAFKA-14675: - Summary: Extract metadata-related tasks from Fetcher into MetadataFetcher Key: KAFKA-14675 URL: https://issues.apache.org/jira/browse/KAFKA-14675 Project: Kafka I

[GitHub] [kafka] hgeraldino opened a new pull request, #13191: KAFKA-14060: Replace EasyMock and PowerMock with Mockito in AbstractWorkerSourceTaskTest

2023-02-02 Thread via GitHub
hgeraldino opened a new pull request, #13191: URL: https://github.com/apache/kafka/pull/13191 This PR is part of the larger initiative of migrating tests from EasyMock/PowerMock to Mockito](https://issues.apache.org/jira/browse/KAFKA-7438), and is a "blocker" of https://issues.apache.org/j

[GitHub] [kafka] ijuma commented on a diff in pull request #13169: KAFKA-14658: Do not open broker ports until we are ready to accept traffic

2023-02-02 Thread via GitHub
ijuma commented on code in PR #13169: URL: https://github.com/apache/kafka/pull/13169#discussion_r1095220913 ## server-common/src/main/java/org/apache/kafka/server/util/FutureUtils.java: ## @@ -66,4 +67,27 @@ public static T waitWithLogging( throw new RuntimeExcept

[jira] [Commented] (KAFKA-12639) AbstractCoordinator ignores backoff timeout when joining the consumer group

2023-02-02 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17683598#comment-17683598 ] Guozhang Wang commented on KAFKA-12639: --- Yeah that would work better I think. > A

[GitHub] [kafka] philipnee commented on pull request #13190: KAFKA-12639: exit upon expired timer to prevent tight looping

2023-02-02 Thread via GitHub
philipnee commented on PR #13190: URL: https://github.com/apache/kafka/pull/13190#issuecomment-1414556430 @guozhangwang - would you have time to review this 🥺 ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [kafka] kirktrue opened a new pull request, #13192: KAFKA-14675: Extract metadata-related tasks from Fetcher into MetadataFetcher

2023-02-02 Thread via GitHub
kirktrue opened a new pull request, #13192: URL: https://github.com/apache/kafka/pull/13192 Extract from `Fetcher` the APIs that are related to metadata operations into a new class named `MetadataFetcher`. This will allow the refactoring of `Fetcher` and `MetadataFetcher` for the new consum

[GitHub] [kafka] kirktrue commented on pull request #13192: KAFKA-14675: Extract metadata-related tasks from Fetcher into MetadataFetcher

2023-02-02 Thread via GitHub
kirktrue commented on PR #13192: URL: https://github.com/apache/kafka/pull/13192#issuecomment-1414573568 cc @hachikuji @rajinisivaram @philipnee -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [kafka] jolshan commented on pull request #13078: KAFKA-13999: Add ProducerCount metrics (KIP-847)

2023-02-02 Thread via GitHub
jolshan commented on PR #13078: URL: https://github.com/apache/kafka/pull/13078#issuecomment-1414580619 @Hangleton We can try to get this merged before https://github.com/apache/kafka/pull/13040 if that helps. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [kafka] jolshan commented on pull request #13078: KAFKA-13999: Add ProducerCount metrics (KIP-847)

2023-02-02 Thread via GitHub
jolshan commented on PR #13078: URL: https://github.com/apache/kafka/pull/13078#issuecomment-1414584410 @ijuma Do you have any concerns with switching to ConcurrentHashMap here? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [kafka] hgeraldino opened a new pull request, #13193: KAFKA-14659 source-record-write-[rate|total] metrics include filtered records

2023-02-02 Thread via GitHub
hgeraldino opened a new pull request, #13193: URL: https://github.com/apache/kafka/pull/13193 This PR aligns the description for `source-record-write-rate` and `source-record-write-total` metrics, and excludes the filtered records from the metrics being published. Today, the `source-

[jira] [Assigned] (KAFKA-14659) source-record-write-[rate|total] metrics include filtered records

2023-02-02 Thread Hector Geraldino (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hector Geraldino reassigned KAFKA-14659: Assignee: Hector Geraldino > source-record-write-[rate|total] metrics include fil

  1   2   >