[GitHub] [kafka] ivanyu commented on a diff in pull request #13067: KAFKA-14524: Rewrite KafkaMetricsGroup in Java

2023-03-06 Thread via GitHub
ivanyu commented on code in PR #13067: URL: https://github.com/apache/kafka/pull/13067#discussion_r1127463069 ## server-common/src/main/java/org/apache/kafka/server/metrics/KafkaMetricsGroup.java: ## @@ -0,0 +1,161 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [kafka] ivanyu commented on pull request #13067: KAFKA-14524: Rewrite KafkaMetricsGroup in Java

2023-03-06 Thread via GitHub
ivanyu commented on PR #13067: URL: https://github.com/apache/kafka/pull/13067#issuecomment-1457689418 Thank you @satishd! I addressed your last comment. > Please have incremental commits instead of a single squashed/merged commit. This is helpful for reviewers to review the

[jira] [Created] (KAFKA-14787) Supports reading ssl certificate files from hdfs

2023-03-06 Thread melin (Jira)
melin created KAFKA-14787: - Summary: Supports reading ssl certificate files from hdfs Key: KAFKA-14787 URL: https://issues.apache.org/jira/browse/KAFKA-14787 Project: Kafka Issue Type: Bug

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13340: KAFKA-14491: [15/N] Add integration tests for versioned stores

2023-03-06 Thread via GitHub
vcrfxia commented on code in PR #13340: URL: https://github.com/apache/kafka/pull/13340#discussion_r1127290672 ## streams/src/test/java/org/apache/kafka/streams/integration/VersionedKeyValueStoreIntegrationTest.java: ## @@ -0,0 +1,592 @@ +/* + * Licensed to the Apache Software

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13292: KAFKA-14491: [14/N] Set changelog topic configs for versioned stores

2023-03-06 Thread via GitHub
vcrfxia commented on code in PR #13292: URL: https://github.com/apache/kafka/pull/13292#discussion_r1127274296 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/InternalTopologyBuilder.java: ## @@ -1293,12 +1306,16 @@ private void

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13292: KAFKA-14491: [14/N] Set changelog topic configs for versioned stores

2023-03-06 Thread via GitHub
vcrfxia commented on code in PR #13292: URL: https://github.com/apache/kafka/pull/13292#discussion_r1127273827 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/InternalTopologyBuilder.java: ## @@ -1293,12 +1306,16 @@ private void

[jira] [Updated] (KAFKA-14371) quorum-state file contains empty/unused clusterId field

2023-03-06 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-14371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio updated KAFKA-14371: --- Fix Version/s: (was: 3.5.0) > quorum-state file contains

[jira] [Reopened] (KAFKA-14371) quorum-state file contains empty/unused clusterId field

2023-03-06 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-14371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio reopened KAFKA-14371: Assignee: (was: Gantigmaa Selenge) > quorum-state file

[GitHub] [kafka] jsancio merged pull request #13355: Revert "KAFKA-14371: Remove unused clusterId field from quorum-state file"

2023-03-06 Thread via GitHub
jsancio merged PR #13355: URL: https://github.com/apache/kafka/pull/13355 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] philipnee commented on a diff in pull request #13303: KAFKA-14761 Adding integration test for the prototype consumer

2023-03-06 Thread via GitHub
philipnee commented on code in PR #13303: URL: https://github.com/apache/kafka/pull/13303#discussion_r1127264709 ## core/src/test/scala/integration/kafka/api/BaseAsyncConsumerTest.scala: ## @@ -0,0 +1,37 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] [kafka] philipnee commented on a diff in pull request #13303: KAFKA-14761 Adding integration test for the prototype consumer

2023-03-06 Thread via GitHub
philipnee commented on code in PR #13303: URL: https://github.com/apache/kafka/pull/13303#discussion_r1127257845 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/PrototypeAsyncConsumerTest.java: ## @@ -16,90 +16,77 @@ */ package

[GitHub] [kafka] philipnee commented on a diff in pull request #13303: KAFKA-14761 Adding integration test for the prototype consumer

2023-03-06 Thread via GitHub
philipnee commented on code in PR #13303: URL: https://github.com/apache/kafka/pull/13303#discussion_r1127256908 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/PrototypeAsyncConsumer.java: ## @@ -226,11 +246,20 @@ public void

[GitHub] [kafka] philipnee commented on a diff in pull request #13303: KAFKA-14761 Adding integration test for the prototype consumer

2023-03-06 Thread via GitHub
philipnee commented on code in PR #13303: URL: https://github.com/apache/kafka/pull/13303#discussion_r1127253922 ## core/src/test/scala/integration/kafka/api/BaseAsyncConsumerTest.scala: ## @@ -0,0 +1,37 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] [kafka] philipnee commented on a diff in pull request #13303: KAFKA-14761 Adding integration test for the prototype consumer

2023-03-06 Thread via GitHub
philipnee commented on code in PR #13303: URL: https://github.com/apache/kafka/pull/13303#discussion_r1127253699 ## core/src/test/scala/integration/kafka/api/BaseAsyncConsumerTest.scala: ## @@ -0,0 +1,37 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] [kafka] philipnee commented on pull request #13303: KAFKA-14761 Adding integration test for the prototype consumer

2023-03-06 Thread via GitHub
philipnee commented on PR #13303: URL: https://github.com/apache/kafka/pull/13303#issuecomment-1457356989 re. @guozhangwang - sorry, I think originally I added 2 tests, then I reduced to 1. Thanks for catching this. For testing poll() - The fetcher isn't available but I could try to

[GitHub] [kafka] philipnee commented on a diff in pull request #13303: KAFKA-14761 Adding integration test for the prototype consumer

2023-03-06 Thread via GitHub
philipnee commented on code in PR #13303: URL: https://github.com/apache/kafka/pull/13303#discussion_r1127252457 ## core/src/test/scala/integration/kafka/api/BaseAsyncConsumerTest.scala: ## @@ -0,0 +1,37 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] [kafka] philipnee commented on a diff in pull request #13303: KAFKA-14761 Adding integration test for the prototype consumer

2023-03-06 Thread via GitHub
philipnee commented on code in PR #13303: URL: https://github.com/apache/kafka/pull/13303#discussion_r1127251663 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/PrototypeAsyncConsumerTest.java: ## @@ -16,90 +16,77 @@ */ package

[GitHub] [kafka] philipnee commented on a diff in pull request #13303: KAFKA-14761 Adding integration test for the prototype consumer

2023-03-06 Thread via GitHub
philipnee commented on code in PR #13303: URL: https://github.com/apache/kafka/pull/13303#discussion_r1127250227 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/PrototypeAsyncConsumerTest.java: ## @@ -16,90 +16,77 @@ */ package

[GitHub] [kafka] mjsax commented on a diff in pull request #13292: KAFKA-14491: [14/N] Set changelog topic configs for versioned stores

2023-03-06 Thread via GitHub
mjsax commented on code in PR #13292: URL: https://github.com/apache/kafka/pull/13292#discussion_r1127245620 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/InternalTopologyBuilder.java: ## @@ -1293,12 +1306,16 @@ private void

[GitHub] [kafka] jsancio commented on a diff in pull request #13355: Revert "KAFKA-14371: Remove unused clusterId field from quorum-state file"

2023-03-06 Thread via GitHub
jsancio commented on code in PR #13355: URL: https://github.com/apache/kafka/pull/13355#discussion_r1127245225 ## raft/src/main/resources/common/message/QuorumStateData.json: ## @@ -16,10 +16,10 @@ { "type": "data", "name": "QuorumStateData", - // Version 1 removes

[GitHub] [kafka] jsancio commented on a diff in pull request #13355: Revert "KAFKA-14371: Remove unused clusterId field from quorum-state file"

2023-03-06 Thread via GitHub
jsancio commented on code in PR #13355: URL: https://github.com/apache/kafka/pull/13355#discussion_r1127237201 ## raft/src/main/resources/common/message/QuorumStateData.json: ## @@ -16,10 +16,10 @@ { "type": "data", "name": "QuorumStateData", - // Version 1 removes

[GitHub] [kafka] showuon commented on a diff in pull request #13355: Revert "KAFKA-14371: Remove unused clusterId field from quorum-state file"

2023-03-06 Thread via GitHub
showuon commented on code in PR #13355: URL: https://github.com/apache/kafka/pull/13355#discussion_r1127240280 ## raft/src/main/resources/common/message/QuorumStateData.json: ## @@ -16,10 +16,10 @@ { "type": "data", "name": "QuorumStateData", - // Version 1 removes

[GitHub] [kafka] showuon commented on a diff in pull request #13355: Revert "KAFKA-14371: Remove unused clusterId field from quorum-state file"

2023-03-06 Thread via GitHub
showuon commented on code in PR #13355: URL: https://github.com/apache/kafka/pull/13355#discussion_r1127240280 ## raft/src/main/resources/common/message/QuorumStateData.json: ## @@ -16,10 +16,10 @@ { "type": "data", "name": "QuorumStateData", - // Version 1 removes

[GitHub] [kafka] showuon commented on a diff in pull request #13355: Revert "KAFKA-14371: Remove unused clusterId field from quorum-state file"

2023-03-06 Thread via GitHub
showuon commented on code in PR #13355: URL: https://github.com/apache/kafka/pull/13355#discussion_r1127240280 ## raft/src/main/resources/common/message/QuorumStateData.json: ## @@ -16,10 +16,10 @@ { "type": "data", "name": "QuorumStateData", - // Version 1 removes

[GitHub] [kafka] jsancio commented on a diff in pull request #13355: Revert "KAFKA-14371: Remove unused clusterId field from quorum-state file"

2023-03-06 Thread via GitHub
jsancio commented on code in PR #13355: URL: https://github.com/apache/kafka/pull/13355#discussion_r1127237201 ## raft/src/main/resources/common/message/QuorumStateData.json: ## @@ -16,10 +16,10 @@ { "type": "data", "name": "QuorumStateData", - // Version 1 removes

[GitHub] [kafka] mjsax merged pull request #13274: KAFKA-14491: [13/N] Add versioned store builder and materializer

2023-03-06 Thread via GitHub
mjsax merged PR #13274: URL: https://github.com/apache/kafka/pull/13274 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] satishd commented on pull request #13067: KAFKA-14524: Rewrite KafkaMetricsGroup in Java

2023-03-06 Thread via GitHub
satishd commented on PR #13067: URL: https://github.com/apache/kafka/pull/13067#issuecomment-1457307583 @ivanyu Please have incremental commits instead of a single squashed/merged commit. This is helpful for reviewers to review the incremental changes done in the PR that address the review

[GitHub] [kafka] showuon commented on pull request #13102: KAFKA-14371: Remove unused clusterId field from quorum-state file

2023-03-06 Thread via GitHub
showuon commented on PR #13102: URL: https://github.com/apache/kafka/pull/13102#issuecomment-1457302953 Nice catch @jsancio ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [kafka] satishd commented on a diff in pull request #13067: KAFKA-14524: Rewrite KafkaMetricsGroup in Java

2023-03-06 Thread via GitHub
satishd commented on code in PR #13067: URL: https://github.com/apache/kafka/pull/13067#discussion_r1127226556 ## server-common/src/main/java/org/apache/kafka/server/metrics/KafkaMetricsGroup.java: ## @@ -0,0 +1,161 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [kafka] satishd commented on a diff in pull request #13067: KAFKA-14524: Rewrite KafkaMetricsGroup in Java

2023-03-06 Thread via GitHub
satishd commented on code in PR #13067: URL: https://github.com/apache/kafka/pull/13067#discussion_r1127222852 ## server-common/src/main/java/org/apache/kafka/server/metrics/KafkaMetricsGroup.java: ## @@ -0,0 +1,161 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [kafka] gharris1727 opened a new pull request, #13356: MINOR: Exclude ServiceLoaded plugins after scanning instead of hiding resource file

2023-03-06 Thread via GitHub
gharris1727 opened a new pull request, #13356: URL: https://github.com/apache/kafka/pull/13356 This will allow classpath ConfigProvider and ConnectRestExtension to appear in ServiceLoader results from within plugins, without discovering them as isolated plugins *More detailed

[GitHub] [kafka] ijuma commented on a diff in pull request #13116: KAFKA-14351: Controller Mutation Quota for KRaft

2023-03-06 Thread via GitHub
ijuma commented on code in PR #13116: URL: https://github.com/apache/kafka/pull/13116#discussion_r1127213105 ## core/src/test/scala/unit/kafka/utils/TestUtils.scala: ## @@ -378,6 +378,118 @@ object TestUtils extends Logging { props } + def

[GitHub] [kafka] cmccabe commented on a diff in pull request #13355: Revert "KAFKA-14371: Remove unused clusterId field from quorum-state file"

2023-03-06 Thread via GitHub
cmccabe commented on code in PR #13355: URL: https://github.com/apache/kafka/pull/13355#discussion_r1127208396 ## raft/src/main/resources/common/message/QuorumStateData.json: ## @@ -16,10 +16,10 @@ { "type": "data", "name": "QuorumStateData", - // Version 1 removes

[GitHub] [kafka] cmccabe commented on a diff in pull request #13355: Revert "KAFKA-14371: Remove unused clusterId field from quorum-state file"

2023-03-06 Thread via GitHub
cmccabe commented on code in PR #13355: URL: https://github.com/apache/kafka/pull/13355#discussion_r1127208396 ## raft/src/main/resources/common/message/QuorumStateData.json: ## @@ -16,10 +16,10 @@ { "type": "data", "name": "QuorumStateData", - // Version 1 removes

[GitHub] [kafka] cmccabe commented on pull request #13116: KAFKA-14351: Controller Mutation Quota for KRaft

2023-03-06 Thread via GitHub
cmccabe commented on PR #13116: URL: https://github.com/apache/kafka/pull/13116#issuecomment-1457277048 Thanks for the PR, @rondagostino . You've been very patient here and I'm sorry that the review wasn't quicker. We did a major pivot from implementing the quota in `ControllerApis` like I

[GitHub] [kafka] kirktrue commented on a diff in pull request #12813: KAFKA-14317: ProduceRequest timeouts are logged as network exceptions

2023-03-06 Thread via GitHub
kirktrue commented on code in PR #12813: URL: https://github.com/apache/kafka/pull/12813#discussion_r1127204081 ## clients/src/main/java/org/apache/kafka/clients/NetworkClient.java: ## @@ -324,11 +324,14 @@ public void disconnect(String nodeId) { log.info("Client

[GitHub] [kafka] cmccabe commented on a diff in pull request #13116: KAFKA-14351: Controller Mutation Quota for KRaft

2023-03-06 Thread via GitHub
cmccabe commented on code in PR #13116: URL: https://github.com/apache/kafka/pull/13116#discussion_r1127197623 ## metadata/src/main/java/org/apache/kafka/controller/ControllerRequestContext.java: ## @@ -42,19 +45,39 @@ public static OptionalLong requestTimeoutMsToDeadlineNs(

[GitHub] [kafka] cmccabe commented on a diff in pull request #13116: KAFKA-14351: Controller Mutation Quota for KRaft

2023-03-06 Thread via GitHub
cmccabe commented on code in PR #13116: URL: https://github.com/apache/kafka/pull/13116#discussion_r1127191979 ## core/src/test/scala/unit/kafka/utils/TestUtils.scala: ## @@ -378,6 +378,118 @@ object TestUtils extends Logging { props } + def

[GitHub] [kafka] cmccabe commented on a diff in pull request #13116: KAFKA-14351: Controller Mutation Quota for KRaft

2023-03-06 Thread via GitHub
cmccabe commented on code in PR #13116: URL: https://github.com/apache/kafka/pull/13116#discussion_r1127191300 ## core/src/test/scala/unit/kafka/utils/TestUtils.scala: ## @@ -378,6 +378,118 @@ object TestUtils extends Logging { props } + def

[GitHub] [kafka] cmccabe commented on a diff in pull request #13116: KAFKA-14351: Controller Mutation Quota for KRaft

2023-03-06 Thread via GitHub
cmccabe commented on code in PR #13116: URL: https://github.com/apache/kafka/pull/13116#discussion_r1127191300 ## core/src/test/scala/unit/kafka/utils/TestUtils.scala: ## @@ -378,6 +378,118 @@ object TestUtils extends Logging { props } + def

[GitHub] [kafka] guozhangwang commented on a diff in pull request #13303: KAFKA-14761 Adding integration test for the prototype consumer

2023-03-06 Thread via GitHub
guozhangwang commented on code in PR #13303: URL: https://github.com/apache/kafka/pull/13303#discussion_r1127185285 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/NetworkClientDelegate.java: ## @@ -213,7 +215,7 @@ public UnsentRequest(

[GitHub] [kafka] cmccabe commented on a diff in pull request #13116: KAFKA-14351: Controller Mutation Quota for KRaft

2023-03-06 Thread via GitHub
cmccabe commented on code in PR #13116: URL: https://github.com/apache/kafka/pull/13116#discussion_r1127186242 ## core/src/test/scala/unit/kafka/server/DynamicBrokerConfigTest.scala: ## @@ -479,6 +489,42 @@ class DynamicBrokerConfigTest { assertEquals("User:admin",

[GitHub] [kafka] cmccabe commented on a diff in pull request #13116: KAFKA-14351: Controller Mutation Quota for KRaft

2023-03-06 Thread via GitHub
cmccabe commented on code in PR #13116: URL: https://github.com/apache/kafka/pull/13116#discussion_r1127186242 ## core/src/test/scala/unit/kafka/server/DynamicBrokerConfigTest.scala: ## @@ -479,6 +489,42 @@ class DynamicBrokerConfigTest { assertEquals("User:admin",

[GitHub] [kafka] cmccabe commented on a diff in pull request #13116: KAFKA-14351: Controller Mutation Quota for KRaft

2023-03-06 Thread via GitHub
cmccabe commented on code in PR #13116: URL: https://github.com/apache/kafka/pull/13116#discussion_r1127182652 ## core/src/main/scala/kafka/server/metadata/DynamicClientQuotaPublisher.scala: ## @@ -0,0 +1,82 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one

[jira] [Commented] (KAFKA-14778) Kafka Streams 2.7.1 to 3.3.1 rolling upgrade with static membership triggers a rebalance

2023-03-06 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697181#comment-17697181 ] Matthias J. Sax commented on KAFKA-14778: - Thanks for reporting this. – I believe the issue is

[GitHub] [kafka] cmccabe commented on a diff in pull request #13116: KAFKA-14351: Controller Mutation Quota for KRaft

2023-03-06 Thread via GitHub
cmccabe commented on code in PR #13116: URL: https://github.com/apache/kafka/pull/13116#discussion_r1127176224 ## core/src/main/scala/kafka/server/DynamicBrokerConfig.scala: ## @@ -730,6 +744,45 @@ class DynamicThreadPool(server: KafkaBroker) extends BrokerReconfigurable {

[GitHub] [kafka] cmccabe commented on a diff in pull request #13116: KAFKA-14351: Controller Mutation Quota for KRaft

2023-03-06 Thread via GitHub
cmccabe commented on code in PR #13116: URL: https://github.com/apache/kafka/pull/13116#discussion_r1127176972 ## core/src/main/scala/kafka/server/DynamicBrokerConfig.scala: ## @@ -911,7 +954,22 @@ object DynamicListenerConfig { ) } -class

[GitHub] [kafka] cmccabe commented on a diff in pull request #13116: KAFKA-14351: Controller Mutation Quota for KRaft

2023-03-06 Thread via GitHub
cmccabe commented on code in PR #13116: URL: https://github.com/apache/kafka/pull/13116#discussion_r1127179616 ## core/src/test/java/kafka/test/MockController.java: ## @@ -181,10 +194,16 @@ public CompletableFuture unregisterBroker( static class MockTopic {

[GitHub] [kafka] cmccabe commented on a diff in pull request #13116: KAFKA-14351: Controller Mutation Quota for KRaft

2023-03-06 Thread via GitHub
cmccabe commented on code in PR #13116: URL: https://github.com/apache/kafka/pull/13116#discussion_r1127176972 ## core/src/main/scala/kafka/server/DynamicBrokerConfig.scala: ## @@ -911,7 +954,22 @@ object DynamicListenerConfig { ) } -class

[GitHub] [kafka] cmccabe commented on a diff in pull request #13116: KAFKA-14351: Controller Mutation Quota for KRaft

2023-03-06 Thread via GitHub
cmccabe commented on code in PR #13116: URL: https://github.com/apache/kafka/pull/13116#discussion_r1127176224 ## core/src/main/scala/kafka/server/DynamicBrokerConfig.scala: ## @@ -730,6 +744,45 @@ class DynamicThreadPool(server: KafkaBroker) extends BrokerReconfigurable {

[jira] [Updated] (KAFKA-14722) Make BooleanSerde public

2023-03-06 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14722: Description: KIP-907:

[jira] [Updated] (KAFKA-14722) Make BooleanSerde public

2023-03-06 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14722: Labels: beginner kip newbie (was: beginner need-kip newbie) > Make BooleanSerde public >

[jira] [Updated] (KAFKA-12446) Define KGroupedTable#aggregate subtractor + adder order of execution

2023-03-06 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-12446: Description: KIP-904:

[jira] [Updated] (KAFKA-12446) Define KGroupedTable#aggregate subtractor + adder order of execution

2023-03-06 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-12446: Labels: kip (was: ) > Define KGroupedTable#aggregate subtractor + adder order of

[jira] [Commented] (KAFKA-13882) Dockerfile for previewing website

2023-03-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697175#comment-17697175 ] ASF GitHub Bot commented on KAFKA-13882: mjsax commented on PR #410: URL:

[jira] [Commented] (KAFKA-14748) Relax non-null FK left-join requirement

2023-03-06 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697167#comment-17697167 ] Guozhang Wang commented on KAFKA-14748: --- Cool! We are on the same page for the first question

[jira] [Commented] (KAFKA-14371) quorum-state file contains empty/unused clusterId field

2023-03-06 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-14371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697165#comment-17697165 ] José Armando García Sancio commented on KAFKA-14371: Even though the KRaft logic

[jira] [Updated] (KAFKA-14371) quorum-state file contains empty/unused clusterId field

2023-03-06 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-14371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio updated KAFKA-14371: --- Labels: needs-kip (was: ) > quorum-state file contains

[GitHub] [kafka] jsancio commented on pull request #13355: Revert "KAFKA-14371: Remove unused clusterId field from quorum-state file"

2023-03-06 Thread via GitHub
jsancio commented on PR #13355: URL: https://github.com/apache/kafka/pull/13355#issuecomment-1457165155 This PR reverts https://github.com/apache/kafka/pull/13102 Reason for the revert is documented here: https://github.com/apache/kafka/pull/13102#issuecomment-1457138403 -- This

[GitHub] [kafka] jsancio opened a new pull request, #13355: Revert "KAFKA-14371: Remove unused clusterId field from quorum-state file"

2023-03-06 Thread via GitHub
jsancio opened a new pull request, #13355: URL: https://github.com/apache/kafka/pull/13355 This reverts commit 0927049a617fa2937a211aab895f6590403130fb. ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and

[GitHub] [kafka] jsancio commented on pull request #13102: KAFKA-14371: Remove unused clusterId field from quorum-state file

2023-03-06 Thread via GitHub
jsancio commented on PR #13102: URL: https://github.com/apache/kafka/pull/13102#issuecomment-1457138403 I was thinking about this change today and realized that this change is not backwards compatible. For example, the user upgrades the cluster and then they downgrade the cluster, it will

[jira] [Commented] (KAFKA-13882) Dockerfile for previewing website

2023-03-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697160#comment-17697160 ] ASF GitHub Bot commented on KAFKA-13882: qingwei91 commented on PR #410: URL:

[jira] [Created] (KAFKA-14786) Implement connector offset write/reset internal logic

2023-03-06 Thread Chris Egerton (Jira)
Chris Egerton created KAFKA-14786: - Summary: Implement connector offset write/reset internal logic Key: KAFKA-14786 URL: https://issues.apache.org/jira/browse/KAFKA-14786 Project: Kafka

[jira] [Created] (KAFKA-14784) Implement connector offset reset REST API

2023-03-06 Thread Chris Egerton (Jira)
Chris Egerton created KAFKA-14784: - Summary: Implement connector offset reset REST API Key: KAFKA-14784 URL: https://issues.apache.org/jira/browse/KAFKA-14784 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-14785) Implement connector offset read REST API

2023-03-06 Thread Chris Egerton (Jira)
Chris Egerton created KAFKA-14785: - Summary: Implement connector offset read REST API Key: KAFKA-14785 URL: https://issues.apache.org/jira/browse/KAFKA-14785 Project: Kafka Issue Type:

[jira] [Updated] (KAFKA-14368) Implement connector offset write REST API

2023-03-06 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton updated KAFKA-14368: -- Component/s: KafkaConnect > Implement connector offset write REST API >

[jira] [Updated] (KAFKA-14368) Implement connector offset write REST API

2023-03-06 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton updated KAFKA-14368: -- Summary: Implement connector offset write REST API (was: Add an offset write REST API to

[jira] [Commented] (KAFKA-14368) Add an offset write REST API to Kafka Connect

2023-03-06 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697157#comment-17697157 ] Chris Egerton commented on KAFKA-14368: --- [~yash.mayya] Given the updates to KIP-875, I've

[jira] [Updated] (KAFKA-14368) Add an offset write REST API to Kafka Connect

2023-03-06 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton updated KAFKA-14368: -- Labels: (was: kip-required) > Add an offset write REST API to Kafka Connect >

[jira] [Updated] (KAFKA-14368) Add an offset write REST API to Kafka Connect

2023-03-06 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton updated KAFKA-14368: -- Description: Implement the {{PATCH /connectors/name/offsets}} endpoint [described in

[jira] [Created] (KAFKA-14783) Implement new STOPPED state for connectors

2023-03-06 Thread Chris Egerton (Jira)
Chris Egerton created KAFKA-14783: - Summary: Implement new STOPPED state for connectors Key: KAFKA-14783 URL: https://issues.apache.org/jira/browse/KAFKA-14783 Project: Kafka Issue Type:

[jira] [Updated] (KAFKA-14783) Implement new STOPPED state for connectors

2023-03-06 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton updated KAFKA-14783: -- Parent: KAFKA-4107 Issue Type: Sub-task (was: Task) > Implement new STOPPED state

[jira] [Updated] (KAFKA-14368) Add an offset write REST API to Kafka Connect

2023-03-06 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton updated KAFKA-14368: -- Parent: KAFKA-4107 Issue Type: Sub-task (was: New Feature) > Add an offset write

[GitHub] [kafka] philipnee opened a new pull request, #13354: KAFKA-14753: Improve kafka producer example

2023-03-06 Thread via GitHub
philipnee opened a new pull request, #13354: URL: https://github.com/apache/kafka/pull/13354 The current kafka producer example needs a bit of improvement, in particular: 1. documentation is lacking 2. it is not closing correctly 3. Code can be cleaner -- This is an automated

[GitHub] [kafka] philipnee commented on pull request #13353: KAFKA-14752: Improving the existing consumer examples

2023-03-06 Thread via GitHub
philipnee commented on PR #13353: URL: https://github.com/apache/kafka/pull/13353#issuecomment-1457033568 This is the snippet of the log: ``` Subscribe to:topic1 ... Assigning partitions:[topic1-0] ... DemoConsumer finished reading 1 messages Revoking

[GitHub] [kafka] philipnee opened a new pull request, #13353: KAFKA-14752: Improving the existing consumer examples

2023-03-06 Thread via GitHub
philipnee opened a new pull request, #13353: URL: https://github.com/apache/kafka/pull/13353 The changes include: 1. Documentation changes 2. Closing mechanism 3. Adding a rebalance listener (to print partition changes when rebalance is happening) 4. Fixing a few errors cc

[GitHub] [kafka] philipnee commented on pull request #13303: KAFKA-14761 Adding integration test for the prototype consumer

2023-03-06 Thread via GitHub
philipnee commented on PR #13303: URL: https://github.com/apache/kafka/pull/13303#issuecomment-1457022169 Thanks for reviewing this, @rajinisivaram - fixes are on the way. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [kafka] philipnee commented on a diff in pull request #13303: KAFKA-14761 Adding integration test for the prototype consumer

2023-03-06 Thread via GitHub
philipnee commented on code in PR #13303: URL: https://github.com/apache/kafka/pull/13303#discussion_r1127046532 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/PrototypeAsyncConsumer.java: ## @@ -83,12 +92,23 @@ private final Metrics metrics;

[GitHub] [kafka] philipnee commented on a diff in pull request #13303: KAFKA-14761 Adding integration test for the prototype consumer

2023-03-06 Thread via GitHub
philipnee commented on code in PR #13303: URL: https://github.com/apache/kafka/pull/13303#discussion_r1127043244 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/PrototypeAsyncConsumer.java: ## @@ -226,11 +246,20 @@ public void

[GitHub] [kafka] rajinisivaram commented on a diff in pull request #13303: KAFKA-14761 Adding integration test for the prototype consumer

2023-03-06 Thread via GitHub
rajinisivaram commented on code in PR #13303: URL: https://github.com/apache/kafka/pull/13303#discussion_r1126983650 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/PrototypeAsyncConsumer.java: ## @@ -83,12 +92,23 @@ private final Metrics metrics;

[GitHub] [kafka] jolshan commented on a diff in pull request #13323: KAFKA-14617; Add ReplicaState to FetchRequest.

2023-03-06 Thread via GitHub
jolshan commented on code in PR #13323: URL: https://github.com/apache/kafka/pull/13323#discussion_r1126944890 ## clients/src/main/java/org/apache/kafka/common/requests/FetchRequest.java: ## @@ -337,8 +362,27 @@ public AbstractResponse getErrorResponse(int throttleTimeMs,

[GitHub] [kafka] jolshan commented on pull request #13352: Add support of topic ids for the OffsetFetch API from version 9.

2023-03-06 Thread via GitHub
jolshan commented on PR #13352: URL: https://github.com/apache/kafka/pull/13352#issuecomment-1456837604 Let me know if you have any topic ID questions @Hangleton -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [kafka] jolshan commented on a diff in pull request #13329: KAFKA-14462; [2/N] Add ConsumerGroupHeartbeart to GroupCoordinator interface

2023-03-06 Thread via GitHub
jolshan commented on code in PR #13329: URL: https://github.com/apache/kafka/pull/13329#discussion_r1126927374 ## core/src/main/scala/kafka/coordinator/group/GroupCoordinatorAdapter.scala: ## @@ -62,6 +63,15 @@ private[group] class GroupCoordinatorAdapter( private val time:

[GitHub] [kafka] cmccabe merged pull request #13331: MINOR: fix fault handling in ControllerServer and KafkaServer

2023-03-06 Thread via GitHub
cmccabe merged PR #13331: URL: https://github.com/apache/kafka/pull/13331 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] dajac commented on a diff in pull request #13329: KAFKA-14462; [2/N] Add ConsumerGroupHeartbeart to GroupCoordinator interface

2023-03-06 Thread via GitHub
dajac commented on code in PR #13329: URL: https://github.com/apache/kafka/pull/13329#discussion_r1126922151 ## core/src/main/scala/kafka/coordinator/group/GroupCoordinatorAdapter.scala: ## @@ -62,6 +63,15 @@ private[group] class GroupCoordinatorAdapter( private val time:

[GitHub] [kafka] jolshan commented on a diff in pull request #13329: KAFKA-14462; [2/N] Add ConsumerGroupHeartbeart to GroupCoordinator interface

2023-03-06 Thread via GitHub
jolshan commented on code in PR #13329: URL: https://github.com/apache/kafka/pull/13329#discussion_r1126921525 ## core/src/test/scala/unit/kafka/server/ConsumerGroupHeartbeatRequestTest.scala: ## @@ -54,6 +54,20 @@ class ConsumerGroupHeartbeatRequestTest(cluster:

[GitHub] [kafka] dajac commented on a diff in pull request #13329: KAFKA-14462; [2/N] Add ConsumerGroupHeartbeart to GroupCoordinator interface

2023-03-06 Thread via GitHub
dajac commented on code in PR #13329: URL: https://github.com/apache/kafka/pull/13329#discussion_r1126920827 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -3573,9 +3573,27 @@ class KafkaApis(val requestChannel: RequestChannel, def

[GitHub] [kafka] jolshan commented on a diff in pull request #13329: KAFKA-14462; [2/N] Add ConsumerGroupHeartbeart to GroupCoordinator interface

2023-03-06 Thread via GitHub
jolshan commented on code in PR #13329: URL: https://github.com/apache/kafka/pull/13329#discussion_r1126919357 ## core/src/main/scala/kafka/coordinator/group/GroupCoordinatorAdapter.scala: ## @@ -62,6 +63,15 @@ private[group] class GroupCoordinatorAdapter( private val time:

[jira] [Commented] (KAFKA-13882) Dockerfile for previewing website

2023-03-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697103#comment-17697103 ] ASF GitHub Bot commented on KAFKA-13882: qingwei91 commented on PR #410: URL:

[GitHub] [kafka] Hangleton opened a new pull request, #13352: Add support of topic ids for the OffsetFetch API from version 9.

2023-03-06 Thread via GitHub
Hangleton opened a new pull request, #13352: URL: https://github.com/apache/kafka/pull/13352 WIP. ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation

[GitHub] [kafka] rondagostino commented on a diff in pull request #13331: MINOR: fix fault handling in ControllerServer and KafkaServer

2023-03-06 Thread via GitHub
rondagostino commented on code in PR #13331: URL: https://github.com/apache/kafka/pull/13331#discussion_r1126859142 ## core/src/main/scala/kafka/server/SharedServer.scala: ## @@ -170,6 +170,17 @@ class SharedServer( snapshotsDiabledReason.compareAndSet(null, "metadata

[GitHub] [kafka] mimaison commented on pull request #13157: KAFKA-14599 Enable javadoc for :connect:mirror module

2023-03-06 Thread via GitHub
mimaison commented on PR #13157: URL: https://github.com/apache/kafka/pull/13157#issuecomment-1456709095 Sorry for the delay. I _think_ you technically don't necessarily need to have transitive dependencies in the classpath to compile a class. For example, it is possible to build a custom

[jira] [Commented] (KAFKA-13882) Dockerfile for previewing website

2023-03-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697070#comment-17697070 ] ASF GitHub Bot commented on KAFKA-13882: mimaison commented on PR #410: URL:

[GitHub] [kafka] C0urante commented on pull request #13351: KAFKA-14781: Downgrade MM2 log message severity when no ACL authorizer is configured on source broker

2023-03-06 Thread via GitHub
C0urante commented on PR #13351: URL: https://github.com/apache/kafka/pull/13351#issuecomment-1456617781 @mimaison would you mind taking a look? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [kafka] C0urante opened a new pull request, #13351: KAFKA-14781: Downgrade MM2 log message severity when no ACL authorizer is configured on source broker

2023-03-06 Thread via GitHub
C0urante opened a new pull request, #13351: URL: https://github.com/apache/kafka/pull/13351 [Jira](https://issues.apache.org/jira/browse/KAFKA-14781) Instead of logging an `ERROR`-level message when topic syncing is enabled (which it is by default) and no ACL authorizer is configured

[GitHub] [kafka] mimaison merged pull request #13212: MINOR: Remove accidental unnecessary code; fix comment references

2023-03-06 Thread via GitHub
mimaison merged PR #13212: URL: https://github.com/apache/kafka/pull/13212 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] mimaison merged pull request #13215: KAFKA-14578: Move ConsumerPerformance to tools

2023-03-06 Thread via GitHub
mimaison merged PR #13215: URL: https://github.com/apache/kafka/pull/13215 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] rajinisivaram opened a new pull request, #13350: KAFKA-14452: Make sticky assignors rack-aware if client rack is configured (KIP-881)

2023-03-06 Thread via GitHub
rajinisivaram opened a new pull request, #13350: URL: https://github.com/apache/kafka/pull/13350 Best-effort rack alignment for sticky assignors when both consumer racks and partition racks are available with the protocol changes introduced in KIP-881. Rack-aware assignment is enabled by

[jira] [Assigned] (KAFKA-14781) MM2 logs misleading error during topic ACL sync when broker does not have authorizer configured

2023-03-06 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton reassigned KAFKA-14781: - Assignee: Chris Egerton > MM2 logs misleading error during topic ACL sync when broker

[GitHub] [kafka] rajinisivaram opened a new pull request, #13349: KAFKA-14452: Refactor AbstractStickyAssignor to prepare for rack-aware assignment

2023-03-06 Thread via GitHub
rajinisivaram opened a new pull request, #13349: URL: https://github.com/apache/kafka/pull/13349 This PR refactors AbstractStickyAssignor without changing any logic to make it easier to add rack-awareness. The class currently consists of a lot of collections that are passed around various

  1   2   >