Re: [PR] KAFKA-16563: retry pollEvent in KRaftMigrationDriver for retriable errors [kafka]

2024-04-21 Thread via GitHub
showuon commented on PR #15732: URL: https://github.com/apache/kafka/pull/15732#issuecomment-2068407055 @akhileshchg @mumrah @cmccabe , could you take a look when available. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] KAFKA-16424: remove truncated logs after alter dir [kafka]

2024-04-21 Thread via GitHub
showuon commented on code in PR #15616: URL: https://github.com/apache/kafka/pull/15616#discussion_r1574049613 ## core/src/test/scala/unit/kafka/server/AlterReplicaLogDirsRequestTest.scala: ## @@ -116,6 +123,57 @@ class AlterReplicaLogDirsRequestTest extends BaseRequestTest {

[jira] [Comment Edited] (KAFKA-16514) Kafka Streams: stream.close(CloseOptions) does not respect options.leaveGroup flag.

2024-04-21 Thread Sal Sorrentino (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839452#comment-17839452 ] Sal Sorrentino edited comment on KAFKA-16514 at 4/22/24 2:13 AM: - IMHO:

[jira] [Comment Edited] (KAFKA-16514) Kafka Streams: stream.close(CloseOptions) does not respect options.leaveGroup flag.

2024-04-21 Thread Sal Sorrentino (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839452#comment-17839452 ] Sal Sorrentino edited comment on KAFKA-16514 at 4/22/24 2:10 AM: - IMHO:

[jira] [Commented] (KAFKA-16514) Kafka Streams: stream.close(CloseOptions) does not respect options.leaveGroup flag.

2024-04-21 Thread Sal Sorrentino (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839452#comment-17839452 ] Sal Sorrentino commented on KAFKA-16514: IMHO: I think if you have a replication factor of 0 and

[jira] [Commented] (KAFKA-16514) Kafka Streams: stream.close(CloseOptions) does not respect options.leaveGroup flag.

2024-04-21 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839441#comment-17839441 ] Matthias J. Sax commented on KAFKA-16514: - You are right that there is alway a member-id etc – I

[jira] [Commented] (KAFKA-16567) Add New Stream Metrics based on KIP-869

2024-04-21 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839440#comment-17839440 ] Matthias J. Sax commented on KAFKA-16567: - I see – this raises a few questions... Given that

Re: [PR] KAFKA-16483: migrate DeleteOffsetsConsumerGroupCommandIntegrationTest to use ClusterTestExtensions [kafka]

2024-04-21 Thread via GitHub
FrankYang0529 commented on code in PR #15679: URL: https://github.com/apache/kafka/pull/15679#discussion_r1574007862 ## tools/src/test/java/org/apache/kafka/tools/consumer/group/DeleteOffsetsConsumerGroupCommandIntegrationTest.java: ## @@ -173,7 +208,11 @@ private void

[PR] Move KRAFT configs out of KafkaConfig [kafka]

2024-04-21 Thread via GitHub
OmniaGM opened a new pull request, #15775: URL: https://github.com/apache/kafka/pull/15775 - Move all Kraft configs/docs/defaults into `KRaftConfigs`. - Note: We have already `RaftConfig` but it seems to contain limited amount of configs that only configure `controller` raft and

[PR] KAFKA-15853: Move quota configs into server-common package [kafka]

2024-04-21 Thread via GitHub
OmniaGM opened a new pull request, #15774: URL: https://github.com/apache/kafka/pull/15774 - Pull all quota configs from `KafkaConfig`, `DynamicConfig` and `LogConfig` into `ServerQuotaConfigs` in `server-commons` as replication configs are shared between server, storage and tools

Re: [PR] KAFKA-15853: Move socket configs into org.apache.kafka.network.SocketServerConfigs [kafka]

2024-04-21 Thread via GitHub
OmniaGM commented on code in PR #15772: URL: https://github.com/apache/kafka/pull/15772#discussion_r1573897839 ## server/src/main/java/org/apache/kafka/network/SocketServerConfigs.java: ## @@ -0,0 +1,146 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

Re: [PR] Fix typo [kafka]

2024-04-21 Thread via GitHub
Janmm14 commented on PR #15743: URL: https://github.com/apache/kafka/pull/15743#issuecomment-2068177862 @ijuma Apache CI might've run untrusted 3rd party code . -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] KAFKA-15853: Move socket configs into org.apache.kafka.network.SocketServerConfigs [kafka]

2024-04-21 Thread via GitHub
chia7712 commented on code in PR #15772: URL: https://github.com/apache/kafka/pull/15772#discussion_r1573880096 ## server/src/main/java/org/apache/kafka/network/SocketServerConfigs.java: ## @@ -0,0 +1,146 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

Re: [PR] KAFKA-16356 RemoteLogMetadataSerde: Serializer via class-name dispatch removed and replaced with if-elseif-else conditions [kafka]

2024-04-21 Thread via GitHub
linu-shibu commented on PR #15620: URL: https://github.com/apache/kafka/pull/15620#issuecomment-2068156085 > Thanks @linu-shibu this is a lot closer to what I expected. > > Can you also add the build.gradle patch I mentioned earlier? I think this is the only raw types used in the

Re: [PR] KAFKA-16356 RemoteLogMetadataSerde: Serializer via class-name dispatch removed and replaced with if-elseif-else conditions [kafka]

2024-04-21 Thread via GitHub
gharris1727 commented on code in PR #15620: URL: https://github.com/apache/kafka/pull/15620#discussion_r1573875832 ## storage/src/main/java/org/apache/kafka/server/log/remote/metadata/storage/serialization/RemoteLogMetadataSerde.java: ## @@ -46,69 +44,65 @@ public class

Re: [PR] KAFKA-16356 RemoteLogMetadataSerde: Serializer via class-name dispatch removed and replaced with if-elseif-else conditions [kafka]

2024-04-21 Thread via GitHub
linu-shibu commented on code in PR #15620: URL: https://github.com/apache/kafka/pull/15620#discussion_r1573871668 ## storage/src/main/java/org/apache/kafka/server/log/remote/metadata/storage/serialization/RemoteLogMetadataSerde.java: ## @@ -46,69 +44,65 @@ public class

Re: [PR] KAFKA-16356 RemoteLogMetadataSerde: Serializer via class-name dispatch removed and replaced with if-elseif-else conditions [kafka]

2024-04-21 Thread via GitHub
linu-shibu commented on code in PR #15620: URL: https://github.com/apache/kafka/pull/15620#discussion_r1573870979 ## storage/src/main/java/org/apache/kafka/server/log/remote/metadata/storage/serialization/RemoteLogMetadataSerde.java: ## @@ -46,69 +44,65 @@ public class

Re: [PR] KAFKA-15853: Move socket configs into org.apache.kafka.network.SocketServerConfigs [kafka]

2024-04-21 Thread via GitHub
chia7712 commented on PR #15772: URL: https://github.com/apache/kafka/pull/15772#issuecomment-2068139760 ``` Code Warning FS Format string should use %n rather than \n in org.apache.kafka.network.SocketServerConfigs.() [Bug type VA_FORMAT_STRING_USES_NEWLINE

Re: [PR] KAFKA-16560: Refactor/cleanup BrokerNode/ControllerNode/ClusterConfig [kafka]

2024-04-21 Thread via GitHub
brandboat commented on code in PR #15761: URL: https://github.com/apache/kafka/pull/15761#discussion_r1573858499 ## core/src/test/java/kafka/test/ClusterConfig.java: ## @@ -67,13 +69,16 @@ public class ClusterConfig { this.listenerName = listenerName;

Re: [PR] KAFKA-16560: Refactor/cleanup BrokerNode/ControllerNode/ClusterConfig [kafka]

2024-04-21 Thread via GitHub
chia7712 commented on code in PR #15761: URL: https://github.com/apache/kafka/pull/15761#discussion_r1573857883 ## core/src/test/java/kafka/test/ClusterConfig.java: ## @@ -67,13 +69,16 @@ public class ClusterConfig { this.listenerName = listenerName;

Re: [PR] KAFKA-15853: Move socket configs into org.apache.kafka.network.SocketServerConfigs [kafka]

2024-04-21 Thread via GitHub
OmniaGM commented on code in PR #15772: URL: https://github.com/apache/kafka/pull/15772#discussion_r1573850333 ## server/src/main/java/org/apache/kafka/network/SocketServerConfigs.java: ## @@ -0,0 +1,146 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

Re: [PR] [DRAFT] KAFKA-16593: wip [kafka]

2024-04-21 Thread via GitHub
chia7712 commented on code in PR #15766: URL: https://github.com/apache/kafka/pull/15766#discussion_r1573855465 ## tools/src/test/java/org/apache/kafka/tools/consumer/group/DeleteConsumerGroupsTest.java: ## @@ -17,279 +17,477 @@ package org.apache.kafka.tools.consumer.group;

Re: [PR] KAFKA-16560: Refactor/cleanup BrokerNode/ControllerNode/ClusterConfig [kafka]

2024-04-21 Thread via GitHub
brandboat commented on code in PR #15761: URL: https://github.com/apache/kafka/pull/15761#discussion_r1573855899 ## core/src/test/java/kafka/test/ClusterConfig.java: ## @@ -67,13 +69,16 @@ public class ClusterConfig { this.listenerName = listenerName;

Re: [PR] KAFKA-16356 RemoteLogMetadataSerde: Serializer via class-name dispatch removed and replaced with if-elseif-else conditions [kafka]

2024-04-21 Thread via GitHub
gharris1727 commented on code in PR #15620: URL: https://github.com/apache/kafka/pull/15620#discussion_r1573855150 ## storage/src/main/java/org/apache/kafka/server/log/remote/metadata/storage/serialization/RemoteLogMetadataSerde.java: ## @@ -46,69 +44,65 @@ public class

Re: [PR] KAFKA-16356 RemoteLogMetadataSerde: Serializer via class-name dispatch removed and replaced with if-elseif-else conditions [kafka]

2024-04-21 Thread via GitHub
linu-shibu commented on code in PR #15620: URL: https://github.com/apache/kafka/pull/15620#discussion_r1573854456 ## storage/src/main/java/org/apache/kafka/server/log/remote/metadata/storage/serialization/RemoteLogMetadataSerde.java: ## @@ -65,50 +59,45 @@ protected ApiMessage

Re: [PR] KAFKA-15853: Move socket configs into org.apache.kafka.network.SocketServerConfigs [kafka]

2024-04-21 Thread via GitHub
chia7712 commented on code in PR #15772: URL: https://github.com/apache/kafka/pull/15772#discussion_r1573853257 ## server/src/main/java/org/apache/kafka/network/SocketServerConfigs.java: ## @@ -0,0 +1,146 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

Re: [PR] KAFKA-15853: Move socket configs into org.apache.kafka.network.SocketServerConfigs [kafka]

2024-04-21 Thread via GitHub
chia7712 commented on PR #15772: URL: https://github.com/apache/kafka/pull/15772#issuecomment-2068132025 @OmniaGM I merge #15770 first since it is a smaller PR. Please fix conflicts. thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Created] (KAFKA-16595) Introduce template in ClusterTests

2024-04-21 Thread Kuan Po Tseng (Jira)
Kuan Po Tseng created KAFKA-16595: - Summary: Introduce template in ClusterTests Key: KAFKA-16595 URL: https://issues.apache.org/jira/browse/KAFKA-16595 Project: Kafka Issue Type: Improvement

Re: [PR] KAFKA-16560: Refactor/cleanup BrokerNode/ControllerNode/ClusterConfig [kafka]

2024-04-21 Thread via GitHub
brandboat commented on code in PR #15761: URL: https://github.com/apache/kafka/pull/15761#discussion_r1573852618 ## core/src/test/scala/unit/kafka/server/ApiVersionsRequestTest.scala: ## @@ -17,48 +17,78 @@ package kafka.server -import kafka.test.{ClusterConfig,

Re: [PR] KAFKA-15853: Refactor KafkaConfig to use PasswordEncoderConfigs [kafka]

2024-04-21 Thread via GitHub
chia7712 merged PR #15770: URL: https://github.com/apache/kafka/pull/15770 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] KAFKA-15853: Move socket configs into org.apache.kafka.network.SocketServerConfigs [kafka]

2024-04-21 Thread via GitHub
OmniaGM commented on code in PR #15772: URL: https://github.com/apache/kafka/pull/15772#discussion_r1573851135 ## server/src/main/java/org/apache/kafka/server/config/Defaults.java: ## @@ -46,6 +42,10 @@ public class Defaults { public static final int

Re: [PR] KAFKA-16560: Refactor/cleanup BrokerNode/ControllerNode/ClusterConfig [kafka]

2024-04-21 Thread via GitHub
brandboat commented on code in PR #15761: URL: https://github.com/apache/kafka/pull/15761#discussion_r1573851263 ## core/src/test/scala/unit/kafka/server/ApiVersionsRequestTest.scala: ## @@ -17,48 +17,78 @@ package kafka.server -import kafka.test.{ClusterConfig,

Re: [PR] KAFKA-15853: Move socket configs into org.apache.kafka.network.SocketServerConfigs [kafka]

2024-04-21 Thread via GitHub
OmniaGM commented on code in PR #15772: URL: https://github.com/apache/kafka/pull/15772#discussion_r1573851135 ## server/src/main/java/org/apache/kafka/server/config/Defaults.java: ## @@ -46,6 +42,10 @@ public class Defaults { public static final int

Re: [PR] KAFKA-15853: Move socket configs into org.apache.kafka.network.SocketServerConfigs [kafka]

2024-04-21 Thread via GitHub
OmniaGM commented on code in PR #15772: URL: https://github.com/apache/kafka/pull/15772#discussion_r1573851135 ## server/src/main/java/org/apache/kafka/server/config/Defaults.java: ## @@ -46,6 +42,10 @@ public class Defaults { public static final int

Re: [PR] KAFKA-15853: Move socket configs into org.apache.kafka.network.SocketServerConfigs [kafka]

2024-04-21 Thread via GitHub
OmniaGM commented on code in PR #15772: URL: https://github.com/apache/kafka/pull/15772#discussion_r1573850333 ## server/src/main/java/org/apache/kafka/network/SocketServerConfigs.java: ## @@ -0,0 +1,146 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

Re: [PR] KAFKA-16560: Refactor/cleanup BrokerNode/ControllerNode/ClusterConfig [kafka]

2024-04-21 Thread via GitHub
chia7712 commented on code in PR #15761: URL: https://github.com/apache/kafka/pull/15761#discussion_r1573850549 ## core/src/test/scala/unit/kafka/server/ApiVersionsRequestTest.scala: ## @@ -17,48 +17,78 @@ package kafka.server -import kafka.test.{ClusterConfig,

Re: [PR] KAFKA-16560: Refactor/cleanup BrokerNode/ControllerNode/ClusterConfig [kafka]

2024-04-21 Thread via GitHub
brandboat commented on code in PR #15761: URL: https://github.com/apache/kafka/pull/15761#discussion_r1573849975 ## core/src/test/scala/unit/kafka/server/ApiVersionsRequestTest.scala: ## @@ -17,48 +17,78 @@ package kafka.server -import kafka.test.{ClusterConfig,

Re: [PR] KAFKA-15853: Move socket configs into org.apache.kafka.network.SocketServerConfigs [kafka]

2024-04-21 Thread via GitHub
chia7712 commented on code in PR #15772: URL: https://github.com/apache/kafka/pull/15772#discussion_r1573848774 ## server/src/main/java/org/apache/kafka/server/config/Defaults.java: ## @@ -46,6 +42,10 @@ public class Defaults { public static final int

Re: [PR] KAFKA-16560: Refactor/cleanup BrokerNode/ControllerNode/ClusterConfig [kafka]

2024-04-21 Thread via GitHub
chia7712 commented on code in PR #15761: URL: https://github.com/apache/kafka/pull/15761#discussion_r1573839545 ## core/src/test/java/kafka/test/junit/RaftClusterInvocationContext.java: ## @@ -290,7 +287,7 @@ public void waitForReadyBrokers() throws InterruptedException {

Re: [PR] KAFKA-16483: migrate DeleteOffsetsConsumerGroupCommandIntegrationTest to use ClusterTestExtensions [kafka]

2024-04-21 Thread via GitHub
chia7712 commented on code in PR #15679: URL: https://github.com/apache/kafka/pull/15679#discussion_r1573834240 ## tools/src/test/java/org/apache/kafka/tools/consumer/group/DeleteOffsetsConsumerGroupCommandIntegrationTest.java: ## @@ -173,7 +208,11 @@ private void

Re: [PR] KAFKA-16483: migrate DeleteOffsetsConsumerGroupCommandIntegrationTest to use ClusterTestExtensions [kafka]

2024-04-21 Thread via GitHub
chia7712 commented on code in PR #15679: URL: https://github.com/apache/kafka/pull/15679#discussion_r1573832025 ## tools/src/test/java/org/apache/kafka/tools/consumer/group/DeleteOffsetsConsumerGroupCommandIntegrationTest.java: ## @@ -16,7 +16,15 @@ */ package

Re: [PR] KAFKA-16592: Add a new constructor which invokes the existing constructor with default value for alternativeString [kafka]

2024-04-21 Thread via GitHub
chia7712 commented on code in PR #15762: URL: https://github.com/apache/kafka/pull/15762#discussion_r1573826054 ## clients/src/main/java/org/apache/kafka/common/config/ConfigDef.java: ## @@ -1256,6 +1256,16 @@ public static class ConfigKey { public final boolean

Re: [PR] KAFKA-14585: Move StorageTool to tools [kafka]

2024-04-21 Thread via GitHub
fvaleri commented on PR #14847: URL: https://github.com/apache/kafka/pull/14847#issuecomment-2068086501 @showuon @mimaison I think this is now ready for review. I think now changes are well isolated. There is no code refactoring or Kafka configuration changes, so comparison with the

Re: [PR] KAFKA-16592: Add a new constructor which invokes the existing constructor with default value for alternativeString [kafka]

2024-04-21 Thread via GitHub
vamossagar12 commented on PR #15762: URL: https://github.com/apache/kafka/pull/15762#issuecomment-2068083995 Thanks @chia7712 , I am thinking we can make the constructors as private and let the users use only `define` method. Even in the AK codebase, I don't see the constructor being used

Re: [PR] KAFKA-16592: Add a new constructor which invokes the existing constructor with default value for alternativeString [kafka]

2024-04-21 Thread via GitHub
vamossagar12 commented on code in PR #15762: URL: https://github.com/apache/kafka/pull/15762#discussion_r1573818929 ## clients/src/main/java/org/apache/kafka/common/config/ConfigDef.java: ## @@ -1256,6 +1256,15 @@ public static class ConfigKey { public final boolean

Re: [PR] KAFKA-16466: add details of an internal exception to the failure message [kafka]

2024-04-21 Thread via GitHub
ilyazr commented on PR #15701: URL: https://github.com/apache/kafka/pull/15701#issuecomment-2068079457 @soarez Hi! I've added some changes to fix those tests, but now it shows one failing check. Could you tell me what has gone wrong now? -- This is an automated message from the

Re: [PR] KAFKA-16483: migrate DeleteOffsetsConsumerGroupCommandIntegrationTest to use ClusterTestExtensions [kafka]

2024-04-21 Thread via GitHub
FrankYang0529 commented on code in PR #15679: URL: https://github.com/apache/kafka/pull/15679#discussion_r1573795818 ## tools/src/test/java/org/apache/kafka/tools/consumer/group/DeleteOffsetsConsumerGroupCommandIntegrationTest.java: ## @@ -16,7 +16,15 @@ */ package

[PR] KAFKA-16588: broker shutdown hangs when file.delete.delay.ms is zero [kafka]

2024-04-21 Thread via GitHub
FrankYang0529 opened a new pull request, #15773: URL: https://github.com/apache/kafka/pull/15773 If `file.delete.delay.ms` is zero, We call `take` even though the `logsToBeDeleted` is empty, and `KafkaScheduler#shutdown` call `shutdown` rather than `shudownNow`

Re: [PR] KAFKA-16356 RemoteLogMetadataSerde: Serializer via class-name dispatch removed and replaced with if-elseif-else conditions [kafka]

2024-04-21 Thread via GitHub
gharris1727 commented on code in PR #15620: URL: https://github.com/apache/kafka/pull/15620#discussion_r1573784112 ## storage/src/main/java/org/apache/kafka/server/log/remote/metadata/storage/serialization/RemoteLogMetadataSerde.java: ## @@ -65,50 +59,45 @@ protected ApiMessage

Re: [PR] MINOR: use assertInstanceOf to replace assertTrue [kafka]

2024-04-21 Thread via GitHub
evalaiyc98 commented on PR #15769: URL: https://github.com/apache/kafka/pull/15769#issuecomment-2068055223 @chia7712 Could you help review this? If there is a need for any further improvement, please let me know. Thanks! -- This is an automated message from the Apache Git Service. To

Re: [PR] KAFKA-16356 RemoteLogMetadataSerde: Serializer via class-name dispatch removed and replaced with if-elseif-else conditions [kafka]

2024-04-21 Thread via GitHub
linu-shibu commented on code in PR #15620: URL: https://github.com/apache/kafka/pull/15620#discussion_r1573755412 ## storage/src/main/java/org/apache/kafka/server/log/remote/metadata/storage/serialization/RemoteLogMetadataSerde.java: ## @@ -74,25 +72,24 @@ protected final Map

[PR] KAFKA-15853: Move socket configs into org.apache.kafka.network.SocketServerConfigs [kafka]

2024-04-21 Thread via GitHub
OmniaGM opened a new pull request, #15772: URL: https://github.com/apache/kafka/pull/15772 - Move socket configs and docs out of core and into `org.apache.kafka.network.SocketServerConfigs` - Move default values for socket configs into same class ### Committer Checklist (excluded

Re: [PR] KAFKA-16356 RemoteLogMetadataSerde: Serializer via class-name dispatch removed and replaced with if-elseif-else conditions [kafka]

2024-04-21 Thread via GitHub
gharris1727 commented on code in PR #15620: URL: https://github.com/apache/kafka/pull/15620#discussion_r1573729186 ## storage/src/main/java/org/apache/kafka/server/log/remote/metadata/storage/serialization/RemoteLogMetadataSerde.java: ## @@ -74,25 +72,24 @@ protected final Map

Re: [PR] KAFKA-16356 RemoteLogMetadataSerde: Serializer via class-name dispatch removed and replaced with if-elseif-else conditions [kafka]

2024-04-21 Thread via GitHub
linu-shibu commented on code in PR #15620: URL: https://github.com/apache/kafka/pull/15620#discussion_r1573721007 ## storage/src/main/java/org/apache/kafka/server/log/remote/metadata/storage/serialization/RemoteLogMetadataSerde.java: ## @@ -74,25 +72,24 @@ protected final Map

[jira] [Created] (KAFKA-16594) Add a test to detect CDS errors

2024-04-21 Thread Vedarth Sharma (Jira)
Vedarth Sharma created KAFKA-16594: -- Summary: Add a test to detect CDS errors Key: KAFKA-16594 URL: https://issues.apache.org/jira/browse/KAFKA-16594 Project: Kafka Issue Type: Sub-task

[PR] Minor: Fix CDS in docker image [kafka]

2024-04-21 Thread via GitHub
VedarthConfluent opened a new pull request, #15771: URL: https://github.com/apache/kafka/pull/15771 Fix CDS in docker image. Due to difference in packages present when jsa files were generated and when docker image is generated, there is a log on starting docker image.

[PR] KAFKA-15853: Refactor KafkaConfig to use PasswordEncoderConfigs [kafka]

2024-04-21 Thread via GitHub
OmniaGM opened a new pull request, #15770: URL: https://github.com/apache/kafka/pull/15770 - Move docs to PasswordEncoderConfigs - Renamed the configs in `PasswordEncoderConfigs` to match `_CONFIG` suffix pattern - Move default values to `PasswordEncoderConfigs` - Replace

[PR] MINOR: use assertInstanceOf to replace assertTrue [kafka]

2024-04-21 Thread via GitHub
evalaiyc98 opened a new pull request, #15769: URL: https://github.com/apache/kafka/pull/15769 I am a newbie and this is a minor change that use `assertInstanceOf` to replace the `assertTrue`. ### Committer Checklist (excluded from commit message) - [ ] Verify design and

[jira] [Assigned] (KAFKA-16550) add integration test for LogDirsCommand

2024-04-21 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai reassigned KAFKA-16550: -- Assignee: JiaChi Wang (was: Chia-Ping Tsai) > add integration test for

[jira] [Commented] (KAFKA-16550) add integration test for LogDirsCommand

2024-04-21 Thread JiaChi Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839369#comment-17839369 ] JiaChi Wang commented on KAFKA-16550: - Hi [~chia7712] I'm interested in this issue. Can I take this

Re: [PR] KAFKA-1655: new test for ClusterTool, integration with ClusterTest [kafka]

2024-04-21 Thread via GitHub
dboyliao commented on PR #15768: URL: https://github.com/apache/kafka/pull/15768#issuecomment-2067968427 The blockers here are `testClusterTooOldToHaveId` and `testUnregisterBroker`. As for `testClusterTooOldToHaveId`, I'm trying which metadata version is old enough to be identified as

[jira] [Commented] (KAFKA-16551) add integration test for ClusterTool

2024-04-21 Thread Yin Chen Liao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839367#comment-17839367 ] Yin Chen Liao commented on KAFKA-16551: --- I want to take over this issue. > add integration test

Re: [PR] KAFKA-16424: remove truncated logs after alter dir [kafka]

2024-04-21 Thread via GitHub
chia7712 commented on PR #15616: URL: https://github.com/apache/kafka/pull/15616#issuecomment-2067966296 > thanks for the great suggestion. I took a look LogSegment#deleteIfExists and LogSegment#deleteTypeIfExists. If we want to handle fallback deletion in LocalLog, we may need to return

Re: [PR] KAFKA-16356 RemoteLogMetadataSerde: Serializer via class-name dispatch removed and replaced with if-elseif-else conditions [kafka]

2024-04-21 Thread via GitHub
The-Gamer-01 commented on code in PR #15620: URL: https://github.com/apache/kafka/pull/15620#discussion_r1573677249 ## storage/src/main/java/org/apache/kafka/server/log/remote/metadata/storage/serialization/RemoteLogMetadataSerde.java: ## @@ -74,25 +72,24 @@ protected final Map

Re: [PR] MINOR: fix javadoc argument name in KRaftMetadataCache#getTopicMetadataForDescribeTopicResponse [kafka]

2024-04-21 Thread via GitHub
brandboat commented on code in PR #15764: URL: https://github.com/apache/kafka/pull/15764#discussion_r1573667382 ## core/src/main/scala/kafka/server/metadata/KRaftMetadataCache.scala: ## @@ -267,7 +267,7 @@ class KRaftMetadataCache(val brokerId: Int) extends MetadataCache with

[PR] KAFKA-16549: suppress the warnings from RemoteLogManager [kafka]

2024-04-21 Thread via GitHub
charliecheng630 opened a new pull request, #15767: URL: https://github.com/apache/kafka/pull/15767 - suppress the warnings from RemoteLogManager ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [x] Verify test coverage and CI build

Re: [PR] KAFKA-16424: remove truncated logs after alter dir [kafka]

2024-04-21 Thread via GitHub
FrankYang0529 commented on code in PR #15616: URL: https://github.com/apache/kafka/pull/15616#discussion_r1573652117 ## core/src/test/scala/unit/kafka/server/AlterReplicaLogDirsRequestTest.scala: ## @@ -116,6 +118,57 @@ class AlterReplicaLogDirsRequestTest extends

Re: [PR] KAFKA-16424: remove truncated logs after alter dir [kafka]

2024-04-21 Thread via GitHub
FrankYang0529 commented on PR #15616: URL: https://github.com/apache/kafka/pull/15616#issuecomment-2067936507 > This PR is good but it seems to me `LogSegment` should NOT guess the directory structure managed by upper class (i.e `LogManager`). > > It seems the root cause is caused by

Re: [PR] [WIP] KAFKA-16560: Refactor/cleanup BrokerNode/ControllerNode/ClusterConfig [kafka]

2024-04-21 Thread via GitHub
brandboat commented on code in PR #15761: URL: https://github.com/apache/kafka/pull/15761#discussion_r1573635829 ## core/src/test/scala/unit/kafka/server/ApiVersionsRequestTest.scala: ## @@ -17,48 +17,78 @@ package kafka.server -import kafka.test.{ClusterConfig,

[PR] [DRAFT] KAFKA-16593: wip [kafka]

2024-04-21 Thread via GitHub
frankvicky opened a new pull request, #15766: URL: https://github.com/apache/kafka/pull/15766 Rewrite DeleteConsumerGroupsTest by ClusterTestExtensions. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] KAFKA-16548: Change to use `streamingIterator` [kafka]

2024-04-21 Thread via GitHub
chia7712 commented on code in PR #15765: URL: https://github.com/apache/kafka/pull/15765#discussion_r1573633727 ## core/src/main/java/kafka/log/remote/RemoteLogManager.java: ## @@ -463,7 +464,9 @@ private Optional lookupTimestamp(RemoteLogSegmen RecordBatch

Re: [PR] KAFKA-16548: Change to use `streamingIterator` [kafka]

2024-04-21 Thread via GitHub
m1a2st commented on PR #15765: URL: https://github.com/apache/kafka/pull/15765#issuecomment-2067922075 @chia7712 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Assigned] (KAFKA-16547) add test for DescribeConfigsOptions#includeDocumentation

2024-04-21 Thread PoAn Yang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PoAn Yang reassigned KAFKA-16547: - Assignee: Ming-Yen Chung (was: Yu-Lin Chen) > add test for

[jira] [Commented] (KAFKA-16547) add test for DescribeConfigsOptions#includeDocumentation

2024-04-21 Thread Ming-Yen Chung (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839323#comment-17839323 ] Ming-Yen Chung commented on KAFKA-16547: Hi [~chia7712],  I would like to do it as my first