Re: [PR] KAFKA-19668: processValue() must be declared as value-changing operation [kafka]

2025-09-03 Thread via GitHub
lucasbru commented on code in PR #20470: URL: https://github.com/apache/kafka/pull/20470#discussion_r2320275918 ## streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamImpl.java: ## @@ -1350,7 +1355,11 @@ public KStream processValues( final Processor

Re: [PR] KAFKA-19259: Async consumer fetch intermittent delays on console consumer [kafka]

2025-09-03 Thread via GitHub
kirktrue commented on code in PR #19980: URL: https://github.com/apache/kafka/pull/19980#discussion_r2320217963 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/FetchBuffer.java: ## @@ -98,7 +98,8 @@ void add(CompletedFetch completedFetch) { try {

Re: [PR] KAFKA-18220: Refactor AsyncConsumerMetrics to not extend KafkaConsumerMetrics [kafka]

2025-09-03 Thread via GitHub
chia7712 commented on code in PR #20283: URL: https://github.com/apache/kafka/pull/20283#discussion_r2319988221 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/ShareConsumerImpl.java: ## @@ -1116,19 +1116,23 @@ private boolean processBackgroundEvents() {

Re: [PR] KAFKA-19259: Async consumer fetch intermittent delays on console consumer [kafka]

2025-09-03 Thread via GitHub
kirktrue commented on code in PR #19980: URL: https://github.com/apache/kafka/pull/19980#discussion_r2320220634 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractFetch.java: ## @@ -222,6 +222,10 @@ protected void handleFetchSuccess(final Node fetchTarg

Re: [PR] KAFKA-19259: Async consumer fetch intermittent delays on console consumer [kafka]

2025-09-03 Thread via GitHub
kirktrue commented on code in PR #19980: URL: https://github.com/apache/kafka/pull/19980#discussion_r2320188205 ## clients/clients-integration-tests/src/test/java/org/apache/kafka/clients/consumer/PlaintextConsumerTest.java: ## @@ -1588,6 +1590,75 @@ private void sendCompressedM

Re: [PR] MINOR: Refactor CLI tools to use CommandLineUtils#maybePrintHelpOrVersion [kafka]

2025-09-03 Thread via GitHub
Yunyung commented on PR #20469: URL: https://github.com/apache/kafka/pull/20469#issuecomment-3250577602 Great. LGTM, thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] MINOR: Fix failed e2e compatibility_test_new_broker_test and upgrade_test.py [kafka]

2025-09-03 Thread via GitHub
chia7712 commented on code in PR #20471: URL: https://github.com/apache/kafka/pull/20471#discussion_r2319940997 ## tests/kafkatest/services/verifiable_producer.py: ## @@ -249,7 +249,14 @@ def start_cmd(self, node, idx): if self.repeating_keys is not None: c

Re: [PR] KAFKA-19658: Tweak org.apache.kafka.clients.consumer.OffsetAndMetadata [kafka]

2025-09-03 Thread via GitHub
chia7712 commented on code in PR #20451: URL: https://github.com/apache/kafka/pull/20451#discussion_r2320005613 ## clients/clients-integration-tests/src/test/java/org/apache/kafka/clients/consumer/PlaintextConsumerTest.java: ## @@ -553,14 +553,18 @@ private void testInterceptors

Re: [PR] KAFKA-19467: Add a metric for controller thread idleness [kafka]

2025-09-03 Thread via GitHub
MahsaSeifikar commented on code in PR #20422: URL: https://github.com/apache/kafka/pull/20422#discussion_r2319986360 ## metadata/src/main/java/org/apache/kafka/controller/QuorumController.java: ## @@ -549,6 +550,7 @@ private Throwable handleEventException( } else {

Re: [PR] MINOR: extend consumer close java doc with error handling behaviour [kafka]

2025-09-03 Thread via GitHub
chia7712 commented on code in PR #20472: URL: https://github.com/apache/kafka/pull/20472#discussion_r2320011286 ## clients/src/main/java/org/apache/kafka/clients/consumer/KafkaConsumer.java: ## @@ -1833,6 +1838,9 @@ public void close(Duration timeout) { * {@link ConsumerCo

Re: [PR] KAFKA-19668: processValue() must be declared as value-changing operation [kafka]

2025-09-03 Thread via GitHub
bbejeck commented on code in PR #20470: URL: https://github.com/apache/kafka/pull/20470#discussion_r2319992952 ## streams/src/test/java/org/apache/kafka/streams/kstream/internals/graph/StreamsGraphTest.java: ## @@ -386,20 +392,20 @@ private int getCountOfRepartitionTopicsFound(f

Re: [PR] KAFKA-19668: processValue() must be declared as value-changing operation [kafka]

2025-09-03 Thread via GitHub
mjsax commented on code in PR #20470: URL: https://github.com/apache/kafka/pull/20470#discussion_r2319983417 ## streams/src/main/java/org/apache/kafka/streams/TopologyConfig.java: ## @@ -86,6 +87,28 @@ */ @SuppressWarnings("deprecation") public final class TopologyConfig ext

Re: [PR] KAFKA-19668: processValue() must be declared as value-changing operation [kafka]

2025-09-03 Thread via GitHub
mjsax commented on code in PR #20470: URL: https://github.com/apache/kafka/pull/20470#discussion_r2319982525 ## streams/src/main/java/org/apache/kafka/streams/TopologyConfig.java: ## @@ -86,6 +87,28 @@ */ @SuppressWarnings("deprecation") public final class TopologyConfig ext

[PR] MINOR: extend consumer close java doc with error handling behaviour [kafka]

2025-09-03 Thread via GitHub
lianetm opened a new pull request, #20472: URL: https://github.com/apache/kafka/pull/20472 Add to the consumer.close java doc to describe the error handling behaviour. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

Re: [PR] KAFKA-19668: processValue() must be declared as value-changing operation [kafka]

2025-09-03 Thread via GitHub
bbejeck commented on code in PR #20470: URL: https://github.com/apache/kafka/pull/20470#discussion_r2319932841 ## streams/src/main/java/org/apache/kafka/streams/TopologyConfig.java: ## @@ -86,6 +87,28 @@ */ @SuppressWarnings("deprecation") public final class TopologyConfig e

Re: [PR] KAFKA-19668: processValue() must be declared as value-chaning operation [kafka]

2025-09-03 Thread via GitHub
mjsax commented on code in PR #20470: URL: https://github.com/apache/kafka/pull/20470#discussion_r2319958062 ## streams/src/test/java/org/apache/kafka/streams/kstream/internals/graph/StreamsGraphTest.java: ## @@ -386,20 +392,20 @@ private int getCountOfRepartitionTopicsFound(fin

Re: [PR] KAFKA-19535: add integration tests for DescribeProducersOptions#brokerId [kafka]

2025-09-03 Thread via GitHub
chia7712 merged PR #20420: URL: https://github.com/apache/kafka/pull/20420 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[PR] MINOR: Fix failed e2e compatibility_test_new_broker_test and upgrade_test.py [kafka]

2025-09-03 Thread via GitHub
JimmyWang6 opened a new pull request, #20471: URL: https://github.com/apache/kafka/pull/20471 #20390 Replace the -`-producer.config` for the verifiable producer and `--consumer.config` option by `--command-config` for the verifiable consumer. However, for e2e tests targeting older broker v

[PR] KAFKA-19668: processValue() must be declared as value-chaning operation [kafka]

2025-09-03 Thread via GitHub
mjsax opened a new pull request, #20470: URL: https://github.com/apache/kafka/pull/20470 With "merge.repartition.topic" optimization enabled, Kafka Streams tries to push repartition topics upstream, to be able to merge multiple repartition topics from different downstream branches together.

Re: [PR] MINOR: Refactor JmxTool and StreamsResetter to use CommandLineUtils#maybePrintHelpOrVersion [kafka]

2025-09-03 Thread via GitHub
Yunyung commented on PR #20469: URL: https://github.com/apache/kafka/pull/20469#issuecomment-3250370171 Thanks for the PR. I see the same pattern in ReplicaVerificationTool.java; could you update it as well? Also, it would be great if you could provide the before and after output results

Re: [PR] KAFKA-19467: Add a metric for controller thread idleness [kafka]

2025-09-03 Thread via GitHub
ahuang98 commented on code in PR #20422: URL: https://github.com/apache/kafka/pull/20422#discussion_r2319808559 ## metadata/src/main/java/org/apache/kafka/controller/QuorumController.java: ## @@ -549,6 +550,7 @@ private Throwable handleEventException( } else {

Re: [PR] KAFKA-19011: Improve EndToEndLatency Tool with argument parser and message key/header support [kafka]

2025-09-03 Thread via GitHub
chia7712 merged PR #20301: URL: https://github.com/apache/kafka/pull/20301 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[PR] MINOR: Refactor JmxTool and StreamsResetter to use CommandLineUtils#maybePrintHelpOrVersion [kafka]

2025-09-03 Thread via GitHub
apalan60 opened a new pull request, #20469: URL: https://github.com/apache/kafka/pull/20469 Refactor help and version handling in command-line tools by replacing duplicate code with `CommandLineUtils#maybePrintHelpOrVersion`. -- This is an automated message from the Apache Git Service. To

Re: [PR] KAFKA-19653: Improve metavariable names in usage messages [kafka]

2025-09-03 Thread via GitHub
Yunyung commented on code in PR #20438: URL: https://github.com/apache/kafka/pull/20438#discussion_r2319771084 ## tools/src/main/java/org/apache/kafka/tools/VerifiableShareConsumer.java: ## @@ -547,14 +548,15 @@ private static ArgumentParser argParser() { .setDefaul

Re: [PR] KAFKA-19653: Improve metavariable names in usage messages [kafka]

2025-09-03 Thread via GitHub
Yunyung commented on code in PR #20438: URL: https://github.com/apache/kafka/pull/20438#discussion_r2319771084 ## tools/src/main/java/org/apache/kafka/tools/VerifiableShareConsumer.java: ## @@ -547,14 +548,15 @@ private static ArgumentParser argParser() { .setDefaul

Re: [PR] KAFKA-19653: Improve metavariable names in usage messages [kafka]

2025-09-03 Thread via GitHub
Yunyung commented on code in PR #20438: URL: https://github.com/apache/kafka/pull/20438#discussion_r2319771084 ## tools/src/main/java/org/apache/kafka/tools/VerifiableShareConsumer.java: ## @@ -547,14 +548,15 @@ private static ArgumentParser argParser() { .setDefaul

Re: [PR] KAFKA-19112 Unifying LIST-Type Configuration Validation and Default Values [kafka]

2025-09-03 Thread via GitHub
chia7712 commented on code in PR #20334: URL: https://github.com/apache/kafka/pull/20334#discussion_r2319744748 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/rest/RestServerConfig.java: ## @@ -139,12 +139,12 @@ public abstract class RestServerConfig extends

Re: [PR] MINOR: fix docs references to missing features that are no longer missing [kafka]

2025-09-03 Thread via GitHub
chia7712 merged PR #20435: URL: https://github.com/apache/kafka/pull/20435 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] MINOR: fix docs references to missing features that are no longer missing [kafka]

2025-09-03 Thread via GitHub
chia7712 commented on PR #19498: URL: https://github.com/apache/kafka/pull/19498#issuecomment-3250160433 the successor is #20435 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] MINOR: Cleanup Connect Module (5/n) [kafka]

2025-09-03 Thread via GitHub
chia7712 commented on code in PR #20393: URL: https://github.com/apache/kafka/pull/20393#discussion_r2319705983 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/rest/entities/PluginInfo.java: ## @@ -19,85 +19,30 @@ import org.apache.kafka.connect.runtime.isolat

Re: [PR] KAFKA-19653: Improve metavariable names in usage messages [kafka]

2025-09-03 Thread via GitHub
chia7712 commented on code in PR #20438: URL: https://github.com/apache/kafka/pull/20438#discussion_r2319682177 ## tools/src/main/java/org/apache/kafka/tools/VerifiableShareConsumer.java: ## @@ -547,14 +548,15 @@ private static ArgumentParser argParser() { .setDefau

Re: [PR] KAFKA-19625: Consistency of command-line arguments for verifiable producer/consumer [kafka]

2025-09-03 Thread via GitHub
AndrewJSchofield commented on code in PR #20390: URL: https://github.com/apache/kafka/pull/20390#discussion_r2319525684 ## tests/kafkatest/services/verifiable_producer.py: ## @@ -249,7 +249,7 @@ def start_cmd(self, node, idx): if self.repeating_keys is not None:

Re: [PR] KAFKA-15038: Replace topicIdByPartitionMap with MetadataCache instance in RemoteLogManager [kafka]

2025-09-03 Thread via GitHub
aheev commented on code in PR #20256: URL: https://github.com/apache/kafka/pull/20256#discussion_r2319418482 ## storage/src/main/java/org/apache/kafka/server/log/remote/storage/RemoteLogManager.java: ## @@ -490,8 +479,8 @@ public void onLeadershipChange(Set partitionsBecomeLead

Re: [PR] KAFKA-19625: Consistency of command-line arguments for verifiable producer/consumer [kafka]

2025-09-03 Thread via GitHub
omkreddy commented on code in PR #20390: URL: https://github.com/apache/kafka/pull/20390#discussion_r2319391162 ## tests/kafkatest/services/verifiable_producer.py: ## @@ -249,7 +249,7 @@ def start_cmd(self, node, idx): if self.repeating_keys is not None: cm

Re: [PR] KAFKA-19478 [3/N]: Use heaps to discover the least loaded process [kafka]

2025-09-03 Thread via GitHub
lucasbru merged PR #20172: URL: https://github.com/apache/kafka/pull/20172 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] KAFKA-19620: Move AutoTopicCreationManager to server module [kafka]

2025-09-03 Thread via GitHub
frankvicky commented on code in PR #20383: URL: https://github.com/apache/kafka/pull/20383#discussion_r2319276289 ## server/src/main/java/org/apache/kafka/server/DefaultAutoTopicCreationManager.java: ## @@ -0,0 +1,255 @@ +/* + * Licensed to the Apache Software Foundation (ASF) u

Re: [PR] MINOR: Cleanup 'share' from group.coordinator.rebalance.protocols [kafka]

2025-09-03 Thread via GitHub
AndrewJSchofield commented on PR #20466: URL: https://github.com/apache/kafka/pull/20466#issuecomment-3249561868 @elmoctarebnou There are some build failures. Please check the logs and resolve. For example: ``` Error: /home/runner/work/kafka/kafka/core/src/test/scala/unit/kafka/s

Re: [PR] KAFKA-19624: Improving consistency of command-line arguments for consumer performance tests [kafka]

2025-09-03 Thread via GitHub
AndrewJSchofield commented on PR #20385: URL: https://github.com/apache/kafka/pull/20385#issuecomment-3249552935 > > Thanks for the PR. Once we have a green build, I'm ready to merge this. > > Shouldn't we wait for this? I am trying to run the tests, but running into some issues >

Re: [PR] KAFKA-19653: Improve metavariable names in usage messages [kafka]

2025-09-03 Thread via GitHub
AndrewJSchofield merged PR #20438: URL: https://github.com/apache/kafka/pull/20438 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafk

Re: [PR] KAFKA-19661 [4/N]: Use below-quota as a condition for standby task assignment [kafka]

2025-09-03 Thread via GitHub
lucasbru commented on code in PR #20458: URL: https://github.com/apache/kafka/pull/20458#discussion_r2315959967 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/streams/assignor/StickyTaskAssignor.java: ## @@ -185,11 +195,13 @@ private void assignActive(fina

Re: [PR] MINOR: Cleanup 'share' from group.coordinator.rebalance.protocols [kafka]

2025-09-03 Thread via GitHub
elmoctarebnou commented on code in PR #20466: URL: https://github.com/apache/kafka/pull/20466#discussion_r2319107607 ## .gitignore: ## @@ -31,6 +31,8 @@ TAGS Vagrantfile.local /logs .DS_Store +.bloop/ Review Comment: Thanks for the review, @AndrewJSchofield. I’ve reverted

[PR] KAFKA-18704: Move ScramPublisher to metadata module [kafka]

2025-09-03 Thread via GitHub
see-quick opened a new pull request, #20468: URL: https://github.com/apache/kafka/pull/20468 This PR moves the ScramPublisher class from the server metadata package to the dedicated metadata module. During refactoring, I found out that I also need to move the CredentialProvider interface to

Re: [PR] KAFKA-19467: Add a metric for controller thread idleness [kafka]

2025-09-03 Thread via GitHub
MahsaSeifikar commented on PR #20422: URL: https://github.com/apache/kafka/pull/20422#issuecomment-3249255423 @chia7712 Could you please review this metric KIP when you get a chance? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

Re: [PR] KAFKA-19259: Async consumer fetch intermittent delays on console consumer [kafka]

2025-09-03 Thread via GitHub
lianetm commented on code in PR #19980: URL: https://github.com/apache/kafka/pull/19980#discussion_r2318963044 ## clients/clients-integration-tests/src/test/java/org/apache/kafka/clients/consumer/PlaintextConsumerTest.java: ## @@ -1588,6 +1590,75 @@ private void sendCompressedMe

Re: [PR] KAFKA-19661 [4/N]: Use below-quota as a condition for standby task assignment [kafka]

2025-09-03 Thread via GitHub
Copilot commented on code in PR #20458: URL: https://github.com/apache/kafka/pull/20458#discussion_r2318899271 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/streams/assignor/StickyTaskAssignor.java: ## @@ -103,19 +113,19 @@ private void initialize(final G

Re: [PR] KAFKA-19431: Ensure consumer and share assignment consistency with subscriptions [kafka]

2025-09-03 Thread via GitHub
dajac commented on code in PR #20055: URL: https://github.com/apache/kafka/pull/20055#discussion_r2318877931 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/GroupMetadataManager.java: ## @@ -3089,9 +3111,9 @@ private static boolean isNotEmpty(String value)

Re: [PR] KAFKA-19666: Clean up integration tests related to state-updater [kafka]

2025-09-03 Thread via GitHub
shashankhs11 commented on code in PR #20462: URL: https://github.com/apache/kafka/pull/20462#discussion_r2318872382 ## streams/integration-tests/src/test/java/org/apache/kafka/streams/integration/KafkaStreamsTelemetryIntegrationTest.java: ## @@ -303,16 +304,15 @@ public void sho

Re: [PR] KAFKA-19666: Clean up integration tests related to state-updater [kafka]

2025-09-03 Thread via GitHub
lucasbru commented on code in PR #20462: URL: https://github.com/apache/kafka/pull/20462#discussion_r2318823100 ## streams/integration-tests/src/test/java/org/apache/kafka/streams/integration/KafkaStreamsTelemetryIntegrationTest.java: ## @@ -303,16 +304,15 @@ public void shouldP

Re: [PR] KAFKA-19259: Async consumer fetch intermittent delays on console consumer [kafka]

2025-09-03 Thread via GitHub
AndrewJSchofield commented on code in PR #19980: URL: https://github.com/apache/kafka/pull/19980#discussion_r2318806420 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractFetch.java: ## @@ -222,6 +222,10 @@ protected void handleFetchSuccess(final Node f

Re: [PR] MINOR: Add metrics corresponding to consumer rebalance listener metrics [kafka]

2025-09-03 Thread via GitHub
Copilot commented on code in PR #20464: URL: https://github.com/apache/kafka/pull/20464#discussion_r2318793769 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/DefaultStreamsRebalanceListener.java: ## @@ -91,16 +107,21 @@ public Optional onTasksAssigned(fina

Re: [PR] KAFKA-19624: Improving consistency of command-line arguments for consumer performance tests [kafka]

2025-09-03 Thread via GitHub
aheev commented on PR #20385: URL: https://github.com/apache/kafka/pull/20385#issuecomment-3248992064 > Thanks for the PR. Once we have a green build, I'm ready to merge this. Shouldn't we wait for this? I am trying to run the tests, but running into some issues > Since you hav

Re: [PR] KAFKA-19259: Async consumer fetch intermittent delays on console consumer [kafka]

2025-09-03 Thread via GitHub
AndrewJSchofield commented on code in PR #19980: URL: https://github.com/apache/kafka/pull/19980#discussion_r2318715441 ## clients/clients-integration-tests/src/test/java/org/apache/kafka/clients/consumer/PlaintextConsumerTest.java: ## @@ -1588,6 +1590,75 @@ private void sendCom

Re: [PR] KAFKA-18220: Refactor AsyncConsumerMetrics to not extend KafkaConsumerMetrics [kafka]

2025-09-03 Thread via GitHub
AndrewJSchofield merged PR #20283: URL: https://github.com/apache/kafka/pull/20283 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafk

Re: [PR] KAFKA-18220: Refactor AsyncConsumerMetrics to not extend KafkaConsumerMetrics [kafka]

2025-09-03 Thread via GitHub
ShivsundarR commented on PR #20283: URL: https://github.com/apache/kafka/pull/20283#issuecomment-3248851776 Thanks @AndrewJSchofield, I used the `consumer-perf-test.sh` and `share-consumer-perf-test.sh` tools to print the metrics before and after the changes. - For `ClassicKafkaConsu

Re: [PR] KAFKA-19518: Remove the usage of KafkaMetricsGroup(Class klass) [kafka]

2025-09-03 Thread via GitHub
Yunyung commented on code in PR #20399: URL: https://github.com/apache/kafka/pull/20399#discussion_r2318573502 ## core/src/main/scala/kafka/server/AbstractFetcherManager.scala: ## @@ -30,7 +30,9 @@ import scala.jdk.OptionConverters._ abstract class AbstractFetcherManager[T <:

Re: [PR] KAFKA-19490: Remove usages of distutils in docker scripts [kafka]

2025-09-03 Thread via GitHub
mimaison commented on PR #20178: URL: https://github.com/apache/kafka/pull/20178#issuecomment-3248674398 Can you also resolve the conflict? Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] Bump requests from 2.31.0 to 2.32.4 in /tests [kafka]

2025-09-03 Thread via GitHub
mimaison merged PR #19940: URL: https://github.com/apache/kafka/pull/19940 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] KAFKA-19518: Remove the usage of KafkaMetricsGroup(Class klass) [kafka]

2025-09-03 Thread via GitHub
kuoche1712003 commented on code in PR #20399: URL: https://github.com/apache/kafka/pull/20399#discussion_r2318536120 ## core/src/main/scala/kafka/server/AbstractFetcherManager.scala: ## @@ -30,7 +30,9 @@ import scala.jdk.OptionConverters._ abstract class AbstractFetcherManage

Re: [PR] KAFKA-19086: Add support for microsecond precision for Connect [kafka]

2025-09-03 Thread via GitHub
mimaison commented on PR #19845: URL: https://github.com/apache/kafka/pull/19845#issuecomment-3248596607 Thanks for the PR! This modifies the Kafka Connect public API, so in order to accept this change we need to have a Kafka Improvement Proposal (KIP). See the process on https://cwi

Re: [PR] MINOR: Cleanup Connect Module (5/n) [kafka]

2025-09-03 Thread via GitHub
sjhajharia commented on code in PR #20393: URL: https://github.com/apache/kafka/pull/20393#discussion_r2318467236 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/rest/entities/PluginInfo.java: ## @@ -45,59 +46,23 @@ public PluginInfo(PluginDesc plugin) {

Re: [PR] KAFKA-19624: Improving consistency of command-line arguments for consumer performance tests [kafka]

2025-09-03 Thread via GitHub
AndrewJSchofield commented on PR #20385: URL: https://github.com/apache/kafka/pull/20385#issuecomment-3248580711 @aheev Please resolve conflicts -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] KAFKA-17834 Improvement the Dockerfile [kafka]

2025-09-03 Thread via GitHub
mimaison commented on PR #17554: URL: https://github.com/apache/kafka/pull/17554#issuecomment-3248561958 @chia7712 Did you have other comments? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] KAFKA-15307: Kafka Streams configuration docs outdated [kafka]

2025-09-03 Thread via GitHub
mimaison commented on PR #20408: URL: https://github.com/apache/kafka/pull/20408#issuecomment-3248423413 > Will hold of merging until 4.1 went out, and I can cherry-pick to AK 4.1 branch Feel free to merge and backport to 4.1. I've bumped 4.1 to 4.1.1-SNAPSHOT, it's open to commits

Re: [PR] KAFKA-19654 [WIP] test issues with GitHub actions builds <<--->> Develocity instance (for both trunk/Gradle 8 and attempted upgrade to Gradle 9) [kafka]

2025-09-03 Thread via GitHub
dejan2609 commented on PR #20450: URL: https://github.com/apache/kafka/pull/20450#issuecomment-3248401370 Much obliged Ken @m1a2st :ok_hand: ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[PR] KAFKA-19667: Close ShareConsumer in ShareConsumerPerformance after metrics displayed [kafka]

2025-09-03 Thread via GitHub
AndrewJSchofield opened a new pull request, #20467: URL: https://github.com/apache/kafka/pull/20467 Ensure that metrics are retrieved and displayed (when requested) before ShareConsumer.close() is called. This is important because metrics are technically supposed to be removed on ShareC

Re: [PR] MINOR: Cleanups in Connect [kafka]

2025-09-03 Thread via GitHub
mimaison merged PR #20077: URL: https://github.com/apache/kafka/pull/20077 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] KAFKA-19564: Close Consumer in ConsumerPerformance only after metrics displayed [kafka]

2025-09-03 Thread via GitHub
chia7712 commented on code in PR #20267: URL: https://github.com/apache/kafka/pull/20267#discussion_r2318289086 ## tools/src/main/java/org/apache/kafka/tools/ConsumerPerformance.java: ## @@ -66,45 +69,42 @@ public static void main(String[] args) { if (!options.hideH

Re: [PR] KAFKA-18185: remove internal.leave.group.on.close config [kafka]

2025-09-03 Thread via GitHub
lucasbru commented on PR #19400: URL: https://github.com/apache/kafka/pull/19400#issuecomment-3242118581 @frankvicky It looks like that integration test was broken by https://github.com/apache/kafka/pull/20284 . I can see that it passes on CI only because it is first run with the old protoc

Re: [PR] KAFKA-19564: Close Consumer in ConsumerPerformance only after metrics displayed [kafka]

2025-09-03 Thread via GitHub
AndrewJSchofield commented on code in PR #20267: URL: https://github.com/apache/kafka/pull/20267#discussion_r2318287119 ## tools/src/main/java/org/apache/kafka/tools/ConsumerPerformance.java: ## @@ -66,45 +69,42 @@ public static void main(String[] args) { if (!optio

Re: [PR] KAFKA-17302: ReplicaFetcher changes for fetching from tiered offset [kafka]

2025-09-03 Thread via GitHub
kamalcph commented on code in PR #20428: URL: https://github.com/apache/kafka/pull/20428#discussion_r2317900129 ## core/src/main/scala/kafka/server/LocalLeaderEndPoint.scala: ## @@ -135,6 +135,35 @@ class LocalLeaderEndPoint(sourceBroker: BrokerEndPoint, new OffsetAndEpoch(

Re: [PR] KAFKA-19564: Close Consumer in ConsumerPerformance only after metrics displayed [kafka]

2025-09-03 Thread via GitHub
chia7712 commented on code in PR #20267: URL: https://github.com/apache/kafka/pull/20267#discussion_r2318276501 ## tools/src/main/java/org/apache/kafka/tools/ConsumerPerformance.java: ## @@ -66,45 +69,42 @@ public static void main(String[] args) { if (!options.hideH

Re: [PR] KAFKA-19550 Integration test for Streams-related Admin APIs[1/N] [kafka]

2025-09-03 Thread via GitHub
lucasbru commented on code in PR #20244: URL: https://github.com/apache/kafka/pull/20244#discussion_r2318251588 ## core/src/test/scala/integration/kafka/api/IntegrationTestHarness.scala: ## @@ -22,23 +22,26 @@ import org.apache.kafka.clients.consumer.{Consumer, ConsumerConfig,

Re: [PR] MINOR: Cleanups in Connect [kafka]

2025-09-03 Thread via GitHub
mimaison commented on code in PR #20077: URL: https://github.com/apache/kafka/pull/20077#discussion_r2318247211 ## connect/json/src/main/java/org/apache/kafka/connect/json/JsonConverter.java: ## @@ -152,8 +152,6 @@ public JsonNode toJson(final Schema schema, final Object value,

Re: [PR] KAFKA-19550 Integration test for Streams-related Admin APIs[1/N] [kafka]

2025-09-03 Thread via GitHub
lucasbru commented on code in PR #20244: URL: https://github.com/apache/kafka/pull/20244#discussion_r2318241369 ## core/src/test/scala/integration/kafka/api/IntegrationTestHarness.scala: ## @@ -152,12 +155,11 @@ abstract class IntegrationTestHarness extends KafkaServerTestHarne

Re: [PR] KAFKA-19625: Consistency of command-line arguments for verifiable producer/consumer [kafka]

2025-09-03 Thread via GitHub
chia7712 commented on code in PR #20390: URL: https://github.com/apache/kafka/pull/20390#discussion_r2318235635 ## tests/kafkatest/services/verifiable_consumer.py: ## @@ -424,7 +424,7 @@ def start_cmd(self, node): if self.max_messages > 0: cmd += " --max-me

Re: [PR] KAFKA-19564: Close Consumer in ConsumerPerformance only after metrics displayed [kafka]

2025-09-03 Thread via GitHub
AndrewJSchofield merged PR #20267: URL: https://github.com/apache/kafka/pull/20267 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafk

Re: [PR] MINOR: code cleanup [kafka]

2025-09-03 Thread via GitHub
lucasbru commented on code in PR #20455: URL: https://github.com/apache/kafka/pull/20455#discussion_r2318171288 ## clients/clients-integration-tests/src/test/java/org/apache/kafka/clients/admin/ClientTelemetryTest.java: ## @@ -123,13 +123,12 @@ public void testClientInstanceId(C

Re: [PR] KAFKA-19550 Integration test for Streams-related Admin APIs[1/N] [kafka]

2025-09-03 Thread via GitHub
Copilot commented on code in PR #20244: URL: https://github.com/apache/kafka/pull/20244#discussion_r2317179080 ## core/src/test/scala/integration/kafka/api/PlaintextAdminIntegrationTest.scala: ## @@ -2589,13 +2590,14 @@ class PlaintextAdminIntegrationTest extends BaseAdminInteg

Re: [PR] KAFKA-18585 Fix fail test ValuesTest#shouldConvertDateValues [kafka]

2025-09-03 Thread via GitHub
chia7712 commented on code in PR #18611: URL: https://github.com/apache/kafka/pull/18611#discussion_r2318146619 ## connect/api/src/test/java/org/apache/kafka/connect/data/ValuesTest.java: ## @@ -901,8 +903,10 @@ public void shouldConvertDateValues() { assertEquals(curre

Re: [PR] MINOR: Deflake streams admin api describe streams group with short timeout [kafka]

2025-09-03 Thread via GitHub
aliehsaeedii commented on code in PR #20320: URL: https://github.com/apache/kafka/pull/20320#discussion_r2315502617 ## tools/src/test/java/org/apache/kafka/tools/streams/DescribeStreamsGroupTest.java: ## @@ -252,10 +255,17 @@ public void testDescribeNonExistingStreamsGroup() {

[PR] KAFKA-19631 Admin#describeReplicaLogDirs does not handle error correctly [kafka]

2025-09-03 Thread via GitHub
jack2012aa opened a new pull request, #20461: URL: https://github.com/apache/kafka/pull/20461 # Description Admin#desceibeReplicaLogDirs fails all futures when any error happens, regardless of the exception type or the failed directory. Especially, required by the issue, CLUSTER_AUTHORIZ

Re: [PR] KAFKA-15599: Move KafkaMetadataLog to the raft module [kafka]

2025-09-03 Thread via GitHub
mimaison commented on PR #19762: URL: https://github.com/apache/kafka/pull/19762#issuecomment-3245965884 Rebased on trunk, @jsancio @junrao can you take another look? Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] KAFKA-18913: Remove state.updater.enabled flag from StreamThread and … [kafka]

2025-09-03 Thread via GitHub
shashankhs11 commented on PR #20392: URL: https://github.com/apache/kafka/pull/20392#issuecomment-3246764959 I created a new subtask [KAFKA-19666](https://issues.apache.org/jira/browse/KAFKA-19666) to this parent issue to track the cleanup of all related integration tests. Clean up o

Re: [PR] Cleanup 'share' from group.coordinator.rebalance.protocols [kafka]

2025-09-03 Thread via GitHub
AndrewJSchofield commented on code in PR #20466: URL: https://github.com/apache/kafka/pull/20466#discussion_r2318107859 ## .gitignore: ## @@ -31,6 +31,8 @@ TAGS Vagrantfile.local /logs .DS_Store +.bloop/ Review Comment: Please revert this change. -- This is an automat

[PR] KAFKA-19654 [WIP] test issues with GitHub actions builds <<--->> Develocity instance (for both trunk/Gradle 8 and attempted upgrade to Gradle 9) [kafka]

2025-09-03 Thread via GitHub
dejan2609 opened a new pull request, #20450: URL: https://github.com/apache/kafka/pull/20450 Blocks this PR: - #19513 **Rationale:** GitHub Actions build breaks (with a different errors) when trying to upgrade plugins mentioned below. **Scenario:** test plugin upgrades for

Re: [PR] MINOR: Cleanup Connect Module (5/n) [kafka]

2025-09-03 Thread via GitHub
chia7712 commented on code in PR #20393: URL: https://github.com/apache/kafka/pull/20393#discussion_r2318100347 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/rest/entities/PluginInfo.java: ## @@ -45,59 +46,23 @@ public PluginInfo(PluginDesc plugin) {

Re: [PR] KAFKA-18913: Remove state.updater.enabled flag from StreamThread and … [kafka]

2025-09-03 Thread via GitHub
github-actions[bot] commented on PR #20392: URL: https://github.com/apache/kafka/pull/20392#issuecomment-3243660066 A label of 'needs-attention' was automatically added to this PR in order to raise the attention of the committers. Once this issue has been triaged, the `triage` label s

Re: [PR] Add support to set the target timezone when we use the TimestampConverter. [kafka]

2025-09-03 Thread via GitHub
github-actions[bot] commented on PR #20402: URL: https://github.com/apache/kafka/pull/20402#issuecomment-3243660045 A label of 'needs-attention' was automatically added to this PR in order to raise the attention of the committers. Once this issue has been triaged, the `triage` label s

[PR] MINOR: Add metrics corresponding to consumer rebalance listener metrics [kafka]

2025-09-03 Thread via GitHub
RaidenE1 opened a new pull request, #20464: URL: https://github.com/apache/kafka/pull/20464 - Background Add new metrics for TasksLost, TasksAssigned and TasksRevoked in `StreamsRebalanceListener`. - Features Implemented Added three rebalance latency metrics to Defau

[PR] KAFKA-19666: Clean up integration tests related to state-updater [kafka]

2025-09-03 Thread via GitHub
shashankhs11 opened a new pull request, #20463: URL: https://github.com/apache/kafka/pull/20463 Clean up `PauseResumeIntegrationTest` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] KAFKA-19589: Reduce number of events generated in AsyncKafkaConsumer.updateFetchPositions() [kafka]

2025-09-03 Thread via GitHub
lianetm commented on code in PR #20324: URL: https://github.com/apache/kafka/pull/20324#discussion_r2316969099 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/ThreadSafeAsyncConsumerState.java: ## @@ -0,0 +1,160 @@ +/* + * Licensed to the Apache Software Fou

Re: [PR] KAFKA-18185: remove internal.leave.group.on.close config [kafka]

2025-09-03 Thread via GitHub
lucasbru commented on PR #19400: URL: https://github.com/apache/kafka/pull/19400#issuecomment-3241614781 @frankvicky What I actually meant to ask in my previous comment: Are you planning to implement these changes also for KIP-1071? While static membership isn't fully implemented yet for KI

Re: [PR] KAFKA-19666: Clean up integration tests related to state-updater [kafka]

2025-09-03 Thread via GitHub
shashankhs11 commented on code in PR #20462: URL: https://github.com/apache/kafka/pull/20462#discussion_r2317221468 ## streams/integration-tests/src/test/java/org/apache/kafka/streams/integration/KafkaStreamsTelemetryIntegrationTest.java: ## @@ -444,7 +444,7 @@ private List getT

[PR] Cleanup 'share' from group.coordinator.rebalance.protocols [kafka]

2025-09-03 Thread via GitHub
elmoctarebnou opened a new pull request, #20466: URL: https://github.com/apache/kafka/pull/20466 Cleanup 'share' from group.coordinator.rebalance.protocols as a valid value. Share Groups should instead be enabled through the share.version Reviewers: Christo Lolov[christolo...@gmail.com](

Re: [PR] KAFKA-19308: Add unit tests for OAuthBearerRefreshingLogin [kafka]

2025-09-02 Thread via GitHub
skrcode commented on PR #20454: URL: https://github.com/apache/kafka/pull/20454#issuecomment-3243720720 Reviewers: @kirktrue -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[PR] KAFKA-19666: Clean up integration tests related to state-updater [kafka]

2025-09-02 Thread via GitHub
shashankhs11 opened a new pull request, #20465: URL: https://github.com/apache/kafka/pull/20465 clean up `SmokeTestDriverIntegrationTest` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [PR] KAFKA-19550 Integration test for Streams-related Admin APIs[1/N] [kafka]

2025-09-02 Thread via GitHub
lucliu1108 commented on code in PR #20244: URL: https://github.com/apache/kafka/pull/20244#discussion_r2317283715 ## core/src/test/scala/integration/kafka/api/IntegrationTestHarness.scala: ## @@ -56,6 +59,7 @@ abstract class IntegrationTestHarness extends KafkaServerTestHarness

Re: [PR] KAFKA-19259: Async consumer fetch intermittent delays on console consumer [kafka]

2025-09-02 Thread via GitHub
lianetm commented on code in PR #19980: URL: https://github.com/apache/kafka/pull/19980#discussion_r2298653648 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractFetch.java: ## @@ -222,6 +222,10 @@ protected void handleFetchSuccess(final Node fetchTarge

[PR] MINOR: Update supported image tags in docker_scan [kafka]

2025-09-02 Thread via GitHub
mimaison opened a new pull request, #20459: URL: https://github.com/apache/kafka/pull/20459 Update the supported tags for the 4.1.0 release -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] MINOR: Cleanups in Connect [kafka]

2025-09-02 Thread via GitHub
showuon commented on code in PR #20077: URL: https://github.com/apache/kafka/pull/20077#discussion_r2317632328 ## connect/json/src/main/java/org/apache/kafka/connect/json/JsonConverter.java: ## @@ -152,8 +152,6 @@ public JsonNode toJson(final Schema schema, final Object value,

  1   2   3   4   5   6   7   8   9   10   >