[GitHub] [kafka] hudeqi commented on pull request #13421: KAFKA-14824: ReplicaAlterLogDirsThread may cause serious disk growing in case of potential exception

2023-05-04 Thread via GitHub
hudeqi commented on PR #13421: URL: https://github.com/apache/kafka/pull/13421#issuecomment-1535663733 There are indeed corresponding recovery methods for this issue, such as directly deleting the future log on the disk and restarting the corresponding broker. Therefore, if the failed

[GitHub] [kafka] showuon commented on a diff in pull request #13312: KAFKA-14766: Improve performance of VarInt encoding and decoding

2023-05-04 Thread via GitHub
showuon commented on code in PR #13312: URL: https://github.com/apache/kafka/pull/13312#discussion_r1185666434 ## clients/src/test/java/org/apache/kafka/common/utils/ByteUtilsTest.java: ## @@ -241,6 +244,119 @@ public void testDouble() throws IOException {

[GitHub] [kafka] showuon commented on a diff in pull request #13515: KAFKA-14752: Kafka examples improvements - producer changes

2023-05-04 Thread via GitHub
showuon commented on code in PR #13515: URL: https://github.com/apache/kafka/pull/13515#discussion_r1185665409 ## examples/src/main/java/kafka/examples/Producer.java: ## @@ -21,133 +21,164 @@ import org.apache.kafka.clients.producer.ProducerConfig; import

[GitHub] [kafka] showuon commented on a diff in pull request #13660: KAFKA-14662: Update the ACL list in the doc

2023-05-04 Thread via GitHub
showuon commented on code in PR #13660: URL: https://github.com/apache/kafka/pull/13660#discussion_r1185661328 ## docs/security.html: ## @@ -2089,6 +2089,144 @@

[GitHub] [kafka] hudeqi commented on a diff in pull request #13617: MINOR:code optimization in QuorumController

2023-05-04 Thread via GitHub
hudeqi commented on code in PR #13617: URL: https://github.com/apache/kafka/pull/13617#discussion_r1185655736 ## metadata/src/main/java/org/apache/kafka/controller/QuorumController.java: ## @@ -1635,7 +1636,7 @@ private enum ImbalanceSchedule { /** * Tracks if a

[GitHub] [kafka] hudeqi commented on a diff in pull request #13617: MINOR:code optimization in QuorumController

2023-05-04 Thread via GitHub
hudeqi commented on code in PR #13617: URL: https://github.com/apache/kafka/pull/13617#discussion_r1185653614 ## metadata/src/main/java/org/apache/kafka/controller/QuorumController.java: ## @@ -1635,7 +1636,7 @@ private enum ImbalanceSchedule { /** * Tracks if a

[GitHub] [kafka] hudeqi commented on a diff in pull request #13617: MINOR:code optimization in QuorumController

2023-05-04 Thread via GitHub
hudeqi commented on code in PR #13617: URL: https://github.com/apache/kafka/pull/13617#discussion_r1185653614 ## metadata/src/main/java/org/apache/kafka/controller/QuorumController.java: ## @@ -1635,7 +1636,7 @@ private enum ImbalanceSchedule { /** * Tracks if a

[jira] [Commented] (KAFKA-14914) binarySearch in AbstactIndex may execute with infinite loop

2023-05-04 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719585#comment-17719585 ] Luke Chen commented on KAFKA-14914: --- [~flashmouse] , thanks for reporting this issue. Does the offset

[GitHub] [kafka] clayburn commented on a diff in pull request #13676: MINOR: Capture build scans on ge.apache.org to benefit from deep build insights

2023-05-04 Thread via GitHub
clayburn commented on code in PR #13676: URL: https://github.com/apache/kafka/pull/13676#discussion_r1185635216 ## build.gradle: ## @@ -39,7 +39,6 @@ plugins { id "io.swagger.core.v3.swagger-gradle-plugin" version "2.2.8" id "com.github.spotbugs" version '5.0.13' apply

[GitHub] [kafka] mjsax commented on a diff in pull request #13656: KAFKA-14911: Add system tests for rolling upgrade path of KIP-904

2023-05-04 Thread via GitHub
mjsax commented on code in PR #13656: URL: https://github.com/apache/kafka/pull/13656#discussion_r1185622586 ## tests/kafkatest/tests/streams/streams_upgrade_test.py: ## @@ -236,6 +237,96 @@ def test_rolling_upgrade_with_2_bounces(self, from_version, to_version):

[GitHub] [kafka] bmscomp commented on a diff in pull request #13676: MINOR: Capture build scans on ge.apache.org to benefit from deep build insights

2023-05-04 Thread via GitHub
bmscomp commented on code in PR #13676: URL: https://github.com/apache/kafka/pull/13676#discussion_r1185622030 ## build.gradle: ## @@ -39,7 +39,6 @@ plugins { id "io.swagger.core.v3.swagger-gradle-plugin" version "2.2.8" id "com.github.spotbugs" version '5.0.13' apply

[GitHub] [kafka] mjsax commented on a diff in pull request #13656: KAFKA-14911: Add system tests for rolling upgrade path of KIP-904

2023-05-04 Thread via GitHub
mjsax commented on code in PR #13656: URL: https://github.com/apache/kafka/pull/13656#discussion_r1185621879 ## tests/kafkatest/tests/streams/streams_upgrade_test.py: ## @@ -236,6 +237,96 @@ def test_rolling_upgrade_with_2_bounces(self, from_version, to_version):

[GitHub] [kafka] mjsax commented on a diff in pull request #13656: KAFKA-14911: Add system tests for rolling upgrade path of KIP-904

2023-05-04 Thread via GitHub
mjsax commented on code in PR #13656: URL: https://github.com/apache/kafka/pull/13656#discussion_r1185618918 ## streams/src/test/java/org/apache/kafka/streams/tests/SmokeTestDriver.java: ## @@ -106,7 +106,11 @@ private static class ValueList { } int next() {

[jira] [Commented] (KAFKA-13891) sync group failed with rebalanceInProgress error cause rebalance many rounds in coopeartive

2023-05-04 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719572#comment-17719572 ] A. Sophie Blee-Goldman commented on KAFKA-13891: Thanks [~pnee] – just to round out the

[GitHub] [kafka] bmscomp commented on pull request #13673: MINOR: Update dependencies (minor versions only)

2023-05-04 Thread via GitHub
bmscomp commented on PR #13673: URL: https://github.com/apache/kafka/pull/13673#issuecomment-1535547766 It's a good think to keep dependencies up to date -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Commented] (KAFKA-14016) Revoke more partitions than expected in Cooperative rebalance

2023-05-04 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719570#comment-17719570 ] A. Sophie Blee-Goldman commented on KAFKA-14016: Nice job [~pnee] – thanks for taking

[GitHub] [kafka] cmccabe commented on a diff in pull request #13461: KAFKA-14840: Support for snapshots during ZK migration

2023-05-04 Thread via GitHub
cmccabe commented on code in PR #13461: URL: https://github.com/apache/kafka/pull/13461#discussion_r1185605065 ## metadata/src/test/java/org/apache/kafka/metadata/migration/CapturingTopicMigrationClient.java: ## @@ -0,0 +1,66 @@ +/* + * Licensed to the Apache Software

[GitHub] [kafka] cmccabe commented on a diff in pull request #13461: KAFKA-14840: Support for snapshots during ZK migration

2023-05-04 Thread via GitHub
cmccabe commented on code in PR #13461: URL: https://github.com/apache/kafka/pull/13461#discussion_r1185604698 ## metadata/src/main/java/org/apache/kafka/metadata/migration/KRaftMigrationZkWriter.java: ## @@ -0,0 +1,333 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] cmccabe commented on a diff in pull request #13461: KAFKA-14840: Support for snapshots during ZK migration

2023-05-04 Thread via GitHub
cmccabe commented on code in PR #13461: URL: https://github.com/apache/kafka/pull/13461#discussion_r1185604580 ## metadata/src/main/java/org/apache/kafka/metadata/migration/KRaftMigrationZkWriter.java: ## @@ -0,0 +1,333 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] mumrah commented on a diff in pull request #13461: KAFKA-14840: Support for snapshots during ZK migration

2023-05-04 Thread via GitHub
mumrah commented on code in PR #13461: URL: https://github.com/apache/kafka/pull/13461#discussion_r1185602073 ## metadata/src/test/java/org/apache/kafka/metadata/migration/CapturingTopicMigrationClient.java: ## @@ -0,0 +1,66 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] mumrah commented on a diff in pull request #13461: KAFKA-14840: Support for snapshots during ZK migration

2023-05-04 Thread via GitHub
mumrah commented on code in PR #13461: URL: https://github.com/apache/kafka/pull/13461#discussion_r1185600997 ## core/src/main/scala/kafka/zk/migration/ZkAclMigrationClient.scala: ## @@ -0,0 +1,115 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more +

[GitHub] [kafka] mumrah commented on a diff in pull request #13461: KAFKA-14840: Support for snapshots during ZK migration

2023-05-04 Thread via GitHub
mumrah commented on code in PR #13461: URL: https://github.com/apache/kafka/pull/13461#discussion_r1185600867 ## metadata/src/main/java/org/apache/kafka/metadata/migration/KRaftMigrationZkWriter.java: ## @@ -0,0 +1,333 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [kafka] bmscomp commented on pull request #13662: MINOR: Upgrade Jackson dependencies to version 2.15.0

2023-05-04 Thread via GitHub
bmscomp commented on PR #13662: URL: https://github.com/apache/kafka/pull/13662#issuecomment-1535524442 @divijvaidya this pull request targets an update to version 2.15.0, please can you tell me better about updating not only minor versions ? -- This is an automated message from

[GitHub] [kafka] mjsax commented on pull request #13654: HOTFIX: fix broken Streams upgrade system test

2023-05-04 Thread via GitHub
mjsax commented on PR #13654: URL: https://github.com/apache/kafka/pull/13654#issuecomment-1535516492 Ok. Dug into this a little bit, and some test are broken, because KS is broken. The original PR for https://issues.apache.org/jira/browse/KAFKA-13769 broke KS, but it also added the

[GitHub] [kafka] junrao commented on a diff in pull request #13535: KAFKA-9579 Fetch implementation for records in the remote storage through a specific purgatory.

2023-05-04 Thread via GitHub
junrao commented on code in PR #13535: URL: https://github.com/apache/kafka/pull/13535#discussion_r1184289360 ## core/src/main/scala/kafka/server/ReplicaManager.scala: ## @@ -1160,48 +1172,100 @@ class ReplicaManager(val config: KafkaConfig, fetchPartitionStatus +=

[GitHub] [kafka] sfc-gh-japatel commented on pull request #12647: KAFKA-14191: Add end-to-end latency metrics to Connectors

2023-05-04 Thread via GitHub
sfc-gh-japatel commented on PR #12647: URL: https://github.com/apache/kafka/pull/12647#issuecomment-1535462677 Hi team, any progress/plans on this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [kafka] jolshan commented on a diff in pull request #13608: KAFKA-14884: Include check transaction is still ongoing right before append

2023-05-04 Thread via GitHub
jolshan commented on code in PR #13608: URL: https://github.com/apache/kafka/pull/13608#discussion_r1185544285 ## core/src/test/scala/unit/kafka/cluster/PartitionTest.scala: ## @@ -3273,17 +3274,46 @@ class PartitionTest extends AbstractPartitionTest { baseOffset = 0L,

[GitHub] [kafka] kirktrue commented on a diff in pull request #13591: KAFKA-14831: Illegal state errors should be fatal in transactional producer

2023-05-04 Thread via GitHub
kirktrue commented on code in PR #13591: URL: https://github.com/apache/kafka/pull/13591#discussion_r1185533261 ## clients/src/main/java/org/apache/kafka/clients/producer/internals/TransactionManager.java: ## @@ -1090,6 +1090,9 @@ private void maybeFailWithError() {

[GitHub] [kafka] kirktrue commented on a diff in pull request #13591: KAFKA-14831: Illegal state errors should be fatal in transactional producer

2023-05-04 Thread via GitHub
kirktrue commented on code in PR #13591: URL: https://github.com/apache/kafka/pull/13591#discussion_r1185525137 ## clients/src/test/java/org/apache/kafka/clients/producer/internals/TransactionManagerTest.java: ## @@ -3405,6 +3406,54 @@ MAX_REQUEST_SIZE, ACKS_ALL, MAX_RETRIES,

[GitHub] [kafka] kirktrue commented on a diff in pull request #13591: KAFKA-14831: Illegal state errors should be fatal in transactional producer

2023-05-04 Thread via GitHub
kirktrue commented on code in PR #13591: URL: https://github.com/apache/kafka/pull/13591#discussion_r1185524662 ## clients/src/test/java/org/apache/kafka/clients/producer/internals/TransactionManagerTest.java: ## @@ -3405,6 +3406,52 @@ MAX_REQUEST_SIZE, ACKS_ALL, MAX_RETRIES,

[GitHub] [kafka] kirktrue commented on pull request #13640: KAFKA-14937: Refactoring for client code to reduce boilerplate

2023-05-04 Thread via GitHub
kirktrue commented on PR #13640: URL: https://github.com/apache/kafka/pull/13640#issuecomment-1535394647 > With this PR I consistently get failures with the following tests Thanks for catching that. I was not setting the client ID to the correct value for the `KafkaAdminClient`'s

[GitHub] [kafka] clayburn commented on a diff in pull request #13676: MINOR: Capture build scans on ge.apache.org to benefit from deep build insights

2023-05-04 Thread via GitHub
clayburn commented on code in PR #13676: URL: https://github.com/apache/kafka/pull/13676#discussion_r1185496911 ## build.gradle: ## @@ -39,7 +39,6 @@ plugins { id "io.swagger.core.v3.swagger-gradle-plugin" version "2.2.8" id "com.github.spotbugs" version '5.0.13' apply

[GitHub] [kafka] clayburn opened a new pull request, #13676: MINOR: Capture build scans on ge.apache.org to benefit from deep build insights

2023-05-04 Thread via GitHub
clayburn opened a new pull request, #13676: URL: https://github.com/apache/kafka/pull/13676 This PR publishes a build scan for every CI build on Jenkins and GitHub Actions and for every local build from an authenticated Apache committer. The build will not fail if publishing fails.

[GitHub] [kafka] jeffkbkim commented on a diff in pull request #13638: KAFKA-14462; [11/N] Add CurrentAssignmentBuilder

2023-05-04 Thread via GitHub
jeffkbkim commented on code in PR #13638: URL: https://github.com/apache/kafka/pull/13638#discussion_r1185475014 ## group-coordinator/src/test/java/org/apache/kafka/coordinator/group/consumer/CurrentAssignmentBuilderTest.java: ## @@ -0,0 +1,558 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] jeffkbkim commented on a diff in pull request #13638: KAFKA-14462; [11/N] Add CurrentAssignmentBuilder

2023-05-04 Thread via GitHub
jeffkbkim commented on code in PR #13638: URL: https://github.com/apache/kafka/pull/13638#discussion_r1185460028 ## group-coordinator/src/test/java/org/apache/kafka/coordinator/group/consumer/CurrentAssignmentBuilderTest.java: ## @@ -0,0 +1,558 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] jeffkbkim commented on a diff in pull request #13644: KAFKA-14500; [1/N] Rewrite MemberMetadata in Java

2023-05-04 Thread via GitHub
jeffkbkim commented on code in PR #13644: URL: https://github.com/apache/kafka/pull/13644#discussion_r1185446129 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/generic/GenericGroupMember.java: ## @@ -0,0 +1,560 @@ +/** + * Licensed to the Apache Software

[GitHub] [kafka] jeffkbkim commented on a diff in pull request #13644: KAFKA-14500; [1/N] Rewrite MemberMetadata in Java

2023-05-04 Thread via GitHub
jeffkbkim commented on code in PR #13644: URL: https://github.com/apache/kafka/pull/13644#discussion_r1185444113 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/generic/GenericGroupMember.java: ## @@ -0,0 +1,499 @@ +/** + * Licensed to the Apache Software

[GitHub] [kafka] jeffkbkim commented on a diff in pull request #13644: KAFKA-14500; [1/N] Rewrite MemberMetadata in Java

2023-05-04 Thread via GitHub
jeffkbkim commented on code in PR #13644: URL: https://github.com/apache/kafka/pull/13644#discussion_r1185441081 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/generic/GenericGroupMember.java: ## @@ -0,0 +1,499 @@ +/** + * Licensed to the Apache Software

[GitHub] [kafka] hertzsprung commented on pull request #13671: KAFKA-14967: fix NPE in MockAdminClient CreateTopicsResult

2023-05-04 Thread via GitHub
hertzsprung commented on PR #13671: URL: https://github.com/apache/kafka/pull/13671#issuecomment-1535283665 `:clients:test:` succeeded locally but fails in CI due to a gradle configuration problem: > Could not create task ':clients:test'. > > [2023-05-04T16:19:19.121Z] >

[GitHub] [kafka] cmccabe closed pull request #13540: MINOR: improve QuorumController logging

2023-05-04 Thread via GitHub
cmccabe closed pull request #13540: MINOR: improve QuorumController logging URL: https://github.com/apache/kafka/pull/13540 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [kafka] jeffkbkim commented on a diff in pull request #13644: KAFKA-14500; [1/N] Rewrite MemberMetadata in Java

2023-05-04 Thread via GitHub
jeffkbkim commented on code in PR #13644: URL: https://github.com/apache/kafka/pull/13644#discussion_r1185332905 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/generic/GenericGroupMember.java: ## @@ -0,0 +1,499 @@ +/** + * Licensed to the Apache Software

[jira] [Updated] (KAFKA-14958) Investigate enforcing all batches have the same producer ID

2023-05-04 Thread Justine Olshan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Justine Olshan updated KAFKA-14958: --- Description: KAFKA-14916 was created after I incorrectly assumed transaction ID in the

[jira] [Resolved] (KAFKA-14916) Fix code that assumes transactional ID implies all records are transactional

2023-05-04 Thread Justine Olshan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Justine Olshan resolved KAFKA-14916. Resolution: Fixed > Fix code that assumes transactional ID implies all records are

[jira] [Resolved] (KAFKA-13668) Failed cluster authorization should not be fatal for producer

2023-05-04 Thread Philip Nee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Philip Nee resolved KAFKA-13668. Fix Version/s: 3.6.0 Resolution: Fixed > Failed cluster authorization should not be fatal

[jira] [Commented] (KAFKA-14624) State restoration is broken with standby tasks and cache-enabled stores in processor API

2023-05-04 Thread Lucas Brutschy (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719425#comment-17719425 ] Lucas Brutschy commented on KAFKA-14624: This seems to be a duplicate of

[GitHub] [kafka] jolshan merged pull request #13607: KAFKA-14916: Fix code that assumes transactional ID implies all records are transactional

2023-05-04 Thread via GitHub
jolshan merged PR #13607: URL: https://github.com/apache/kafka/pull/13607 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] Hangleton commented on pull request #12331: KAFKA-1194: changes needed to run on Windows

2023-05-04 Thread via GitHub
Hangleton commented on PR #12331: URL: https://github.com/apache/kafka/pull/12331#issuecomment-1535077333 Agree that this change should be ideally confined to the Windows platform. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [kafka] cmccabe commented on pull request #12331: KAFKA-1194: changes needed to run on Windows

2023-05-04 Thread via GitHub
cmccabe commented on PR #12331: URL: https://github.com/apache/kafka/pull/12331#issuecomment-1535052942 I'm going to leave a -1 here because there are a number of issues in the patch and it's not ready to commit yet. I would encourage you to split this patch into several parts and clearly

[GitHub] [kafka] jolshan merged pull request #12149: KAFKA-13668: Retry upon missing initProducerId due to authorization error

2023-05-04 Thread via GitHub
jolshan merged PR #12149: URL: https://github.com/apache/kafka/pull/12149 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] dajac commented on a diff in pull request #13638: KAFKA-14462; [11/N] Add CurrentAssignmentBuilder

2023-05-04 Thread via GitHub
dajac commented on code in PR #13638: URL: https://github.com/apache/kafka/pull/13638#discussion_r1185204551 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/consumer/CurrentAssignmentBuilder.java: ## @@ -0,0 +1,415 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] dajac commented on a diff in pull request #13638: KAFKA-14462; [11/N] Add CurrentAssignmentBuilder

2023-05-04 Thread via GitHub
dajac commented on code in PR #13638: URL: https://github.com/apache/kafka/pull/13638#discussion_r1185195017 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/consumer/CurrentAssignmentBuilder.java: ## @@ -0,0 +1,436 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] dajac commented on a diff in pull request #13638: KAFKA-14462; [11/N] Add CurrentAssignmentBuilder

2023-05-04 Thread via GitHub
dajac commented on code in PR #13638: URL: https://github.com/apache/kafka/pull/13638#discussion_r1185193708 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/consumer/CurrentAssignmentBuilder.java: ## @@ -0,0 +1,436 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] dajac commented on a diff in pull request #13638: KAFKA-14462; [11/N] Add CurrentAssignmentBuilder

2023-05-04 Thread via GitHub
dajac commented on code in PR #13638: URL: https://github.com/apache/kafka/pull/13638#discussion_r1185188619 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/consumer/CurrentAssignmentBuilder.java: ## @@ -0,0 +1,415 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] jeffkbkim commented on a diff in pull request #13638: KAFKA-14462; [11/N] Add CurrentAssignmentBuilder

2023-05-04 Thread via GitHub
jeffkbkim commented on code in PR #13638: URL: https://github.com/apache/kafka/pull/13638#discussion_r1185172881 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/consumer/CurrentAssignmentBuilder.java: ## @@ -0,0 +1,415 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] jeffkbkim commented on a diff in pull request #13638: KAFKA-14462; [11/N] Add CurrentAssignmentBuilder

2023-05-04 Thread via GitHub
jeffkbkim commented on code in PR #13638: URL: https://github.com/apache/kafka/pull/13638#discussion_r1185168753 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/consumer/CurrentAssignmentBuilder.java: ## @@ -0,0 +1,436 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] clolov commented on a diff in pull request #13240: KAFKA-14690: Add topic IDs to the OffsetCommit API version 9

2023-05-04 Thread via GitHub
clolov commented on code in PR #13240: URL: https://github.com/apache/kafka/pull/13240#discussion_r1185137613 ## core/src/test/scala/unit/kafka/server/OffsetCommitRequestTest.scala: ## @@ -0,0 +1,147 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] [kafka] fvaleri commented on a diff in pull request #13515: KAFKA-14752: Kafka examples improvements - producer changes

2023-05-04 Thread via GitHub
fvaleri commented on code in PR #13515: URL: https://github.com/apache/kafka/pull/13515#discussion_r1185104750 ## examples/src/main/java/kafka/examples/Producer.java: ## @@ -21,133 +21,164 @@ import org.apache.kafka.clients.producer.ProducerConfig; import

[GitHub] [kafka] lucasbru commented on a diff in pull request #11433: KAFKA-13295: Avoiding Transation timeouts arising due to long restora…

2023-05-04 Thread via GitHub
lucasbru commented on code in PR #11433: URL: https://github.com/apache/kafka/pull/11433#discussion_r1185039728 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java: ## @@ -342,7 +342,19 @@ public void handleAssignment(final Map> activeTasks,

[GitHub] [kafka] dajac commented on a diff in pull request #13644: KAFKA-14500; [1/N] Rewrite MemberMetadata in Java

2023-05-04 Thread via GitHub
dajac commented on code in PR #13644: URL: https://github.com/apache/kafka/pull/13644#discussion_r118500 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/generic/GenericGroupMember.java: ## @@ -0,0 +1,499 @@ +/** + * Licensed to the Apache Software

[GitHub] [kafka] clolov commented on a diff in pull request #13240: KAFKA-14690: Add topic IDs to the OffsetCommit API version 9

2023-05-04 Thread via GitHub
clolov commented on code in PR #13240: URL: https://github.com/apache/kafka/pull/13240#discussion_r1185002319 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/ConsumerCoordinatorTest.java: ## @@ -129,16 +150,19 @@ import static

[GitHub] [kafka] machi1990 commented on pull request #13673: MINOR: Update dependencies (minor versions only)

2023-05-04 Thread via GitHub
machi1990 commented on PR #13673: URL: https://github.com/apache/kafka/pull/13673#issuecomment-1534757023 > > In relation to dependency upgrade, has there been any discussion around automated tooling e.g usage of dependabot or renovate? > > I don't know. I have seen @ijuma being the

[GitHub] [kafka] divijvaidya commented on pull request #13673: MINOR: Update dependencies (minor versions only)

2023-05-04 Thread via GitHub
divijvaidya commented on PR #13673: URL: https://github.com/apache/kafka/pull/13673#issuecomment-1534729885 > In relation to dependency upgrade, has there been any discussion around automated tooling e.g usage of dependabot or renovate? I don't know. I have seen @ijuma being the one

[GitHub] [kafka] dajac opened a new pull request, #13675: KAFKA-14462; [14/N]; Add PartitionWriter

2023-05-04 Thread via GitHub
dajac opened a new pull request, #13675: URL: https://github.com/apache/kafka/pull/13675 This patch introduces the `PartitionWriter` interface in the `group-coordinator` module. The `ReplicaManager` resides in the `core` module and it is thus not accessible from the `group-coordinator`

[GitHub] [kafka] divijvaidya commented on pull request #13673: MINOR: Update dependencies (minor versions only)

2023-05-04 Thread via GitHub
divijvaidya commented on PR #13673: URL: https://github.com/apache/kafka/pull/13673#issuecomment-1534725676 Thanks for your comment @machi1990. In principle what you say is right but given the limited committer bandwidth in the community, I am trying to optimize for code reviewer comfort

[GitHub] [kafka] machi1990 commented on pull request #13673: MINOR: Update dependencies (minor versions only)

2023-05-04 Thread via GitHub
machi1990 commented on PR #13673: URL: https://github.com/apache/kafka/pull/13673#issuecomment-1534706839 In relation to dependency upgrade, has there been any discussion around automated tooling e.g usage of dependabot or renovate? -- This is an automated message from the Apache Git

[GitHub] [kafka] machi1990 commented on pull request #13673: MINOR: Update dependencies (minor versions only)

2023-05-04 Thread via GitHub
machi1990 commented on PR #13673: URL: https://github.com/apache/kafka/pull/13673#issuecomment-1534704953 Thanks @divijvaidya I am wondering whether it is best to separate each upgrade on a separate PR? That makes each dependency update atomic and thus easier to revert in case we notice

[GitHub] [kafka] divijvaidya opened a new pull request, #13674: MINOR: Release resources in FetcherTest

2023-05-04 Thread via GitHub
divijvaidya opened a new pull request, #13674: URL: https://github.com/apache/kafka/pull/13674 FetcherTest fails intermittently with OOM since it doesn't close the spied resources properly. ``` org.gradle.api.internal.tasks.testing.TestSuiteExecutionException: Could not complete

[GitHub] [kafka] divijvaidya opened a new pull request, #13673: MINOR: Update dependencies (minor versions only)

2023-05-04 Thread via GitHub
divijvaidya opened a new pull request, #13673: URL: https://github.com/apache/kafka/pull/13673 All dependency upgrades in the PR are minor upgrades with backward compatible changes. Note that no major version for dependencies have been changed to make it a low risk change (and possibly

[jira] [Commented] (KAFKA-14817) LogCleaner mark some partitions of __consumer_offsets as uncleanable

2023-05-04 Thread Sergey Ivanov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719288#comment-17719288 ] Sergey Ivanov commented on KAFKA-14817: --- [~showuon], thank you for explanation!  At the moment we

[jira] [Comment Edited] (KAFKA-13392) Timeout Exception triggering reassign partitions with --bootstrap-server option

2023-05-04 Thread Jonas Lundholm Bertelsen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719274#comment-17719274 ] Jonas Lundholm Bertelsen edited comment on KAFKA-13392 at 5/4/23 11:12 AM:

[GitHub] [kafka] satishd commented on a diff in pull request #13535: KAFKA-9579 Fetch implementation for records in the remote storage through a specific purgatory.

2023-05-04 Thread via GitHub
satishd commented on code in PR #13535: URL: https://github.com/apache/kafka/pull/13535#discussion_r1184873142 ## core/src/main/java/kafka/log/remote/RemoteLogManager.java: ## @@ -670,6 +875,14 @@ public void close() { } catch (InterruptedException e) {

[jira] [Commented] (KAFKA-13392) Timeout Exception triggering reassign partitions with --bootstrap-server option

2023-05-04 Thread Jonas Lundholm Bertelsen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719274#comment-17719274 ] Jonas Lundholm Bertelsen commented on KAFKA-13392: -- We have seen this same issue with a

[GitHub] [kafka] divijvaidya opened a new pull request, #13672: MINOR: Print the cause of failure for PlaintextAdminIntegrationTest

2023-05-04 Thread via GitHub
divijvaidya opened a new pull request, #13672: URL: https://github.com/apache/kafka/pull/13672 # Motivation PlaintextAdminIntegrationTest fails in a flaky manner with the follow trace (e.g. in [this

[GitHub] [kafka] hertzsprung opened a new pull request, #13671: KAFKA-14967: fix NPE in CreateTopicsResult

2023-05-04 Thread via GitHub
hertzsprung opened a new pull request, #13671: URL: https://github.com/apache/kafka/pull/13671 instead of passing `null` to the future, pass a populated `TopicAndMetadataConfig` `MockAdminClient` has no tests that I'm aware of. The contribution is my original work and that I

[GitHub] [kafka] showuon commented on a diff in pull request #13515: KAFKA-14752: Kafka examples improvements - producer changes

2023-05-04 Thread via GitHub
showuon commented on code in PR #13515: URL: https://github.com/apache/kafka/pull/13515#discussion_r1184835821 ## examples/src/main/java/kafka/examples/Producer.java: ## @@ -21,133 +21,164 @@ import org.apache.kafka.clients.producer.ProducerConfig; import

[jira] [Comment Edited] (KAFKA-14817) LogCleaner mark some partitions of __consumer_offsets as uncleanable

2023-05-04 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719250#comment-17719250 ] Luke Chen edited comment on KAFKA-14817 at 5/4/23 10:11 AM:

[jira] [Commented] (KAFKA-14817) LogCleaner mark some partitions of __consumer_offsets as uncleanable

2023-05-04 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719250#comment-17719250 ] Luke Chen commented on KAFKA-14817: --- [~polaris.alioth] [~mrMigles] , thanks for reporting this issue.

[GitHub] [kafka] mimaison merged pull request #13122: KAFKA-14594: Move LogDirsCommand to tools module

2023-05-04 Thread via GitHub
mimaison merged PR #13122: URL: https://github.com/apache/kafka/pull/13122 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] chia7712 commented on pull request #13659: MINOR: add docs to remind reader that impl of ConsumerPartitionAssign…

2023-05-04 Thread via GitHub
chia7712 commented on PR #13659: URL: https://github.com/apache/kafka/pull/13659#issuecomment-1534435900 @kirktrue could you take a look? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] divijvaidya commented on a diff in pull request #13623: KAFKA-14926: Remove metrics on Log Cleaner shutdown

2023-05-04 Thread via GitHub
divijvaidya commented on code in PR #13623: URL: https://github.com/apache/kafka/pull/13623#discussion_r1184786130 ## core/src/test/scala/unit/kafka/log/LogCleanerTest.scala: ## @@ -62,6 +65,39 @@ class LogCleanerTest { Utils.delete(tmpdir) } + @Test + def

[GitHub] [kafka] sandybis commented on pull request #12331: KAFKA-1194: changes needed to run on Windows

2023-05-04 Thread via GitHub
sandybis commented on PR #12331: URL: https://github.com/apache/kafka/pull/12331#issuecomment-1534414079 @MPeli I found AccessDenied exception again when a topic is deleted. This causes a crash same way it used to while deleting message. Could the same fix be applied to delete topic

[GitHub] [kafka] showuon commented on a diff in pull request #13515: KAFKA-14752: Kafka examples improvements - producer changes

2023-05-04 Thread via GitHub
showuon commented on code in PR #13515: URL: https://github.com/apache/kafka/pull/13515#discussion_r1184761649 ## examples/src/main/java/kafka/examples/Producer.java: ## @@ -21,133 +21,159 @@ import org.apache.kafka.clients.producer.ProducerConfig; import

[jira] [Updated] (KAFKA-14967) MockAdminClient throws NullPointerException in CreateTopicsResult

2023-05-04 Thread James Shaw (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Shaw updated KAFKA-14967: --- Description: Calling {{CreateTopicsResult.topicId().get()}} throws {{{}NullPointerException{}}},

[GitHub] [kafka] showuon commented on a diff in pull request #13515: KAFKA-14752: Kafka examples improvements - producer changes

2023-05-04 Thread via GitHub
showuon commented on code in PR #13515: URL: https://github.com/apache/kafka/pull/13515#discussion_r1184756806 ## examples/src/main/java/kafka/examples/Producer.java: ## @@ -21,133 +21,159 @@ import org.apache.kafka.clients.producer.ProducerConfig; import

[jira] [Updated] (KAFKA-14967) MockAdminClient throws NullPointerException in CreateTopicsResult

2023-05-04 Thread James Shaw (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Shaw updated KAFKA-14967: --- Description: Calling {{CreateTopicsResult.topicId().get()}} throws {{{}NullPointerException{}}},

[jira] [Updated] (KAFKA-14967) MockAdminClient throws NullPointerException in CreateTopicsResult

2023-05-04 Thread James Shaw (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Shaw updated KAFKA-14967: --- Description: Calling {{CreateTopicsResult.topicId().get()}} throws {{{}NullPointerException{}}},

[GitHub] [kafka] fvaleri commented on a diff in pull request #13515: KAFKA-14752: Kafka examples improvements - producer changes

2023-05-04 Thread via GitHub
fvaleri commented on code in PR #13515: URL: https://github.com/apache/kafka/pull/13515#discussion_r1183960378 ## examples/src/main/java/kafka/examples/Producer.java: ## @@ -21,133 +21,159 @@ import org.apache.kafka.clients.producer.ProducerConfig; import

[jira] [Created] (KAFKA-14967) MockAdminClient throws NullPointerException in CreateTopicsResult

2023-05-04 Thread James Shaw (Jira)
James Shaw created KAFKA-14967: -- Summary: MockAdminClient throws NullPointerException in CreateTopicsResult Key: KAFKA-14967 URL: https://issues.apache.org/jira/browse/KAFKA-14967 Project: Kafka

[GitHub] [kafka] fvaleri commented on a diff in pull request #13669: MINOR: Fix producer Callback comment

2023-05-04 Thread via GitHub
fvaleri commented on code in PR #13669: URL: https://github.com/apache/kafka/pull/13669#discussion_r1184732376 ## clients/src/main/java/org/apache/kafka/clients/producer/Callback.java: ## @@ -36,7 +36,7 @@ public interface Callback { * Non-Retriable

[GitHub] [kafka] dajac commented on a diff in pull request #13623: KAFKA-14926: Remove metrics on Log Cleaner shutdown

2023-05-04 Thread via GitHub
dajac commented on code in PR #13623: URL: https://github.com/apache/kafka/pull/13623#discussion_r1184723565 ## core/src/test/scala/unit/kafka/log/LogCleanerTest.scala: ## @@ -62,6 +65,39 @@ class LogCleanerTest { Utils.delete(tmpdir) } + @Test + def

[GitHub] [kafka] dajac commented on pull request #13666: KAFKA-14462; [13/N] CoordinatorEvent and CoordinatorEventProcessor

2023-05-04 Thread via GitHub
dajac commented on PR #13666: URL: https://github.com/apache/kafka/pull/13666#issuecomment-1534317488 @kirktrue Thanks for your comments. I have addressed them. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [kafka] dajac commented on a diff in pull request #13666: KAFKA-14462; [13/N] CoordinatorEvent and CoordinatorEventProcessor

2023-05-04 Thread via GitHub
dajac commented on code in PR #13666: URL: https://github.com/apache/kafka/pull/13666#discussion_r1184718825 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/runtime/MultiThreadedEventProcessor.java: ## @@ -0,0 +1,191 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] dajac commented on a diff in pull request #13666: KAFKA-14462; [13/N] CoordinatorEvent and CoordinatorEventProcessor

2023-05-04 Thread via GitHub
dajac commented on code in PR #13666: URL: https://github.com/apache/kafka/pull/13666#discussion_r1184688955 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/runtime/CoordinatorEvent.java: ## @@ -0,0 +1,35 @@ +/* + * Licensed to the Apache Software

[GitHub] [kafka] dajac commented on a diff in pull request #13666: KAFKA-14462; [13/N] CoordinatorEvent and CoordinatorEventProcessor

2023-05-04 Thread via GitHub
dajac commented on code in PR #13666: URL: https://github.com/apache/kafka/pull/13666#discussion_r1184687089 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/runtime/MultiThreadedEventProcessor.java: ## @@ -0,0 +1,191 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] dajac commented on pull request #13638: KAFKA-14462; [11/N] Add CurrentAssignmentBuilder

2023-05-04 Thread via GitHub
dajac commented on PR #13638: URL: https://github.com/apache/kafka/pull/13638#issuecomment-1534267271 @jeffkbkim @jolshan Thanks for your comments. I have addressed them. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [kafka] dajac commented on a diff in pull request #13638: KAFKA-14462; [11/N] Add CurrentAssignmentBuilder

2023-05-04 Thread via GitHub
dajac commented on code in PR #13638: URL: https://github.com/apache/kafka/pull/13638#discussion_r1184677397 ## group-coordinator/src/test/java/org/apache/kafka/coordinator/group/consumer/CurrentAssignmentBuilderTest.java: ## @@ -0,0 +1,548 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] dajac commented on a diff in pull request #13638: KAFKA-14462; [11/N] Add CurrentAssignmentBuilder

2023-05-04 Thread via GitHub
dajac commented on code in PR #13638: URL: https://github.com/apache/kafka/pull/13638#discussion_r1184669415 ## group-coordinator/src/test/java/org/apache/kafka/coordinator/group/consumer/CurrentAssignmentBuilderTest.java: ## @@ -0,0 +1,548 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] dajac commented on a diff in pull request #13638: KAFKA-14462; [11/N] Add CurrentAssignmentBuilder

2023-05-04 Thread via GitHub
dajac commented on code in PR #13638: URL: https://github.com/apache/kafka/pull/13638#discussion_r118484 ## group-coordinator/src/test/java/org/apache/kafka/coordinator/group/consumer/CurrentAssignmentBuilderTest.java: ## @@ -0,0 +1,548 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] dajac commented on a diff in pull request #13638: KAFKA-14462; [11/N] Add CurrentAssignmentBuilder

2023-05-04 Thread via GitHub
dajac commented on code in PR #13638: URL: https://github.com/apache/kafka/pull/13638#discussion_r1184655502 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/consumer/CurrentAssignmentBuilder.java: ## @@ -0,0 +1,436 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] dajac commented on a diff in pull request #13638: KAFKA-14462; [11/N] Add CurrentAssignmentBuilder

2023-05-04 Thread via GitHub
dajac commented on code in PR #13638: URL: https://github.com/apache/kafka/pull/13638#discussion_r1184654172 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/consumer/CurrentAssignmentBuilder.java: ## @@ -0,0 +1,415 @@ +/* + * Licensed to the Apache

  1   2   >