Re: [PR] KAFKA-15879: Add documentation and examples for docker image [kafka]

2023-12-06 Thread via GitHub
omkreddy commented on code in PR #14938: URL: https://github.com/apache/kafka/pull/14938#discussion_r1418474509 ## docker/examples/jvm/cluster/docker-compose.yml: ## @@ -0,0 +1,110 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license

Re: [PR] KAFKA-14132; Replace EasyMock with Mockito in StandaloneHerderTest [kafka]

2023-12-06 Thread via GitHub
mdedetrich commented on PR #12728: URL: https://github.com/apache/kafka/pull/12728#issuecomment-1844822620 I have just pushed a merge commit which adds the `testCreateConnectorWithStoppedInitialState()` test. The translation of the test was quite straight forward, only thing to note is

Re: [PR] KAFKA-15971: Re-enable consumer integration tests for new consumer [kafka]

2023-12-06 Thread via GitHub
dajac commented on PR #14925: URL: https://github.com/apache/kafka/pull/14925#issuecomment-1844810244 Triggered a new build. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] KAFKA-15784: Ensure atomicity of in memory update and write when transactionally committing offsets [kafka]

2023-12-06 Thread via GitHub
dajac commented on PR #14774: URL: https://github.com/apache/kafka/pull/14774#issuecomment-1844806301 @junrao @jolshan I work on implementing the transactional offset commits in the new world. I will take care of adding the verification steps there when this PR is done. We can replicate

Re: [PR] KAFKA-14589 ConsumerGroupCommand options and case classes rewritten [kafka]

2023-12-06 Thread via GitHub
tledkov commented on code in PR #14856: URL: https://github.com/apache/kafka/pull/14856#discussion_r1418448844 ## tools/src/main/java/org/apache/kafka/tools/consumergroup/ConsumerGroupCommandOptions.java: ## @@ -0,0 +1,263 @@ +/* + * Licensed to the Apache Software Foundation

Re: [PR] KAFKA-15903: Add Github Actions Workflow for RC Docker Image [kafka]

2023-12-06 Thread via GitHub
omkreddy merged PR #14940: URL: https://github.com/apache/kafka/pull/14940 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] KAFKA-15880: Add Github Actions Workflow for promoting docker image [kafka]

2023-12-06 Thread via GitHub
omkreddy merged PR #14941: URL: https://github.com/apache/kafka/pull/14941 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] KAFKA-14589 ConsumerGroupCommand options and case classes rewritten [kafka]

2023-12-06 Thread via GitHub
tledkov commented on code in PR #14856: URL: https://github.com/apache/kafka/pull/14856#discussion_r1418426538 ## tools/src/main/java/org/apache/kafka/tools/consumergroup/ConsumerGroupCommandOptions.java: ## @@ -0,0 +1,263 @@ +/* + * Licensed to the Apache Software Foundation

Re: [PR] KAFKA-15980: add KIP-1001 CurrentControllerId metric [kafka]

2023-12-06 Thread via GitHub
cmccabe merged PR #14749: URL: https://github.com/apache/kafka/pull/14749 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] KAFKA-15956: MetadataShell must take the log directory lock when reading [kafka]

2023-12-06 Thread via GitHub
cmccabe commented on PR #14899: URL: https://github.com/apache/kafka/pull/14899#issuecomment-1844406974 Jenkins had an internal issue. Re-pushing to get a clean build. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] KAFKA-15347: fix unit test [kafka]

2023-12-06 Thread via GitHub
mjsax merged PR #14947: URL: https://github.com/apache/kafka/pull/14947 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] KAFKA-13109: SourceTask#poll not enforcing retries in case of RetriableException [kafka]

2023-12-06 Thread via GitHub
github-actions[bot] commented on PR #13726: URL: https://github.com/apache/kafka/pull/13726#issuecomment-1844200113 This PR is being marked as stale since it has not had any activity in 90 days. If you would like to keep this PR alive, please ask a committer for review. If the PR has

Re: [PR] KAFKA-15178: Improve ConsumerCoordinator.poll perf [kafka]

2023-12-06 Thread via GitHub
github-actions[bot] commented on PR #13993: URL: https://github.com/apache/kafka/pull/13993#issuecomment-1844199926 This PR is being marked as stale since it has not had any activity in 90 days. If you would like to keep this PR alive, please ask a committer for review. If the PR has

[PR] KAFKA-15662: Add support for clientInstanceIds in Kafka Stream [kafka]

2023-12-06 Thread via GitHub
mjsax opened a new pull request, #14951: URL: https://github.com/apache/kafka/pull/14951 Stacked on other PRs. Still not completed. But early feedback is welcome. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] KAKFA-15629: Update upgrade-guide.html for TimestampedKeyQuery and TimestampedRangeQuery [kafka]

2023-12-06 Thread via GitHub
mjsax merged PR #14898: URL: https://github.com/apache/kafka/pull/14898 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] KAKFA-15629: Update upgrade-guide.html for TimestampedKeyQuery and TimestampedRangeQuery [kafka]

2023-12-06 Thread via GitHub
mjsax commented on code in PR #14898: URL: https://github.com/apache/kafka/pull/14898#discussion_r1418202440 ## docs/streams/upgrade-guide.html: ## @@ -139,6 +139,10 @@ Streams API

Re: [PR] KAFKA-15696: Refactor closing consumer [kafka]

2023-12-06 Thread via GitHub
kirktrue commented on code in PR #14937: URL: https://github.com/apache/kafka/pull/14937#discussion_r1418183946 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/ConsumerNetworkThread.java: ## @@ -274,79 +269,18 @@ private void closeInternal(final Duration

[jira] [Commented] (KAFKA-12670) KRaft support for unclean.leader.election.enable

2023-12-06 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793974#comment-17793974 ] Luke Chen commented on KAFKA-12670: --- [~cmccabe], do you have any idea when KRaft will support unclean

Re: [PR] MINOR: remove the use of ConsumerTestBuilder from MembershipManagerImplTest [kafka]

2023-12-06 Thread via GitHub
kirktrue commented on PR #14950: URL: https://github.com/apache/kafka/pull/14950#issuecomment-1843973958 @lucasbru—please add the `ctr` tag. If you can also review the code, even better  -- This is an automated message from the Apache Git Service. To respond to the message, please log

[PR] MINOR: remove the use of ConsumerTestBuilder from MembershipManagerImplTest [kafka]

2023-12-06 Thread via GitHub
kirktrue opened a new pull request, #14950: URL: https://github.com/apache/kafka/pull/14950 This is one in a series of changes to reduce/remove reliance on the `ConsumerTestBuilder` for CTR-related tests. -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Created] (KAFKA-15984) Client disconnections can cause hanging transactions on __consumer_offsets

2023-12-06 Thread Justine Olshan (Jira)
Justine Olshan created KAFKA-15984: -- Summary: Client disconnections can cause hanging transactions on __consumer_offsets Key: KAFKA-15984 URL: https://issues.apache.org/jira/browse/KAFKA-15984

[jira] [Comment Edited] (KAFKA-15556) Remove NetworkClientDelegate methods isUnavailable, maybeThrowAuthFailure, and tryConnect

2023-12-06 Thread Phuc Hong Tran (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793972#comment-17793972 ] Phuc Hong Tran edited comment on KAFKA-15556 at 12/7/23 12:51 AM: --

[jira] [Commented] (KAFKA-15556) Remove NetworkClientDelegate methods isUnavailable, maybeThrowAuthFailure, and tryConnect

2023-12-06 Thread Phuc Hong Tran (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793972#comment-17793972 ] Phuc Hong Tran commented on KAFKA-15556: There is a duplicated method "nodeUnavailable" which

[jira] [Updated] (KAFKA-15983) Kafka-acls should return authorization already done if repeating work is issued

2023-12-06 Thread Chen He (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated KAFKA-15983: Summary: Kafka-acls should return authorization already done if repeating work is issued (was:

[jira] [Updated] (KAFKA-15983) Kafka-acls should return authorization already done if repeat work is issued

2023-12-06 Thread Chen He (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated KAFKA-15983: Labels: newbie (was: ) > Kafka-acls should return authorization already done if repeat work is issued >

[jira] [Created] (KAFKA-15983) Kafka-acls should return authorization already done if repeat work is issued

2023-12-06 Thread Chen He (Jira)
Chen He created KAFKA-15983: --- Summary: Kafka-acls should return authorization already done if repeat work is issued Key: KAFKA-15983 URL: https://issues.apache.org/jira/browse/KAFKA-15983 Project: Kafka

Re: [PR] KAFKA-15208: Upgrade Jackson dependencies to version 2.15.3 [kafka]

2023-12-06 Thread via GitHub
bmscomp commented on PR #13662: URL: https://github.com/apache/kafka/pull/13662#issuecomment-1843889093 @mimaison Done! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] KAFKA-15696: Refactor closing consumer [kafka]

2023-12-06 Thread via GitHub
philipnee commented on code in PR #14937: URL: https://github.com/apache/kafka/pull/14937#discussion_r1418129061 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/ConsumerNetworkThread.java: ## @@ -274,79 +269,18 @@ private void closeInternal(final Duration

Re: [PR] KAFKA-15696: Refactor closing consumer [kafka]

2023-12-06 Thread via GitHub
philipnee commented on code in PR #14937: URL: https://github.com/apache/kafka/pull/14937#discussion_r1418128177 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumer.java: ## @@ -1024,15 +1037,14 @@ private void close(Duration timeout, boolean

Re: [PR] KAFKA-14132; Replace EasyMock with Mockito in StandaloneHerderTest [kafka]

2023-12-06 Thread via GitHub
mdedetrich commented on PR #12728: URL: https://github.com/apache/kafka/pull/12728#issuecomment-1843872683 > @mdedetrich Thanks, the changes look good to go. But the build is failing because there are new tests on trunk that still use EasyMock/PowerMock. Can you rebase on the latest from

Re: [PR] KAFKA-15784: Ensure atomicity of in memory update and write when transactionally committing offsets [kafka]

2023-12-06 Thread via GitHub
hachikuji commented on code in PR #14774: URL: https://github.com/apache/kafka/pull/14774#discussion_r1418127368 ## core/src/main/scala/kafka/server/ReplicaManager.scala: ## @@ -941,39 +851,209 @@ class ReplicaManager(val config: KafkaConfig, } } - private def

Re: [PR] KAFKA-15696: Refactor closing consumer [kafka]

2023-12-06 Thread via GitHub
philipnee commented on PR #14937: URL: https://github.com/apache/kafka/pull/14937#issuecomment-1843871662 Hi @kirktrue - I rewrote the previous PR based on your feedback. I thought driving the close via event is a better and clearer pattern, so thanks for the suggestions. Would you have

[PR] KAFKA-15215: docs for KIP-954 [kafka]

2023-12-06 Thread via GitHub
agavra opened a new pull request, #14949: URL: https://github.com/apache/kafka/pull/14949 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [PR] KAFKA-15696: Refactor AsyncConsumer close procedure [kafka]

2023-12-06 Thread via GitHub
philipnee commented on PR #14920: URL: https://github.com/apache/kafka/pull/14920#issuecomment-1843868318 Thanks @lucasbru and @kirktrue - i'm closing this one and reopening another one. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] KAFKA-15696: Refactor AsyncConsumer close procedure [kafka]

2023-12-06 Thread via GitHub
philipnee closed pull request #14920: KAFKA-15696: Refactor AsyncConsumer close procedure URL: https://github.com/apache/kafka/pull/14920 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[PR] KAFKA-15662: Add support for clientInstanceIds in Kafka Stream [kafka]

2023-12-06 Thread via GitHub
mjsax opened a new pull request, #14948: URL: https://github.com/apache/kafka/pull/14948 Part of KIP-714. Adds support to expose producer client instance id. This PR only adds support for thread producer and state-updater disabled. -- This is an automated message from the Apache

Re: [PR] Refactor closing consumer [kafka]

2023-12-06 Thread via GitHub
philipnee commented on code in PR #14937: URL: https://github.com/apache/kafka/pull/14937#discussion_r1418122441 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumer.java: ## @@ -1050,6 +1062,81 @@ private void close(Duration timeout, boolean

Re: [PR] KAFKA-15347: add support for 'single key multi timestamp' IQs with versioned state stores (KIP-968) [kafka]

2023-12-06 Thread via GitHub
aliehsaeedii commented on PR #14626: URL: https://github.com/apache/kafka/pull/14626#issuecomment-1843861522 > @aliehsaeedii @mjsax The last build has many failed tests: https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka-pr/detail/PR-14626/26/tests. I also see them in

Re: [PR] KAFKA-15784: Ensure atomicity of in memory update and write when transactionally committing offsets [kafka]

2023-12-06 Thread via GitHub
jolshan commented on code in PR #14774: URL: https://github.com/apache/kafka/pull/14774#discussion_r1418097344 ## core/src/main/scala/kafka/coordinator/group/GroupMetadataManager.scala: ## @@ -349,146 +468,68 @@ class GroupMetadataManager(brokerId: Int,

Re: [PR] KAFKA-15784: Ensure atomicity of in memory update and write when transactionally committing offsets [kafka]

2023-12-06 Thread via GitHub
jolshan commented on code in PR #14774: URL: https://github.com/apache/kafka/pull/14774#discussion_r1418096753 ## core/src/main/scala/kafka/coordinator/group/GroupMetadataManager.scala: ## @@ -339,156 +340,183 @@ class GroupMetadataManager(brokerId: Int,

Re: [PR] KAFKA-15784: Ensure atomicity of in memory update and write when transactionally committing offsets [kafka]

2023-12-06 Thread via GitHub
jolshan commented on PR #14774: URL: https://github.com/apache/kafka/pull/14774#issuecomment-1843841126 @junrao Thanks for taking a look. I was just rewriting the code to make this clearer. I will take a look at @artemlivshits and your questions about locking now. -- This is an

Re: [PR] KAFKA-15784: Ensure atomicity of in memory update and write when transactionally committing offsets [kafka]

2023-12-06 Thread via GitHub
jolshan commented on code in PR #14774: URL: https://github.com/apache/kafka/pull/14774#discussion_r1418093193 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -708,23 +708,40 @@ class KafkaApis(val requestChannel: RequestChannel, } } -if

Re: [PR] KAFKA-15950: Serialize broker heartbeat requests [kafka]

2023-12-06 Thread via GitHub
soarez commented on PR #14903: URL: https://github.com/apache/kafka/pull/14903#issuecomment-1843813913 @junrao: Thanks for revewing this. It seems there are currently some issues with faling tests. See https://github.com/apache/kafka/pull/14838#issuecomment-1843693525 The test failures

Re: [PR] KAFKA-15347: fix unit test [kafka]

2023-12-06 Thread via GitHub
mjsax commented on code in PR #14947: URL: https://github.com/apache/kafka/pull/14947#discussion_r1418059234 ## streams/src/test/java/org/apache/kafka/streams/state/internals/RocksDBVersionedStoreSegmentValueFormatterTest.java: ## @@ -230,13 +230,19 @@ public void

Re: [PR] KAFKA-15662: Add support for clientInstanceIds in Kafka Stream [kafka]

2023-12-06 Thread via GitHub
wcarlson5 commented on code in PR #14935: URL: https://github.com/apache/kafka/pull/14935#discussion_r1418058902 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamThread.java: ## @@ -1477,6 +1528,27 @@ public Object getStateLock() { return

Re: [PR] KAFKA-15662: Add support for clientInstanceIds in Kafka Stream [kafka]

2023-12-06 Thread via GitHub
wcarlson5 commented on code in PR #14922: URL: https://github.com/apache/kafka/pull/14922#discussion_r1418054625 ## streams/src/main/java/org/apache/kafka/streams/KafkaStreams.java: ## @@ -1802,7 +1805,7 @@ protected int processStreamThread(final Consumer consumer) { *

Re: [PR] KAFKA-15363: Broker log directory failure changes [kafka]

2023-12-06 Thread via GitHub
rondagostino commented on code in PR #14790: URL: https://github.com/apache/kafka/pull/14790#discussion_r1418016489 ## core/src/main/scala/kafka/server/ReplicaAlterLogDirsThread.scala: ## @@ -76,13 +83,69 @@ class ReplicaAlterLogDirsThread(name: String,

Re: [PR] KAFKA-15978: Update member information on HB response [kafka]

2023-12-06 Thread via GitHub
AndrewJSchofield commented on PR #14945: URL: https://github.com/apache/kafka/pull/14945#issuecomment-1843752569 Investigating failure of new test -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] KAFKA-15361: Process and persist dir info with broker registration [kafka]

2023-12-06 Thread via GitHub
rondagostino merged PR #14838: URL: https://github.com/apache/kafka/pull/14838 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Created] (KAFKA-15982) Move GenericGroup state metrics to `GroupCoordinatorMetricsShard`

2023-12-06 Thread Jeff Kim (Jira)
Jeff Kim created KAFKA-15982: Summary: Move GenericGroup state metrics to `GroupCoordinatorMetricsShard` Key: KAFKA-15982 URL: https://issues.apache.org/jira/browse/KAFKA-15982 Project: Kafka

Re: [PR] KAFKA-15784: Ensure atomicity of in memory update and write when transactionally committing offsets [kafka]

2023-12-06 Thread via GitHub
junrao commented on PR #14774: URL: https://github.com/apache/kafka/pull/14774#issuecomment-1843729483 @jolshan : Thanks for the PR. Should we fix the `append` call in `CoordinatorRuntime` (https://github.com/apache/kafka/pull/14705) too? There, a partition level lock in

Re: [PR] KAFKA-15361: Process and persist dir info with broker registration [kafka]

2023-12-06 Thread via GitHub
cmccabe commented on PR #14838: URL: https://github.com/apache/kafka/pull/14838#issuecomment-1843728301 @rondagostino : I think we can merge this now because I don't think it's adding more failures. I do think we need to do another sweep looking for people calling `Exit.exit`, but that

[jira] [Created] (KAFKA-15981) only record GenericGroup state metrics once per group during load

2023-12-06 Thread Jeff Kim (Jira)
Jeff Kim created KAFKA-15981: Summary: only record GenericGroup state metrics once per group during load Key: KAFKA-15981 URL: https://issues.apache.org/jira/browse/KAFKA-15981 Project: Kafka

Re: [PR] KAFKA-15563: Provide informative error messages when Connect REST requests time out [kafka]

2023-12-06 Thread via GitHub
gharris1727 commented on code in PR #14562: URL: https://github.com/apache/kafka/pull/14562#discussion_r1418003736 ## connect/runtime/src/test/java/org/apache/kafka/connect/integration/ConnectWorkerIntegrationTest.java: ## @@ -771,6 +778,104 @@ private Map

Re: [PR] KAFKA-15361: Process and persist dir info with broker registration [kafka]

2023-12-06 Thread via GitHub
rondagostino commented on PR #14838: URL: https://github.com/apache/kafka/pull/14838#issuecomment-1843693525 Looking at the [trunk build jobs](https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka/activity?branch=trunk):

Re: [PR] KAFKA-15361: Process and persist dir info with broker registration [kafka]

2023-12-06 Thread via GitHub
rondagostino commented on PR #14838: URL: https://github.com/apache/kafka/pull/14838#issuecomment-1843668221 I think the issue is not with our PR. Here's another [PR that is basically a 2-line change in a single test](https://github.com/apache/kafka/pull/14944) and that has [144 test

Re: [PR] KAFKA-15361: Process and persist dir info with broker registration [kafka]

2023-12-06 Thread via GitHub
rondagostino commented on PR #14838: URL: https://github.com/apache/kafka/pull/14838#issuecomment-1843665517 [Latest builds for JDKs 8 and 21 failed](https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka-pr/detail/PR-14838/16/pipeline/). Restarted the build:

[PR] KAFKA-15347: fix unit test [kafka]

2023-12-06 Thread via GitHub
aliehsaeedii opened a new pull request, #14947: URL: https://github.com/apache/kafka/pull/14947 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.* *Summary of

Re: [PR] KAFKA-15950: Serialize broker heartbeat requests [kafka]

2023-12-06 Thread via GitHub
junrao commented on code in PR #14903: URL: https://github.com/apache/kafka/pull/14903#discussion_r1417911671 ## core/src/main/scala/kafka/server/BrokerLifecycleManager.scala: ## @@ -364,10 +377,30 @@ class BrokerLifecycleManager( } _channelManager.sendRequest(new

Re: [PR] Refactor closing consumer [kafka]

2023-12-06 Thread via GitHub
philipnee commented on code in PR #14937: URL: https://github.com/apache/kafka/pull/14937#discussion_r1417650715 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumerTest.java: ## @@ -778,18 +783,23 @@ public void testGroupIdNull() {

Re: [PR] KAFKA-15818: ensure leave group on max poll interval [kafka]

2023-12-06 Thread via GitHub
philipnee commented on PR #14873: URL: https://github.com/apache/kafka/pull/14873#issuecomment-1843583099 Hi @lianetm @cadonna @lucasbru - Thanks for taking the time reviewing my PR. I addressed your comments and left one for @cadonna. -- This is an automated message from the Apache Git

Re: [PR] KAFKA-15818: ensure leave group on max poll interval [kafka]

2023-12-06 Thread via GitHub
philipnee commented on code in PR #14873: URL: https://github.com/apache/kafka/pull/14873#discussion_r1417898446 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/HeartbeatRequestManagerTest.java: ## @@ -399,14 +400,45 @@ public void testHeartbeatState() {

Re: [PR] KAFKA-15978: Update member information on HB response [kafka]

2023-12-06 Thread via GitHub
lianetm commented on code in PR #14945: URL: https://github.com/apache/kafka/pull/14945#discussion_r1417895767 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/CommitRequestManager.java: ## @@ -224,6 +224,13 @@ boolean canAutoCommit() { return

Re: [PR] KAFKA-15978: Update member information on HB response [kafka]

2023-12-06 Thread via GitHub
lianetm commented on code in PR #14945: URL: https://github.com/apache/kafka/pull/14945#discussion_r1417895767 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/CommitRequestManager.java: ## @@ -224,6 +224,13 @@ boolean canAutoCommit() { return

Re: [PR] KAFKA-15978: Update member information on HB response [kafka]

2023-12-06 Thread via GitHub
lianetm commented on code in PR #14945: URL: https://github.com/apache/kafka/pull/14945#discussion_r1417892970 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/CommitRequestManager.java: ## @@ -224,6 +224,13 @@ boolean canAutoCommit() { return

Re: [PR] KAFKA-15978: Update member information on HB response [kafka]

2023-12-06 Thread via GitHub
dajac commented on code in PR #14945: URL: https://github.com/apache/kafka/pull/14945#discussion_r1417891269 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/CommitRequestManager.java: ## @@ -224,6 +224,13 @@ boolean canAutoCommit() { return

Re: [PR] KAFKA-14505; [2/N] Implement TxnOffsetCommit API [kafka]

2023-12-06 Thread via GitHub
dajac commented on PR #14845: URL: https://github.com/apache/kafka/pull/14845#issuecomment-1843565757 It looks like the new failing tests are coming from https://github.com/apache/kafka/pull/14626. -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] KAFKA-14589 ConsumerGroupCommand rewritten in java [kafka]

2023-12-06 Thread via GitHub
nizhikov commented on code in PR #14471: URL: https://github.com/apache/kafka/pull/14471#discussion_r1417877630 ## tools/src/main/java/org/apache/kafka/tools/consumergroup/CsvUtils.java: ## @@ -0,0 +1,154 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

Re: [PR] MINOR: Support to update Async Consumer group member label (KIP-714) [kafka]

2023-12-06 Thread via GitHub
apoorvmittal10 commented on code in PR #14946: URL: https://github.com/apache/kafka/pull/14946#discussion_r1417877859 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/MembershipManagerImpl.java: ## @@ -321,6 +332,9 @@ public void

Re: [PR] KAFKA-15347: add support for 'single key multi timestamp' IQs with versioned state stores (KIP-968) [kafka]

2023-12-06 Thread via GitHub
dajac commented on PR #14626: URL: https://github.com/apache/kafka/pull/14626#issuecomment-1843551173 @aliehsaeedii @mjsax The last build has many failed tests: https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka-pr/detail/PR-14626/26/tests. I also see them in other

[jira] [Resolved] (KAFKA-15972) Add support to exclude labels in client telemetry

2023-12-06 Thread Apoorv Mittal (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal resolved KAFKA-15972. --- Resolution: Done > Add support to exclude labels in client telemetry >

[jira] [Resolved] (KAFKA-15877) Support change of temporality in Java client

2023-12-06 Thread Apoorv Mittal (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal resolved KAFKA-15877. --- Resolution: Done > Support change of temporality in Java client >

[jira] [Resolved] (KAFKA-15684) Add support to describe all subscriptions through utility

2023-12-06 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-15684. - Fix Version/s: 3.7.0 Resolution: Fixed merged the PR to trunk. > Add support to describe all

[jira] [Commented] (KAFKA-15877) Support change of temporality in Java client

2023-12-06 Thread Apoorv Mittal (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793896#comment-17793896 ] Apoorv Mittal commented on KAFKA-15877: --- Changes were committed as part of PR:

Re: [PR] KAFKA-15684: Support to describe all client metrics resources (KIP-714) [kafka]

2023-12-06 Thread via GitHub
junrao merged PR #14933: URL: https://github.com/apache/kafka/pull/14933 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Created] (KAFKA-15979) Add KIP-1001 CurrentControllerId metric

2023-12-06 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-15979: Summary: Add KIP-1001 CurrentControllerId metric Key: KAFKA-15979 URL: https://issues.apache.org/jira/browse/KAFKA-15979 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-15980) Add KIP-1001 CurrentControllerId metric

2023-12-06 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-15980: Summary: Add KIP-1001 CurrentControllerId metric Key: KAFKA-15980 URL: https://issues.apache.org/jira/browse/KAFKA-15980 Project: Kafka Issue Type:

Re: [PR] KAFKA-15684: Support to describe all client metrics resources (KIP-714) [kafka]

2023-12-06 Thread via GitHub
apoorvmittal10 commented on PR #14933: URL: https://github.com/apache/kafka/pull/14933#issuecomment-1843520738 > @apoorvmittal10 : Thanks for the updated PR. Just a minor comment. @junrao Thanks for again reviewing the PR. I have added thoughts for the comment and verified same

Re: [PR] MINOR: Support to update Async Consumer group member label (KIP-714) [kafka]

2023-12-06 Thread via GitHub
apoorvmittal10 commented on code in PR #14946: URL: https://github.com/apache/kafka/pull/14946#discussion_r1417849266 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/MembershipManagerImpl.java: ## @@ -321,6 +332,9 @@ public void

[jira] [Updated] (KAFKA-15816) Typos in tests leak network sockets

2023-12-06 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris updated KAFKA-15816: Description: There are a few tests which leak network sockets due to small typos in the tests

Re: [PR] KAFKA-15816: Fix leaked sockets in mirror tests [kafka]

2023-12-06 Thread via GitHub
gharris1727 merged PR #14761: URL: https://github.com/apache/kafka/pull/14761 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] KAFKA-15816: Fix leaked sockets in mirror tests [kafka]

2023-12-06 Thread via GitHub
gharris1727 commented on PR #14761: URL: https://github.com/apache/kafka/pull/14761#issuecomment-1843486780 Test failures appear unrelated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] KAFKA-15684: Support to describe all client metrics resources (KIP-714) [kafka]

2023-12-06 Thread via GitHub
apoorvmittal10 commented on code in PR #14933: URL: https://github.com/apache/kafka/pull/14933#discussion_r1417826343 ## core/src/test/scala/unit/kafka/admin/ConfigCommandTest.scala: ## @@ -1690,13 +1690,33 @@ class ConfigCommandTest extends Logging { } @Test - def

Re: [PR] MINOR: fully encapsulate user restore listener in the DelegatingRestoreListener [kafka]

2023-12-06 Thread via GitHub
ableegoldman merged PR #14886: URL: https://github.com/apache/kafka/pull/14886 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] MINOR: Support to update Async Consumer group member label (KIP-714) [kafka]

2023-12-06 Thread via GitHub
apoorvmittal10 commented on code in PR #14946: URL: https://github.com/apache/kafka/pull/14946#discussion_r1417815612 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/MembershipManagerImpl.java: ## @@ -321,6 +332,9 @@ public void

Re: [PR] KAFKA-15684: Support to describe all client metrics resources (KIP-714) [kafka]

2023-12-06 Thread via GitHub
apoorvmittal10 commented on code in PR #14933: URL: https://github.com/apache/kafka/pull/14933#discussion_r1417807074 ## core/src/test/scala/unit/kafka/admin/ConfigCommandTest.scala: ## @@ -1690,13 +1690,33 @@ class ConfigCommandTest extends Logging { } @Test - def

Re: [PR] KAFKA-15818: ensure leave group on max poll interval [kafka]

2023-12-06 Thread via GitHub
philipnee commented on code in PR #14873: URL: https://github.com/apache/kafka/pull/14873#discussion_r1417795477 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/HeartbeatRequestManager.java: ## @@ -201,13 +224,35 @@ public long maximumTimeToWait(long

[jira] [Resolved] (KAFKA-15871) Implement kafka-client-metrics.sh tool

2023-12-06 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-15871. - Resolution: Fixed merged the PR to trunk > Implement kafka-client-metrics.sh tool >

Re: [PR] KAFKA-14132; Replace EasyMock with Mockito in StandaloneHerderTest [kafka]

2023-12-06 Thread via GitHub
C0urante commented on PR #12728: URL: https://github.com/apache/kafka/pull/12728#issuecomment-1843418398 @mdedetrich Thanks, the changes look good to go. But the build is failing because there are new tests on trunk that still use EasyMock/PowerMock. Can you rebase on the latest from

Re: [PR] KAFKA-15871: kafka-client-metrics.sh [kafka]

2023-12-06 Thread via GitHub
junrao merged PR #14926: URL: https://github.com/apache/kafka/pull/14926 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] KAFKA-15684: Support to describe all client metrics resources (KIP-714) [kafka]

2023-12-06 Thread via GitHub
junrao commented on code in PR #14933: URL: https://github.com/apache/kafka/pull/14933#discussion_r1417759706 ## core/src/test/scala/unit/kafka/admin/ConfigCommandTest.scala: ## @@ -1690,13 +1690,33 @@ class ConfigCommandTest extends Logging { } @Test - def

Re: [PR] MINOR: Support to update Async Consumer group member label (KIP-714) [kafka]

2023-12-06 Thread via GitHub
AndrewJSchofield commented on code in PR #14946: URL: https://github.com/apache/kafka/pull/14946#discussion_r1417760787 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/MembershipManagerImpl.java: ## @@ -321,6 +332,9 @@ public void

Re: [PR] KAFKA-15018: Failing offset flush for EOS when secondary offset store writes fails for tombstone records [kafka]

2023-12-06 Thread via GitHub
C0urante commented on code in PR #13801: URL: https://github.com/apache/kafka/pull/13801#discussion_r1417751374 ## connect/runtime/src/main/java/org/apache/kafka/connect/storage/ConnectorOffsetBackingStore.java: ## @@ -279,15 +290,54 @@ public Future set(Map values, Callback

Re: [PR] KAFKA-15662: Add support for clientInstanceIds in Kafka Stream [kafka]

2023-12-06 Thread via GitHub
mjsax commented on code in PR #14922: URL: https://github.com/apache/kafka/pull/14922#discussion_r1417761864 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamThread.java: ## @@ -1477,6 +1533,29 @@ public Object getStateLock() { return

Re: [PR] KAFKA-15018: Failing offset flush for EOS when secondary offset store writes fails for tombstone records [kafka]

2023-12-06 Thread via GitHub
C0urante commented on code in PR #13801: URL: https://github.com/apache/kafka/pull/13801#discussion_r1417677509 ## connect/runtime/src/main/java/org/apache/kafka/connect/storage/ConnectorOffsetBackingStore.java: ## @@ -279,15 +290,54 @@ public Future set(Map values, Callback

[jira] [Resolved] (KAFKA-15932) Flaky test - PlaintextConsumerTest.testSeek("kraft+kip-848","consumer")

2023-12-06 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-15932. -- Resolution: Fixed > Flaky test -

Re: [PR] KAFKA-15932: Wait for responses in consumer operations [kafka]

2023-12-06 Thread via GitHub
cadonna merged PR #14912: URL: https://github.com/apache/kafka/pull/14912 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] KAFKA-15764: Missing Tests for Transactions [kafka]

2023-12-06 Thread via GitHub
jolshan commented on PR #14702: URL: https://github.com/apache/kafka/pull/14702#issuecomment-1843376087 I've restarted the build every day since the approval and have yet to get a clean build ‍ -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] MINOR: Support to update Async Consumer group member label (KIP-714) [kafka]

2023-12-06 Thread via GitHub
apoorvmittal10 commented on PR #14946: URL: https://github.com/apache/kafka/pull/14946#issuecomment-1843373904 @kirktrue @philipnee @AndrewJSchofield Can you please review the change and let me know if change is at right place for new consumer? cc: @mjsax @wcarlson5 -- This is an

[PR] MINOR: Support to update Async Consumer group member label (KIP-714) [kafka]

2023-12-06 Thread via GitHub
apoorvmittal10 opened a new pull request, #14946: URL: https://github.com/apache/kafka/pull/14946 - As the KIP-848 introduced new Kafka Consumer hence KIP-714 required further changes to capture `group_member_id`. - The change also includes a fix to update labels, as earlier calling

  1   2   3   >