[jira] (KAFKA-3700) CRL support

2023-11-08 Thread Igor Shipenkov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-3700 ] Igor Shipenkov deleted comment on KAFKA-3700: --- was (Author: JIRAUSER280700): For people, looking for OCSP support. Use Oracle Java documentation "[Security Developer’s Guide - OCSP Stapling

Re: [PR] MINOR: Rewrite the meta.properties handling code in Java and fix some issues [kafka]

2023-11-08 Thread via GitHub
cmccabe commented on code in PR #14628: URL: https://github.com/apache/kafka/pull/14628#discussion_r1386171452 ## metadata/src/main/java/org/apache/kafka/metadata/properties/MetaPropertiesVersion.java: ## @@ -0,0 +1,71 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] MINOR: Rewrite the meta.properties handling code in Java and fix some issues [kafka]

2023-11-08 Thread via GitHub
cmccabe commented on code in PR #14628: URL: https://github.com/apache/kafka/pull/14628#discussion_r1386172972 ## metadata/src/main/java/org/apache/kafka/metadata/properties/MetaPropertiesVersion.java: ## @@ -0,0 +1,71 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] MINOR: Rewrite the meta.properties handling code in Java and fix some issues [kafka]

2023-11-08 Thread via GitHub
cmccabe commented on code in PR #14628: URL: https://github.com/apache/kafka/pull/14628#discussion_r1386175030 ## metadata/src/main/java/org/apache/kafka/metadata/properties/MetaPropertiesEnsemble.java: ## @@ -0,0 +1,575 @@ +/* + * Licensed to the Apache Software Foundation (ASF

Re: [PR] MINOR: Rewrite the meta.properties handling code in Java and fix some issues [kafka]

2023-11-08 Thread via GitHub
cmccabe commented on code in PR #14628: URL: https://github.com/apache/kafka/pull/14628#discussion_r1386175030 ## metadata/src/main/java/org/apache/kafka/metadata/properties/MetaPropertiesEnsemble.java: ## @@ -0,0 +1,575 @@ +/* + * Licensed to the Apache Software Foundation (ASF

[jira] [Commented] (KAFKA-14419) Failed SyncGroup leading to partitions lost due to processing during rebalances

2023-11-08 Thread Mikael (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17783924#comment-17783924 ] Mikael commented on KAFKA-14419: [~mjsax] The reduced session.timeout.ms is because we w

[jira] [Commented] (KAFKA-15707) KRaft support in TopicBasedRemoteLogMetadataManagerHarness

2023-11-08 Thread Zihao Lin (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17783927#comment-17783927 ] Zihao Lin commented on KAFKA-15707: --- The description is not clear. The test need to be

[jira] [Updated] (KAFKA-15707) KRaft support in TopicBasedRemoteLogMetadataManagerTest

2023-11-08 Thread Zihao Lin (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zihao Lin updated KAFKA-15707: -- Summary: KRaft support in TopicBasedRemoteLogMetadataManagerTest (was: KRaft support in TopicBasedRem

[jira] [Comment Edited] (KAFKA-15707) KRaft support in TopicBasedRemoteLogMetadataManagerTest

2023-11-08 Thread Zihao Lin (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17783927#comment-17783927 ] Zihao Lin edited comment on KAFKA-15707 at 11/8/23 8:41 AM:

[jira] [Updated] (KAFKA-15707) KRaft support in TopicBasedRemoteLogMetadataManagerTest

2023-11-08 Thread Zihao Lin (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zihao Lin updated KAFKA-15707: -- Description: The following tests in TopicBasedRemoteLogMetadataManagerTest in storage/src/test/java/o

[jira] [Updated] (KAFKA-15750) KRaft support in KafkaMetricReporterExceptionHandlingTest

2023-11-08 Thread Zihao Lin (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zihao Lin updated KAFKA-15750: -- Fix Version/s: (was: 4.0.0) > KRaft support in KafkaMetricReporterExceptionHandlingTest >

[jira] [Updated] (KAFKA-15739) KRaft support in ResetConsumerGroupOffsetTest

2023-11-08 Thread Zihao Lin (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zihao Lin updated KAFKA-15739: -- Fix Version/s: (was: 4.0.0) > KRaft support in ResetConsumerGroupOffsetTest >

Re: [PR] KAFKA-15277: Design & implement support for internal Consumer delegates [kafka]

2023-11-08 Thread via GitHub
dajac commented on PR #14670: URL: https://github.com/apache/kafka/pull/14670#issuecomment-1801359691 Thanks for the explanation, @kirktrue. I agree with you that we should not block this PR on fixing all those tests. We can continue to fix them in subsequent PRs. For the tests only applica

Re: [PR] KAFKA-15277: Design & implement support for internal Consumer delegates [kafka]

2023-11-08 Thread via GitHub
dajac commented on code in PR #14670: URL: https://github.com/apache/kafka/pull/14670#discussion_r1386231835 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/ConsumerDelegate.java: ## @@ -0,0 +1,36 @@ +/* + * Licensed to the Apache Software Foundation (ASF) u

Re: [PR] KAFKA-15470: Allow creating connectors in a stopped state [kafka]

2023-11-08 Thread via GitHub
yashmayya commented on code in PR #14704: URL: https://github.com/apache/kafka/pull/14704#discussion_r1386195297 ## docs/connect.html: ## @@ -41,7 +41,7 @@ Running Kafka ConnectIn standalone mode all work is performed in a single process. This configuration is simpler to setup

Re: [PR] KAFKA-15277: Design & implement support for internal Consumer delegates [kafka]

2023-11-08 Thread via GitHub
dajac commented on code in PR #14670: URL: https://github.com/apache/kafka/pull/14670#discussion_r1386232830 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/ConsumerNetworkThread.java: ## @@ -247,12 +247,10 @@ private void closeInternal(final Duration timeou

Re: [PR] KAFKA-15277: Design & implement support for internal Consumer delegates [kafka]

2023-11-08 Thread via GitHub
dajac commented on code in PR #14670: URL: https://github.com/apache/kafka/pull/14670#discussion_r1386239113 ## clients/src/test/java/org/apache/kafka/clients/consumer/KafkaConsumerTest.java: ## @@ -222,42 +214,74 @@ public void cleanup() { } } -@Test -pu

Re: [PR] KAFKA-15277: Design & implement support for internal Consumer delegates [kafka]

2023-11-08 Thread via GitHub
dajac commented on PR #14670: URL: https://github.com/apache/kafka/pull/14670#issuecomment-1801373056 @kirktrue The build is red. Could you please take a look? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[jira] [Assigned] (KAFKA-15708) KRaft support in FetchRequestDownConversionConfigTest

2023-11-08 Thread Zihao Lin (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zihao Lin reassigned KAFKA-15708: - Assignee: Zihao Lin > KRaft support in FetchRequestDownConversionConfigTest > -

[PR] KAFKA-15708: KRaft support in FetchRequestDownConversionConfigTest [kafka]

2023-11-08 Thread via GitHub
linzihao1999 opened a new pull request, #14715: URL: https://github.com/apache/kafka/pull/14715 The tests in FetchRequestDownConversionConfigTest in core/src/test/scala/unit/kafka/server/FetchRequestDownConversionConfigTest.scala updated to support KRaft. ### Committer Checklist (exc

Re: [PR] KAFKA-14132; Replace EasyMock with Mockito in StandaloneHerderTest [kafka]

2023-11-08 Thread via GitHub
mdedetrich commented on PR #12728: URL: https://github.com/apache/kafka/pull/12728#issuecomment-1801718171 @C0urante So I can confirm the following things * No methods are directly called on mocks (I checked both mocks defined by the `@Mock` annotation or local mocks created with `moc

[PR] KAFKA-14133: Move StreamTaskTest to Mockito [kafka]

2023-11-08 Thread via GitHub
clolov opened a new pull request, #14716: URL: https://github.com/apache/kafka/pull/14716 This pull requests migrates mocks from StreamTaskTest to Mockito. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

Re: [PR] KAFKA-14133: Move StreamTaskTest to Mockito [kafka]

2023-11-08 Thread via GitHub
clolov commented on PR #14716: URL: https://github.com/apache/kafka/pull/14716#issuecomment-1801761375 I will circle back a bit later to provide reasoning about why some seemingly needed things were removed. -- This is an automated message from the Apache Git Service. To respond to the me

Re: [PR] KAFKA-14517:Implement regex subscriptions [kafka]

2023-11-08 Thread via GitHub
vamossagar12 commented on PR #14327: URL: https://github.com/apache/kafka/pull/14327#issuecomment-1801765565 @JimmyWang6 , Did you get a chance to go through the comments above? Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] KAFKA-15360: Include dirs in BrokerRegistration [kafka]

2023-11-08 Thread via GitHub
soarez commented on PR #14392: URL: https://github.com/apache/kafka/pull/14392#issuecomment-1801863864 I don't think I understand your comment/suggestion. The broker can only know UUIDs for directories that are online. If they are offline the directory ID cannot be read. What should be done

Re: [PR] KAFKA-15357: Aggregate and propagate assignments [kafka]

2023-11-08 Thread via GitHub
soarez commented on code in PR #14369: URL: https://github.com/apache/kafka/pull/14369#discussion_r1386609951 ## core/src/main/scala/kafka/server/ReplicaManager.scala: ## @@ -2296,13 +2298,41 @@ class ReplicaManager(val config: KafkaConfig, if (sendZkNotification)

Re: [PR] MINOR: Remove unsed code in clients:common:errors [kafka]

2023-11-08 Thread via GitHub
jlprat commented on PR #14692: URL: https://github.com/apache/kafka/pull/14692#issuecomment-1801887255 Hi @ex172000 These methods might be indeed not used within the Kafka codebase. However, they are part of the public APIs and removing these methods might break source/binary compatibili

Re: [PR] KAFKA-7632: Support Compression Level [kafka]

2023-11-08 Thread via GitHub
mimaison commented on PR #10826: URL: https://github.com/apache/kafka/pull/10826#issuecomment-1801941525 Yes it would be good to get this over the line. @dongjinleekr Do you think you'll have time to update it? or would you need some help? -- This is an automated message from the Apache G

Re: [PR] MINOR: Remove unsed code in clients:common:errors [kafka]

2023-11-08 Thread via GitHub
ex172000 commented on PR #14692: URL: https://github.com/apache/kafka/pull/14692#issuecomment-1802087614 > Hi @ex172000 thanks for the PR. These methods might be indeed not used within the Kafka codebase. However, they are part of the public APIs and removing these methods might break sourc

Re: [PR] KAFKA-15357: Aggregate and propagate assignments [kafka]

2023-11-08 Thread via GitHub
pprovenzano commented on code in PR #14369: URL: https://github.com/apache/kafka/pull/14369#discussion_r1386788917 ## core/src/main/scala/kafka/server/ReplicaManager.scala: ## @@ -2296,13 +2298,41 @@ class ReplicaManager(val config: KafkaConfig, if (sendZkNotification)

Re: [PR] KAFKA-15360: Include dirs in BrokerRegistration [kafka]

2023-11-08 Thread via GitHub
pprovenzano commented on PR #14392: URL: https://github.com/apache/kafka/pull/14392#issuecomment-1802108456 > I don't think I understand your comment/suggestion. The broker can only know UUIDs for directories that are online. If they are offline the directory ID cannot be read. What should

Re: [PR] MINOR: Remove unsed code in clients:common:errors [kafka]

2023-11-08 Thread via GitHub
jlprat commented on PR #14692: URL: https://github.com/apache/kafka/pull/14692#issuecomment-1802117942 Correct, deprecated methods and classes can be removed in `4.0.0` (but we are not yet preparing this release) as long as they have been deprecated for a year (if my memory serves right the

Re: [PR] KAFKA-15360: Include dirs in BrokerRegistration [kafka]

2023-11-08 Thread via GitHub
pprovenzano commented on PR #14392: URL: https://github.com/apache/kafka/pull/14392#issuecomment-1802120042 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscr

Re: [PR] KAFKA-15357: Aggregate and propagate assignments [kafka]

2023-11-08 Thread via GitHub
soarez commented on code in PR #14369: URL: https://github.com/apache/kafka/pull/14369#discussion_r1386805266 ## core/src/main/java/kafka/server/AssignmentsManager.java: ## @@ -0,0 +1,386 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contribut

Re: [PR] KAFKA-15357: Aggregate and propagate assignments [kafka]

2023-11-08 Thread via GitHub
soarez commented on code in PR #14369: URL: https://github.com/apache/kafka/pull/14369#discussion_r1386810622 ## core/src/main/scala/kafka/server/ReplicaManager.scala: ## @@ -2296,13 +2298,41 @@ class ReplicaManager(val config: KafkaConfig, if (sendZkNotification)

Re: [PR] KAFKA-14683 Migrate #testStartPaused to Mockito [kafka]

2023-11-08 Thread via GitHub
mimaison commented on PR #14663: URL: https://github.com/apache/kafka/pull/14663#issuecomment-1802170828 It's such a big file that doing it incrementally may make the reviews easier. That said a lot of changes should be mechanical and similar across all tests so we probably don't want to do

[jira] [Commented] (KAFKA-14589) Move ConsumerGroupCommand to tools

2023-11-08 Thread Nikolay Izhikov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17784106#comment-17784106 ] Nikolay Izhikov commented on KAFKA-14589: - PR https://github.com/apache/kafka/pu

Re: [PR] KAFKA-15645 ReplicationQuotasTestRig rewritten in java [kafka]

2023-11-08 Thread via GitHub
nizhikov commented on PR #14588: URL: https://github.com/apache/kafka/pull/14588#issuecomment-1802193860 Hello, @mimaison @jolshan Can, you, please, take a look? I think we have to merge PR to don't lost test utility. -- This is an automated message from the Apache Git Service. To

Re: [PR] MINOR: Do not checkpoint standbys when handling corrupted tasks [kafka]

2023-11-08 Thread via GitHub
lucasbru merged PR #14709: URL: https://github.com/apache/kafka/pull/14709 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] KAFKA-15062: Adding ppc64le build stage [kafka]

2023-11-08 Thread via GitHub
mimaison commented on PR #13817: URL: https://github.com/apache/kafka/pull/13817#issuecomment-1802230356 Thanks for the updates! Can we switch to jdk_21_latest? as it's the newest java version we use in the other stages -- This is an automated message from the Apache Git Service. To respo

Re: [PR] KAFKA-15277: Design & implement support for internal Consumer delegates [kafka]

2023-11-08 Thread via GitHub
kirktrue commented on code in PR #14670: URL: https://github.com/apache/kafka/pull/14670#discussion_r1386903370 ## clients/src/main/java/org/apache/kafka/clients/consumer/ConsumerConfig.java: ## @@ -321,20 +320,6 @@ public class ConsumerConfig extends AbstractConfig { */

Re: [PR] KAFKA-15277: Design & implement support for internal Consumer delegates [kafka]

2023-11-08 Thread via GitHub
kirktrue commented on PR #14670: URL: https://github.com/apache/kafka/pull/14670#issuecomment-1802247627 An update on the `KafkaConsumerTest`— Of the 100 tests, 39 successfully pass using both group protocols. 61 have failures when using the `CONSUMER` group protocol, so they have bee

Re: [PR] KAFKA-15277: Design & implement support for internal Consumer delegates [kafka]

2023-11-08 Thread via GitHub
kirktrue commented on code in PR #14670: URL: https://github.com/apache/kafka/pull/14670#discussion_r1386903933 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/ConsumerUtils.java: ## @@ -211,4 +226,17 @@ else if (t instanceof KafkaException) thr

Re: [PR] KAFKA-15277: Design & implement support for internal Consumer delegates [kafka]

2023-11-08 Thread via GitHub
kirktrue commented on code in PR #14670: URL: https://github.com/apache/kafka/pull/14670#discussion_r1386907003 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/ConsumerDelegate.java: ## @@ -0,0 +1,36 @@ +/* + * Licensed to the Apache Software Foundation (ASF

Re: [PR] KAFKA-15277: Design & implement support for internal Consumer delegates [kafka]

2023-11-08 Thread via GitHub
kirktrue commented on code in PR #14670: URL: https://github.com/apache/kafka/pull/14670#discussion_r1386910396 ## clients/src/test/java/org/apache/kafka/clients/consumer/KafkaConsumerTest.java: ## @@ -222,42 +214,74 @@ public void cleanup() { } } -@Test -

Re: [PR] KAFKA-15277: Design & implement support for internal Consumer delegates [kafka]

2023-11-08 Thread via GitHub
kirktrue commented on code in PR #14670: URL: https://github.com/apache/kafka/pull/14670#discussion_r1386912274 ## clients/src/test/java/org/apache/kafka/clients/consumer/KafkaConsumerTest.java: ## @@ -881,24 +967,26 @@ public void testResetUsingAutoResetPolicy() { asse

Re: [PR] KAFKA-15277: Design & implement support for internal Consumer delegates [kafka]

2023-11-08 Thread via GitHub
kirktrue commented on code in PR #14670: URL: https://github.com/apache/kafka/pull/14670#discussion_r1386911536 ## clients/src/test/java/org/apache/kafka/clients/consumer/KafkaConsumerTest.java: ## @@ -721,16 +802,17 @@ public void verifyNoCoordinatorLookupForManualAssignmentWi

Re: [PR] KAFKA-15277: Design & implement support for internal Consumer delegates [kafka]

2023-11-08 Thread via GitHub
kirktrue commented on code in PR #14670: URL: https://github.com/apache/kafka/pull/14670#discussion_r1386911868 ## clients/src/test/java/org/apache/kafka/clients/consumer/KafkaConsumerTest.java: ## @@ -835,16 +919,17 @@ public void testMissingOffsetNoResetPolicy() { ass

Re: [PR] KAFKA-15277: Design & implement support for internal Consumer delegates [kafka]

2023-11-08 Thread via GitHub
kirktrue commented on code in PR #14670: URL: https://github.com/apache/kafka/pull/14670#discussion_r1386913209 ## clients/src/test/java/org/apache/kafka/clients/consumer/KafkaConsumerTest.java: ## @@ -1893,8 +2014,9 @@ private void consumerCloseTest(final long closeTimeoutMs,

Re: [PR] KAFKA-15347: add support for 'single key multi timestamp' IQs with versioned state stores (KIP-968) [kafka]

2023-11-08 Thread via GitHub
aliehsaeedii commented on PR #14626: URL: https://github.com/apache/kafka/pull/14626#issuecomment-1802270514 @cadonna -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[PR] IGNORE: Test PR for KAFKA-15062 [kafka]

2023-11-08 Thread via GitHub
mimaison opened a new pull request, #14717: URL: https://github.com/apache/kafka/pull/14717 Changes in Jenkinsfile are only tested if the PR is from a committer. So opening this temp PR to check if the changes from https://github.com/apache/kafka/pull/13817 work. ### Committer Checkl

Re: [PR] KAFKA-15062: Adding ppc64le build stage [kafka]

2023-11-08 Thread via GitHub
mimaison commented on PR #13817: URL: https://github.com/apache/kafka/pull/13817#issuecomment-1802275265 So obvious reasons, changes in Jenkinsfile are only tested if the PR is from a committer. So I opened https://github.com/apache/kafka/pull/14717 to run your changes. You can see

Re: [PR] KAFKA-15277: Design & implement support for internal Consumer delegates [kafka]

2023-11-08 Thread via GitHub
kirktrue commented on PR #14670: URL: https://github.com/apache/kafka/pull/14670#issuecomment-1802288411 > @kirktrue The build is red. Could you please take a look? The build failures are due to the recent "Dodgy code Warnings" that SpotBugs is suddenly issuing. SpotBugs report

Re: [PR] KAFKA-15645 ReplicationQuotasTestRig rewritten in java [kafka]

2023-11-08 Thread via GitHub
mimaison commented on code in PR #14588: URL: https://github.com/apache/kafka/pull/14588#discussion_r1386949236 ## tools/src/test/resources/log4j-off.properties: ## @@ -0,0 +1,26 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more Review Comment: Do we r

Re: [PR] KAFKA-15645 ReplicationQuotasTestRig rewritten in java [kafka]

2023-11-08 Thread via GitHub
jolshan commented on code in PR #14588: URL: https://github.com/apache/kafka/pull/14588#discussion_r1386957752 ## tools/src/test/resources/log4j-off.properties: ## @@ -0,0 +1,26 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more Review Comment: +1 --

Re: [PR] KAFKA-15645 ReplicationQuotasTestRig rewritten in java [kafka]

2023-11-08 Thread via GitHub
nizhikov commented on code in PR #14588: URL: https://github.com/apache/kafka/pull/14588#discussion_r1386960816 ## tools/src/test/java/org/apache/kafka/tools/other/ReplicationQuotasTestRig.java: ## @@ -0,0 +1,481 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

Re: [PR] KAFKA-15645 ReplicationQuotasTestRig rewritten in java [kafka]

2023-11-08 Thread via GitHub
nizhikov commented on code in PR #14588: URL: https://github.com/apache/kafka/pull/14588#discussion_r1386961908 ## tools/src/test/java/org/apache/kafka/tools/other/ReplicationQuotasTestRig.java: ## @@ -0,0 +1,481 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

Re: [PR] KAFKA-15645 ReplicationQuotasTestRig rewritten in java [kafka]

2023-11-08 Thread via GitHub
nizhikov commented on code in PR #14588: URL: https://github.com/apache/kafka/pull/14588#discussion_r1386961908 ## tools/src/test/java/org/apache/kafka/tools/other/ReplicationQuotasTestRig.java: ## @@ -0,0 +1,481 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[jira] [Created] (KAFKA-15799) ZK brokers incorrectly handle KRaft metadata snapshots

2023-11-08 Thread David Arthur (Jira)
David Arthur created KAFKA-15799: Summary: ZK brokers incorrectly handle KRaft metadata snapshots Key: KAFKA-15799 URL: https://issues.apache.org/jira/browse/KAFKA-15799 Project: Kafka Issue

Re: [PR] KAFKA-15346: add support for 'single key single timestamp' IQs with versioned state stores (KIP-960) [kafka]

2023-11-08 Thread via GitHub
aliehsaeedii commented on PR #14596: URL: https://github.com/apache/kafka/pull/14596#issuecomment-1802337074 @mjsax maybe needs approval;-) cc: @cadonna -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [PR] KAFKA-15645 ReplicationQuotasTestRig rewritten in java [kafka]

2023-11-08 Thread via GitHub
nizhikov commented on code in PR #14588: URL: https://github.com/apache/kafka/pull/14588#discussion_r1386970135 ## tools/src/test/java/org/apache/kafka/tools/other/ReplicationQuotasTestRig.java: ## @@ -0,0 +1,481 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

Re: [PR] KAFKA-15645 ReplicationQuotasTestRig rewritten in java [kafka]

2023-11-08 Thread via GitHub
nizhikov commented on code in PR #14588: URL: https://github.com/apache/kafka/pull/14588#discussion_r1386974229 ## tools/src/test/resources/log4j-off.properties: ## @@ -0,0 +1,26 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more Review Comment: Without

Re: [PR] KAFKA-15062: Adding ppc64le build stage [kafka]

2023-11-08 Thread via GitHub
Vaibhav-Nazare commented on PR #13817: URL: https://github.com/apache/kafka/pull/13817#issuecomment-1802353727 Raised a JIRA ticket to have jdk_21_latest installed on shared power nodes https://issues.apache.org/jira/browse/INFRA-25149 -- This is an automated message from the Apache Git

Re: [PR] MINOR: Rewrite the meta.properties handling code in Java and fix some issues [kafka]

2023-11-08 Thread via GitHub
cmccabe commented on code in PR #14628: URL: https://github.com/apache/kafka/pull/14628#discussion_r1386983421 ## core/src/main/scala/kafka/server/KafkaServer.scala: ## @@ -270,10 +271,31 @@ class KafkaServer( logDirFailureChannel = new LogDirFailureChannel(config.log

[jira] [Created] (KAFKA-15800) Malformed connect source offsets corrupt other partitions with DataException

2023-11-08 Thread Greg Harris (Jira)
Greg Harris created KAFKA-15800: --- Summary: Malformed connect source offsets corrupt other partitions with DataException Key: KAFKA-15800 URL: https://issues.apache.org/jira/browse/KAFKA-15800 Project: K

Re: [PR] KAFKA-15174: Ensure CommitAsync propagate the exception to the user [kafka]

2023-11-08 Thread via GitHub
philipnee commented on PR #14680: URL: https://github.com/apache/kafka/pull/14680#issuecomment-1802364240 Hi @kirktrue Thanks for taking time reviewing the PR: Just to quickly respond to your comment. The BackgroundEventProcessor is already invoked inside poll() and if the event is a

Re: [PR] KAFKA-15174: Ensure CommitAsync propagate the exception to the user [kafka]

2023-11-08 Thread via GitHub
philipnee commented on code in PR #14680: URL: https://github.com/apache/kafka/pull/14680#discussion_r1386995116 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/PrototypeAsyncConsumerTest.java: ## @@ -168,6 +200,45 @@ public void testCommitted_ExceptionThrow

[PR] KAFKA-15800: Prevent DataExceptions from corrupting KafkaOffsetBackingStore [kafka]

2023-11-08 Thread via GitHub
gharris1727 opened a new pull request, #14718: URL: https://github.com/apache/kafka/pull/14718 https://issues.apache.org/jira/browse/KAFKA-15800 The JsonConverter may throw DataException when encountering malformed data. This causes part or all of the batch of ConsumerRecords from the

[PR] KAFKA-15799 Handle full metadata updates on ZK brokers [kafka]

2023-11-08 Thread via GitHub
mumrah opened a new pull request, #14719: URL: https://github.com/apache/kafka/pull/14719 TODO -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-

Re: [PR] KAFKA-15277: Design & implement support for internal Consumer delegates [kafka]

2023-11-08 Thread via GitHub
dajac commented on code in PR #14670: URL: https://github.com/apache/kafka/pull/14670#discussion_r1387013819 ## clients/src/test/java/org/apache/kafka/clients/consumer/KafkaConsumerTest.java: ## @@ -222,42 +214,74 @@ public void cleanup() { } } -@Test -pu

Re: [PR] cherrypick KAFKA-15653: Pass requestLocal as argument to callback so we use the correct one for the thread [kafka]

2023-11-08 Thread via GitHub
junrao commented on code in PR #14712: URL: https://github.com/apache/kafka/pull/14712#discussion_r1387012471 ## core/src/main/scala/kafka/server/KafkaRequestHandler.scala: ## @@ -54,23 +54,29 @@ object KafkaRequestHandler { } /** - * Wrap callback to schedule it on a

Re: [PR] KAFKA-15277: Design & implement support for internal Consumer delegates [kafka]

2023-11-08 Thread via GitHub
dajac commented on PR #14670: URL: https://github.com/apache/kafka/pull/14670#issuecomment-1802394898 > 3 reference the enforceRebalance() that the CONSUMER group protocol intentionally doesn't implement Should we add a small comment to those to explain that this is not supported in

Re: [PR] cherrypick KAFKA-15653: Pass requestLocal as argument to callback so we use the correct one for the thread [kafka]

2023-11-08 Thread via GitHub
jolshan commented on code in PR #14712: URL: https://github.com/apache/kafka/pull/14712#discussion_r1387025174 ## core/src/main/scala/kafka/server/KafkaRequestHandler.scala: ## @@ -54,23 +54,29 @@ object KafkaRequestHandler { } /** - * Wrap callback to schedule it on a

Re: [PR] cherrypick KAFKA-15653: Pass requestLocal as argument to callback so we use the correct one for the thread [kafka]

2023-11-08 Thread via GitHub
jolshan commented on PR #14712: URL: https://github.com/apache/kafka/pull/14712#issuecomment-1802409370 I also see a test failure so I will fix that. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] cherrypick KAFKA-15653: Pass requestLocal as argument to callback so we use the correct one for the thread [kafka]

2023-11-08 Thread via GitHub
junrao commented on code in PR #14712: URL: https://github.com/apache/kafka/pull/14712#discussion_r1387049371 ## core/src/main/scala/kafka/server/KafkaRequestHandler.scala: ## @@ -54,23 +54,29 @@ object KafkaRequestHandler { } /** - * Wrap callback to schedule it on a

Re: [PR] DRAFT: KAFKA-15764: Missing Tests for Transactions [kafka]

2023-11-08 Thread via GitHub
jolshan commented on code in PR #14702: URL: https://github.com/apache/kafka/pull/14702#discussion_r1387054947 ## core/src/test/scala/integration/kafka/api/TransactionsTest.scala: ## @@ -69,6 +70,8 @@ class TransactionsTest extends IntegrationTestHarness { props.put(KafkaCo

[PR] Update subscriptions at the end. [kafka]

2023-11-08 Thread via GitHub
michaldo opened a new pull request, #14720: URL: https://github.com/apache/kafka/pull/14720 ConsumerCoordinator should first call invokePartitionsAssigned and then save the subscription state. Otherwise the following scenario is possible: 1. ConsumerCoordinator is notified that par

Re: [PR] KAFKA-15774: refactor windowed stores to use StoreFactory [kafka]

2023-11-08 Thread via GitHub
agavra commented on code in PR #14708: URL: https://github.com/apache/kafka/pull/14708#discussion_r1387070971 ## streams/src/main/java/org/apache/kafka/streams/kstream/internals/TimeWindowStoreMaterializer.java: ## @@ -0,0 +1,133 @@ +/* + * Licensed to the Apache Software Founda

Re: [PR] KAFKA-15681: Add support of client-metrics in kafka-configs.sh (KIP-714) [kafka]

2023-11-08 Thread via GitHub
apoorvmittal10 commented on code in PR #14632: URL: https://github.com/apache/kafka/pull/14632#discussion_r1387072536 ## core/src/main/scala/kafka/admin/ConfigCommand.scala: ## @@ -536,6 +552,8 @@ object ConfigCommand extends Logging { adminClient.listTopics(new List

Re: [PR] cherrypick KAFKA-15653: Pass requestLocal as argument to callback so we use the correct one for the thread [kafka]

2023-11-08 Thread via GitHub
junrao commented on code in PR #14712: URL: https://github.com/apache/kafka/pull/14712#discussion_r1387075522 ## core/src/main/scala/kafka/server/KafkaRequestHandler.scala: ## @@ -54,23 +54,27 @@ object KafkaRequestHandler { } /** - * Wrap callback to schedule it on a

Re: [PR] KAFKA-15681: Add support of client-metrics in kafka-configs.sh (KIP-714) [kafka]

2023-11-08 Thread via GitHub
apoorvmittal10 commented on code in PR #14632: URL: https://github.com/apache/kafka/pull/14632#discussion_r1387077385 ## core/src/main/scala/kafka/server/DynamicConfig.scala: ## @@ -111,6 +112,16 @@ object DynamicConfig { } } + object ClientMetrics { +private val

Re: [PR] KAFKA-15681: Add support of client-metrics in kafka-configs.sh (KIP-714) [kafka]

2023-11-08 Thread via GitHub
apoorvmittal10 commented on code in PR #14632: URL: https://github.com/apache/kafka/pull/14632#discussion_r1387099016 ## core/src/test/scala/unit/kafka/admin/ConfigCommandTest.scala: ## @@ -1628,6 +1628,122 @@ class ConfigCommandTest extends Logging { Seq("/clients/clie

Re: [PR] KAFKA-15681: Add support of client-metrics in kafka-configs.sh (KIP-714) [kafka]

2023-11-08 Thread via GitHub
apoorvmittal10 commented on code in PR #14632: URL: https://github.com/apache/kafka/pull/14632#discussion_r1387101615 ## core/src/test/scala/unit/kafka/admin/ConfigCommandTest.scala: ## @@ -1628,6 +1628,122 @@ class ConfigCommandTest extends Logging { Seq("/clients/clie

Re: [PR] KAFKA-15681: Add support of client-metrics in kafka-configs.sh (KIP-714) [kafka]

2023-11-08 Thread via GitHub
apoorvmittal10 commented on PR #14632: URL: https://github.com/apache/kafka/pull/14632#issuecomment-1802514338 > @apoorvmittal10 : Thanks for the PR. Left a few comments. Thanks for the feedback @junrao. I have addressed the comments. -- This is an automated message from the Apache

Re: [PR] cherrypick KAFKA-15780: Wait for consistent KRaft metadata when creating or deleting topics [kafka]

2023-11-08 Thread via GitHub
splett2 commented on PR #14713: URL: https://github.com/apache/kafka/pull/14713#issuecomment-1802533050 updates to TopicCommandIntegrationTest lgtm -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] KAFKA-15764: Missing Tests for Transactions [kafka]

2023-11-08 Thread via GitHub
jolshan commented on code in PR #14702: URL: https://github.com/apache/kafka/pull/14702#discussion_r1387139976 ## core/src/test/scala/integration/kafka/api/TransactionsTest.scala: ## @@ -94,8 +97,8 @@ class TransactionsTest extends IntegrationTestHarness { createTopic(topic

Re: [PR] KAFKA-15774: refactor windowed stores to use StoreFactory [kafka]

2023-11-08 Thread via GitHub
mjsax commented on code in PR #14708: URL: https://github.com/apache/kafka/pull/14708#discussion_r1387169903 ## streams/src/main/java/org/apache/kafka/streams/TopologyConfig.java: ## @@ -217,8 +217,19 @@ public TopologyConfig(final String topologyName, final StreamsConfig globa

Re: [PR] KAFKA-15774: refactor windowed stores to use StoreFactory [kafka]

2023-11-08 Thread via GitHub
mjsax commented on code in PR #14708: URL: https://github.com/apache/kafka/pull/14708#discussion_r1387182591 ## streams/src/main/java/org/apache/kafka/streams/kstream/internals/TimeWindowStoreMaterializer.java: ## @@ -0,0 +1,133 @@ +/* + * Licensed to the Apache Software Foundat

Re: [PR] KAFKA-15774: refactor windowed stores to use StoreFactory [kafka]

2023-11-08 Thread via GitHub
agavra commented on code in PR #14708: URL: https://github.com/apache/kafka/pull/14708#discussion_r1387215167 ## streams/src/main/java/org/apache/kafka/streams/TopologyConfig.java: ## @@ -217,8 +217,19 @@ public TopologyConfig(final String topologyName, final StreamsConfig glob

Re: [PR] KAFKA-15661: KIP-951: Server side changes [kafka]

2023-11-08 Thread via GitHub
jolshan commented on code in PR #1: URL: https://github.com/apache/kafka/pull/1#discussion_r1387217781 ## core/src/test/scala/unit/kafka/server/KafkaApisTest.scala: ## @@ -2610,6 +2610,73 @@ class KafkaApisTest { } } + @Test + def testProduceResponseMetadataL

Re: [PR] KAFKA-15764: Missing Tests for Transactions [kafka]

2023-11-08 Thread via GitHub
jolshan commented on code in PR #14702: URL: https://github.com/apache/kafka/pull/14702#discussion_r1387221735 ## core/src/test/scala/integration/kafka/api/TransactionsTest.scala: ## @@ -69,6 +70,8 @@ class TransactionsTest extends IntegrationTestHarness { props.put(KafkaCo

Re: [PR] PROPOSAL: support async event execution in group coordinator [kafka]

2023-11-08 Thread via GitHub
junrao commented on code in PR #14705: URL: https://github.com/apache/kafka/pull/14705#discussion_r1387227928 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/runtime/CoordinatorRuntime.java: ## @@ -659,9 +660,21 @@ public TopicPartition key() { */

Re: [PR] KAFKA-15645 ReplicationQuotasTestRig rewritten in java [kafka]

2023-11-08 Thread via GitHub
nizhikov commented on code in PR #14588: URL: https://github.com/apache/kafka/pull/14588#discussion_r1387236588 ## tools/src/test/resources/log4j-off.properties: ## @@ -0,0 +1,26 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more Review Comment: I remov

Re: [PR] KAFKA-15357: Aggregate and propagate assignments [kafka]

2023-11-08 Thread via GitHub
soarez commented on code in PR #14369: URL: https://github.com/apache/kafka/pull/14369#discussion_r1386805266 ## core/src/main/java/kafka/server/AssignmentsManager.java: ## @@ -0,0 +1,386 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contribut

Re: [PR] KAFKA-14519; [2/N] New coordinator metrics [kafka]

2023-11-08 Thread via GitHub
jolshan commented on PR #14387: URL: https://github.com/apache/kafka/pull/14387#issuecomment-1802757018 Something very strange is up with this build. I will try again. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

Re: [PR] KAFKA-15661: KIP-951: Server side changes [kafka]

2023-11-08 Thread via GitHub
chb2ab commented on code in PR #1: URL: https://github.com/apache/kafka/pull/1#discussion_r1387252814 ## core/src/test/scala/unit/kafka/server/KafkaApisTest.scala: ## @@ -2610,6 +2610,73 @@ class KafkaApisTest { } } + @Test + def testProduceResponseMetadataLo

Re: [PR] KAFKA-15661: KIP-951: Server side changes [kafka]

2023-11-08 Thread via GitHub
chb2ab commented on PR #1: URL: https://github.com/apache/kafka/pull/1#issuecomment-1802764239 Updated to not include the node if it wasn't found in metadata lookup based on offline chat with @jolshan -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] KAFKA-15681: Add support of client-metrics in kafka-configs.sh (KIP-714) [kafka]

2023-11-08 Thread via GitHub
junrao commented on code in PR #14632: URL: https://github.com/apache/kafka/pull/14632#discussion_r1387265452 ## core/src/main/scala/kafka/server/DynamicConfig.scala: ## @@ -111,6 +112,16 @@ object DynamicConfig { } } + object ClientMetrics { +private val clientCo

Re: [PR] KAFKA-15357: Aggregate and propagate assignments [kafka]

2023-11-08 Thread via GitHub
soarez commented on code in PR #14369: URL: https://github.com/apache/kafka/pull/14369#discussion_r1386805266 ## core/src/main/java/kafka/server/AssignmentsManager.java: ## @@ -0,0 +1,386 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contribut

Re: [PR] KAFKA-15357: Aggregate and propagate assignments [kafka]

2023-11-08 Thread via GitHub
soarez commented on code in PR #14369: URL: https://github.com/apache/kafka/pull/14369#discussion_r1386805266 ## core/src/main/java/kafka/server/AssignmentsManager.java: ## @@ -0,0 +1,386 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contribut

  1   2   >