Re: [PR] KAFKA-15632: Drop the invalid remote log metadata events [kafka]

2023-10-23 Thread via GitHub
showuon commented on code in PR #14576: URL: https://github.com/apache/kafka/pull/14576#discussion_r1369627969 ## storage/src/main/java/org/apache/kafka/server/log/remote/metadata/storage/RemoteLogMetadataCache.java: ## @@ -157,13 +157,20 @@ public void

Re: [PR] KAFKA-15602: revert KAFKA-4852 [kafka]

2023-10-23 Thread via GitHub
philipnee commented on code in PR #14617: URL: https://github.com/apache/kafka/pull/14617#discussion_r1369600869 ## clients/src/main/java/org/apache/kafka/common/serialization/ByteBufferSerializer.java: ## @@ -16,38 +16,34 @@ */ package org.apache.kafka.common.serialization;

[jira] [Commented] (KAFKA-15602) Breaking change in 3.4.0 ByteBufferSerializer

2023-10-23 Thread Philip Nee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778913#comment-17778913 ] Philip Nee commented on KAFKA-15602: Thanks, [~luke.kirby] - Can you create a Jira to document what

Re: [PR] [MINOR] Deduplicating ConsumerGroupCommand print formating [kafka]

2023-10-23 Thread via GitHub
hudeqi commented on PR #14610: URL: https://github.com/apache/kafka/pull/14610#issuecomment-1776463505 > @hudeqi Are you OK with merging this? I'm ok, but need other commiters to merge. @showuon -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] [MINOR] Deduplicating ConsumerGroupCommand print formating [kafka]

2023-10-23 Thread via GitHub
nizhikov commented on PR #14610: URL: https://github.com/apache/kafka/pull/14610#issuecomment-1776460338 @hudeqi Are you OK with merging this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] KAFKA-15481: Fix concurrency bug in RemoteIndexCache [kafka]

2023-10-23 Thread via GitHub
hudeqi commented on PR #14483: URL: https://github.com/apache/kafka/pull/14483#issuecomment-1776392320 > > @jeel2420

[jira] [Updated] (KAFKA-15675) Fix flaky ConnectorRestartApiIntegrationTest.testMultiWorkerRestartOnlyConnector() test

2023-10-23 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15675: -- Labels: flaky-test (was: ) > Fix flaky >

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-23 Thread via GitHub
kirktrue closed pull request #14406: KAFKA-14274 [6, 7]: Introduction of fetch request manager URL: https://github.com/apache/kafka/pull/14406 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-23 Thread via GitHub
kirktrue commented on PR #14406: URL: https://github.com/apache/kafka/pull/14406#issuecomment-1776378053 Closing and reopening to restart test. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-23 Thread via GitHub
kirktrue commented on PR #14406: URL: https://github.com/apache/kafka/pull/14406#issuecomment-1776377391 Ugh. One of the builds failed with: ``` ERROR: Error fetching remote repo 'origin' hudson.plugins.git.GitException: Failed to fetch from https://github.com/apache/kafka.git

[jira] [Commented] (KAFKA-15388) Handle topics that were having compaction as retention earlier are changed to delete only retention policy and onboarded to tiered storage.

2023-10-23 Thread Arpit Goyal (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778884#comment-17778884 ] Arpit Goyal commented on KAFKA-15388: - [~divijvaidya] Sure I am picking it up. > Handle topics that

[jira] [Assigned] (KAFKA-15388) Handle topics that were having compaction as retention earlier are changed to delete only retention policy and onboarded to tiered storage.

2023-10-23 Thread Arpit Goyal (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Goyal reassigned KAFKA-15388: --- Assignee: Arpit Goyal > Handle topics that were having compaction as retention earlier are

Re: [PR] KAFKA-14133: Replace Easymock with Mockito in StreamsProducerTest, TopologyMetadataTest & GlobalStateStoreProviderTest [kafka]

2023-10-23 Thread via GitHub
bachmanity1 commented on code in PR #14410: URL: https://github.com/apache/kafka/pull/14410#discussion_r1368465903 ## streams/src/test/java/org/apache/kafka/streams/state/internals/GlobalStateStoreProviderTest.java: ## @@ -105,28 +105,19 @@ public void before() {

Re: [PR] KAFKA-15673: Adding client metrics resource types (KIP-714) [kafka]

2023-10-23 Thread via GitHub
apoorvmittal10 commented on code in PR #14621: URL: https://github.com/apache/kafka/pull/14621#discussion_r1369416326 ## core/src/main/scala/kafka/metrics/clientmetrics/ClientMetricsConfig.scala: ## @@ -0,0 +1,137 @@ +/** + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] KAFKA-15673: Adding client metrics resource types (KIP-714) [kafka]

2023-10-23 Thread via GitHub
apoorvmittal10 commented on code in PR #14621: URL: https://github.com/apache/kafka/pull/14621#discussion_r1369415500 ## core/src/main/scala/kafka/server/ClientMetricsManager.scala: ## @@ -0,0 +1,38 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or more

Re: [PR] KAFKA-15673: Adding client metrics resource types (KIP-714) [kafka]

2023-10-23 Thread via GitHub
apoorvmittal10 commented on code in PR #14621: URL: https://github.com/apache/kafka/pull/14621#discussion_r1369413838 ## core/src/main/scala/kafka/server/ClientMetricsManager.scala: ## @@ -0,0 +1,38 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or more

[PR] KAFKA-15673: Adding client metrics resource types (KIP-714) [kafka]

2023-10-23 Thread via GitHub
apoorvmittal10 opened a new pull request, #14621: URL: https://github.com/apache/kafka/pull/14621 This PR add resources to store and handle client metrics needed for KIP-714 as defined

[jira] [Updated] (KAFKA-15673) Define new client_metrics resource type configuration to store metric config.

2023-10-23 Thread Apoorv Mittal (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal updated KAFKA-15673: -- Description: The KIP-714 introduces new resource type named CLIENT_METRICS -

Re: [PR] KAFKA-15605: Fix topic deletion handling during ZK migration [kafka]

2023-10-23 Thread via GitHub
cmccabe commented on code in PR #14545: URL: https://github.com/apache/kafka/pull/14545#discussion_r1369368851 ## core/src/main/scala/kafka/zk/migration/ZkTopicMigrationClient.scala: ## @@ -47,8 +47,14 @@ class ZkTopicMigrationClient(zkClient: KafkaZkClient) extends

Re: [PR] KAFKA-15605: Fix topic deletion handling during ZK migration [kafka]

2023-10-23 Thread via GitHub
cmccabe commented on PR #14545: URL: https://github.com/apache/kafka/pull/14545#issuecomment-1776180980 oh, and please remove the thing where we log all deleting topic names … if it’s too much effort, just log the # . We don't want to blow up our log4j files -- This is an automated

Re: [PR] KAFKA-15605: Fix topic deletion handling during ZK migration [kafka]

2023-10-23 Thread via GitHub
cmccabe commented on code in PR #14545: URL: https://github.com/apache/kafka/pull/14545#discussion_r1369366766 ## clients/src/main/java/org/apache/kafka/common/requests/LeaderAndIsrRequest.java: ## @@ -42,26 +42,52 @@ public class LeaderAndIsrRequest extends

Re: [PR] KAFKA-15605: Fix topic deletion handling during ZK migration [kafka]

2023-10-23 Thread via GitHub
cmccabe commented on code in PR #14545: URL: https://github.com/apache/kafka/pull/14545#discussion_r1369366766 ## clients/src/main/java/org/apache/kafka/common/requests/LeaderAndIsrRequest.java: ## @@ -42,26 +42,52 @@ public class LeaderAndIsrRequest extends

Re: [PR] KAFKA-14808: fix leaderless partition issue when controller removes u… [kafka]

2023-10-23 Thread via GitHub
junrao commented on code in PR #13451: URL: https://github.com/apache/kafka/pull/13451#discussion_r1369359298 ## core/src/main/scala/kafka/controller/KafkaController.scala: ## @@ -1894,10 +1894,16 @@ class KafkaController(val config: KafkaConfig, val currentAssignment =

Re: [PR] KAFKA-14808: fix leaderless partition issue when controller removes u… [kafka]

2023-10-23 Thread via GitHub
junrao commented on code in PR #13451: URL: https://github.com/apache/kafka/pull/13451#discussion_r1369359298 ## core/src/main/scala/kafka/controller/KafkaController.scala: ## @@ -1894,10 +1894,16 @@ class KafkaController(val config: KafkaConfig, val currentAssignment =

Re: [PR] KAFKA-14808: fix leaderless partition issue when controller removes u… [kafka]

2023-10-23 Thread via GitHub
junrao commented on code in PR #13451: URL: https://github.com/apache/kafka/pull/13451#discussion_r1369359298 ## core/src/main/scala/kafka/controller/KafkaController.scala: ## @@ -1894,10 +1894,16 @@ class KafkaController(val config: KafkaConfig, val currentAssignment =

Re: [PR] KAFKA-15633: Fix overwrite of meta.properties at startup to handle JBOD. [WIP] [kafka]

2023-10-23 Thread via GitHub
pprovenzano commented on code in PR #14578: URL: https://github.com/apache/kafka/pull/14578#discussion_r1369329881 ## core/src/main/scala/kafka/server/KafkaServer.scala: ## @@ -1025,9 +1026,13 @@ class KafkaServer( */ private def checkpointBrokerMetadata(brokerMetadata:

[jira] [Assigned] (KAFKA-15643) Improve unloading logging

2023-10-23 Thread Ritika Muduganti (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ritika Muduganti reassigned KAFKA-15643: Assignee: Ritika Muduganti > Improve unloading logging >

Re: [PR] KAFKA-15633: Fix overwrite of meta.properties at startup to handle JBOD. [WIP] [kafka]

2023-10-23 Thread via GitHub
pprovenzano commented on code in PR #14578: URL: https://github.com/apache/kafka/pull/14578#discussion_r1369328666 ## core/src/main/scala/kafka/server/BrokerMetadataCheckpoint.scala: ## @@ -166,6 +166,7 @@ case class MetaProperties( } } +// Return only the

[PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-23 Thread via GitHub
kirktrue opened a new pull request, #14406: URL: https://github.com/apache/kafka/pull/14406 Changes: 1. Introduces `FetchRequestManager` that implements the `RequestManager` API for fetching messages from brokers. Unlike `Fetcher`, record decompression and deserialization is

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-23 Thread via GitHub
kirktrue commented on PR #14406: URL: https://github.com/apache/kafka/pull/14406#issuecomment-1776110492 Closing and reopening to trigger another Jenkins test run. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-23 Thread via GitHub
kirktrue closed pull request #14406: KAFKA-14274 [6, 7]: Introduction of fetch request manager URL: https://github.com/apache/kafka/pull/14406 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-23 Thread via GitHub
kirktrue commented on PR #14406: URL: https://github.com/apache/kafka/pull/14406#issuecomment-1776108652 > Are the 30 test failures related? No, I do not believe they are. There are 8 failures, of which two are the same test with different parameters. Here are the tests and

[jira] [Created] (KAFKA-15675) Fix flaky ConnectorRestartApiIntegrationTest.testMultiWorkerRestartOnlyConnector() test

2023-10-23 Thread Kirk True (Jira)
Kirk True created KAFKA-15675: - Summary: Fix flaky ConnectorRestartApiIntegrationTest.testMultiWorkerRestartOnlyConnector() test Key: KAFKA-15675 URL: https://issues.apache.org/jira/browse/KAFKA-15675

[jira] [Commented] (KAFKA-15674) Consider making RequestLocal thread safe

2023-10-23 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778835#comment-17778835 ] Jun Rao commented on KAFKA-15674: - For context, [https://github.com/apache/kafka/pull/9220] was the

[jira] [Commented] (KAFKA-15653) NPE in ChunkedByteStream

2023-10-23 Thread Justine Olshan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778831#comment-17778831 ] Justine Olshan commented on KAFKA-15653: I will definitely work on this [~divijvaidya]. I plan

[jira] [Created] (KAFKA-15674) Consider making RequestLocal thread safe

2023-10-23 Thread Justine Olshan (Jira)
Justine Olshan created KAFKA-15674: -- Summary: Consider making RequestLocal thread safe Key: KAFKA-15674 URL: https://issues.apache.org/jira/browse/KAFKA-15674 Project: Kafka Issue Type:

[jira] [Assigned] (KAFKA-15653) NPE in ChunkedByteStream

2023-10-23 Thread Justine Olshan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Justine Olshan reassigned KAFKA-15653: -- Assignee: Justine Olshan > NPE in ChunkedByteStream > > >

Re: [PR] KAFKA-15355: Message schema changes [kafka]

2023-10-23 Thread via GitHub
rondagostino commented on code in PR #14290: URL: https://github.com/apache/kafka/pull/14290#discussion_r1368928056 ## metadata/src/main/resources/common/metadata/BrokerRegistrationChangeRecord.json: ## @@ -13,11 +13,12 @@ // See the License for the specific language governing

[jira] [Resolved] (KAFKA-15656) Frequent INVALID_RECORD on Kafka 3.6

2023-10-23 Thread Travis Bischel (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Bischel resolved KAFKA-15656. Resolution: Duplicate Closing this as a different manifestation of (and thus, duplicate

[jira] [Resolved] (KAFKA-15657) Unexpected errors when producing transactionally in 3.6

2023-10-23 Thread Travis Bischel (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Bischel resolved KAFKA-15657. Resolution: Duplicate Closing this as a different manifestation (and thus, duplicate of)

[jira] [Commented] (KAFKA-15653) NPE in ChunkedByteStream

2023-10-23 Thread Travis Bischel (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778827#comment-17778827 ] Travis Bischel commented on KAFKA-15653: I've loop tested this a few times at this point, and so

[jira] [Created] (KAFKA-15673) Define new client_metrics resource type configuration to store metric config.

2023-10-23 Thread Apoorv Mittal (Jira)
Apoorv Mittal created KAFKA-15673: - Summary: Define new client_metrics resource type configuration to store metric config. Key: KAFKA-15673 URL: https://issues.apache.org/jira/browse/KAFKA-15673

Re: [PR] KAFKA-15669: Implement telemetry metric naming strategy (KIP-714) [kafka]

2023-10-23 Thread via GitHub
apoorvmittal10 commented on code in PR #14619: URL: https://github.com/apache/kafka/pull/14619#discussion_r1369241432 ## clients/src/test/java/org/apache/kafka/common/telemetry/internals/MetricNamingConventionTest.java: ## @@ -0,0 +1,196 @@ +/* + * Licensed to the Apache

Re: [PR] KAFKA-15628: Refactor ConsumerRebalanceListener invocation for reuse [kafka]

2023-10-23 Thread via GitHub
kirktrue commented on PR #14565: URL: https://github.com/apache/kafka/pull/14565#issuecomment-1775972229 @dajac This is ready for another review. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] KAFKA-15669: Implement telemetry metric naming strategy (KIP-714) [kafka]

2023-10-23 Thread via GitHub
AndrewJSchofield commented on code in PR #14619: URL: https://github.com/apache/kafka/pull/14619#discussion_r1369227989 ## clients/src/test/java/org/apache/kafka/common/telemetry/internals/MetricNamingConventionTest.java: ## @@ -0,0 +1,196 @@ +/* + * Licensed to the Apache

[jira] [Commented] (KAFKA-15401) Segment with corrupted index should not be uploaded to remote storage

2023-10-23 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778807#comment-17778807 ] Jun Rao commented on KAFKA-15401: - [~nickstery] : Thanks for reporting this issue. I am wondering how a

Re: [PR] KAFKA-15050: format the prompts in the quickstart [kafka]

2023-10-23 Thread via GitHub
tombentley commented on PR #13862: URL: https://github.com/apache/kafka/pull/13862#issuecomment-1775906514 @joobisb when I said > It works fine for me with ``, using both FF and a chrome-based browser. I meant that I still don't think we need the changes which add the

[jira] [Updated] (KAFKA-15093) Add 3.5.0 to broker/client and streams upgrade/compatibility tests

2023-10-23 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison updated KAFKA-15093: --- Fix Version/s: (was: 3.5.2) > Add 3.5.0 to broker/client and streams

Re: [PR] KAFKA-15093: Add 3.5 Streams upgrade system tests [kafka]

2023-10-23 Thread via GitHub
mimaison commented on PR #14602: URL: https://github.com/apache/kafka/pull/14602#issuecomment-1775903085 Done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] KAFKA-15093: Add 3.5 Streams upgrade system tests [kafka]

2023-10-23 Thread via GitHub
mimaison commented on PR #14602: URL: https://github.com/apache/kafka/pull/14602#issuecomment-1775898581 Ok, I'll revert d769f1dd87 in the 3.5 branch. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] KAFKA-14132; Replace EasyMock with Mockito in StandaloneHerderTest [kafka]

2023-10-23 Thread via GitHub
mdedetrich commented on PR #12728: URL: https://github.com/apache/kafka/pull/12728#issuecomment-1775892079 @mimaison I started rebasing across `trunk` and under-estimated the amount of changes that have since landed so this may take a day or two longer -- This is an automated message

[jira] [Commented] (KAFKA-15602) Breaking change in 3.4.0 ByteBufferSerializer

2023-10-23 Thread Luke Kirby (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778797#comment-17778797 ] Luke Kirby commented on KAFKA-15602: Hi [~pnee] , [~mjsax] – I largely agree with what's been said

[jira] [Assigned] (KAFKA-15671) Flaky test RemoteIndexCacheTest.testClearCacheAndIndexFilesWhenResizeCache

2023-10-23 Thread Brian (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian reassigned KAFKA-15671: - Assignee: Brian > Flaky test RemoteIndexCacheTest.testClearCacheAndIndexFilesWhenResizeCache >

[jira] [Commented] (KAFKA-15671) Flaky test RemoteIndexCacheTest.testClearCacheAndIndexFilesWhenResizeCache

2023-10-23 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778782#comment-17778782 ] Divij Vaidya commented on KAFKA-15671: -- Sure [~brian030128] , please go ahead and assign it to

[jira] [Assigned] (KAFKA-15542) Release member assignments on errors

2023-10-23 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True reassigned KAFKA-15542: - Assignee: Kirk True > Release member assignments on errors >

Re: [PR] KAFKA-15632: Drop the invalid remote log metadata events [kafka]

2023-10-23 Thread via GitHub
kamalcph commented on code in PR #14576: URL: https://github.com/apache/kafka/pull/14576#discussion_r1369070287 ## storage/src/main/java/org/apache/kafka/server/log/remote/metadata/storage/RemoteLogMetadataCache.java: ## @@ -157,13 +157,20 @@ public void

[jira] [Assigned] (KAFKA-15574) Integrate partition assignment reconciliation with heartbeat request manager

2023-10-23 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True reassigned KAFKA-15574: - Assignee: Kirk True > Integrate partition assignment reconciliation with heartbeat request

Re: [PR] KAFKA-15632: Drop the invalid remote log metadata events [kafka]

2023-10-23 Thread via GitHub
kamalcph commented on code in PR #14576: URL: https://github.com/apache/kafka/pull/14576#discussion_r1369070287 ## storage/src/main/java/org/apache/kafka/server/log/remote/metadata/storage/RemoteLogMetadataCache.java: ## @@ -157,13 +157,20 @@ public void

Re: [PR] KAFKA-15632: Drop the invalid remote log metadata events [kafka]

2023-10-23 Thread via GitHub
kamalcph commented on code in PR #14576: URL: https://github.com/apache/kafka/pull/14576#discussion_r1369070287 ## storage/src/main/java/org/apache/kafka/server/log/remote/metadata/storage/RemoteLogMetadataCache.java: ## @@ -157,13 +157,20 @@ public void

Re: [PR] KAFKA-15632: Drop the invalid remote log metadata events [kafka]

2023-10-23 Thread via GitHub
kamalcph commented on code in PR #14576: URL: https://github.com/apache/kafka/pull/14576#discussion_r1367695583 ## storage/src/test/java/org/apache/kafka/server/log/remote/metadata/storage/RemoteLogMetadataCacheTest.java: ## @@ -26,83 +26,136 @@ import

Re: [PR] KAFKA-15584: Leader election with ELR [kafka]

2023-10-23 Thread via GitHub
CalvinConfluent commented on code in PR #14593: URL: https://github.com/apache/kafka/pull/14593#discussion_r1369069244 ## metadata/src/main/java/org/apache/kafka/controller/PartitionChangeBuilder.java: ## @@ -253,17 +269,30 @@ private ElectionResult electAnyLeader() {

Re: [PR] KAFKA-15584: Leader election with ELR [kafka]

2023-10-23 Thread via GitHub
CalvinConfluent commented on code in PR #14593: URL: https://github.com/apache/kafka/pull/14593#discussion_r1369067852 ## metadata/src/main/java/org/apache/kafka/controller/PartitionChangeBuilder.java: ## @@ -253,17 +269,30 @@ private ElectionResult electAnyLeader() {

[jira] [Commented] (KAFKA-15671) Flaky test RemoteIndexCacheTest.testClearCacheAndIndexFilesWhenResizeCache

2023-10-23 Thread Brian (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778777#comment-17778777 ] Brian commented on KAFKA-15671: --- [~divijvaidya] Hello I'm new to this project, can I give it a try? >

[jira] (KAFKA-15672) Add 3.6 to streams system tests

2023-10-23 Thread Brian (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15672 ] Brian deleted comment on KAFKA-15672: --- was (Author: JIRAUSER302723): I could work on this, can you assign it to me?   > Add 3.6 to streams system tests > --- > >

[jira] [Commented] (KAFKA-15672) Add 3.6 to streams system tests

2023-10-23 Thread Brian (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778771#comment-17778771 ] Brian commented on KAFKA-15672: --- I could work on this, can you assign it to me?   > Add 3.6 to streams

[jira] [Assigned] (KAFKA-15653) NPE in ChunkedByteStream

2023-10-23 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divij Vaidya reassigned KAFKA-15653: Assignee: (was: Divij Vaidya) > NPE in ChunkedByteStream >

Re: [PR] KAFKA-15584: Leader election with ELR [kafka]

2023-10-23 Thread via GitHub
CalvinConfluent commented on code in PR #14593: URL: https://github.com/apache/kafka/pull/14593#discussion_r1369023859 ## metadata/src/main/java/org/apache/kafka/controller/PartitionChangeBuilder.java: ## @@ -253,17 +269,30 @@ private ElectionResult electAnyLeader() {

Re: [PR] KAFKA-15582: Move the clean shutdown file to the storage package [kafka]

2023-10-23 Thread via GitHub
ijuma commented on code in PR #14603: URL: https://github.com/apache/kafka/pull/14603#discussion_r1369015980 ## storage/src/main/java/org/apache/kafka/storage/internals/util/CleanShutdownFileHandler.java: ## @@ -85,6 +85,7 @@ void write(long brokerEpoch, int version) throws

Re: [PR] KAFKA-15582: Move the clean shutdown file to the storage package [kafka]

2023-10-23 Thread via GitHub
ijuma commented on code in PR #14603: URL: https://github.com/apache/kafka/pull/14603#discussion_r1369013666 ## storage/src/main/java/org/apache/kafka/storage/internals/util/CleanShutdownFileHandler.java: ## @@ -15,7 +15,7 @@ * limitations under the License. */ -package

Re: [PR] KAFKA-15584: Leader election with ELR [kafka]

2023-10-23 Thread via GitHub
CalvinConfluent commented on code in PR #14593: URL: https://github.com/apache/kafka/pull/14593#discussion_r1369012157 ## metadata/src/main/java/org/apache/kafka/controller/PartitionChangeBuilder.java: ## @@ -93,6 +93,9 @@ public enum Election { private boolean

Re: [PR] KAFKA-15582: Move the clean shutdown file to the storage package [kafka]

2023-10-23 Thread via GitHub
CalvinConfluent commented on code in PR #14603: URL: https://github.com/apache/kafka/pull/14603#discussion_r1369010124 ## storage/src/main/java/org/apache/kafka/storage/internals/util/CleanShutdownFileHandler.java: ## @@ -15,7 +15,7 @@ * limitations under the License. */

[PR] KAFKA-15618: Kafka metrics collector and supporting classes (KIP-714) [kafka]

2023-10-23 Thread via GitHub
apoorvmittal10 opened a new pull request, #14620: URL: https://github.com/apache/kafka/pull/14620 The PR ([jira](https://issues.apache.org/jira/browse/KAFKA-15618)) outlines classes to collect metrics for client by KafkaMetricsCollector implementation. The MetricsCollector defines

Re: [PR] KAFKA-15582: Move the clean shutdown file to the storage package [kafka]

2023-10-23 Thread via GitHub
ijuma commented on code in PR #14603: URL: https://github.com/apache/kafka/pull/14603#discussion_r1369008762 ## storage/src/main/java/org/apache/kafka/storage/internals/util/CleanShutdownFileHandler.java: ## @@ -15,7 +15,7 @@ * limitations under the License. */ -package

Re: [PR] KAFKA-15628: Refactor ConsumerRebalanceListener invocation for reuse [kafka]

2023-10-23 Thread via GitHub
kirktrue commented on code in PR #14565: URL: https://github.com/apache/kafka/pull/14565#discussion_r1369002478 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/ConsumerCoordinatorMetrics.java: ## @@ -0,0 +1,80 @@ +/* + * Licensed to the Apache Software

Re: [PR] KAFKA-15628: Refactor ConsumerRebalanceListener invocation for reuse [kafka]

2023-10-23 Thread via GitHub
kirktrue commented on code in PR #14565: URL: https://github.com/apache/kafka/pull/14565#discussion_r1368991272 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/ConsumerRebalanceListenerInvoker.java: ## @@ -0,0 +1,128 @@ +/* + * Licensed to the Apache

Re: [PR] KAFKA-15093: Add 3.5 Streams upgrade system tests [kafka]

2023-10-23 Thread via GitHub
mjsax commented on PR #14602: URL: https://github.com/apache/kafka/pull/14602#issuecomment-1775630277 I think it would be good to revert? System test run already very long, and if we can cut down a few minutes by not re-running the same test twice, it might be good? -- This is an

Re: [PR] KAFKA-15628: Refactor ConsumerRebalanceListener invocation for reuse [kafka]

2023-10-23 Thread via GitHub
kirktrue commented on code in PR #14565: URL: https://github.com/apache/kafka/pull/14565#discussion_r1368990080 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/ConsumerCoordinator.java: ## @@ -227,6 +224,12 @@ public ConsumerCoordinator(GroupRebalanceConfig

Re: [PR] KAFKA-15628: Refactor ConsumerRebalanceListener invocation for reuse [kafka]

2023-10-23 Thread via GitHub
kirktrue commented on code in PR #14565: URL: https://github.com/apache/kafka/pull/14565#discussion_r1368989675 ## clients/src/main/java/org/apache/kafka/clients/consumer/KafkaConsumer.java: ## @@ -961,7 +960,7 @@ public void subscribe(Collection topics,

[PR] KAFKA-15669: Implement telemetry metric naming strategy (KIP-714) [kafka]

2023-10-23 Thread via GitHub
apoorvmittal10 opened a new pull request, #14619: URL: https://github.com/apache/kafka/pull/14619 The PR defined the naming convention for telemetry metric names for KIP-714. Telemetry metric name should be dot separated and tags should be snake case. PR adds the interface which will

[PR] KAFKA-15668: Adding Opentelmetry shadowed library (KIP-714) [kafka]

2023-10-23 Thread via GitHub
apoorvmittal10 opened a new pull request, #14618: URL: https://github.com/apache/kafka/pull/14618 The PR comprises of changes to include opentlemetry library as defined in KIP-714. The libraries are shadowed to prevent conflicts. ``` jar -tf kafka-clients-3.7.0-SNAPSHOT.jar | grep

Re: [PR] KAFKA-15582: Move the clean shutdown file to the storage package [kafka]

2023-10-23 Thread via GitHub
CalvinConfluent commented on PR #14603: URL: https://github.com/apache/kafka/pull/14603#issuecomment-1775608992 @junrao @ijuma Now the build success with irrelevant test failures. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Updated] (KAFKA-14767) Gradle build fails with missing commitId after git gc

2023-10-23 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris updated KAFKA-14767: Fix Version/s: 3.4.2 3.5.2 3.6.1 > Gradle build fails with

Re: [PR] KAFKA-15602: revert KAFKA-4852 [kafka]

2023-10-23 Thread via GitHub
philipnee commented on code in PR #14617: URL: https://github.com/apache/kafka/pull/14617#discussion_r1368954689 ## clients/src/main/java/org/apache/kafka/common/serialization/ByteBufferSerializer.java: ## @@ -16,38 +16,32 @@ */ package org.apache.kafka.common.serialization;

Re: [PR] MINOR: KAFKA-15526 followup [kafka]

2023-10-23 Thread via GitHub
splett2 commented on code in PR #14485: URL: https://github.com/apache/kafka/pull/14485#discussion_r1368951497 ## storage/src/main/java/org/apache/kafka/storage/internals/log/LogAppendInfo.java: ## @@ -204,6 +204,10 @@ public LeaderHwChange leaderHwChange() { return

[jira] [Comment Edited] (KAFKA-15602) Breaking change in 3.4.0 ByteBufferSerializer

2023-10-23 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778731#comment-17778731 ] Matthias J. Sax edited comment on KAFKA-15602 at 10/23/23 4:20 PM: ---

[jira] [Commented] (KAFKA-15602) Breaking change in 3.4.0 ByteBufferSerializer

2023-10-23 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778731#comment-17778731 ] Matthias J. Sax commented on KAFKA-15602: - Btw: also left a comment on K4852:

[jira] [Commented] (KAFKA-4852) ByteBufferSerializer not compatible with offsets

2023-10-23 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778727#comment-17778727 ] Matthias J. Sax commented on KAFKA-4852: As reported on

[jira] [Commented] (KAFKA-15602) Breaking change in 3.4.0 ByteBufferSerializer

2023-10-23 Thread Philip Nee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778726#comment-17778726 ] Philip Nee commented on KAFKA-15602: Great I think so. [~luke.kirby] - Do you agree? Also, do you

[PR] KAFKA-15602: revert KAFKA-4852 [kafka]

2023-10-23 Thread via GitHub
mjsax opened a new pull request, #14617: URL: https://github.com/apache/kafka/pull/14617 This PR reverts - https://github.com/apache/kafka/commit/51dbd175b08e78aeca03d6752847aa5f23c98659 - https://github.com/apache/kafka/commit/496ae054c2d43c0905167745bfb2f4a0725e9fc2 Also

[jira] [Commented] (KAFKA-15653) NPE in ChunkedByteStream

2023-10-23 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778721#comment-17778721 ] Divij Vaidya commented on KAFKA-15653: -- > However, there was some other way to access the bug in

[jira] [Commented] (KAFKA-15602) Breaking change in 3.4.0 ByteBufferSerializer

2023-10-23 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778719#comment-17778719 ] Matthias J. Sax commented on KAFKA-15602: - Sounds fair. – Let me revert K4852 in all applicable

Re: [PR] KAFKA-15629: Proposal to introduce IQv2 Query Types: TimestampedKeyQuery and TimestampedRangeQuery [kafka]

2023-10-23 Thread via GitHub
hanyuzheng7 commented on code in PR #14570: URL: https://github.com/apache/kafka/pull/14570#discussion_r1368883149 ## streams/src/main/java/org/apache/kafka/streams/state/internals/MeteredKeyValueStore.java: ## @@ -99,9 +101,17 @@ public class MeteredKeyValueStore

[jira] [Resolved] (KAFKA-15666) Добавить функцию поиска по почте

2023-10-23 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-15666. - Resolution: Invalid [~noraverba] – We can only take tickets in English. – Also piped

Re: [PR] KAFKA-15093: Add 3.5 Streams upgrade system tests [kafka]

2023-10-23 Thread via GitHub
mimaison commented on PR #14602: URL: https://github.com/apache/kafka/pull/14602#issuecomment-1775452320 Are we ok keeping the commit or should we revert it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Created] (KAFKA-15672) Add 3.6 to streams system tests

2023-10-23 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-15672: --- Summary: Add 3.6 to streams system tests Key: KAFKA-15672 URL: https://issues.apache.org/jira/browse/KAFKA-15672 Project: Kafka Issue Type: Test

Re: [PR] KAFKA-15664: Add 3.4 Streams upgrade system tests [kafka]

2023-10-23 Thread via GitHub
mimaison commented on PR #14601: URL: https://github.com/apache/kafka/pull/14601#issuecomment-1775449629 Ah ok, thanks for clarifying. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Commented] (KAFKA-15653) NPE in ChunkedByteStream

2023-10-23 Thread Justine Olshan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778709#comment-17778709 ] Justine Olshan commented on KAFKA-15653: Thanks [~divijvaidya] and [~ijuma] for looking at this.

Re: [PR] KAFKA-15093: Add 3.5 Streams upgrade system tests [kafka]

2023-10-23 Thread via GitHub
mjsax commented on PR #14602: URL: https://github.com/apache/kafka/pull/14602#issuecomment-1775443078 Why backport to `3.5` ? That's not necessary -- we test upgrade to `DEV_VERSION` what is `3.5.x-SNAPSHOT` -- no need to double test. -- This is an automated message from the Apache Git

Re: [PR] KAFKA-15664: Add 3.4 Streams upgrade system tests [kafka]

2023-10-23 Thread via GitHub
mjsax commented on PR #14601: URL: https://github.com/apache/kafka/pull/14601#issuecomment-1775440767 We don't need to backported to `3.4` branch -- In `3.4` branch we test this implicitly by upgrading to `DEV_VERSION`. -- This is an automated message from the Apache Git Service. To

Re: [PR] KAFKA-15514: Metadata records Replicas->Assignment [kafka]

2023-10-23 Thread via GitHub
OmniaGM commented on code in PR #14516: URL: https://github.com/apache/kafka/pull/14516#discussion_r1368826071 ## core/src/test/scala/integration/kafka/zk/ZkMigrationIntegrationTest.scala: ## @@ -128,7 +128,7 @@ class ZkMigrationIntegrationTest { val underlying =

  1   2   >