Re: [PR] KAFKA-15629: Proposal to introduce IQv2 Query Types: TimestampedKeyQuery and TimestampedRangeQuery [kafka]

2023-10-20 Thread via GitHub
hanyuzheng7 commented on code in PR #14570: URL: https://github.com/apache/kafka/pull/14570#discussion_r1367663858 ## streams/src/main/java/org/apache/kafka/streams/state/internals/MeteredKeyValueStore.java: ## @@ -288,6 +298,48 @@ protected QueryResult runRangeQuery(final

Re: [PR] KAFKA-15629: Proposal to introduce IQv2 Query Types: TimestampedKeyQuery and TimestampedRangeQuery [kafka]

2023-10-20 Thread via GitHub
hanyuzheng7 commented on code in PR #14570: URL: https://github.com/apache/kafka/pull/14570#discussion_r1367663818 ## streams/src/main/java/org/apache/kafka/streams/state/internals/MeteredKeyValueStore.java: ## @@ -99,9 +101,17 @@ public class MeteredKeyValueStore

Re: [PR] KAFKA-15566: Fix test FetchRequestTest.testLastFetchedEpochValidation for KRaft mode [kafka]

2023-10-20 Thread via GitHub
showuon commented on PR #14563: URL: https://github.com/apache/kafka/pull/14563#issuecomment-1773668936 cc @dengziming -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] KAFKA-15527: Update Javadoc for range and reverseRange in ReadOnlyKeyValueStore and update upgrade-guide.html for kafka streams webpage [kafka]

2023-10-20 Thread via GitHub
hanyuzheng7 commented on code in PR #14600: URL: https://github.com/apache/kafka/pull/14600#discussion_r1367661864 ## docs/streams/upgrade-guide.html: ## @@ -133,6 +133,15 @@ < More details about the new config StreamsConfig#TOPOLOGY_OPTIMIZATION can be found in

Re: [PR] KAFKA-15527: Update Javadoc for range and reverseRange in ReadOnlyKeyValueStore and update upgrade-guide.html for kafka streams webpage [kafka]

2023-10-20 Thread via GitHub
hanyuzheng7 commented on code in PR #14600: URL: https://github.com/apache/kafka/pull/14600#discussion_r1367619716 ## streams/src/main/java/org/apache/kafka/streams/state/ReadOnlyKeyValueStore.java: ## @@ -48,13 +48,13 @@ public interface ReadOnlyKeyValueStore { * Get an

Re: [PR] KAFKA-15527: Update Javadoc for range and reverseRange in ReadOnlyKeyValueStore and update upgrade-guide.html for kafka streams webpage [kafka]

2023-10-20 Thread via GitHub
hanyuzheng7 commented on PR #14600: URL: https://github.com/apache/kafka/pull/14600#issuecomment-1773625949 > I think we should also improve `RangeQuery` JavaDocs in addition, to be clear about ordering guarantees there, too. ok -- This is an automated message from the Apache Git

Re: [PR] KAFKA-15527: Update Javadoc for range and reverseRange in ReadOnlyKeyValueStore and update upgrade-guide.html for kafka streams webpage [kafka]

2023-10-20 Thread via GitHub
mjsax commented on code in PR #14600: URL: https://github.com/apache/kafka/pull/14600#discussion_r1367568404 ## docs/streams/upgrade-guide.html: ## @@ -133,6 +133,15 @@ < More details about the new config StreamsConfig#TOPOLOGY_OPTIMIZATION can be found in

Re: [PR] KAFKA-15629: Proposal to introduce IQv2 Query Types: TimestampedKeyQuery and TimestampedRangeQuery [kafka]

2023-10-20 Thread via GitHub
mjsax commented on code in PR #14570: URL: https://github.com/apache/kafka/pull/14570#discussion_r1367565174 ## streams/src/main/java/org/apache/kafka/streams/query/TimestampedKeyQuery.java: ## @@ -0,0 +1,70 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-20 Thread via GitHub
kirktrue commented on code in PR #14406: URL: https://github.com/apache/kafka/pull/14406#discussion_r1367565477 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/PrototypeAsyncConsumer.java: ## @@ -639,56 +835,175 @@ public void assign(Collection partitions)

Re: [PR] KAFKA-15093: Add 3.4 and 3.5 Streams upgrade system tests [kafka]

2023-10-20 Thread via GitHub
mjsax commented on PR #13860: URL: https://github.com/apache/kafka/pull/13860#issuecomment-1773536152 Merged the other PR. Btw: should we split this PR into two, one to add 3.4 and one to add 3.5? So it's easier to cherry-pick? (Adding 3.5 should only go into `3.6` branch, but adding 3.4

Re: [PR] KAFKA-15378: fix streams upgrade system test [kafka]

2023-10-20 Thread via GitHub
mjsax commented on PR #14539: URL: https://github.com/apache/kafka/pull/14539#issuecomment-1773534318 Just looked into the branch builder results for `test_compatible_brokers_eos_v2_enabled` 2.6.3 in more details. Broker log shows: ``` bash:

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-20 Thread via GitHub
junrao commented on code in PR #14406: URL: https://github.com/apache/kafka/pull/14406#discussion_r1367562895 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/PrototypeAsyncConsumer.java: ## @@ -639,56 +835,175 @@ public void assign(Collection partitions) {

[jira] [Resolved] (KAFKA-15378) Rolling upgrade system tests are failing

2023-10-20 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-15378. - Fix Version/s: 3.4.2 3.5.2 3.7.0

Re: [PR] KAFKA-15378: fix streams upgrade system test [kafka]

2023-10-20 Thread via GitHub
mjsax commented on PR #14539: URL: https://github.com/apache/kafka/pull/14539#issuecomment-1773526503 Merged to `trunk` and cherry-picked to `3.6`, `3.5`, and `3.4` branches. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-20 Thread via GitHub
kirktrue commented on code in PR #14406: URL: https://github.com/apache/kafka/pull/14406#discussion_r1367559124 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/PrototypeAsyncConsumer.java: ## @@ -639,56 +835,175 @@ public void assign(Collection partitions)

Re: [PR] KAFKA-15378: fix streams upgrade system test [kafka]

2023-10-20 Thread via GitHub
mjsax commented on PR #14539: URL: https://github.com/apache/kafka/pull/14539#issuecomment-1773521845 For example, just re-run: ``` $ TC_PATHS="tests/kafkatest/tests/streams/streams_broker_compatibility_test.py::StreamsBrokerCompatibility.test_compatible_brokers_eos_v2_enabled" bash

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-20 Thread via GitHub
junrao commented on code in PR #14406: URL: https://github.com/apache/kafka/pull/14406#discussion_r1367557772 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/PrototypeAsyncConsumer.java: ## @@ -639,56 +835,175 @@ public void assign(Collection partitions) {

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-20 Thread via GitHub
kirktrue commented on code in PR #14406: URL: https://github.com/apache/kafka/pull/14406#discussion_r1367556045 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/PrototypeAsyncConsumer.java: ## @@ -639,56 +835,175 @@ public void assign(Collection partitions)

Re: [PR] KAFKA-15378: fix streams upgrade system test [kafka]

2023-10-20 Thread via GitHub
mjsax merged PR #14539: URL: https://github.com/apache/kafka/pull/14539 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] KAFKA-15378: fix streams upgrade system test [kafka]

2023-10-20 Thread via GitHub
mjsax commented on PR #14539: URL: https://github.com/apache/kafka/pull/14539#issuecomment-1773506747 I did not run all of them locally yet... the upgrade tests, and cooperative rebalancing ones only. I am running them on my Mac, macOS Monterey (12.7), 2.3GHz 8-Core Intel i9 -- 32GB

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-20 Thread via GitHub
junrao commented on code in PR #14406: URL: https://github.com/apache/kafka/pull/14406#discussion_r1367537583 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/PrototypeAsyncConsumer.java: ## @@ -639,56 +835,175 @@ public void assign(Collection partitions) {

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-20 Thread via GitHub
kirktrue commented on PR #14406: URL: https://github.com/apache/kafka/pull/14406#issuecomment-1773483995 FYI: I rebased against `trunk` to remove the conflicts. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-20 Thread via GitHub
kirktrue commented on code in PR #14406: URL: https://github.com/apache/kafka/pull/14406#discussion_r1367536108 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/PrototypeAsyncConsumer.java: ## @@ -633,56 +829,178 @@ public void assign(Collection partitions)

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-20 Thread via GitHub
kirktrue commented on code in PR #14406: URL: https://github.com/apache/kafka/pull/14406#discussion_r1367535648 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/OffsetsRequestManager.java: ## @@ -188,7 +194,14 @@ public CompletableFuture> fetchOffsets(

Re: [PR] KIP-759: new DSL operation on KStreams interface [kafka]

2023-10-20 Thread via GitHub
lqxshay commented on PR #14446: URL: https://github.com/apache/kafka/pull/14446#issuecomment-1773472492 Ran a couple of failed tests in my local - they look good, like @mjsax suggested it might be a set of flakey tests. -- This is an automated message from the Apache Git Service. To

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-20 Thread via GitHub
junrao commented on code in PR #14406: URL: https://github.com/apache/kafka/pull/14406#discussion_r1367516322 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/events/ApplicationEventHandler.java: ## @@ -0,0 +1,115 @@ +/* + * Licensed to the Apache Software

Re: [PR] KAFKA-15481: Fix concurrency bug in RemoteIndexCache [kafka]

2023-10-20 Thread via GitHub
jeel2420 commented on PR #14483: URL: https://github.com/apache/kafka/pull/14483#issuecomment-1773469285 > @jeel2420

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-20 Thread via GitHub
kirktrue commented on code in PR #14406: URL: https://github.com/apache/kafka/pull/14406#discussion_r1367517181 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/OffsetsRequestManager.java: ## @@ -188,7 +194,14 @@ public CompletableFuture> fetchOffsets(

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-20 Thread via GitHub
kirktrue commented on code in PR #14406: URL: https://github.com/apache/kafka/pull/14406#discussion_r1367510616 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/NetworkClientDelegate.java: ## @@ -227,6 +282,13 @@ public UnsentRequest(final

Re: [PR] KAFKA-15481: Fix concurrency bug in RemoteIndexCache [kafka]

2023-10-20 Thread via GitHub
divijvaidya commented on PR #14483: URL: https://github.com/apache/kafka/pull/14483#issuecomment-1773437487 @jeel2420

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-20 Thread via GitHub
kirktrue commented on code in PR #14406: URL: https://github.com/apache/kafka/pull/14406#discussion_r1367508628 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/PrototypeAsyncConsumer.java: ## @@ -633,56 +832,159 @@ public void assign(Collection partitions)

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-20 Thread via GitHub
kirktrue commented on code in PR #14406: URL: https://github.com/apache/kafka/pull/14406#discussion_r1367508455 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/FetcherTest.java: ## @@ -872,19 +876,16 @@ public byte[] deserialize(String topic, byte[] data) {

[jira] [Resolved] (KAFKA-15651) Investigate auto commit guarantees during Consumer.assign()

2023-10-20 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-15651. - Resolution: Not A Problem > Investigate auto commit guarantees during Consumer.assign() >

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-20 Thread via GitHub
kirktrue commented on code in PR #14406: URL: https://github.com/apache/kafka/pull/14406#discussion_r1367498133 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/PrototypeAsyncConsumer.java: ## @@ -621,56 +824,177 @@ public void assign(Collection partitions)

Re: [PR] KAFKA-15626: Replace verification guard object with an specific type [kafka]

2023-10-20 Thread via GitHub
jolshan merged PR #14568: URL: https://github.com/apache/kafka/pull/14568 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Resolved] (KAFKA-15626) Replace verification guard object with an specific type

2023-10-20 Thread Justine Olshan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Justine Olshan resolved KAFKA-15626. Resolution: Fixed > Replace verification guard object with an specific type >

Re: [PR] KAFKA-15346: add support for 'single key single timestamp' IQs with versioned state stores (KIP-960) [kafka]

2023-10-20 Thread via GitHub
mjsax commented on code in PR #14596: URL: https://github.com/apache/kafka/pull/14596#discussion_r1367475515 ## streams/src/main/java/org/apache/kafka/streams/query/VersionedKeyQuery.java: ## @@ -0,0 +1,75 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

Re: [PR] KAFKA-15626: Replace verification guard object with an specific type [kafka]

2023-10-20 Thread via GitHub
jolshan commented on PR #14568: URL: https://github.com/apache/kafka/pull/14568#issuecomment-1773413391 Test failures look unrelated. Will merge. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Created] (KAFKA-15663) Implement ClientTelemetryReporter which manages telemetry lifecyclye

2023-10-20 Thread Apoorv Mittal (Jira)
Apoorv Mittal created KAFKA-15663: - Summary: Implement ClientTelemetryReporter which manages telemetry lifecyclye Key: KAFKA-15663 URL: https://issues.apache.org/jira/browse/KAFKA-15663 Project:

[jira] [Updated] (KAFKA-15662) Implement support for clientInstanceIds in Kafka Stream

2023-10-20 Thread Apoorv Mittal (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal updated KAFKA-15662: -- Description: The KIP requires Kafka Stream to support below method to give access to the

[jira] [Created] (KAFKA-15662) Implement support for clientInstanceIds in Kafka Stream

2023-10-20 Thread Apoorv Mittal (Jira)
Apoorv Mittal created KAFKA-15662: - Summary: Implement support for clientInstanceIds in Kafka Stream Key: KAFKA-15662 URL: https://issues.apache.org/jira/browse/KAFKA-15662 Project: Kafka

[PR] KAFKA-15527: Update Javadoc for range and reverseRange in ReadOnlyKeyValueStore and update upgrade-guide.html for kafka streams webpage [kafka]

2023-10-20 Thread via GitHub
hanyuzheng7 opened a new pull request, #14600: URL: https://github.com/apache/kafka/pull/14600 Update Javadoc for range and reverseRange in ReadOnlyKeyValueStore. Update upgrade-guide.html for kafka streams webpage. ### Committer Checklist (excluded from commit message) - [ ]

Re: [PR] KAFKA-14509 [WIP] [2/2] Implement server side logic for ConsumerGroupDescribe API [kafka]

2023-10-20 Thread via GitHub
riedelmax commented on code in PR #14544: URL: https://github.com/apache/kafka/pull/14544#discussion_r1367479438 ## core/src/test/scala/unit/kafka/server/KafkaApisTest.scala: ## @@ -6206,12 +6206,40 @@ class KafkaApisTest {

[jira] [Commented] (KAFKA-15534) Propagate client response time when timeout to the request handler

2023-10-20 Thread Philip Nee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1966#comment-1966 ] Philip Nee commented on KAFKA-15534: Hi - one more follow up:

[jira] [Commented] (KAFKA-15534) Propagate client response time when timeout to the request handler

2023-10-20 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1963#comment-1963 ] Kirk True commented on KAFKA-15534: --- [~pnee] can this be marked as resolved since the PR was merged?

[jira] [Commented] (KAFKA-15550) OffsetsForTimes validation for negative timestamps in new consumer

2023-10-20 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1962#comment-1962 ] Kirk True commented on KAFKA-15550: --- [~lianetm] can this be marked as resolved since the PR was

[jira] [Commented] (KAFKA-15658) Zookeeper.jar | CVE-2023-44981

2023-10-20 Thread masood (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1937#comment-1937 ] masood commented on KAFKA-15658: What would be the tentative date of v3.6.1 or v3.7. > Zookeeper.jar |

[jira] [Updated] (KAFKA-15357) Aggregate and propagate assignments

2023-10-20 Thread Igor Soarez (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Soarez updated KAFKA-15357: Description: A new AssignmentsManager accumulates, batches, and sends assignment events to the

[jira] [Updated] (KAFKA-15357) Aggregate and propagate assignments

2023-10-20 Thread Igor Soarez (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Soarez updated KAFKA-15357: Summary: Aggregate and propagate assignments (was: Aggregate and propagate assignments and

Re: [PR] MINOR: Server-Commons cleanup [kafka]

2023-10-20 Thread via GitHub
jlprat merged PR #14572: URL: https://github.com/apache/kafka/pull/14572 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] MINOR: Server-Commons cleanup [kafka]

2023-10-20 Thread via GitHub
jlprat commented on PR #14572: URL: https://github.com/apache/kafka/pull/14572#issuecomment-1773257357 All tests seem to be unrelated to the change -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] KAFKA-14274 [6, 7]: Introduction of fetch request manager [kafka]

2023-10-20 Thread via GitHub
junrao commented on code in PR #14406: URL: https://github.com/apache/kafka/pull/14406#discussion_r1361357104 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/FetcherTest.java: ## @@ -872,19 +876,16 @@ public byte[] deserialize(String topic, byte[] data) {

Re: [PR] KAFKA-14509 [WIP] [2/2] Implement server side logic for ConsumerGroupDescribe API [kafka]

2023-10-20 Thread via GitHub
riedelmax commented on code in PR #14544: URL: https://github.com/apache/kafka/pull/14544#discussion_r1367392319 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/GroupMetadataManager.java: ## @@ -444,6 +445,43 @@ public List listGroups(List statesFi

[jira] [Updated] (KAFKA-15373) AdminClient#describeTopics should not throw InvalidTopicException if topic ID is not found

2023-10-20 Thread Michael Edgar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Edgar updated KAFKA-15373: -- External issue URL: https://github.com/apache/kafka/pull/14599 > AdminClient#describeTopics

[PR] KAFKA-15373: fix exception thrown in Admin#describeTopics for unknown ID [kafka]

2023-10-20 Thread via GitHub
MikeEdgar opened a new pull request, #14599: URL: https://github.com/apache/kafka/pull/14599 Throw `UnknownTopicIdException` instead of `InvalidTopicException` when no name is found for the topic ID. Similar to #6124 for `describeTopics` using a topic name. `MockAdminClient` already

Re: [PR] KAFKA-15563: Provide informative error messages when Connect REST requests time out [kafka]

2023-10-20 Thread via GitHub
gharris1727 commented on PR #14562: URL: https://github.com/apache/kafka/pull/14562#issuecomment-1773197588 > it's the first published one :) This is a much better way to put it, and captures what I was going for :) > I suppose we could do something similar where we decompose

Re: [PR] KAFKA-15614: Define interfaces and classes for client telemetry [kafka]

2023-10-20 Thread via GitHub
philipnee commented on PR #14575: URL: https://github.com/apache/kafka/pull/14575#issuecomment-1773183542 Thanks for taking time to address and answer my question. I think the PR looks good. Here is the list of failing test, also jdk8 didn't finish. But I think it is most likely

Re: [PR] KAFKA-14595 Move ReassignPartitionsCommand to java [kafka]

2023-10-20 Thread via GitHub
nizhikov commented on PR #13247: URL: https://github.com/apache/kafka/pull/13247#issuecomment-1773121877 `throttling_test.py` OK too: ``` [INFO:2023-10-20 10:03:55,974]: starting test run with session id 2023-10-20--002... [INFO:2023-10-20 10:03:55,974]: running 2 tests...

Re: [PR] KAFKA-14595 Move ReassignPartitionsCommand to java [kafka]

2023-10-20 Thread via GitHub
nizhikov commented on PR #13247: URL: https://github.com/apache/kafka/pull/13247#issuecomment-1773088158 `reassign_partitions_test.py` is OK. Will check second in a minute. ``` $ git rev-parse HEAD 53e767a75f2d48c4e5419fdf83033f881f21771e docker exec ducker01 bash -c "cd

Re: [PR] KAFKA-15614: Define interfaces and classes for client telemetry [kafka]

2023-10-20 Thread via GitHub
apoorvmittal10 commented on PR #14575: URL: https://github.com/apache/kafka/pull/14575#issuecomment-1773065993 @kirktrue @mjsax @wcarlson5 Please let me know if I need to address something else as well. Thanks @AndrewJSchofield and @philipnee for reviews. -- This is an automated message

Re: [PR] KAFKA-15614: Define interfaces and classes for client telemetry [kafka]

2023-10-20 Thread via GitHub
apoorvmittal10 commented on code in PR #14575: URL: https://github.com/apache/kafka/pull/14575#discussion_r1367242148 ## clients/src/main/java/org/apache/kafka/common/telemetry/internals/ClientTelemetrySender.java: ## @@ -0,0 +1,79 @@ +/* + * Licensed to the Apache Software

Re: [PR] MINOR: Simplify UnsentRequest constructor [kafka]

2023-10-20 Thread via GitHub
philipnee closed pull request #14581: MINOR: Simplify UnsentRequest constructor URL: https://github.com/apache/kafka/pull/14581 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Commented] (KAFKA-15657) Unexpected errors when producing transactionally in 3.6

2023-10-20 Thread Justine Olshan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1859#comment-1859 ] Justine Olshan commented on KAFKA-15657: Thanks [~twmb] and [~ijuma]. I will follow along with

Re: [PR] KAFKA-14132; Replace EasyMock with Mockito in StandaloneHerderTest [kafka]

2023-10-20 Thread via GitHub
mdedetrich commented on PR #12728: URL: https://github.com/apache/kafka/pull/12728#issuecomment-1773039378 > @mdedetrich Sorry I just notice now that I was "can _we_ rebase", I meant "can _you_ rebase". If you're not able to complete this PR, let me know. I'll have it done by Monday

Re: [PR] KAFKA-15607:Possible NPE is thrown in MirrorCheckpointTask [kafka]

2023-10-20 Thread via GitHub
C0urante merged PR #14587: URL: https://github.com/apache/kafka/pull/14587 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] KAFKA-15607:Possible NPE is thrown in MirrorCheckpointTask [kafka]

2023-10-20 Thread via GitHub
C0urante commented on PR #14587: URL: https://github.com/apache/kafka/pull/14587#issuecomment-1773026960 Makes sense, thanks for the explanation @hudeqi! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] KAFKA-15158: Add metrics for RemoteRequestsPerSec [kafka]

2023-10-20 Thread via GitHub
tinaselenge commented on PR #14375: URL: https://github.com/apache/kafka/pull/14375#issuecomment-1772998045 thank you @clolov! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] MINOR: cherry pick KAFKA-13973 to 3.5 [kafka]

2023-10-20 Thread via GitHub
mjsax commented on PR #14592: URL: https://github.com/apache/kafka/pull/14592#issuecomment-1772992359 Thank you! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Updated] (KAFKA-13973) block-cache-capacity metrics worth twice as much as normal

2023-10-20 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-13973: Fix Version/s: 3.5.2 > block-cache-capacity metrics worth twice as much as normal >

[jira] [Commented] (KAFKA-15653) NPE in ChunkedByteStream

2023-10-20 Thread Travis Bischel (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1846#comment-1846 ] Travis Bischel commented on KAFKA-15653: Sorry, one more note: I'm also occasionally getting

[jira] [Updated] (KAFKA-15653) NPE in ChunkedByteStream

2023-10-20 Thread Travis Bischel (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Bischel updated KAFKA-15653: --- Attachment: repro.sh > NPE in ChunkedByteStream > > >

Re: [PR] KAFKA-14132; Replace EasyMock with Mockito in StandaloneHerderTest [kafka]

2023-10-20 Thread via GitHub
mimaison commented on PR #12728: URL: https://github.com/apache/kafka/pull/12728#issuecomment-1772979943 @mdedetrich Sorry I just notice now that I was "can _we_ rebase", I meant "can _you_ rebase". If you're not able to complete this PR, let me know. -- This is an automated message from

Re: [PR] KAFKA-15614: Define interfaces and classes for client telemetry [kafka]

2023-10-20 Thread via GitHub
philipnee commented on code in PR #14575: URL: https://github.com/apache/kafka/pull/14575#discussion_r1367156113 ## clients/src/main/java/org/apache/kafka/common/telemetry/internals/ClientTelemetrySender.java: ## @@ -0,0 +1,79 @@ +/* + * Licensed to the Apache Software

[jira] [Commented] (KAFKA-15653) NPE in ChunkedByteStream

2023-10-20 Thread Travis Bischel (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1835#comment-1835 ] Travis Bischel commented on KAFKA-15653: Maybe related? {noformat}

Re: [PR] KAFKA-15661: KIP-951: Server side and protocol changes [kafka]

2023-10-20 Thread via GitHub
chb2ab commented on code in PR #1: URL: https://github.com/apache/kafka/pull/1#discussion_r1367101090 ## core/src/test/scala/unit/kafka/server/ReplicaFetcherThreadTest.scala: ## @@ -125,7 +125,6 @@ class ReplicaFetcherThreadTest { val replicaManager: ReplicaManager

Re: [PR] KAFKA-15661: KIP-951: Server side and protocol changes [kafka]

2023-10-20 Thread via GitHub
chb2ab commented on PR #1: URL: https://github.com/apache/kafka/pull/1#issuecomment-1772933027 > @chb2ab is there a JIRA for this work? If not, can we create one and format the title as the jira title? done, lmk if anything's missing, it's my first AK JIRA.

Re: [PR] KIP-951: Server side and protocol changes for KIP-951 [kafka]

2023-10-20 Thread via GitHub
chb2ab commented on code in PR #1: URL: https://github.com/apache/kafka/pull/1#discussion_r1367126017 ## server-common/src/main/java/org/apache/kafka/server/common/MetadataVersion.java: ## @@ -338,7 +338,7 @@ public boolean isControllerRegistrationSupported() {

Re: [PR] KIP-951: Server side and protocol changes for KIP-951 [kafka]

2023-10-20 Thread via GitHub
chb2ab commented on code in PR #1: URL: https://github.com/apache/kafka/pull/1#discussion_r1367119960 ## clients/src/main/java/org/apache/kafka/common/requests/ProduceResponse.java: ## @@ -98,13 +116,20 @@ private static ProduceResponseData toData(Map

Re: [PR] KIP-951: Server side and protocol changes for KIP-951 [kafka]

2023-10-20 Thread via GitHub
chb2ab commented on code in PR #1: URL: https://github.com/apache/kafka/pull/1#discussion_r1367118129 ## clients/src/main/java/org/apache/kafka/common/requests/ProduceResponse.java: ## @@ -156,7 +182,11 @@ public PartitionResponse(Errors error, long baseOffset, long

Re: [PR] KIP-951: Server side and protocol changes for KIP-951 [kafka]

2023-10-20 Thread via GitHub
chb2ab commented on code in PR #1: URL: https://github.com/apache/kafka/pull/1#discussion_r1367116597 ## clients/src/main/resources/common/message/FetchResponse.json: ## @@ -102,6 +104,15 @@ "about": "The preferred read replica for the consumer to use on its

Re: [PR] KIP-951: Server side and protocol changes for KIP-951 [kafka]

2023-10-20 Thread via GitHub
chb2ab commented on code in PR #1: URL: https://github.com/apache/kafka/pull/1#discussion_r1367112293 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -619,6 +641,21 @@ class KafkaApis(val requestChannel: RequestChannel, request.header.clientId,

Re: [PR] KIP-951: Server side and protocol changes for KIP-951 [kafka]

2023-10-20 Thread via GitHub
chb2ab commented on code in PR #1: URL: https://github.com/apache/kafka/pull/1#discussion_r1367101090 ## core/src/test/scala/unit/kafka/server/ReplicaFetcherThreadTest.scala: ## @@ -125,7 +125,6 @@ class ReplicaFetcherThreadTest { val replicaManager: ReplicaManager

Re: [PR] KAFKA-15645 ReplicationQuotasTestRig rewritten in java [kafka]

2023-10-20 Thread via GitHub
nizhikov commented on code in PR #14588: URL: https://github.com/apache/kafka/pull/14588#discussion_r1367075805 ## tools/src/test/java/org/apache/kafka/tools/other/ReplicationQuotasTestRig.java: ## @@ -0,0 +1,482 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

Re: [PR] KAFKA-15645 ReplicationQuotasTestRig rewritten in java [kafka]

2023-10-20 Thread via GitHub
tledkov commented on code in PR #14588: URL: https://github.com/apache/kafka/pull/14588#discussion_r1367069575 ## tools/src/test/java/org/apache/kafka/tools/other/ReplicationQuotasTestRig.java: ## @@ -0,0 +1,482 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

Re: [PR] MINOR: Server-Commons cleanup [kafka]

2023-10-20 Thread via GitHub
jlprat commented on PR #14572: URL: https://github.com/apache/kafka/pull/14572#issuecomment-1772862994 I mistakenly added 2 imports in the last commit (added when writing the example code) -- This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Updated] (KAFKA-14133) Remaining EasyMock to Mockito tests

2023-10-20 Thread Christo Lolov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christo Lolov updated KAFKA-14133: -- Description: {color:#de350b}There are tests which use both PowerMock and EasyMock. I have

[jira] [Created] (KAFKA-15661) KIP-951: Server side and protocol changes

2023-10-20 Thread Crispin Bernier (Jira)
Crispin Bernier created KAFKA-15661: --- Summary: KIP-951: Server side and protocol changes Key: KAFKA-15661 URL: https://issues.apache.org/jira/browse/KAFKA-15661 Project: Kafka Issue Type:

Re: [PR] KAFKA-15610: Fix `CoreUtils.swallow()` test gaps [kafka]

2023-10-20 Thread via GitHub
divijvaidya commented on code in PR #14583: URL: https://github.com/apache/kafka/pull/14583#discussion_r1367044096 ## core/src/test/scala/unit/kafka/utils/CoreUtilsTest.scala: ## @@ -43,6 +43,18 @@ class CoreUtilsTest extends Logging { CoreUtils.swallow(throw new

Re: [PR] KAFKA-15605: Fix topic deletion handling during ZK migration [kafka]

2023-10-20 Thread via GitHub
mumrah commented on code in PR #14545: URL: https://github.com/apache/kafka/pull/14545#discussion_r1367032618 ## core/src/test/scala/integration/kafka/zk/ZkMigrationIntegrationTest.scala: ## @@ -265,6 +265,96 @@ class ZkMigrationIntegrationTest { migrationState =

Re: [PR] KAFKA-14133: Move RocksDBGenericOptionsToDbOptionsColumnFamilyOptionsAdapterTest to Mockito [kafka]

2023-10-20 Thread via GitHub
divijvaidya merged PR #14586: URL: https://github.com/apache/kafka/pull/14586 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] KAFKA-15645 ReplicationQuotasTestRig rewritten in java [kafka]

2023-10-20 Thread via GitHub
nizhikov commented on PR #14588: URL: https://github.com/apache/kafka/pull/14588#issuecomment-1772796727 @mimaison > If so can you attach them? Done. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] KAFKA-15645 ReplicationQuotasTestRig rewritten in java [kafka]

2023-10-20 Thread via GitHub
nizhikov commented on PR #14588: URL: https://github.com/apache/kafka/pull/14588#issuecomment-1772795864 Results from java version: html - https://gist.github.com/nizhikov/bbfd325b2483a6cd688bcca458c36061 ![Снимок экрана 2023-10-20 в 16 57

[jira] [Resolved] (KAFKA-15428) Cluster-wide dynamic log adjustments for Connect

2023-10-20 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-15428. --- Fix Version/s: 3.7.0 Resolution: Done > Cluster-wide dynamic log adjustments for

Re: [PR] KAFKA-15428: Cluster-wide dynamic log adjustments for Connect [kafka]

2023-10-20 Thread via GitHub
C0urante merged PR #14538: URL: https://github.com/apache/kafka/pull/14538 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] KAFKA-15428: Cluster-wide dynamic log adjustments for Connect [kafka]

2023-10-20 Thread via GitHub
C0urante commented on PR #14538: URL: https://github.com/apache/kafka/pull/14538#issuecomment-177221 Thanks for the reviews, all! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] KAFKA-15645 ReplicationQuotasTestRig rewritten in java [kafka]

2023-10-20 Thread via GitHub
nizhikov commented on PR #14588: URL: https://github.com/apache/kafka/pull/14588#issuecomment-1772770415 Trunk results html - https://gist.github.com/nizhikov/f013c63174c46e46429a43609c9bd2be ![Снимок экрана 2023-10-20 в 16 44

Re: [PR] MINOR: Server-Commons cleanup [kafka]

2023-10-20 Thread via GitHub
jlprat commented on code in PR #14572: URL: https://github.com/apache/kafka/pull/14572#discussion_r1366996892 ## server-common/src/main/java/org/apache/kafka/server/util/json/JsonValue.java: ## @@ -26,18 +26,16 @@ /** * A simple wrapper over Jackson's JsonNode that enables

Re: [PR] KAFKA-14133: Move RocksDBGenericOptionsToDbOptionsColumnFamilyOptionsAdapterTest to Mockito [kafka]

2023-10-20 Thread via GitHub
divijvaidya commented on PR #14586: URL: https://github.com/apache/kafka/pull/14586#issuecomment-1772757628 There are unrelated test failures: ``` [Build / JDK 17 and Scala 2.13 /

Re: [PR] KAFKA-15158: Add metrics for RemoteRequestsPerSec [kafka]

2023-10-20 Thread via GitHub
clolov commented on PR #14375: URL: https://github.com/apache/kafka/pull/14375#issuecomment-1772757204 Yup, I believe these metrics are useful and I will add them as part of KIP-963, thanks for bringing this to my attention! -- This is an automated message from the Apache Git Service. To

Re: [PR] KAFKA-14595 Move ReassignPartitionsCommand to java [kafka]

2023-10-20 Thread via GitHub
nizhikov commented on PR #13247: URL: https://github.com/apache/kafka/pull/13247#issuecomment-1772753275 @mimaison Thanks for the hint. I will run system test, also. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

  1   2   >