Re: [PR] MINOR: cleanup warnings in Kafka Streams code base [kafka]

2023-10-14 Thread via GitHub
ableegoldman commented on code in PR #14549: URL: https://github.com/apache/kafka/pull/14549#discussion_r1359737490 ## streams/src/main/java/org/apache/kafka/streams/StreamsBuilder.java: ## @@ -87,12 +87,12 @@ public StreamsBuilder() { */

Re: [PR] KAFKA-14684 Replace EasyMock and PowerMock with Mockito in WorkerSinkTaskThreadedTest [kafka]

2023-10-14 Thread via GitHub
hgeraldino commented on code in PR #14505: URL: https://github.com/apache/kafka/pull/14505#discussion_r1359700014 ## connect/runtime/src/test/java/org/apache/kafka/connect/runtime/WorkerSinkTaskThreadedTest.java: ## @@ -409,309 +430,266 @@ public void

Re: [PR] MINOR: Fix `Consumed` to return new object instead of `this` [kafka]

2023-10-14 Thread via GitHub
guozhangwang commented on code in PR #14550: URL: https://github.com/apache/kafka/pull/14550#discussion_r1359692144 ## streams/src/main/java/org/apache/kafka/streams/kstream/Branched.java: ## @@ -90,33 +104,43 @@ public static Branched withConsumer(final Consumer> c /**

Re: [PR] MINOR: cleanup warnings in Kafka Streams code base [kafka]

2023-10-14 Thread via GitHub
mjsax commented on code in PR #14549: URL: https://github.com/apache/kafka/pull/14549#discussion_r1359669572 ## streams/src/main/java/org/apache/kafka/streams/StreamsBuilder.java: ## @@ -87,12 +87,12 @@ public StreamsBuilder() { */ @SuppressWarnings("this-escape")

Re: [PR] MINOR: Fix `Consumed` to return new object instead of `this` [kafka]

2023-10-14 Thread via GitHub
mjsax commented on code in PR #14550: URL: https://github.com/apache/kafka/pull/14550#discussion_r1359669078 ## streams/src/main/java/org/apache/kafka/streams/kstream/Branched.java: ## @@ -90,33 +104,43 @@ public static Branched withConsumer(final Consumer> c /** *

Re: [PR] MINOR: Fix `Consumed` to return new object instead of `this` [kafka]

2023-10-14 Thread via GitHub
mjsax commented on code in PR #14550: URL: https://github.com/apache/kafka/pull/14550#discussion_r1359668981 ## streams/src/main/java/org/apache/kafka/streams/kstream/ForeachAction.java: ## @@ -27,15 +27,18 @@ * * @param key type * @param value type + * * @see

Re: [PR] MINOR: Fix `Consumed` to return new object instead of `this` [kafka]

2023-10-14 Thread via GitHub
mjsax commented on code in PR #14550: URL: https://github.com/apache/kafka/pull/14550#discussion_r1359668737 ## streams/src/main/java/org/apache/kafka/streams/kstream/Branched.java: ## @@ -125,21 +149,14 @@ public static Branched withConsumer(final Consumer(name, null,

[jira] [Commented] (KAFKA-13152) Replace "buffered.records.per.partition" & "cache.max.bytes.buffering" with "{statestore.cache}/{input.buffer}.max.bytes"

2023-10-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17775325#comment-17775325 ] Matthias J. Sax commented on KAFKA-13152: - [~guozhang] would you have interest to help getting

[jira] [Commented] (KAFKA-15594) Add 3.6.0 to streams upgrade/compatibility tests

2023-10-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17775323#comment-17775323 ] Matthias J. Sax commented on KAFKA-15594: - This ticket is to include upgrade test from 3.6 to

[jira] [Commented] (KAFKA-15594) Add 3.6.0 to streams upgrade/compatibility tests

2023-10-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17775324#comment-17775324 ] Matthias J. Sax commented on KAFKA-15594: - This ticket is to include upgrade test from 3.6 to

[jira] [Commented] (KAFKA-15593) Add 3.6.0 to broker/client upgrade/compatibility tests

2023-10-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17775322#comment-17775322 ] Matthias J. Sax commented on KAFKA-15593: - This ticket is to include upgrade test from 3.6 to

[jira] [Commented] (KAFKA-15406) Add the ForwardingManager metrics from KIP-938

2023-10-14 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17775316#comment-17775316 ] Colin McCabe commented on KAFKA-15406: -- This feature is planned for 3.7, but not with high

Re: [PR] MINOR: cleanup warnings in Kafka Streams code base [kafka]

2023-10-14 Thread via GitHub
guozhangwang commented on code in PR #14549: URL: https://github.com/apache/kafka/pull/14549#discussion_r1359654735 ## streams/src/main/java/org/apache/kafka/streams/StreamsBuilder.java: ## @@ -87,12 +87,12 @@ public StreamsBuilder() { */

Re: [PR] MINOR: Fix `Consumed` to return new object instead of `this` [kafka]

2023-10-14 Thread via GitHub
guozhangwang commented on code in PR #14550: URL: https://github.com/apache/kafka/pull/14550#discussion_r1359652648 ## streams/src/main/java/org/apache/kafka/streams/kstream/ForeachAction.java: ## @@ -27,15 +27,18 @@ * * @param key type * @param value type + * * @see

[jira] [Assigned] (KAFKA-15147) Measure pending and outstanding Remote Segment operations

2023-10-14 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divij Vaidya reassigned KAFKA-15147: Assignee: Christo Lolov (was: Divij Vaidya) > Measure pending and outstanding Remote

[jira] [Resolved] (KAFKA-15249) Verify Connect test-plugins artifact is published to Maven Central

2023-10-14 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-15249. --- Resolution: Done > Verify Connect test-plugins artifact is published to Maven Central >

[jira] [Commented] (KAFKA-15147) Measure pending and outstanding Remote Segment operations

2023-10-14 Thread Stanislav Kozlovski (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17775304#comment-17775304 ] Stanislav Kozlovski commented on KAFKA-15147: - thanks for the quick update [~divijvaidya] -

[jira] [Commented] (KAFKA-15147) Measure pending and outstanding Remote Segment operations

2023-10-14 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17775303#comment-17775303 ] Divij Vaidya commented on KAFKA-15147: -- Hi [~enether]  We have a KIP for this Jira which is under

[jira] [Resolved] (KAFKA-14175) KRaft Upgrades Part 2

2023-10-14 Thread Stanislav Kozlovski (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stanislav Kozlovski resolved KAFKA-14175. - Resolution: Won't Fix > KRaft Upgrades Part 2 > - > >

[jira] [Updated] (KAFKA-14175) KRaft Upgrades Part 2

2023-10-14 Thread Stanislav Kozlovski (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stanislav Kozlovski updated KAFKA-14175: Fix Version/s: (was: 3.7.0) > KRaft Upgrades Part 2 > - >

[jira] [Commented] (KAFKA-14175) KRaft Upgrades Part 2

2023-10-14 Thread Stanislav Kozlovski (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17775301#comment-17775301 ] Stanislav Kozlovski commented on KAFKA-14175: - [~mumrah] confirmed to me that this seems to

[jira] [Commented] (KAFKA-14945) Add Serializer#serializeToByteBuffer() to reduce memory copying

2023-10-14 Thread Stanislav Kozlovski (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17775300#comment-17775300 ] Stanislav Kozlovski commented on KAFKA-14945: - [~LSK] given the lack of activity from July

[PR] MINOR: Fix `Consumed` to return new object instead of `this` [kafka]

2023-10-14 Thread via GitHub
mjsax opened a new pull request, #14550: URL: https://github.com/apache/kafka/pull/14550 We embrace immutability and thus should return a new object instead of `this`, similar to other config classed we use in the DSL. Side JavaDocs cleanup for a bunch of classes. -- This is an

[jira] [Commented] (KAFKA-15230) ApiVersions data between controllers is not reliable

2023-10-14 Thread Stanislav Kozlovski (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17775299#comment-17775299 ] Stanislav Kozlovski commented on KAFKA-15230: - Did it release with 3.6.0?   > ApiVersions

[jira] [Updated] (KAFKA-10892) Add Topology#connectSourceStoreAndTopic as a public method

2023-10-14 Thread Stanislav Kozlovski (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stanislav Kozlovski updated KAFKA-10892: Fix Version/s: (was: 3.7.0) > Add Topology#connectSourceStoreAndTopic as a

[jira] [Commented] (KAFKA-10892) Add Topology#connectSourceStoreAndTopic as a public method

2023-10-14 Thread Stanislav Kozlovski (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17775298#comment-17775298 ] Stanislav Kozlovski commented on KAFKA-10892: - Given the lack of activity on

[jira] [Commented] (KAFKA-12473) Make the "cooperative-sticky, range" as the default assignor

2023-10-14 Thread Stanislav Kozlovski (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17775296#comment-17775296 ] Stanislav Kozlovski commented on KAFKA-12473: - [~dajac] [~showuon] shall we update the KIP

[jira] [Commented] (KAFKA-15147) Measure pending and outstanding Remote Segment operations

2023-10-14 Thread Stanislav Kozlovski (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17775295#comment-17775295 ] Stanislav Kozlovski commented on KAFKA-15147: - [~divijvaidya] given that there is no kip, is

[jira] [Commented] (KAFKA-14175) KRaft Upgrades Part 2

2023-10-14 Thread Stanislav Kozlovski (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17775294#comment-17775294 ] Stanislav Kozlovski commented on KAFKA-14175: - given the lack of activity in the last few

[jira] [Commented] (KAFKA-15594) Add 3.6.0 to streams upgrade/compatibility tests

2023-10-14 Thread Stanislav Kozlovski (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17775293#comment-17775293 ] Stanislav Kozlovski commented on KAFKA-15594: - [~satish.duggana] is anyone going to be

[jira] [Updated] (KAFKA-12399) Deprecate Log4J Appender KIP-719

2023-10-14 Thread Stanislav Kozlovski (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stanislav Kozlovski updated KAFKA-12399: Fix Version/s: (was: 3.7.0) > Deprecate Log4J Appender KIP-719 >

[jira] [Commented] (KAFKA-12399) Deprecate Log4J Appender KIP-719

2023-10-14 Thread Stanislav Kozlovski (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17775292#comment-17775292 ] Stanislav Kozlovski commented on KAFKA-12399: - This was last reviewed on March 7 and there

[jira] [Commented] (KAFKA-13152) Replace "buffered.records.per.partition" & "cache.max.bytes.buffering" with "{statestore.cache}/{input.buffer}.max.bytes"

2023-10-14 Thread Stanislav Kozlovski (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17775291#comment-17775291 ] Stanislav Kozlovski commented on KAFKA-13152: - Given there hasn't been much movement in this

[jira] [Commented] (KAFKA-15593) Add 3.6.0 to broker/client upgrade/compatibility tests

2023-10-14 Thread Stanislav Kozlovski (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17775286#comment-17775286 ] Stanislav Kozlovski commented on KAFKA-15593: - [~satish.duggana] is this good to close?

[jira] [Updated] (KAFKA-14077) KRaft should support recovery from failed disk

2023-10-14 Thread Stanislav Kozlovski (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stanislav Kozlovski updated KAFKA-14077: Fix Version/s: (was: 3.7.0) > KRaft should support recovery from failed disk

[jira] [Commented] (KAFKA-14077) KRaft should support recovery from failed disk

2023-10-14 Thread Stanislav Kozlovski (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17775285#comment-17775285 ] Stanislav Kozlovski commented on KAFKA-14077: - I asked [~jagsancio] and [~hachikuji] for

[jira] [Commented] (KAFKA-12886) Enable request forwarding by default

2023-10-14 Thread Stanislav Kozlovski (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17775284#comment-17775284 ] Stanislav Kozlovski commented on KAFKA-12886: - [~rdielhenn] is this targetting 3.7? I wonder

[jira] [Updated] (KAFKA-12886) Enable request forwarding by default

2023-10-14 Thread Stanislav Kozlovski (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stanislav Kozlovski updated KAFKA-12886: Fix Version/s: (was: 3.7.0) > Enable request forwarding by default >

[jira] [Commented] (KAFKA-15406) Add the ForwardingManager metrics from KIP-938

2023-10-14 Thread Stanislav Kozlovski (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17775275#comment-17775275 ] Stanislav Kozlovski commented on KAFKA-15406: - [~cmccabe] given that we are targetting this

[PR] MINOR: cleanup warnings in Kafka Streams code base [kafka]

2023-10-14 Thread via GitHub
mjsax opened a new pull request, #14549: URL: https://github.com/apache/kafka/pull/14549 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.* *Summary of testing

Re: [PR] POC - DO NO MERGE: refactor StreamsConfig [kafka]

2023-10-14 Thread via GitHub
mjsax commented on code in PR #14548: URL: https://github.com/apache/kafka/pull/14548#discussion_r1359477497 ## build.gradle: ## @@ -2151,7 +2151,7 @@ project(':streams') { task genStreamsConfigDocs(type: JavaExec) { classpath = sourceSets.main.runtimeClasspath -

[PR] POC - DO NO MERGE: refactor StreamsConfig [kafka]

2023-10-14 Thread via GitHub
mjsax opened a new pull request, #14548: URL: https://github.com/apache/kafka/pull/14548 This is a POC to refactor `StreamsConfig` to move "leaking" internal methods into a newly added subclass `InternalStreamsConfig`, following an already established pattern using for DSL config objects

[jira] [Created] (KAFKA-15607) Possible NPE is thrown in MirrorCheckpointTask

2023-10-14 Thread hudeqi (Jira)
hudeqi created KAFKA-15607: -- Summary: Possible NPE is thrown in MirrorCheckpointTask Key: KAFKA-15607 URL: https://issues.apache.org/jira/browse/KAFKA-15607 Project: Kafka Issue Type: Bug

Re: [PR] KAFKA-15536:Dynamically resize remoteIndexCache [kafka]

2023-10-14 Thread via GitHub
hudeqi commented on code in PR #14511: URL: https://github.com/apache/kafka/pull/14511#discussion_r1359460675 ## core/src/test/scala/unit/kafka/log/remote/RemoteIndexCacheTest.scala: ## @@ -561,6 +561,108 @@ class RemoteIndexCacheTest {

Re: [PR] KAFKA-15536:Dynamically resize remoteIndexCache [kafka]

2023-10-14 Thread via GitHub
hudeqi commented on code in PR #14511: URL: https://github.com/apache/kafka/pull/14511#discussion_r1359460627 ## core/src/test/scala/unit/kafka/log/remote/RemoteIndexCacheTest.scala: ## @@ -561,6 +561,108 @@ class RemoteIndexCacheTest {

Re: [PR] KAFKA-15536:Dynamically resize remoteIndexCache [kafka]

2023-10-14 Thread via GitHub
hudeqi commented on code in PR #14511: URL: https://github.com/apache/kafka/pull/14511#discussion_r1359460606 ## core/src/test/scala/unit/kafka/log/remote/RemoteIndexCacheTest.scala: ## @@ -561,6 +561,108 @@ class RemoteIndexCacheTest {

Re: [PR] KAFKA-15536:Dynamically resize remoteIndexCache [kafka]

2023-10-14 Thread via GitHub
hudeqi commented on code in PR #14511: URL: https://github.com/apache/kafka/pull/14511#discussion_r1359460521 ## core/src/test/scala/unit/kafka/log/remote/RemoteIndexCacheTest.scala: ## @@ -561,6 +561,108 @@ class RemoteIndexCacheTest {

Re: [PR] KAFKA-15536:Dynamically resize remoteIndexCache [kafka]

2023-10-14 Thread via GitHub
hudeqi commented on code in PR #14511: URL: https://github.com/apache/kafka/pull/14511#discussion_r1359435180 ## core/src/test/scala/unit/kafka/log/remote/RemoteIndexCacheTest.scala: ## @@ -525,7 +525,7 @@ class RemoteIndexCacheTest { .filter(path =>

Re: [PR] KAFKA-15481: Fix concurrency bug in RemoteIndexCache [kafka]

2023-10-14 Thread via GitHub
iit2009060 commented on code in PR #14483: URL: https://github.com/apache/kafka/pull/14483#discussion_r1359185319 ## core/src/test/scala/unit/kafka/log/remote/RemoteIndexCacheTest.scala: ## @@ -592,16 +593,75 @@ class RemoteIndexCacheTest { verifyFetchIndexInvocation(count

Re: [PR] KAFKA-15387: Deprecate Connect's redundant task configurations endpoint [kafka]

2023-10-14 Thread via GitHub
yashmayya commented on PR #14361: URL: https://github.com/apache/kafka/pull/14361#issuecomment-1762750265 Test failures are unrelated, merging to `trunk` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] KAFKA-15387: Deprecate Connect's redundant task configurations endpoint [kafka]

2023-10-14 Thread via GitHub
yashmayya merged PR #14361: URL: https://github.com/apache/kafka/pull/14361 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] KAFKA-15481: Fix concurrency bug in RemoteIndexCache [kafka]

2023-10-14 Thread via GitHub
showuon commented on code in PR #14483: URL: https://github.com/apache/kafka/pull/14483#discussion_r1359202415 ## storage/src/main/java/org/apache/kafka/storage/internals/log/RemoteIndexCache.java: ## @@ -193,7 +192,16 @@ public File cacheDir() { public void remove(Uuid

Re: [PR] KAFKA-15481: Fix concurrency bug in RemoteIndexCache [kafka]

2023-10-14 Thread via GitHub
showuon commented on code in PR #14483: URL: https://github.com/apache/kafka/pull/14483#discussion_r1359202160 ## storage/src/main/java/org/apache/kafka/storage/internals/log/RemoteIndexCache.java: ## @@ -193,7 +192,16 @@ public File cacheDir() { public void remove(Uuid