[jira] [Updated] (KAFKA-14000) Kafka-connect standby server shows empty tasks list

2022-06-15 Thread Xinyu Zou (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinyu Zou updated KAFKA-14000: -- Description: I'm using Kafka-connect distributed mode. There're two servers. One active and one

[jira] [Updated] (KAFKA-14000) Kafka-connect standby server shows empty tasks list

2022-06-15 Thread Xinyu Zou (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinyu Zou updated KAFKA-14000: -- Attachment: kafka-connect-trace.log > Kafka-connect standby server shows empty tasks list >

[jira] [Created] (KAFKA-14000) Kafka-connect standby server shows empty tasks list

2022-06-15 Thread Xinyu Zou (Jira)
Xinyu Zou created KAFKA-14000: - Summary: Kafka-connect standby server shows empty tasks list Key: KAFKA-14000 URL: https://issues.apache.org/jira/browse/KAFKA-14000 Project: Kafka Issue Type:

[jira] [Commented] (KAFKA-12478) Consumer group may lose data for newly expanded partitions when add partitions for topic if the group is set to consume from the latest

2022-06-15 Thread hudeqi (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554884#comment-17554884 ] hudeqi commented on KAFKA-12478: Hello, Guozhang. I have started a vote on KIP-842 for this issue. Does

[GitHub] [kafka] C0urante commented on pull request #11781: KAFKA-10000: Per-connector offsets topics (KIP-618)

2022-06-15 Thread GitBox
C0urante commented on PR #11781: URL: https://github.com/apache/kafka/pull/11781#issuecomment-1157162231 Hey guys--thanks for the reviews, really appreciate the rapid responses here. I found a bug that's been a bit trickier to solve than expected and have had little time to work on it this

[GitHub] [kafka] bozhao12 commented on pull request #12286: KAFKA-13984: Fix TopicBasedRemoteLogMetadataManager#initializeResources should exit immediately when partition size of __remote_log_metadata

2022-06-15 Thread GitBox
bozhao12 commented on PR #12286: URL: https://github.com/apache/kafka/pull/12286#issuecomment-1157064520 @divijvaidya Thanks for your review. I add a unit test based on your suggestion. Due to the restart operation involved, I put this unit test in

[jira] [Created] (KAFKA-13999) Add ProducerCount metrics (KIP-847)

2022-06-15 Thread Artem Livshits (Jira)
Artem Livshits created KAFKA-13999: -- Summary: Add ProducerCount metrics (KIP-847) Key: KAFKA-13999 URL: https://issues.apache.org/jira/browse/KAFKA-13999 Project: Kafka Issue Type:

[GitHub] [kafka] mdedetrich commented on pull request #12284: KAFKA-13980: Upgrade from Scala 2.12.15 to 2.12.16

2022-06-15 Thread GitBox
mdedetrich commented on PR #12284: URL: https://github.com/apache/kafka/pull/12284#issuecomment-1156984238 > Is there something you're looking for in 2.12.16? So I already had a detailed look into this, it only occurs at compile time (see

[GitHub] [kafka] ijuma commented on pull request #12284: KAFKA-13980: Upgrade from Scala 2.12.15 to 2.12.16

2022-06-15 Thread GitBox
ijuma commented on PR #12284: URL: https://github.com/apache/kafka/pull/12284#issuecomment-1156981130 I notice there's a regression: > Scala 2.12.16 contains a https://github.com/scala/bug/issues/12605 that was discovered after the artifacts were published. Only mixed compilation of

[GitHub] [kafka] ijuma commented on a diff in pull request #12241: MINOR: Fix docs in upgrade.html

2022-06-15 Thread GitBox
ijuma commented on code in PR #12241: URL: https://github.com/apache/kafka/pull/12241#discussion_r898459208 ## docs/upgrade.html: ## @@ -1265,7 +1265,7 @@ Notable changes in 1 on live log directories even if there are offline log directories. A log directory may

[GitHub] [kafka] ijuma closed pull request #12241: MINOR: Fix docs in upgrade.html

2022-06-15 Thread GitBox
ijuma closed pull request #12241: MINOR: Fix docs in upgrade.html URL: https://github.com/apache/kafka/pull/12241 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [kafka] jnh5y opened a new pull request, #12299: MINOR: Guard against decrementing `totalCommittedSinceLastSummary` du…

2022-06-15 Thread GitBox
jnh5y opened a new pull request, #12299: URL: https://github.com/apache/kafka/pull/12299 …ring rebalancing. ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation

[GitHub] [kafka] jnh5y commented on pull request #12298: KAFKA-13998 JoinGroupRequestData 'reason' can be too large

2022-06-15 Thread GitBox
jnh5y commented on PR #12298: URL: https://github.com/apache/kafka/pull/12298#issuecomment-1156967918 I tried to find a way to create a unit test for this change, but I wasn't able to do so quickly. If someone has a suggestion for how to do that, I'm happy to follow through with it. --

[GitHub] [kafka] jnh5y opened a new pull request, #12298: KAFKA-13998 JoinGroupRequestData 'reason' can be too large

2022-06-15 Thread GitBox
jnh5y opened a new pull request, #12298: URL: https://github.com/apache/kafka/pull/12298 This fix follows the pattern which is established in `AbstractCoordinator.java` of setting the request reason with the method `requestRejoin`. ### Committer Checklist (excluded from commit

[GitHub] [kafka] bozhao12 commented on a diff in pull request #12241: MINOR: Fix docs in upgrade.html

2022-06-15 Thread GitBox
bozhao12 commented on code in PR #12241: URL: https://github.com/apache/kafka/pull/12241#discussion_r898448690 ## docs/upgrade.html: ## @@ -1265,7 +1265,7 @@ Notable changes in 1 on live log directories even if there are offline log directories. A log directory may

[jira] [Created] (KAFKA-13998) JoinGroupRequestData 'reason' can be too large

2022-06-15 Thread Jim Hughes (Jira)
Jim Hughes created KAFKA-13998: -- Summary: JoinGroupRequestData 'reason' can be too large Key: KAFKA-13998 URL: https://issues.apache.org/jira/browse/KAFKA-13998 Project: Kafka Issue Type: Bug

[GitHub] [kafka] guozhangwang commented on pull request #12121: KAFKA-13846: Adding overloaded addMetricIfAbsent method

2022-06-15 Thread GitBox
guozhangwang commented on PR #12121: URL: https://github.com/apache/kafka/pull/12121#issuecomment-1156954295 > @guozhangwang , which file does this correspond to? that update the web docs on 3.3 release new API changes Here:

[GitHub] [kafka] mjsax commented on a diff in pull request #12204: [9/N WIP][Emit final] Emit final for session window aggregations

2022-06-15 Thread GitBox
mjsax commented on code in PR #12204: URL: https://github.com/apache/kafka/pull/12204#discussion_r898411852 ## streams/src/main/java/org/apache/kafka/streams/state/internals/RocksDBTimeOrderedSessionStore.java: ## @@ -61,6 +65,18 @@ public QueryResult query(final Query query,

[GitHub] [kafka] mjsax commented on a diff in pull request #12204: [9/N WIP][Emit final] Emit final for session window aggregations

2022-06-15 Thread GitBox
mjsax commented on code in PR #12204: URL: https://github.com/apache/kafka/pull/12204#discussion_r898406030 ## streams/src/main/java/org/apache/kafka/streams/state/SessionStore.java: ## @@ -39,6 +39,13 @@ */ public interface SessionStore extends StateStore,

[GitHub] [kafka] guozhangwang commented on a diff in pull request #12204: [9/N WIP][Emit final] Emit final for session window aggregations

2022-06-15 Thread GitBox
guozhangwang commented on code in PR #12204: URL: https://github.com/apache/kafka/pull/12204#discussion_r880784817 ## streams/src/main/java/org/apache/kafka/streams/state/internals/RocksDBTimeOrderedSessionStore.java: ## @@ -61,6 +65,18 @@ public QueryResult query(final Query

[GitHub] [kafka] mjsax commented on a diff in pull request #12204: [9/N WIP][Emit final] Emit final for session window aggregations

2022-06-15 Thread GitBox
mjsax commented on code in PR #12204: URL: https://github.com/apache/kafka/pull/12204#discussion_r898340071 ## streams/src/main/java/org/apache/kafka/streams/state/internals/InMemorySessionStore.java: ## @@ -202,25 +205,43 @@ public void remove(final Windowed sessionKey) {

[GitHub] [kafka] mjsax commented on a diff in pull request #12204: [9/N WIP][Emit final] Emit final for session window aggregations

2022-06-15 Thread GitBox
mjsax commented on code in PR #12204: URL: https://github.com/apache/kafka/pull/12204#discussion_r898339592 ## streams/src/main/java/org/apache/kafka/streams/state/internals/InMemorySessionStore.java: ## @@ -202,25 +205,43 @@ public void remove(final Windowed sessionKey) {

[jira] [Commented] (KAFKA-13939) Memory Leak When Logging Is Disabled In InMemoryTimeOrderedKeyValueBuffer

2022-06-15 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554742#comment-17554742 ] Matthias J. Sax commented on KAFKA-13939: - Thanks for the PR. I added you to list of

[jira] [Assigned] (KAFKA-13939) Memory Leak When Logging Is Disabled In InMemoryTimeOrderedKeyValueBuffer

2022-06-15 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-13939: --- Assignee: Jackson Newhouse > Memory Leak When Logging Is Disabled In

[jira] [Commented] (KAFKA-13888) KIP-836: Addition of Information in DescribeQuorumResponse about Voter Lag

2022-06-15 Thread Niket Goel (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554738#comment-17554738 ] Niket Goel commented on KAFKA-13888: The PR that adds the API to handler to the admin client

[jira] [Comment Edited] (KAFKA-13888) KIP-836: Addition of Information in DescribeQuorumResponse about Voter Lag

2022-06-15 Thread Niket Goel (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554738#comment-17554738 ] Niket Goel edited comment on KAFKA-13888 at 6/15/22 5:59 PM: - The PR that

[GitHub] [kafka] mjsax commented on a diff in pull request #12293: KAFKA-13963: Clarified java doc for processors api

2022-06-15 Thread GitBox
mjsax commented on code in PR #12293: URL: https://github.com/apache/kafka/pull/12293#discussion_r898266334 ## streams/src/main/java/org/apache/kafka/streams/TopologyDescription.java: ## @@ -30,6 +30,7 @@ * In contrast, two sub-topologies are not connected but can be linked

[GitHub] [kafka] niket-goel commented on pull request #12212: Kafka 13888 new fields

2022-06-15 Thread GitBox
niket-goel commented on PR #12212: URL: https://github.com/apache/kafka/pull/12212#issuecomment-1156768917 Hey @lqjack . Thanks for raising this PR. The PR https://github.com/apache/kafka/pull/12206 has now been merged to trunk. Can you please update your PR with the latest code so we can

[GitHub] [kafka] vamossagar12 commented on pull request #12121: KAFKA-13846: Adding overloaded addMetricIfAbsent method

2022-06-15 Thread GitBox
vamossagar12 commented on PR #12121: URL: https://github.com/apache/kafka/pull/12121#issuecomment-1156764298 @ijuma ., i updated the PR name. Also, created a follow up PR to address some of the comments: https://github.com/apache/kafka/pull/12297 @guozhangwang , which file does this

[GitHub] [kafka] philipnee commented on pull request #12149: KAFKA-13668: Retry upon missing initProducerId due to authorization error

2022-06-15 Thread GitBox
philipnee commented on PR #12149: URL: https://github.com/apache/kafka/pull/12149#issuecomment-1156747595 @ijuma - I think @hachikuji is reviewing it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [kafka] clolov commented on pull request #12285: KAFKA-7342 Part 1: Straightforward JUnit4 to JUnit5 migrations

2022-06-15 Thread GitBox
clolov commented on PR #12285: URL: https://github.com/apache/kafka/pull/12285#issuecomment-1156744613 Hello! Thank you to everyone who has left a comment and suggestions for improvement. In the next few days I will aim to rework this pull request. In summary: * I will revert the import

[GitHub] [kafka] divijvaidya commented on a diff in pull request #12233: MINOR: Clean up tmp files created by tests

2022-06-15 Thread GitBox
divijvaidya commented on code in PR #12233: URL: https://github.com/apache/kafka/pull/12233#discussion_r898241099 ## metadata/src/test/java/org/apache/kafka/controller/BootstrapMetadataTest.java: ## @@ -31,9 +35,21 @@ import static org.junit.jupiter.api.Assertions.assertTrue;

[GitHub] [kafka] mdedetrich commented on a diff in pull request #12284: KAFKA-13980: Upgrade from Scala 2.12.15 to 2.12.16

2022-06-15 Thread GitBox
mdedetrich commented on code in PR #12284: URL: https://github.com/apache/kafka/pull/12284#discussion_r898217940 ## docs/upgrade.html: ## @@ -59,6 +59,9 @@ Upgrading to 3.2.0 from any vers (or to take advantage of exactly once semantics), the newer Java

[GitHub] [kafka] ijuma commented on pull request #12149: KAFKA-13668: Retry upon missing initProducerId due to authorization error

2022-06-15 Thread GitBox
ijuma commented on PR #12149: URL: https://github.com/apache/kafka/pull/12149#issuecomment-1156718718 @philipnee where are we with this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] ijuma commented on pull request #12148: MINOR: Remove unnecessary log4j-appender dependency and tweak explicit log4j dependency

2022-06-15 Thread GitBox
ijuma commented on PR #12148: URL: https://github.com/apache/kafka/pull/12148#issuecomment-1156718290 @omkreddy maybe you can help review this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [kafka] mdedetrich commented on a diff in pull request #12284: KAFKA-13980: Upgrade from Scala 2.12.15 to 2.12.16

2022-06-15 Thread GitBox
mdedetrich commented on code in PR #12284: URL: https://github.com/apache/kafka/pull/12284#discussion_r898217940 ## docs/upgrade.html: ## @@ -59,6 +59,9 @@ Upgrading to 3.2.0 from any vers (or to take advantage of exactly once semantics), the newer Java

[GitHub] [kafka] ijuma closed pull request #12232: MINOR:rm deprecated method

2022-06-15 Thread GitBox
ijuma closed pull request #12232: MINOR:rm deprecated method URL: https://github.com/apache/kafka/pull/12232 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[GitHub] [kafka] ijuma commented on pull request #12232: MINOR:rm deprecated method

2022-06-15 Thread GitBox
ijuma commented on PR #12232: URL: https://github.com/apache/kafka/pull/12232#issuecomment-1156711344 Yes, we only remove deprecated methods during major releases. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [kafka] ijuma commented on pull request #12233: MINOR: Clean up tmp files created by tests

2022-06-15 Thread GitBox
ijuma commented on PR #12233: URL: https://github.com/apache/kafka/pull/12233#issuecomment-1156710957 Thanks for the PR. It looks reasonable, just one nit. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [kafka] ijuma commented on a diff in pull request #12233: MINOR: Clean up tmp files created by tests

2022-06-15 Thread GitBox
ijuma commented on code in PR #12233: URL: https://github.com/apache/kafka/pull/12233#discussion_r898209292 ## metadata/src/test/java/org/apache/kafka/controller/BootstrapMetadataTest.java: ## @@ -31,9 +35,21 @@ import static org.junit.jupiter.api.Assertions.assertTrue;

[GitHub] [kafka] ijuma commented on a diff in pull request #12241: MINOR: Fix docs in upgrade.html

2022-06-15 Thread GitBox
ijuma commented on code in PR #12241: URL: https://github.com/apache/kafka/pull/12241#discussion_r898207431 ## docs/upgrade.html: ## @@ -1265,7 +1265,7 @@ Notable changes in 1 on live log directories even if there are offline log directories. A log directory may

[GitHub] [kafka] ijuma commented on pull request #12278: MINOR: add AuthorizerNotReadyException

2022-06-15 Thread GitBox
ijuma commented on PR #12278: URL: https://github.com/apache/kafka/pull/12278#issuecomment-1156706455 Do we have a KIP for this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [kafka] ijuma commented on pull request #12290: MINOR: Stop leaking threads in BlockingConnectorTest

2022-06-15 Thread GitBox
ijuma commented on PR #12290: URL: https://github.com/apache/kafka/pull/12290#issuecomment-1156705915 @kkonstantine can you please review this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [kafka] ijuma commented on a diff in pull request #12284: KAFKA-13980: Upgrade from Scala 2.12.15 to 2.12.16

2022-06-15 Thread GitBox
ijuma commented on code in PR #12284: URL: https://github.com/apache/kafka/pull/12284#discussion_r898205328 ## docs/upgrade.html: ## @@ -59,6 +59,9 @@ Upgrading to 3.2.0 from any vers (or to take advantage of exactly once semantics), the newer Java clients

[GitHub] [kafka] ijuma commented on pull request #12285: KAFKA-7342 Part 1: Straightforward JUnit4 to JUnit5 migrations

2022-06-15 Thread GitBox
ijuma commented on PR #12285: URL: https://github.com/apache/kafka/pull/12285#issuecomment-1156705224 > Worth putting in a separate PR, but have you tried enabling the Jupiter parallel test runner? When I ran it on a work project, it improved build times by an order of magnitude We

[jira] [Reopened] (KAFKA-13888) KIP-836: Addition of Information in DescribeQuorumResponse about Voter Lag

2022-06-15 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson reopened KAFKA-13888: - > KIP-836: Addition of Information in DescribeQuorumResponse about Voter Lag >

[GitHub] [kafka] hachikuji commented on pull request #12212: Kafka 13888 new fields

2022-06-15 Thread GitBox
hachikuji commented on PR #12212: URL: https://github.com/apache/kafka/pull/12212#issuecomment-1156686396 @lqjack Can you merge with trunk please? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Resolved] (KAFKA-13888) KIP-836: Addition of Information in DescribeQuorumResponse about Voter Lag

2022-06-15 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-13888. - Fix Version/s: 3.3.0 Resolution: Fixed > KIP-836: Addition of Information in

[GitHub] [kafka] hachikuji merged pull request #12206: KAFKA-13888: Addition of Information in DescribeQuorumResponse about Voter Lag

2022-06-15 Thread GitBox
hachikuji merged PR #12206: URL: https://github.com/apache/kafka/pull/12206 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] dajac closed pull request #12292: MINOR: KRaft nodes not shutdown correctly when using one controller in colocated mode

2022-06-15 Thread GitBox
dajac closed pull request #12292: MINOR: KRaft nodes not shutdown correctly when using one controller in colocated mode URL: https://github.com/apache/kafka/pull/12292 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [kafka] dajac commented on pull request #12292: MINOR: KRaft nodes not shutdown correctly when using one controller in colocated mode

2022-06-15 Thread GitBox
dajac commented on PR #12292: URL: https://github.com/apache/kafka/pull/12292#issuecomment-1156567953 Already fixed by https://github.com/apache/kafka/pull/11238. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [kafka] dajac merged pull request #11238: MINOR: Fix force kill of KRaft colocated controllers in system tests

2022-06-15 Thread GitBox
dajac merged PR #11238: URL: https://github.com/apache/kafka/pull/11238 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] tyamashi-oss opened a new pull request, #12296: KAFKA-13996: log.cleaner.io.max.bytes.per.second can be changed dynamically

2022-06-15 Thread GitBox
tyamashi-oss opened a new pull request, #12296: URL: https://github.com/apache/kafka/pull/12296 - Implementation: - Add updateDesiredRatePerSec() on Throttler - Call updateDesiredRatePerSec() of Throttler with new log.cleaner.io.max.bytes.per.second value in reconfigure() of Log

[jira] [Created] (KAFKA-13996) log.cleaner.io.max.bytes.per.second cannot be changed dynamically

2022-06-15 Thread Tomonari Yamashita (Jira)
Tomonari Yamashita created KAFKA-13996: -- Summary: log.cleaner.io.max.bytes.per.second cannot be changed dynamically Key: KAFKA-13996 URL: https://issues.apache.org/jira/browse/KAFKA-13996

[jira] [Updated] (KAFKA-13997) one partition logs are not getting purged

2022-06-15 Thread Naveen P (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naveen P updated KAFKA-13997: - Description: We have issue with one of our topic in kafka cluster, which is taking huge space, while

[jira] [Created] (KAFKA-13997) one partition logs are not getting purged

2022-06-15 Thread Naveen P (Jira)
Naveen P created KAFKA-13997: Summary: one partition logs are not getting purged Key: KAFKA-13997 URL: https://issues.apache.org/jira/browse/KAFKA-13997 Project: Kafka Issue Type: Bug

[jira] [Commented] (KAFKA-13995) Does Kafka support Network File System (NFS)? Is it recommended in Production?

2022-06-15 Thread Devarshi Shah (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554577#comment-17554577 ] Devarshi Shah commented on KAFKA-13995: --- A kind request to answer as soon as possible as it's

[jira] [Updated] (KAFKA-13995) Does Kafka support Network File System (NFS)? Is it recommended in Production?

2022-06-15 Thread Devarshi Shah (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devarshi Shah updated KAFKA-13995: -- Description: I've gone through the Apache Kafka Documentation. It does not contain

[jira] [Created] (KAFKA-13995) Does Kafka support Network File System (NFS)? Is it recommended in Production?

2022-06-15 Thread Devarshi Shah (Jira)
Devarshi Shah created KAFKA-13995: - Summary: Does Kafka support Network File System (NFS)? Is it recommended in Production? Key: KAFKA-13995 URL: https://issues.apache.org/jira/browse/KAFKA-13995

[GitHub] [kafka] divijvaidya commented on pull request #12224: KAFKA-13943: Make LocalLogManager implementation consistent with the RaftClient interface contract

2022-06-15 Thread GitBox
divijvaidya commented on PR #12224: URL: https://github.com/apache/kafka/pull/12224#issuecomment-1156428420 @jsancio please review when you get a chance. Currently multiple tests in `QuorumControllerTest` are acting flaky because we are allowing to create a snapshot with LONG_MAX value.

[jira] [Assigned] (KAFKA-13943) Fix flaky test QuorumControllerTest.testMissingInMemorySnapshot()

2022-06-15 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divij Vaidya reassigned KAFKA-13943: Assignee: Divij Vaidya > Fix flaky test

[GitHub] [kafka] divijvaidya commented on a diff in pull request #12284: KAFKA-13980: Upgrade from Scala 2.12.15 to 2.12.16

2022-06-15 Thread GitBox
divijvaidya commented on code in PR #12284: URL: https://github.com/apache/kafka/pull/12284#discussion_r897932645 ## docs/upgrade.html: ## @@ -59,6 +59,9 @@ Upgrading to 3.2.0 from any vers (or to take advantage of exactly once semantics), the newer Java

[GitHub] [kafka] divijvaidya commented on pull request #12284: KAFKA-13980: Upgrade from Scala 2.12.15 to 2.12.16

2022-06-15 Thread GitBox
divijvaidya commented on PR #12284: URL: https://github.com/apache/kafka/pull/12284#issuecomment-1156421242 cc: @ijuma (since you seem have performed scala upgrades in the past) The test failures do not seem related to this code change to me. -- This is an automated message from

[GitHub] [kafka] divijvaidya commented on pull request #12286: KAFKA-13984: Fix TopicBasedRemoteLogMetadataManager#initializeResources should exit immediately when partition size of __remote_log_metad

2022-06-15 Thread GitBox
divijvaidya commented on PR #12286: URL: https://github.com/apache/kafka/pull/12286#issuecomment-1156415549 @bozhao12 can you please add a unit test in `TopicBasedRemoteLogMetadataManagerTest` that fails before this change and succeeds after this change. -- This is an automated message

[GitHub] [kafka] cadonna commented on pull request #10881: KAFKA-12947 Replace EasyMock and PowerMock with Mockito for Streams…

2022-06-15 Thread GitBox
cadonna commented on PR #10881: URL: https://github.com/apache/kafka/pull/10881#issuecomment-1156400720 @wycc Do you plan to still work on this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [kafka] cadonna commented on pull request #10881: KAFKA-12947 Replace EasyMock and PowerMock with Mockito for Streams…

2022-06-15 Thread GitBox
cadonna commented on PR #10881: URL: https://github.com/apache/kafka/pull/10881#issuecomment-1156398967 @clolov Thank you for your interest and help! Since this PR was not touched more than half a year, I would be fine to close it and you can open a new one. -- This is an automated

[GitHub] [kafka] cadonna commented on pull request #12285: KAFKA-7342 Part 1: Straightforward JUnit4 to JUnit5 migrations

2022-06-15 Thread GitBox
cadonna commented on PR #12285: URL: https://github.com/apache/kafka/pull/12285#issuecomment-1156391414 @clolov Thank you for the PR! I agree with @divijvaidya about doing the reformatting in a separate PR. Could you also try to subdivide the PR into smaller PRs? Reviewing a 6500 line

[GitHub] [kafka] jnh5y commented on pull request #12161: KAFKA-13873 Add ability to Pause / Resume KafkaStreams Topologies

2022-06-15 Thread GitBox
jnh5y commented on PR #12161: URL: https://github.com/apache/kafka/pull/12161#issuecomment-1156385644 > > @jnh5y Thank you for the updates! > > LGTM! > > Had just one nit. > > Thank you for your patience! @cadonna Thank you for pushing me and

[GitHub] [kafka] jnh5y commented on a diff in pull request #12161: KAFKA-13873 Add ability to Pause / Resume KafkaStreams Topologies

2022-06-15 Thread GitBox
jnh5y commented on code in PR #12161: URL: https://github.com/apache/kafka/pull/12161#discussion_r897893883 ## streams/src/test/java/org/apache/kafka/streams/integration/PauseResumeIntegrationTest.java: ## @@ -0,0 +1,422 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] cadonna commented on a diff in pull request #12161: KAFKA-13873 Add ability to Pause / Resume KafkaStreams Topologies

2022-06-15 Thread GitBox
cadonna commented on code in PR #12161: URL: https://github.com/apache/kafka/pull/12161#discussion_r897887371 ## streams/src/test/java/org/apache/kafka/streams/integration/PauseResumeIntegrationTest.java: ## @@ -0,0 +1,422 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] jnh5y commented on a diff in pull request #12161: KAFKA-13873 Add ability to Pause / Resume KafkaStreams Topologies

2022-06-15 Thread GitBox
jnh5y commented on code in PR #12161: URL: https://github.com/apache/kafka/pull/12161#discussion_r897869162 ## streams/src/test/java/org/apache/kafka/streams/integration/PauseResumeIntegrationTest.java: ## @@ -335,7 +333,39 @@ public void pauseResumehouldWorkAcrossInstances()

[GitHub] [kafka] jnh5y commented on a diff in pull request #12161: KAFKA-13873 Add ability to Pause / Resume KafkaStreams Topologies

2022-06-15 Thread GitBox
jnh5y commented on code in PR #12161: URL: https://github.com/apache/kafka/pull/12161#discussion_r897868472 ## streams/src/test/java/org/apache/kafka/streams/integration/PauseResumeIntegrationTest.java: ## @@ -335,7 +333,39 @@ public void pauseResumehouldWorkAcrossInstances()

[GitHub] [kafka] divijvaidya commented on pull request #12230: MINOR: Catch InvocationTargetException explicitly and propagate underlying cause

2022-06-15 Thread GitBox
divijvaidya commented on PR #12230: URL: https://github.com/apache/kafka/pull/12230#issuecomment-1156355538 @dengziming @showuon please review this small change. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [kafka] divijvaidya commented on pull request #12229: MINOR: Include the inner exception stack trace when re-throwing an exception

2022-06-15 Thread GitBox
divijvaidya commented on PR #12229: URL: https://github.com/apache/kafka/pull/12229#issuecomment-1156352282 @mimaison perhaps you may want to look into this? This already has 2 approvals from non-committers. -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (KAFKA-13386) Foreign Key Join filtering out valid records after a code change / schema evolved

2022-06-15 Thread Kin Siu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554526#comment-17554526 ] Kin Siu commented on KAFKA-13386: - [~guozhang], I am not sure if what I faced is same as [~sduran], but

[GitHub] [kafka] divijvaidya commented on pull request #12229: MINOR: Include the inner exception stack trace when re-throwing an exception

2022-06-15 Thread GitBox
divijvaidya commented on PR #12229: URL: https://github.com/apache/kafka/pull/12229#issuecomment-1156349743 > Can this kind of problem be caught by spotbugs? manual checking is error prone. > Can this kind of problem be caught by spotbugs? manual checking is error prone.

[GitHub] [kafka] divijvaidya commented on pull request #12229: MINOR: Include the inner exception stack trace when re-throwing an exception

2022-06-15 Thread GitBox
divijvaidya commented on PR #12229: URL: https://github.com/apache/kafka/pull/12229#issuecomment-1156349744 > Can this kind of problem be caught by spotbugs? manual checking is error prone. > Can this kind of problem be caught by spotbugs? manual checking is error prone.

[GitHub] [kafka] divijvaidya commented on a diff in pull request #12045: KAFKA-12319: Change calculation of window size used to calculate `Rate`

2022-06-15 Thread GitBox
divijvaidya commented on code in PR #12045: URL: https://github.com/apache/kafka/pull/12045#discussion_r897838652 ## clients/src/main/java/org/apache/kafka/common/metrics/stats/SampledStat.java: ## @@ -34,35 +35,56 @@ */ public abstract class SampledStat implements

[jira] [Created] (KAFKA-13994) Incorrect quota calculation due to a bug

2022-06-15 Thread Divij Vaidya (Jira)
Divij Vaidya created KAFKA-13994: Summary: Incorrect quota calculation due to a bug Key: KAFKA-13994 URL: https://issues.apache.org/jira/browse/KAFKA-13994 Project: Kafka Issue Type: Bug

[GitHub] [kafka] divijvaidya commented on pull request #12184: KAFKA-13911: Fix the rate window size calculation for edge cases

2022-06-15 Thread GitBox
divijvaidya commented on PR #12184: URL: https://github.com/apache/kafka/pull/12184#issuecomment-1156329800 @dajac @guozhangwang please review when you get a chance. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [kafka] cadonna commented on a diff in pull request #12161: KAFKA-13873 Add ability to Pause / Resume KafkaStreams Topologies

2022-06-15 Thread GitBox
cadonna commented on code in PR #12161: URL: https://github.com/apache/kafka/pull/12161#discussion_r897835619 ## streams/src/test/java/org/apache/kafka/streams/integration/PauseResumeIntegrationTest.java: ## @@ -335,7 +333,39 @@ public void pauseResumehouldWorkAcrossInstances()

[GitHub] [kafka] tombentley commented on a diff in pull request #11781: KAFKA-10000: Per-connector offsets topics (KIP-618)

2022-06-15 Thread GitBox
tombentley commented on code in PR #11781: URL: https://github.com/apache/kafka/pull/11781#discussion_r897830233 ## connect/runtime/src/main/java/org/apache/kafka/connect/util/TopicAdmin.java: ## @@ -274,18 +276,23 @@ public static NewTopicBuilder defineTopic(String topicName)

[GitHub] [kafka] cadonna commented on a diff in pull request #12161: KAFKA-13873 Add ability to Pause / Resume KafkaStreams Topologies

2022-06-15 Thread GitBox
cadonna commented on code in PR #12161: URL: https://github.com/apache/kafka/pull/12161#discussion_r897818350 ## streams/src/test/java/org/apache/kafka/streams/integration/PauseResumeIntegrationTest.java: ## @@ -335,7 +333,39 @@ public void pauseResumehouldWorkAcrossInstances()

[jira] [Updated] (KAFKA-13993) Large log.cleaner.buffer.size config breaks Kafka Broker

2022-06-15 Thread Tomohiro Hashidate (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomohiro Hashidate updated KAFKA-13993: --- Description: LogCleaner builds a Cleaner instance in the following way.  

[GitHub] [kafka] tombentley commented on a diff in pull request #11781: KAFKA-10000: Per-connector offsets topics (KIP-618)

2022-06-15 Thread GitBox
tombentley commented on code in PR #11781: URL: https://github.com/apache/kafka/pull/11781#discussion_r897812219 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/Worker.java: ## @@ -1327,30 +1334,39 @@ public WorkerTask doBuild(Task task,

[jira] [Updated] (KAFKA-13993) Large log.cleaner.buffer.size config breaks Kafka Broker

2022-06-15 Thread Tomohiro Hashidate (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomohiro Hashidate updated KAFKA-13993: --- Description: LogCleaner builds a Cleaner instance in the following way.  

[jira] [Created] (KAFKA-13993) Large log.cleaner.buffer.size config breaks Kafka Broker

2022-06-15 Thread Tomohiro Hashidate (Jira)
Tomohiro Hashidate created KAFKA-13993: -- Summary: Large log.cleaner.buffer.size config breaks Kafka Broker Key: KAFKA-13993 URL: https://issues.apache.org/jira/browse/KAFKA-13993 Project: Kafka

[GitHub] [kafka] cadonna commented on a diff in pull request #12161: KAFKA-13873 Add ability to Pause / Resume KafkaStreams Topologies

2022-06-15 Thread GitBox
cadonna commented on code in PR #12161: URL: https://github.com/apache/kafka/pull/12161#discussion_r897789473 ## streams/src/test/java/org/apache/kafka/streams/integration/PauseResumeIntegrationTest.java: ## @@ -335,7 +333,39 @@ public void pauseResumehouldWorkAcrossInstances()

[GitHub] [kafka] mdedetrich commented on pull request #12284: KAFKA-13980: Upgrade from Scala 2.12.15 to 2.12.16

2022-06-15 Thread GitBox
mdedetrich commented on PR #12284: URL: https://github.com/apache/kafka/pull/12284#issuecomment-1156251953 @divijvaidya Done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [kafka] divijvaidya commented on pull request #12284: KAFKA-13980: Upgrade from Scala 2.12.15 to 2.12.16

2022-06-15 Thread GitBox
divijvaidya commented on PR #12284: URL: https://github.com/apache/kafka/pull/12284#issuecomment-1156237309 @mdedetrich could you please re-run the tests (by pushing another commit or by rebasing from trunk & force pushing). It would be ideal if we have a clean test run (with known flaky

[GitHub] [kafka] divijvaidya commented on a diff in pull request #12045: KAFKA-12319: Change calculation of window size used to calculate `Rate`

2022-06-15 Thread GitBox
divijvaidya commented on code in PR #12045: URL: https://github.com/apache/kafka/pull/12045#discussion_r897722547 ## clients/src/test/java/org/apache/kafka/common/metrics/MetricsTest.java: ## @@ -608,14 +609,14 @@ public void testRateWindowing() throws Exception {

[GitHub] [kafka] divijvaidya commented on a diff in pull request #12045: KAFKA-12319: Change calculation of window size used to calculate `Rate`

2022-06-15 Thread GitBox
divijvaidya commented on code in PR #12045: URL: https://github.com/apache/kafka/pull/12045#discussion_r897733191 ## clients/src/main/java/org/apache/kafka/common/metrics/stats/SampledStat.java: ## @@ -34,35 +35,56 @@ */ public abstract class SampledStat implements

[GitHub] [kafka] divijvaidya commented on a diff in pull request #12045: KAFKA-12319: Change calculation of window size used to calculate `Rate`

2022-06-15 Thread GitBox
divijvaidya commented on code in PR #12045: URL: https://github.com/apache/kafka/pull/12045#discussion_r897733191 ## clients/src/main/java/org/apache/kafka/common/metrics/stats/SampledStat.java: ## @@ -34,35 +35,56 @@ */ public abstract class SampledStat implements

[GitHub] [kafka] divijvaidya commented on a diff in pull request #12045: KAFKA-12319: Change calculation of window size used to calculate `Rate`

2022-06-15 Thread GitBox
divijvaidya commented on code in PR #12045: URL: https://github.com/apache/kafka/pull/12045#discussion_r897724648 ## clients/src/main/java/org/apache/kafka/common/metrics/stats/SampledStat.java: ## @@ -84,13 +106,7 @@ public Sample current(long timeMs) { public Sample

[GitHub] [kafka] divijvaidya commented on a diff in pull request #12045: KAFKA-12319: Change calculation of window size used to calculate `Rate`

2022-06-15 Thread GitBox
divijvaidya commented on code in PR #12045: URL: https://github.com/apache/kafka/pull/12045#discussion_r897724922 ## clients/src/main/java/org/apache/kafka/common/metrics/stats/Rate.java: ## @@ -68,24 +68,55 @@ public double measure(MetricConfig config, long now) { }

[GitHub] [kafka] divijvaidya commented on a diff in pull request #12045: KAFKA-12319: Change calculation of window size used to calculate `Rate`

2022-06-15 Thread GitBox
divijvaidya commented on code in PR #12045: URL: https://github.com/apache/kafka/pull/12045#discussion_r897721779 ## clients/src/test/java/org/apache/kafka/common/metrics/MetricsTest.java: ## @@ -149,13 +149,14 @@ private void verifyStats(Function metricValueFunc) {

[GitHub] [kafka] fred-ro commented on pull request #12201: MINOR: Replace left single quote with single quote in Connect worker's log message

2022-06-15 Thread GitBox
fred-ro commented on PR #12201: URL: https://github.com/apache/kafka/pull/12201#issuecomment-1156048902 Is it possible to back ported it to branch 2.8 ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [kafka] tkaszuba commented on a diff in pull request #12293: KAFKA-13963: Clarified java doc for processors api

2022-06-15 Thread GitBox
tkaszuba commented on code in PR #12293: URL: https://github.com/apache/kafka/pull/12293#discussion_r897565836 ## streams/src/main/java/org/apache/kafka/streams/TopologyDescription.java: ## @@ -30,6 +30,7 @@ * In contrast, two sub-topologies are not connected but can be