[GitHub] [kafka] hudeqi commented on pull request #13421: KAFKA-14824: ReplicaAlterLogDirsThread may cause serious disk growing in case of potential exception

2023-06-16 Thread via GitHub
hudeqi commented on PR #13421: URL: https://github.com/apache/kafka/pull/13421#issuecomment-1595613347 > Sorry I'm late to the party but I had a question on this: > > > It seems like @clolov is right, I tested it both in quorum and zk mode, Kafka successfully reconciles the

[GitHub] [kafka] hudeqi commented on pull request #13421: KAFKA-14824: ReplicaAlterLogDirsThread may cause serious disk growing in case of potential exception

2023-06-16 Thread via GitHub
hudeqi commented on PR #13421: URL: https://github.com/apache/kafka/pull/13421#issuecomment-1595608359 > @viktorsomogyi Trogdor has some fault injection capabilities. I'm not sure if disk errors are among them, but it could probably be added. See

[GitHub] [kafka] iblislin opened a new pull request, #13871: fix doc typo of StreamsBuilder.addGlobalStore

2023-06-16 Thread via GitHub
iblislin opened a new pull request, #13871: URL: https://github.com/apache/kafka/pull/13871 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[jira] [Created] (KAFKA-15100) Unsafe to call tryCompleteFetchResponse on request timeout

2023-06-16 Thread Jira
José Armando García Sancio created KAFKA-15100: -- Summary: Unsafe to call tryCompleteFetchResponse on request timeout Key: KAFKA-15100 URL: https://issues.apache.org/jira/browse/KAFKA-15100

[GitHub] [kafka] wcarlson5 commented on a diff in pull request #13855: KAFKA-14936: Add Grace period logic to Stream Table Join (2/N)

2023-06-16 Thread via GitHub
wcarlson5 commented on code in PR #13855: URL: https://github.com/apache/kafka/pull/13855#discussion_r1232831833 ## streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamKTableJoinProcessor.java: ## @@ -56,10 +75,63 @@ public void init(final ProcessorContext

[GitHub] [kafka] jolshan commented on a diff in pull request #13421: KAFKA-14824: ReplicaAlterLogDirsThread may cause serious disk growing in case of potential exception

2023-06-16 Thread via GitHub
jolshan commented on code in PR #13421: URL: https://github.com/apache/kafka/pull/13421#discussion_r1232859633 ## core/src/test/scala/unit/kafka/server/ReplicaAlterLogDirsThreadTest.scala: ## @@ -196,6 +201,110 @@ class ReplicaAlterLogDirsThreadTest { assertEquals(0,

[GitHub] [kafka] jolshan commented on pull request #13421: KAFKA-14824: ReplicaAlterLogDirsThread may cause serious disk growing in case of potential exception

2023-06-16 Thread via GitHub
jolshan commented on PR #13421: URL: https://github.com/apache/kafka/pull/13421#issuecomment-1595410641 Sorry I'm late to the party but I had a question on this: >It seems like @clolov is right, I tested it both in quorum and zk mode, Kafka successfully reconciles the questionable case

[GitHub] [kafka] jolshan commented on a diff in pull request #13421: KAFKA-14824: ReplicaAlterLogDirsThread may cause serious disk growing in case of potential exception

2023-06-16 Thread via GitHub
jolshan commented on code in PR #13421: URL: https://github.com/apache/kafka/pull/13421#discussion_r1232859633 ## core/src/test/scala/unit/kafka/server/ReplicaAlterLogDirsThreadTest.scala: ## @@ -196,6 +201,110 @@ class ReplicaAlterLogDirsThreadTest { assertEquals(0,

[GitHub] [kafka] jolshan commented on a diff in pull request #13421: KAFKA-14824: ReplicaAlterLogDirsThread may cause serious disk growing in case of potential exception

2023-06-16 Thread via GitHub
jolshan commented on code in PR #13421: URL: https://github.com/apache/kafka/pull/13421#discussion_r1232859045 ## core/src/main/scala/kafka/server/AbstractFetcherThread.scala: ## @@ -706,6 +706,8 @@ abstract class AbstractFetcherThread(name: String, *- the request

[GitHub] [kafka] jolshan commented on pull request #13721: KAFKA-14782: Implementation Details Different from Documentation (del…

2023-06-16 Thread via GitHub
jolshan commented on PR #13721: URL: https://github.com/apache/kafka/pull/13721#issuecomment-1595392012 Yup, looks like this is what the KIP mentioned. It's very possible this was just missed in the initial implementation. I don't think this should cause major issues since the defaults are

[GitHub] [kafka] mumrah commented on pull request #13421: KAFKA-14824: ReplicaAlterLogDirsThread may cause serious disk growing in case of potential exception

2023-06-16 Thread via GitHub
mumrah commented on PR #13421: URL: https://github.com/apache/kafka/pull/13421#issuecomment-1595373852 @viktorsomogyi Trogdor has some fault injection capabilities. I'm not sure if disk errors are among them, but it could probably be added. See

[GitHub] [kafka] jeffkbkim opened a new pull request, #13870: KAFKA-14500; [5/N]

2023-06-16 Thread via GitHub
jeffkbkim opened a new pull request, #13870: URL: https://github.com/apache/kafka/pull/13870 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.* *Summary of

[GitHub] [kafka] jolshan commented on pull request #13848: MINOR: Make offsets topic creation more reliable in tests (zk mode)

2023-06-16 Thread via GitHub
jolshan commented on PR #13848: URL: https://github.com/apache/kafka/pull/13848#issuecomment-1595350950 Btw, @dajac do we typically autocreate this topic? Just curious because I've seen some issues with __transaction_state not having enough replicas in tests (taking 10 or so seconds to get

[jira] [Created] (KAFKA-15099) Flaky Test kafka.api.TransactionsTest.testBumpTransactionalEpoch(String).quorum=kraft

2023-06-16 Thread Justine Olshan (Jira)
Justine Olshan created KAFKA-15099: -- Summary: Flaky Test kafka.api.TransactionsTest.testBumpTransactionalEpoch(String).quorum=kraft Key: KAFKA-15099 URL: https://issues.apache.org/jira/browse/KAFKA-15099

[GitHub] [kafka] jolshan commented on pull request #13868: MINOR: Close ReplicaManager correctly in ReplicaManagerTest

2023-06-16 Thread via GitHub
jolshan commented on PR #13868: URL: https://github.com/apache/kafka/pull/13868#issuecomment-1595345954 Thanks for the fix. The thread leaks have been bugging me. Did we also want to set the hw argument to false here too?

[GitHub] [kafka] jolshan commented on a diff in pull request #13868: MINOR: Close ReplicaManager correctly in ReplicaManagerTest

2023-06-16 Thread via GitHub
jolshan commented on code in PR #13868: URL: https://github.com/apache/kafka/pull/13868#discussion_r1232797807 ## core/src/test/scala/unit/kafka/server/ReplicaManagerTest.scala: ## @@ -342,9 +347,7 @@ class ReplicaManagerTest { rm.becomeLeaderOrFollower(1,

[GitHub] [kafka] jolshan commented on a diff in pull request #13868: MINOR: Close ReplicaManager correctly in ReplicaManagerTest

2023-06-16 Thread via GitHub
jolshan commented on code in PR #13868: URL: https://github.com/apache/kafka/pull/13868#discussion_r1232796642 ## core/src/test/scala/unit/kafka/server/ReplicaManagerTest.scala: ## @@ -84,7 +84,7 @@ import scala.jdk.CollectionConverters._ class ReplicaManagerTest { val

[jira] [Updated] (KAFKA-15098) KRaft migration does not proceed and broker dies if authorizer.class.name is set

2023-06-16 Thread Ron Dagostino (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Dagostino updated KAFKA-15098: -- Description: [ERROR] 2023-06-16 20:14:14,298 [main] kafka.Kafka$ - Exiting Kafka due to

[jira] [Created] (KAFKA-15098) KRaft migration does not proceed and broker dies if authorizer.class.name is set

2023-06-16 Thread Ron Dagostino (Jira)
Ron Dagostino created KAFKA-15098: - Summary: KRaft migration does not proceed and broker dies if authorizer.class.name is set Key: KAFKA-15098 URL: https://issues.apache.org/jira/browse/KAFKA-15098

[GitHub] [kafka] vp224 closed pull request #13869: Ktls test

2023-06-16 Thread via GitHub
vp224 closed pull request #13869: Ktls test URL: https://github.com/apache/kafka/pull/13869 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] vp224 opened a new pull request, #13869: Ktls test

2023-06-16 Thread via GitHub
vp224 opened a new pull request, #13869: URL: https://github.com/apache/kafka/pull/13869 Description: Rebased the repo with ktls-jni changes and modified the ktls-jni library version JIRA Ticket: https://jira01.corp.linkedin.com:8443/browse/LIKAFKA-53140 Changes: - Added

[GitHub] [kafka] divijvaidya commented on pull request #13676: MINOR: Capture build scans on ge.apache.org to benefit from deep build insights

2023-06-16 Thread via GitHub
divijvaidya commented on PR #13676: URL: https://github.com/apache/kafka/pull/13676#issuecomment-1595092684 @ijuma do you have any other questions wrt this PR? This is a useful feature to debug our flaky tests and I would like to ensure that your questions are addressed since you were

[GitHub] [kafka] machi1990 commented on pull request #13865: KAFKA-15096: Update snappy-java to 1.1.10.1

2023-06-16 Thread via GitHub
machi1990 commented on PR #13865: URL: https://github.com/apache/kafka/pull/13865#issuecomment-1595032501 Thanks for the review @divijvaidya -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] divijvaidya opened a new pull request, #13868: MINOR: Close ReplicaManager correctly in ReplicaManagerTest

2023-06-16 Thread via GitHub
divijvaidya opened a new pull request, #13868: URL: https://github.com/apache/kafka/pull/13868 Fixes thread leaks by closing the ReplicaManager properly at the end of each test. The leaks were leading to flaky test failures in ReplicaManagerTest with errors such as: ```

[GitHub] [kafka] tkuramoto33 opened a new pull request, #13867: MINOR: Fix help message for kafka-metadata-shell.

2023-06-16 Thread via GitHub
tkuramoto33 opened a new pull request, #13867: URL: https://github.com/apache/kafka/pull/13867 The current help message for kafka-metadata-shell.sh is as follows. ``` $ ~/kafka_2.13-3.5.0/bin/kafka-metadata-shell.sh -h usage: metadata-tool [-h] [--snapshot SNAPSHOT] [command

[GitHub] [kafka] dajac merged pull request #13854: MINOR: rat should depend on processMessages task

2023-06-16 Thread via GitHub
dajac merged PR #13854: URL: https://github.com/apache/kafka/pull/13854 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (KAFKA-14112) Expose replication-offset-lag Mirror metric

2023-06-16 Thread Elkhan Eminov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elkhan Eminov updated KAFKA-14112: -- Description: The offset lag is the difference of the last replicated record's (LRO) source

[GitHub] [kafka] dajac commented on pull request #13854: MINOR: rat should depend on processMessages task

2023-06-16 Thread via GitHub
dajac commented on PR #13854: URL: https://github.com/apache/kafka/pull/13854#issuecomment-1594960723 The number if failed tests is scary but none of them are related to this change. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [kafka] machi1990 opened a new pull request, #13866: MINOR: update LogCleaner.scala javadoc with a link to OffsetMap to help with code navigation in IDE

2023-06-16 Thread via GitHub
machi1990 opened a new pull request, #13866: URL: https://github.com/apache/kafka/pull/13866 I was going through the LogCleaner.scala file to familiarise myself with that part of the codebase and I noticed this minor improvement to help with code navigation. ### Committer Checklist

[GitHub] [kafka] hudeqi commented on pull request #13839: MINOR:Fill missing parameter annotations for LogCleaner methods

2023-06-16 Thread via GitHub
hudeqi commented on PR #13839: URL: https://github.com/apache/kafka/pull/13839#issuecomment-1594953593 > Thanks for the PR @hudeqi. I think it's always good to improve JavaDocs or ScalaDocs. > > I was looking at the `LogCleaner.scala` file and I saw there are plenty of

[jira] [Updated] (KAFKA-15097) NoSuchFileException in LogCleaner Operation.

2023-06-16 Thread Mukesh Mishra (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukesh Mishra updated KAFKA-15097: -- Description: Currently we are facing NoSuchFileException in LogCleaner, which is critical

[jira] [Updated] (KAFKA-15097) NoSuchFileException in LogCleaner Operation.

2023-06-16 Thread Mukesh Mishra (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukesh Mishra updated KAFKA-15097: -- Affects Version/s: 3.3.1 > NoSuchFileException in LogCleaner Operation. >

[GitHub] [kafka] C0urante commented on pull request #13864: Revert "MINOR: Reduce MM2 integration test flakiness due to missing dummy offset commits"

2023-06-16 Thread via GitHub
C0urante commented on PR #13864: URL: https://github.com/apache/kafka/pull/13864#issuecomment-1594925376 Thanks Josep! Will merge without awaiting CI results as this is a clean revert and I've verified locally that the `MirrorConnectorsIntegrationTransactionsTest::testReplication` test

[jira] [Comment Edited] (KAFKA-15096) CVE 2023-34455 - Vulnerability identified with Apache kafka

2023-06-16 Thread Manyanda Chitimbo (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17733576#comment-17733576 ] Manyanda Chitimbo edited comment on KAFKA-15096 at 6/16/23 4:09 PM:

[jira] [Updated] (KAFKA-15097) NoSuchFileException in LogCleaner Operation.

2023-06-16 Thread Mukesh Mishra (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukesh Mishra updated KAFKA-15097: -- Priority: Blocker (was: Critical) > NoSuchFileException in LogCleaner Operation. >

[GitHub] [kafka] machi1990 commented on pull request #13865: KAFKA-15096: Update snappy-java to 1.1.10.1

2023-06-16 Thread via GitHub
machi1990 commented on PR #13865: URL: https://github.com/apache/kafka/pull/13865#issuecomment-1594915227 @showuon @mimaison @divijvaidya can one of you have a look? Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [kafka] machi1990 opened a new pull request, #13865: KAFKA-15096: Update snappy-java to 1.1.10.1

2023-06-16 Thread via GitHub
machi1990 opened a new pull request, #13865: URL: https://github.com/apache/kafka/pull/13865 Upgrade to 1.1.10.1 to fix CVE 2023-34455 The release notes are available at https://github.com/xerial/snappy-java/releases/tag/v1.1.10.1 ### Committer Checklist (excluded from commit

[jira] [Created] (KAFKA-15097) NoSuchFileException in LogCleaner Operation.

2023-06-16 Thread Mukesh Mishra (Jira)
Mukesh Mishra created KAFKA-15097: - Summary: NoSuchFileException in LogCleaner Operation. Key: KAFKA-15097 URL: https://issues.apache.org/jira/browse/KAFKA-15097 Project: Kafka Issue Type:

[jira] [Assigned] (KAFKA-15096) CVE 2023-34455 - Vulnerability identified with Apache kafka

2023-06-16 Thread Manyanda Chitimbo (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manyanda Chitimbo reassigned KAFKA-15096: - Assignee: Manyanda Chitimbo > CVE 2023-34455 - Vulnerability identified with

[GitHub] [kafka] maniekes commented on pull request #13321: MINOR: added compatibility for MinGW

2023-06-16 Thread via GitHub
maniekes commented on PR #13321: URL: https://github.com/apache/kafka/pull/13321#issuecomment-1594900986 some extra research. i rolled back changes for cygpath --windows in MSYS2 MINGW64 i got following error: ```bash *@rafal-laptok MINGW64 /c/rafal/git/maniekes-kafka $

[GitHub] [kafka] hudeqi commented on pull request #13421: KAFKA-14824: ReplicaAlterLogDirsThread may cause serious disk growing in case of potential exception

2023-06-16 Thread via GitHub
hudeqi commented on PR #13421: URL: https://github.com/apache/kafka/pull/13421#issuecomment-1594893813 Thanks for your comment, I have merged the latest trunk to see if it can pass the CI check. @viktorsomogyi -- This is an automated message from the Apache Git Service. To respond to

[jira] [Updated] (KAFKA-15096) CVE 2023-34455 - Vulnerability identified with Apache kafka

2023-06-16 Thread Sasikumar Muthukrishnan Sampath (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sasikumar Muthukrishnan Sampath updated KAFKA-15096: Description: A new vulnerability CVE-2023-34455 is

[jira] [Created] (KAFKA-15096) CVE 2023-34455 - Vulnerability identified with Apache kafka

2023-06-16 Thread Sasikumar Muthukrishnan Sampath (Jira)
Sasikumar Muthukrishnan Sampath created KAFKA-15096: --- Summary: CVE 2023-34455 - Vulnerability identified with Apache kafka Key: KAFKA-15096 URL: https://issues.apache.org/jira/browse/KAFKA-15096

[GitHub] [kafka] dajac opened a new pull request, #13863: MINOR: Reduce flakiness of testRackAwareRangeAssignor, second try

2023-06-16 Thread via GitHub
dajac opened a new pull request, #13863: URL: https://github.com/apache/kafka/pull/13863 This test still fails regularly with the following error: ``` Error java.util.concurrent.ExecutionException: org.opentest4j.AssertionFailedError: Timed out while awaiting expected

[GitHub] [kafka] mumrah merged pull request #13257: MINOR: Add ZK migration docs to the packaged docs

2023-06-16 Thread via GitHub
mumrah merged PR #13257: URL: https://github.com/apache/kafka/pull/13257 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] divijvaidya commented on a diff in pull request #12976: Improve TestUtils for temporary properties file

2023-06-16 Thread via GitHub
divijvaidya commented on code in PR #12976: URL: https://github.com/apache/kafka/pull/12976#discussion_r1232345504 ## core/src/test/scala/unit/kafka/utils/TestUtils.scala: ## @@ -156,6 +156,21 @@ object TestUtils extends Logging { */ def tempFile(prefix: String, suffix:

[GitHub] [kafka] tombentley commented on a diff in pull request #13862: KAFKA-15050: format the prompts in the quickstart

2023-06-16 Thread via GitHub
tombentley commented on code in PR #13862: URL: https://github.com/apache/kafka/pull/13862#discussion_r1232343003 ## docs/streams/quickstart.html: ## @@ -91,8 +91,8 @@ Step

[GitHub] [kafka] zigarn commented on pull request #12976: Improve TestUtils for temporary properties file

2023-06-16 Thread via GitHub
zigarn commented on PR #12976: URL: https://github.com/apache/kafka/pull/12976#issuecomment-1594798209 @divijvaidya: rebased! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [kafka] justinrlee commented on pull request #12797: MINOR: Remove requirement to specify --bootstrap-server in utility scripts if specified in property file

2023-06-16 Thread via GitHub
justinrlee commented on PR #12797: URL: https://github.com/apache/kafka/pull/12797#issuecomment-1594792962 Sorry for the delay here! I recently went on paternity leave but will pick this up (and add tests) when I get back in a month or two. -- This is an automated message from the Apache

[GitHub] [kafka] divijvaidya commented on pull request #13099: KAFKA-14604: avoid SASL session expiration time overflowed when calculation

2023-06-16 Thread via GitHub
divijvaidya commented on PR #13099: URL: https://github.com/apache/kafka/pull/13099#issuecomment-1594751739 @showuon rebase from trunk please? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] divijvaidya commented on pull request #12976: Improve TestUtils for temporary properties file

2023-06-16 Thread via GitHub
divijvaidya commented on PR #12976: URL: https://github.com/apache/kafka/pull/12976#issuecomment-1594744324 @zigarn can you please rebase this PR with trunk? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [kafka] C0urante commented on pull request #13819: KAFKA-15059: Remove pending rebalance check when fencing zombie source connector tasks

2023-06-16 Thread via GitHub
C0urante commented on PR #13819: URL: https://github.com/apache/kafka/pull/13819#issuecomment-1594743764 Thanks guys! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [kafka] divijvaidya commented on pull request #12852: Enhance the robustness of the program

2023-06-16 Thread via GitHub
divijvaidya commented on PR #12852: URL: https://github.com/apache/kafka/pull/12852#issuecomment-1594740256 Hey @likeyoukang Thank you for your first contribution. Could you please rebase this PR from trunk? And also change the title of the PR to "MINOR: Use "constant equals object"

[GitHub] [kafka] divijvaidya closed pull request #12905: fix check for MinGW64 compatibility

2023-06-16 Thread via GitHub
divijvaidya closed pull request #12905: fix check for MinGW64 compatibility URL: https://github.com/apache/kafka/pull/12905 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [kafka] divijvaidya commented on pull request #12905: fix check for MinGW64 compatibility

2023-06-16 Thread via GitHub
divijvaidya commented on PR #12905: URL: https://github.com/apache/kafka/pull/12905#issuecomment-1594742425 We have another PR https://github.com/apache/kafka/pull/13321 opened for this. Closing this in favour of the other one. -- This is an automated message from the Apache Git Service.

[GitHub] [kafka] divijvaidya commented on pull request #12797: MINOR: Remove requirement to specify --bootstrap-server in utility scripts if specified in property file

2023-06-16 Thread via GitHub
divijvaidya commented on PR #12797: URL: https://github.com/apache/kafka/pull/12797#issuecomment-1594727580 ping @justinrlee -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [kafka] divijvaidya closed pull request #12636: KAFKA-14214: Convert StandardAuthorizer to copy-on-write

2023-06-16 Thread via GitHub
divijvaidya closed pull request #12636: KAFKA-14214: Convert StandardAuthorizer to copy-on-write URL: https://github.com/apache/kafka/pull/12636 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] divijvaidya commented on pull request #12636: KAFKA-14214: Convert StandardAuthorizer to copy-on-write

2023-06-16 Thread via GitHub
divijvaidya commented on PR #12636: URL: https://github.com/apache/kafka/pull/12636#issuecomment-1594725046 > I uploaded a new version at https://github.com/apache/kafka/pull/12662 In that case, closing this one. -- This is an automated message from the Apache Git Service. To

[GitHub] [kafka] mumrah commented on pull request #13257: MINOR: Add ZK migration docs to the packaged docs

2023-06-16 Thread via GitHub
mumrah commented on PR #13257: URL: https://github.com/apache/kafka/pull/13257#issuecomment-1594723400 Thanks @mimaison, updated with your suggestions. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [kafka] divijvaidya commented on pull request #12662: KAFKA-14214: Convert StandardAuthorizer to copy-on-write

2023-06-16 Thread via GitHub
divijvaidya commented on PR #12662: URL: https://github.com/apache/kafka/pull/12662#issuecomment-1594720549 @cmccabe I guess this can be closed now since it is superseded by https://github.com/apache/kafka/pull/13437 ? -- This is an automated message from the Apache Git Service. To

[GitHub] [kafka] divijvaidya commented on pull request #12667: KAFKA-10635: Improve logging with throwing OOOSE

2023-06-16 Thread via GitHub
divijvaidya commented on PR #12667: URL: https://github.com/apache/kafka/pull/12667#issuecomment-1594713861 @nicktelford ping -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [kafka] divijvaidya commented on pull request #13201: KAFKA-14596: Move TopicCommand to tools

2023-06-16 Thread via GitHub
divijvaidya commented on PR #13201: URL: https://github.com/apache/kafka/pull/13201#issuecomment-1594708038 @OmniaGM can you please rebase this with trunk and I would be happy to begin a review for this. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [kafka] divijvaidya commented on pull request #13321: MINOR: added compatibility for MinGW

2023-06-16 Thread via GitHub
divijvaidya commented on PR #13321: URL: https://github.com/apache/kafka/pull/13321#issuecomment-1594696603 > hope you test is also in pipeline for cygwin to be double sure No, we don't have any tests based on windows (or cygwin) in our pipeline. We don't officially promise to

[GitHub] [kafka] divijvaidya merged pull request #13858: MINOR: Add more information in assertion failure for non daemon threads

2023-06-16 Thread via GitHub
divijvaidya merged PR #13858: URL: https://github.com/apache/kafka/pull/13858 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] divijvaidya commented on pull request #13858: MINOR: Add more information in assertion failure for non daemon threads

2023-06-16 Thread via GitHub
divijvaidya commented on PR #13858: URL: https://github.com/apache/kafka/pull/13858#issuecomment-1594662486 Unrelated test failures: ``` [Build / JDK 8 and Scala 2.12 /

[jira] [Created] (KAFKA-15095) Flaky test EosV2UpgradeIntegrationTest.shouldUpgradeFromEosAlphaToEosV2[true]

2023-06-16 Thread Divij Vaidya (Jira)
Divij Vaidya created KAFKA-15095: Summary: Flaky test EosV2UpgradeIntegrationTest.shouldUpgradeFromEosAlphaToEosV2[true] Key: KAFKA-15095 URL: https://issues.apache.org/jira/browse/KAFKA-15095

[GitHub] [kafka] maniekes commented on pull request #13321: MINOR: added compatibility for MinGW

2023-06-16 Thread via GitHub
maniekes commented on PR #13321: URL: https://github.com/apache/kafka/pull/13321#issuecomment-1594651760 okay, i think i found root cause for it: https://github.com/apache/kafka/blob/trunk/bin/kafka-server-start.sh#L25

[jira] [Resolved] (KAFKA-15066) passing listener name config into TopicBasedRemoteLogMetadataManagerConfig

2023-06-16 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-15066. --- Fix Version/s: 3.6.0 Resolution: Fixed > passing listener name config into

[GitHub] [kafka] showuon merged pull request #13828: KAFKA-15066: add "remote.log.metadata.manager.listener.name" config to rlmm

2023-06-16 Thread via GitHub
showuon merged PR #13828: URL: https://github.com/apache/kafka/pull/13828 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] dajac commented on pull request #13854: MINOR: rat should depend on processMessages task

2023-06-16 Thread via GitHub
dajac commented on PR #13854: URL: https://github.com/apache/kafka/pull/13854#issuecomment-1594627878 ``` % ./gradlew rat --dry-run > Configure project : Starting build with version 3.6.0-SNAPSHOT (commit id 55373f1f) using Gradle 8.1.1, Java 17 and Scala 2.13.10 Build

[GitHub] [kafka] maniekes commented on pull request #13321: MINOR: added compatibility for MinGW

2023-06-16 Thread via GitHub
maniekes commented on PR #13321: URL: https://github.com/apache/kafka/pull/13321#issuecomment-1594625896 ok, good catch with MSYS2 @divijvaidya. i have installed git bash, msys2, cygwin and tested on all of them(on msys2 i testes on msys2-mingw and on pure msys2). what i noticed

[GitHub] [kafka] divijvaidya commented on pull request #13854: MINOR: rat should depend on processMessages task

2023-06-16 Thread via GitHub
divijvaidya commented on PR #13854: URL: https://github.com/apache/kafka/pull/13854#issuecomment-1594625865 This is perfect. I was trying a similar approach but somehow my `it.tasks` wasn't returning the `processMessages`?! Can you please verify that it is working fine by running

[GitHub] [kafka] showuon commented on pull request #13828: KAFKA-15066: add "remote.log.metadata.manager.listener.name" config to rlmm

2023-06-16 Thread via GitHub
showuon commented on PR #13828: URL: https://github.com/apache/kafka/pull/13828#issuecomment-1594624985 Failed tests are unrelated and the failed `testReplication` also fail in trunk build. I've identified it's caused by this change: https://github.com/apache/kafka/pull/13838 . Go ahead to

[GitHub] [kafka] dajac commented on pull request #13854: MINOR: rat should depend on processMessages task

2023-06-16 Thread via GitHub
dajac commented on PR #13854: URL: https://github.com/apache/kafka/pull/13854#issuecomment-1594618113 @divijvaidya I just push another approach. Let me know what you think. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [kafka] viktorsomogyi commented on pull request #13696: KAFKA-14979:Incorrect lag was calculated when markPartitionsForTruncation in ReplicaAlterLogDirsThread

2023-06-16 Thread via GitHub
viktorsomogyi commented on PR #13696: URL: https://github.com/apache/kafka/pull/13696#issuecomment-1594603126 @hudeqi I can get to this early next week. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [kafka] viktorsomogyi commented on a diff in pull request #13421: KAFKA-14824: ReplicaAlterLogDirsThread may cause serious disk growing in case of potential exception

2023-06-16 Thread via GitHub
viktorsomogyi commented on code in PR #13421: URL: https://github.com/apache/kafka/pull/13421#discussion_r1232168660 ## core/src/main/scala/kafka/server/ReplicaAlterLogDirsThread.scala: ## @@ -97,6 +97,16 @@ class ReplicaAlterLogDirsThread(name: String, } } + // For

[GitHub] [kafka] viktorsomogyi merged pull request #13719: MINOR:Fix illogical log in fetchOffsetAndTruncate method

2023-06-16 Thread via GitHub
viktorsomogyi merged PR #13719: URL: https://github.com/apache/kafka/pull/13719 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] divijvaidya commented on pull request #13854: MINOR: rat should depend on processMessages task

2023-06-16 Thread via GitHub
divijvaidya commented on PR #13854: URL: https://github.com/apache/kafka/pull/13854#issuecomment-1594554215 I just encountered another idea. Just put `rat.dependsOn compileJava` at https://github.com/apache/kafka/blob/e1d59920f4fed5c4bc890e53e249d3439e148bab/build.gradle#L211

[GitHub] [kafka] lvillaca commented on pull request #12358: KAFKA-13988:Fix mm2 auto.offset.reset=latest not working

2023-06-16 Thread via GitHub
lvillaca commented on PR #12358: URL: https://github.com/apache/kafka/pull/12358#issuecomment-1594475316 > @yuz10 are you able to ping someone to get this moving forward? This must be blocking a lot of people of upgrading existing installs. > > Thanks. Our project is also

[GitHub] [kafka] divijvaidya commented on pull request #13854: MINOR: rat should depend on processMessages task

2023-06-16 Thread via GitHub
divijvaidya commented on PR #13854: URL: https://github.com/apache/kafka/pull/13854#issuecomment-1594472639 This problem is annoying and real. Thank you for starting a PR to fix this. Another example build that fails with similar problems:

[jira] [Commented] (KAFKA-14112) Expose replication-offset-lag Mirror metric

2023-06-16 Thread Elkhan Eminov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17733444#comment-17733444 ] Elkhan Eminov commented on KAFKA-14112: --- [~viktorsomogyi] is this this actual? This went out of my

[jira] (KAFKA-14112) Expose replication-offset-lag Mirror metric

2023-06-16 Thread Elkhan Eminov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14112 ] Elkhan Eminov deleted comment on KAFKA-14112: --- was (Author: JIRAUSER285952): Hey [~viktorsomogyi], this is WIP, I'll submit a PR soon > Expose replication-offset-lag Mirror metric >

[GitHub] [kafka] viktorsomogyi merged pull request #13819: KAFKA-15059: Remove pending rebalance check when fencing zombie source connector tasks

2023-06-16 Thread via GitHub
viktorsomogyi merged PR #13819: URL: https://github.com/apache/kafka/pull/13819 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (KAFKA-15050) Prompts in the quickstarts

2023-06-16 Thread Kumar Shivendu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17733434#comment-17733434 ] Kumar Shivendu commented on KAFKA-15050: Nice! I'll pick up something else then.  > Prompts in

[GitHub] [kafka] dajac commented on pull request #13719: MINOR:Fix illogical log in fetchOffsetAndTruncate method

2023-06-16 Thread via GitHub
dajac commented on PR #13719: URL: https://github.com/apache/kafka/pull/13719#issuecomment-1594414022 @viktorsomogyi Nope. LGTM. Feel free to merge it. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [kafka] viktorsomogyi commented on pull request #13719: MINOR:Fix illogical log in fetchOffsetAndTruncate method

2023-06-16 Thread via GitHub
viktorsomogyi commented on PR #13719: URL: https://github.com/apache/kafka/pull/13719#issuecomment-1594411657 @dajac do you have other comments or can I merge this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [kafka] divijvaidya commented on pull request #13321: MINOR: added compatibility for MinGW

2023-06-16 Thread via GitHub
divijvaidya commented on PR #13321: URL: https://github.com/apache/kafka/pull/13321#issuecomment-1594389639 Thank you @maniekes. MINGW64 looks good. Can you also please provide test details for MSYS? -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [kafka] divijvaidya commented on pull request #13850: KAFKA-15084: Remove lock contention from RemoteIndexCache

2023-06-16 Thread via GitHub
divijvaidya commented on PR #13850: URL: https://github.com/apache/kafka/pull/13850#issuecomment-1594369804 Thank you for looking into this @satishd > But we observed an impact when there is a degradation in our remote storage(HDFS) clusters. Yes, you are right, the impact

[GitHub] [kafka] divijvaidya commented on a diff in pull request #13850: KAFKA-15084: Remove lock contention from RemoteIndexCache

2023-06-16 Thread via GitHub
divijvaidya commented on code in PR #13850: URL: https://github.com/apache/kafka/pull/13850#discussion_r1231951562 ## core/src/main/scala/kafka/log/remote/RemoteIndexCache.scala: ## @@ -37,88 +40,125 @@ object RemoteIndexCache { val TmpFileSuffix = ".tmp" } -class

[GitHub] [kafka] divijvaidya commented on a diff in pull request #13850: KAFKA-15084: Remove lock contention from RemoteIndexCache

2023-06-16 Thread via GitHub
divijvaidya commented on code in PR #13850: URL: https://github.com/apache/kafka/pull/13850#discussion_r1231937722 ## core/src/main/scala/kafka/log/remote/RemoteIndexCache.scala: ## @@ -37,88 +40,125 @@ object RemoteIndexCache { val TmpFileSuffix = ".tmp" } -class

[GitHub] [kafka] divijvaidya commented on a diff in pull request #13850: KAFKA-15084: Remove lock contention from RemoteIndexCache

2023-06-16 Thread via GitHub
divijvaidya commented on code in PR #13850: URL: https://github.com/apache/kafka/pull/13850#discussion_r1231938032 ## core/src/test/scala/unit/kafka/log/remote/RemoteIndexCacheTest.scala: ## @@ -170,44 +190,173 @@ class RemoteIndexCacheTest {

[GitHub] [kafka] divijvaidya commented on a diff in pull request #13850: KAFKA-15084: Remove lock contention from RemoteIndexCache

2023-06-16 Thread via GitHub
divijvaidya commented on code in PR #13850: URL: https://github.com/apache/kafka/pull/13850#discussion_r1231931509 ## core/src/main/scala/kafka/log/remote/RemoteIndexCache.scala: ## @@ -167,14 +210,14 @@ class RemoteIndexCache(maxSize: Int = 1024, remoteStorageManager:

[GitHub] [kafka] satishd commented on a diff in pull request #13850: KAFKA-15084: Remove lock contention from RemoteIndexCache

2023-06-16 Thread via GitHub
satishd commented on code in PR #13850: URL: https://github.com/apache/kafka/pull/13850#discussion_r1231867641 ## core/src/main/scala/kafka/log/remote/RemoteIndexCache.scala: ## @@ -37,88 +40,125 @@ object RemoteIndexCache { val TmpFileSuffix = ".tmp" } -class Entry(val

[GitHub] [kafka] jlprat commented on pull request #13824: MINOR: Use Parametrized types correctly in RemoteLogMetadataSerde

2023-06-16 Thread via GitHub
jlprat commented on PR #13824: URL: https://github.com/apache/kafka/pull/13824#issuecomment-1594214535 Hi @satishd or @showuon any opinions on this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [kafka] cmccabe commented on a diff in pull request #13826: KAFKA-15060: fix the ApiVersionManager interface

2023-06-16 Thread via GitHub
cmccabe commented on code in PR #13826: URL: https://github.com/apache/kafka/pull/13826#discussion_r1230241309 ## core/src/main/scala/kafka/server/ControllerApis.scala: ## @@ -441,23 +441,14 @@ class ControllerApis(val requestChannel: RequestChannel, if

[jira] [Assigned] (KAFKA-15094) Add RemoteIndexCache metrics like misses/evictions/load-failures.

2023-06-16 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana reassigned KAFKA-15094: -- Assignee: Abhijeet Kumar > Add RemoteIndexCache metrics like

[GitHub] [kafka] satishd commented on pull request #13850: KAFKA-15084: Remove lock contention from RemoteIndexCache

2023-06-16 Thread via GitHub
satishd commented on PR #13850: URL: https://github.com/apache/kafka/pull/13850#issuecomment-1594160765 Thanks for the clarification @ben-manes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Created] (KAFKA-15094) Add RemoteIndexCache metrics like misses/evictions/load-failures.

2023-06-16 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15094: -- Summary: Add RemoteIndexCache metrics like misses/evictions/load-failures. Key: KAFKA-15094 URL: https://issues.apache.org/jira/browse/KAFKA-15094 Project: Kafka