[jira] [Commented] (KAFKA-14729) The kafakConsumer pollForFetches(timer) method takes up a lot of cpu due to the abnormal exit of the heartbeat thread

2023-02-16 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690218#comment-17690218 ] Luke Chen commented on KAFKA-14729: --- The change makes sense to me. But I'm more interested in knowing

[jira] [Commented] (KAFKA-14713) Kafka Streams global table startup takes too long

2023-02-16 Thread Tamas (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690215#comment-17690215 ] Tamas commented on KAFKA-14713: --- The difference (at least for my use case) is on the KafkaConsumer side,

[jira] [Updated] (KAFKA-14729) The kafakConsumer pollForFetches(timer) method takes up a lot of cpu due to the abnormal exit of the heartbeat thread

2023-02-16 Thread RivenSun (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] RivenSun updated KAFKA-14729: - Description: h2. case situation: 1. The business program occupies a large amount of memory, causing

[GitHub] [kafka] chia7712 commented on a diff in pull request #13266: MINOR: Fix PluginInfoTest for Connect

2023-02-16 Thread via GitHub
chia7712 commented on code in PR #13266: URL: https://github.com/apache/kafka/pull/13266#discussion_r1109343158 ## connect/runtime/src/test/java/org/apache/kafka/connect/runtime/rest/entities/PluginInfoTest.java: ## @@ -19,17 +19,19 @@ import

[jira] [Comment Edited] (KAFKA-14729) The kafakConsumer pollForFetches(timer) method takes up a lot of cpu due to the abnormal exit of the heartbeat thread

2023-02-16 Thread RivenSun (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690166#comment-17690166 ] RivenSun edited comment on KAFKA-14729 at 2/17/23 6:06 AM: --- 1. After careful

[jira] [Commented] (KAFKA-14729) The kafakConsumer pollForFetches(timer) method takes up a lot of cpu due to the abnormal exit of the heartbeat thread

2023-02-16 Thread RivenSun (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690166#comment-17690166 ] RivenSun commented on KAFKA-14729: -- 1. After careful consideration, in the case of KafkaConsumer's

[GitHub] [kafka] C0urante commented on pull request #13266: MINOR: Fix PluginInfoTest for Connect

2023-02-16 Thread via GitHub
C0urante commented on PR #13266: URL: https://github.com/apache/kafka/pull/13266#issuecomment-1434145501 @chia7712 would you have a moment to take a look at this? I'm going to bed now; feel free to merge if everything looks alright. -- This is an automated message from the Apache

[jira] [Commented] (KAFKA-14729) The kafakConsumer pollForFetches(timer) method takes up a lot of cpu due to the abnormal exit of the heartbeat thread

2023-02-16 Thread RivenSun (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690151#comment-17690151 ] RivenSun commented on KAFKA-14729: -- Hi [~guozhang]   , [~showuon] Could you give some suggestions for

[jira] [Updated] (KAFKA-14729) The kafakConsumer pollForFetches(timer) method takes up a lot of cpu due to the abnormal exit of the heartbeat thread

2023-02-16 Thread RivenSun (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] RivenSun updated KAFKA-14729: - Affects Version/s: (was: 3.3.2) > The kafakConsumer pollForFetches(timer) method takes up a lot of

[jira] [Updated] (KAFKA-14729) The kafakConsumer pollForFetches(timer) method takes up a lot of cpu due to the abnormal exit of the heartbeat thread

2023-02-16 Thread RivenSun (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] RivenSun updated KAFKA-14729: - Description: h2. case situation: 1. The business program occupies a large amount of memory, causing

[jira] [Created] (KAFKA-14729) The kafakConsumer pollForFetches(timer) method takes up a lot of cpu due to the abnormal exit of the heartbeat thread

2023-02-16 Thread RivenSun (Jira)
RivenSun created KAFKA-14729: Summary: The kafakConsumer pollForFetches(timer) method takes up a lot of cpu due to the abnormal exit of the heartbeat thread Key: KAFKA-14729 URL:

[GitHub] [kafka] philipnee opened a new pull request, #13269: Kafka 12634 enforce checkpoint after restoration

2023-02-16 Thread via GitHub
philipnee opened a new pull request, #13269: URL: https://github.com/apache/kafka/pull/13269 *We want to ensure checkpointing the progress after completing the restoration to prevent losing the progress and needing to restore from scratch ### Committer Checklist (excluded from commit

[GitHub] [kafka] kowshik commented on pull request #13268: MINOR: Introduce OffsetAndEpoch in LeaderEndpoint interface return values

2023-02-16 Thread via GitHub
kowshik commented on PR #13268: URL: https://github.com/apache/kafka/pull/13268#issuecomment-1434094602 Hi @junrao and @satishd -- Please could you help review this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [kafka] kowshik opened a new pull request, #13268: MINOR: Introduce OffsetAndEpoch in LeaderEndpoint interface return values

2023-02-16 Thread via GitHub
kowshik opened a new pull request, #13268: URL: https://github.com/apache/kafka/pull/13268 Some of the `LeaderEndpoint` interface methods used a tuple of `(Int, Long)` as return value to represent epoch & offset. In this PR, I have replaced those occcurences with the existing

[GitHub] [kafka] philipnee commented on a diff in pull request #13265: Prototype consumer stubs

2023-02-16 Thread via GitHub
philipnee commented on code in PR #13265: URL: https://github.com/apache/kafka/pull/13265#discussion_r1109286591 ## clients/src/main/java/org/apache/kafka/clients/consumer/StubbedAsyncKafkaConsumer.java: ## @@ -0,0 +1,548 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] philipnee commented on a diff in pull request #13265: Prototype consumer stubs

2023-02-16 Thread via GitHub
philipnee commented on code in PR #13265: URL: https://github.com/apache/kafka/pull/13265#discussion_r1109283896 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/events/ApplicationEvent.java: ## @@ -19,23 +19,35 @@ /** * This is the abstract definition of

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13250: KAFKA-14491: [9/N] Add versioned bytes store and supplier

2023-02-16 Thread via GitHub
vcrfxia commented on code in PR #13250: URL: https://github.com/apache/kafka/pull/13250#discussion_r1109282015 ## streams/src/main/java/org/apache/kafka/streams/state/internals/VersionedKeyValueToBytesStoreAdapter.java: ## @@ -0,0 +1,196 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] philipnee commented on a diff in pull request #13265: Prototype consumer stubs

2023-02-16 Thread via GitHub
philipnee commented on code in PR #13265: URL: https://github.com/apache/kafka/pull/13265#discussion_r1109264154 ## clients/src/main/java/org/apache/kafka/clients/consumer/StubbedAsyncKafkaConsumer.java: ## @@ -0,0 +1,548 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13250: KAFKA-14491: [9/N] Add versioned bytes store and supplier

2023-02-16 Thread via GitHub
vcrfxia commented on code in PR #13250: URL: https://github.com/apache/kafka/pull/13250#discussion_r1109276286 ## streams/src/main/java/org/apache/kafka/streams/state/internals/VersionedKeyValueToBytesStoreAdapter.java: ## @@ -0,0 +1,196 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] showuon merged pull request #13234: KAFKA-14706 Move/rewrite ShutdownableThread to server-common module.

2023-02-16 Thread via GitHub
showuon merged PR #13234: URL: https://github.com/apache/kafka/pull/13234 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (KAFKA-14719) Fix a return code when broker bootstrapped just now.

2023-02-16 Thread shenxingwuying (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shenxingwuying updated KAFKA-14719: --- Summary: Fix a return code when broker bootstrapped just now. (was: Talk about a problem:

[GitHub] [kafka] philipnee commented on a diff in pull request #13265: Prototype consumer stubs

2023-02-16 Thread via GitHub
philipnee commented on code in PR #13265: URL: https://github.com/apache/kafka/pull/13265#discussion_r1109260958 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/events/CompletableApplicationEvent.java: ## @@ -0,0 +1,57 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] satishd commented on pull request #13234: KAFKA-14706 Move/rewrite ShutdownableThread to server-common module.

2023-02-16 Thread via GitHub
satishd commented on PR #13234: URL: https://github.com/apache/kafka/pull/13234#issuecomment-1434009975 One failing test is not related to this change, ready to be merged. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [kafka] showuon commented on pull request #13234: KAFKA-14706 Move/rewrite ShutdownableThread to server-common module.

2023-02-16 Thread via GitHub
showuon commented on PR #13234: URL: https://github.com/apache/kafka/pull/13234#issuecomment-1433985820 I'll take a look today. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [kafka] guozhangwang commented on a diff in pull request #13192: KAFKA-14675: Extract metadata-related tasks from Fetcher into MetadataFetcher 1/4

2023-02-16 Thread via GitHub
guozhangwang commented on code in PR #13192: URL: https://github.com/apache/kafka/pull/13192#discussion_r1109189751 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/OffsetFetcher.java: ## @@ -0,0 +1,717 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] guozhangwang commented on a diff in pull request #13192: KAFKA-14675: Extract metadata-related tasks from Fetcher into MetadataFetcher 1/4

2023-02-16 Thread via GitHub
guozhangwang commented on code in PR #13192: URL: https://github.com/apache/kafka/pull/13192#discussion_r1109189406 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/MetadataFetcher.java: ## @@ -0,0 +1,805 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] jeffkbkim opened a new pull request, #13267: KAFKA-14694: RPCProducerIdManager should not wait on new block

2023-02-16 Thread via GitHub
jeffkbkim opened a new pull request, #13267: URL: https://github.com/apache/kafka/pull/13267 RPCProducerIdManager initiates an async request to the controller to grab a block of producer IDs and then blocks waiting for a response from the controller. This is done in the request

[GitHub] [kafka] junrao commented on a diff in pull request #13255: KAFKA 14714: Move/Rewrite RollParams, LogAppendInfo, and LeaderHwChange to storage module.

2023-02-16 Thread via GitHub
junrao commented on code in PR #13255: URL: https://github.com/apache/kafka/pull/13255#discussion_r1109170546 ## storage/src/main/java/org/apache/kafka/storage/internals/log/LogAppendInfo.java: ## @@ -0,0 +1,324 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] [kafka] guozhangwang commented on a diff in pull request #13025: KAFKA-14299: Fix pause and resume with state updater

2023-02-16 Thread via GitHub
guozhangwang commented on code in PR #13025: URL: https://github.com/apache/kafka/pull/13025#discussion_r1109175366 ## streams/src/test/java/org/apache/kafka/streams/processor/internals/StreamThreadTest.java: ## @@ -3159,7 +3159,7 @@ private void addRecord(final MockConsumer

[GitHub] [kafka] mjsax commented on a diff in pull request #13251: KAFKA-14491: [10/N] Add changelogging wrapper for versioned stores

2023-02-16 Thread via GitHub
mjsax commented on code in PR #13251: URL: https://github.com/apache/kafka/pull/13251#discussion_r1109171225 ## streams/src/main/java/org/apache/kafka/streams/state/internals/ChangeLoggingVersionedKeyValueBytesStore.java: ## @@ -0,0 +1,75 @@ +/* + * Licensed to the Apache

[GitHub] [kafka] guozhangwang commented on pull request #13190: KAFKA-12639: exit upon expired timer to prevent tight looping

2023-02-16 Thread via GitHub
guozhangwang commented on PR #13190: URL: https://github.com/apache/kafka/pull/13190#issuecomment-1433949296 > is it intentional to continue w/o sleep on the backoff timer? Yes that's intentional. For those four exceptions, we'd like to send the follow-up request right away since the

[GitHub] [kafka] mjsax commented on a diff in pull request #13250: KAFKA-14491: [9/N] Add versioned bytes store and supplier

2023-02-16 Thread via GitHub
mjsax commented on code in PR #13250: URL: https://github.com/apache/kafka/pull/13250#discussion_r1109169480 ## streams/src/main/java/org/apache/kafka/streams/state/internals/VersionedKeyValueToBytesStoreAdapter.java: ## @@ -0,0 +1,196 @@ +/* + * Licensed to the Apache Software

[jira] [Resolved] (KAFKA-14253) StreamsPartitionAssignor should print the member count in assignment logs

2023-02-16 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-14253. --- Fix Version/s: 3.5.0 Resolution: Fixed > StreamsPartitionAssignor should print the

[GitHub] [kafka] guozhangwang merged pull request #13253: KAFKA-14253 - More informative logging

2023-02-16 Thread via GitHub
guozhangwang merged PR #13253: URL: https://github.com/apache/kafka/pull/13253 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] bachmanity1 commented on pull request #13261: MINOR: after reading BYTES type it's possible to access data beyond its size

2023-02-16 Thread via GitHub
bachmanity1 commented on PR #13261: URL: https://github.com/apache/kafka/pull/13261#issuecomment-1433923878 @ijuma could you please review this? Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [kafka] C0urante commented on pull request #13262: KAFKA-14727: Enable periodic offset commits for EOS source tasks

2023-02-16 Thread via GitHub
C0urante commented on PR #13262: URL: https://github.com/apache/kafka/pull/13262#issuecomment-1433903556 Backported to 3.4. There were merge conflicts in the `ExactlyOnceWorkerSourceTaskTest` suite (caused by the Mockito migration) on 3.3; I may revisit at some point if I can find the

[jira] [Updated] (KAFKA-14727) Connect EOS mode should periodically call task commit

2023-02-16 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton updated KAFKA-14727: -- Fix Version/s: 3.4.1 > Connect EOS mode should periodically call task commit >

[GitHub] [kafka] C0urante commented on pull request #13261: MINOR: after reading BYTES type it's possible to access data beyond its size

2023-02-16 Thread via GitHub
C0urante commented on PR #13261: URL: https://github.com/apache/kafka/pull/13261#issuecomment-1433898716 Hi @bachmanity1! This is a bit outside my area of expertise and it's probably best for another committer to review. -- This is an automated message from the Apache Git Service. To

[jira] [Resolved] (KAFKA-14727) Connect EOS mode should periodically call task commit

2023-02-16 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-14727. --- Fix Version/s: 3.5.0 Resolution: Fixed > Connect EOS mode should periodically call

[jira] [Comment Edited] (KAFKA-14713) Kafka Streams global table startup takes too long

2023-02-16 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690055#comment-17690055 ] Matthias J. Sax edited comment on KAFKA-14713 at 2/16/23 11:52 PM: ---

[jira] [Commented] (KAFKA-14713) Kafka Streams global table startup takes too long

2023-02-16 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690055#comment-17690055 ] Matthias J. Sax commented on KAFKA-14713: - Thanks for getting back. Glad it's resolved. I am not

[GitHub] [kafka] C0urante merged pull request #13262: KAFKA-14727: Enable periodic offset commits for EOS source tasks

2023-02-16 Thread via GitHub
C0urante merged PR #13262: URL: https://github.com/apache/kafka/pull/13262 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] C0urante commented on pull request #13262: KAFKA-14727: Enable periodic offset commits for EOS source tasks

2023-02-16 Thread via GitHub
C0urante commented on PR #13262: URL: https://github.com/apache/kafka/pull/13262#issuecomment-1433896571 CI looks good, with some acceptable exceptions: - Failures due to the recent changes to the Connect `PluginInfoTest`, which are addressed separately in

[GitHub] [kafka] C0urante opened a new pull request, #13266: MINOR: Fix PluginInfoTest for Connect

2023-02-16 Thread via GitHub
C0urante opened a new pull request, #13266: URL: https://github.com/apache/kafka/pull/13266 The refactorings in https://github.com/apache/kafka/pull/13219 are largely very helpful; however, the changes to the `PluginInfoTest` suite have caused the test to begin failing. This PR

[GitHub] [kafka] bachmanity1 commented on pull request #13246: KAFKA-14707: Improve array size check

2023-02-16 Thread via GitHub
bachmanity1 commented on PR #13246: URL: https://github.com/apache/kafka/pull/13246#issuecomment-1433802673 @showuon > Basically, the size > buffer.remaining() check is originally not trying to check if the size can be allocated in the JVM, it's just a sanity check to see if this size

[GitHub] [kafka] kirktrue commented on a diff in pull request #13192: KAFKA-14675: Extract metadata-related tasks from Fetcher into MetadataFetcher 1/4

2023-02-16 Thread via GitHub
kirktrue commented on code in PR #13192: URL: https://github.com/apache/kafka/pull/13192#discussion_r1109086646 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/OffsetFetcher.java: ## @@ -0,0 +1,717 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [kafka] bachmanity1 commented on pull request #13261: MINOR: after reading BYTES type it's possible to access data beyond its size

2023-02-16 Thread via GitHub
bachmanity1 commented on PR #13261: URL: https://github.com/apache/kafka/pull/13261#issuecomment-1433794388 @showuon @C0urante could you please review this? Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [kafka] kirktrue opened a new pull request, #13265: Prototype consumer stubs

2023-02-16 Thread via GitHub
kirktrue opened a new pull request, #13265: URL: https://github.com/apache/kafka/pull/13265 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.* *Summary of

[GitHub] [kafka] dejan2609 commented on pull request #13263: KAFKA-14728: Gradle task 'spotlessScalaCheck' is moved out of Jenkinsfile

2023-02-16 Thread via GitHub
dejan2609 commented on PR #13263: URL: https://github.com/apache/kafka/pull/13263#issuecomment-1433744998 Only handfull of tests failed (those errors are obviosly unrelated to this small change). FYI @ijuma -- This is an automated message from the Apache Git Service. To respond

[GitHub] [kafka] vcrfxia opened a new pull request, #13264: KAFKA-14491: [12/N] Relax requirement that KTable stores must be TimestampedKVStores

2023-02-16 Thread via GitHub
vcrfxia opened a new pull request, #13264: URL: https://github.com/apache/kafka/pull/13264 As part of introducing versioned key-value stores in [KIP-889](https://cwiki.apache.org/confluence/display/KAFKA/KIP-889%3A+Versioned+State+Stores), we want to lift the existing DSL restriction that

[jira] [Updated] (KAFKA-14728) Remove 'spotlessScalaCheck' task (out of Jenkinsfile)

2023-02-16 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-14728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dejan Stojadinović updated KAFKA-14728: --- Description: *Note*: this ticket blocks Gradle major version upgrade (_*7 -->>

[GitHub] [kafka] philipnee commented on pull request #13253: KAFKA-14253 - More informative logging

2023-02-16 Thread via GitHub
philipnee commented on PR #13253: URL: https://github.com/apache/kafka/pull/13253#issuecomment-1433651333 Failures seem unrelated ``` Build / JDK 11 and Scala 2.13 / testReplicationIsCreatingTopicsUsingProvidedForwardingAdmin() –

[jira] [Updated] (KAFKA-14727) Connect EOS mode should periodically call task commit

2023-02-16 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton updated KAFKA-14727: -- Affects Version/s: 3.3.2 3.3.1 3.3.0 > Connect

[GitHub] [kafka] C0urante commented on pull request #13262: KAFKA-14727: Enable periodic offset commits for EOS source tasks

2023-02-16 Thread via GitHub
C0urante commented on PR #13262: URL: https://github.com/apache/kafka/pull/13262#issuecomment-1433640900 > This is covered by the existing `testPollReturnsNoRecords` where the two arguments to verifyTransactions are different. Ah yes, thanks. Sorry for missing that. > Also the

[GitHub] [kafka] gharris1727 commented on pull request #13262: KAFKA-14727: Enable periodic offset commits for EOS source tasks

2023-02-16 Thread via GitHub
gharris1727 commented on PR #13262: URL: https://github.com/apache/kafka/pull/13262#issuecomment-1433589831 > Could we also add a case to ExactlyOnceWorkerSourceTaskTest that ensures that SourceTask::commit is invoked even if the task doesn't produce any records? This is covered by

[jira] [Comment Edited] (KAFKA-14722) Make BooleanSerde public

2023-02-16 Thread Spacrocket (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689379#comment-17689379 ] Spacrocket edited comment on KAFKA-14722 at 2/16/23 7:02 PM: - Hello

[GitHub] [kafka] pprovenzano commented on a diff in pull request #13114: KAFKA-14084: SCRAM support in KRaft.

2023-02-16 Thread via GitHub
pprovenzano commented on code in PR #13114: URL: https://github.com/apache/kafka/pull/13114#discussion_r1108894205 ## core/src/test/scala/unit/kafka/server/AlterUserScramCredentialsRequestTest.scala: ## @@ -260,11 +271,13 @@ class AlterUserScramCredentialsRequestTest extends

[GitHub] [kafka] philipnee commented on a diff in pull request #13192: KAFKA-14675: Extract metadata-related tasks from Fetcher into MetadataFetcher 1/4

2023-02-16 Thread via GitHub
philipnee commented on code in PR #13192: URL: https://github.com/apache/kafka/pull/13192#discussion_r1107931054 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/OffsetFetcher.java: ## @@ -0,0 +1,717 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] dajac commented on a diff in pull request #13196: KAFKA-14673; Add high watermark listener to Partition/Log layers

2023-02-16 Thread via GitHub
dajac commented on code in PR #13196: URL: https://github.com/apache/kafka/pull/13196#discussion_r1108852113 ## core/src/main/scala/kafka/cluster/Partition.scala: ## @@ -44,11 +44,40 @@ import org.apache.kafka.common.utils.Time import org.apache.kafka.common.{IsolationLevel,

[jira] [Updated] (KAFKA-14565) Interceptor Resource Leak

2023-02-16 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton updated KAFKA-14565: -- Fix Version/s: 3.3.3 > Interceptor Resource Leak > - > >

[GitHub] [kafka] jolshan commented on a diff in pull request #13196: KAFKA-14673; Add high watermark listener to Partition/Log layers

2023-02-16 Thread via GitHub
jolshan commented on code in PR #13196: URL: https://github.com/apache/kafka/pull/13196#discussion_r1108835492 ## core/src/main/scala/kafka/cluster/Partition.scala: ## @@ -44,11 +44,40 @@ import org.apache.kafka.common.utils.Time import org.apache.kafka.common.{IsolationLevel,

[jira] [Updated] (KAFKA-14565) Interceptor Resource Leak

2023-02-16 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton updated KAFKA-14565: -- Fix Version/s: 3.4.1 > Interceptor Resource Leak > - > >

[jira] [Resolved] (KAFKA-14565) Interceptor Resource Leak

2023-02-16 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-14565. --- Resolution: Fixed > Interceptor Resource Leak > - > >

[GitHub] [kafka] C0urante merged pull request #13168: Kafka 14565: Interceptor Resource Leak

2023-02-16 Thread via GitHub
C0urante merged PR #13168: URL: https://github.com/apache/kafka/pull/13168 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] dejan2609 opened a new pull request, #13263: KAFKA-14728: Gradle task 'spotlessScalaCheck' is moved out of Jenkinsfile

2023-02-16 Thread via GitHub
dejan2609 opened a new pull request, #13263: URL: https://github.com/apache/kafka/pull/13263 Blocks this PR: #13205 Related JIRA ticket: https://issues.apache.org/jira/browse/KAFKA-14728 Rationale: - build works fine in trunk with Gradle 7.6 and spotless gradle plugin

[GitHub] [kafka] C0urante commented on a diff in pull request #13262: KAFKA-14727: Enable periodic offset commits for EOS source tasks

2023-02-16 Thread via GitHub
C0urante commented on code in PR #13262: URL: https://github.com/apache/kafka/pull/13262#discussion_r1108806764 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/ExactlyOnceWorkerSourceTask.java: ## @@ -258,6 +258,21 @@ private void commitTransaction() {

[jira] [Created] (KAFKA-14728) Remove 'spotlessScalaCheck' task (out of Jenkinsfile)

2023-02-16 Thread Jira
Dejan Stojadinović created KAFKA-14728: -- Summary: Remove 'spotlessScalaCheck' task (out of Jenkinsfile) Key: KAFKA-14728 URL: https://issues.apache.org/jira/browse/KAFKA-14728 Project: Kafka

[GitHub] [kafka] gharris1727 commented on pull request #13178: KAFKA-12468, KAFKA-13659, KAFKA-12566: Fix MM2 causing negative downstream lag

2023-02-16 Thread via GitHub
gharris1727 commented on PR #13178: URL: https://github.com/apache/kafka/pull/13178#issuecomment-1433443867 I've split the periodic commit fix into a separate PR (https://github.com/apache/kafka/pull/13262) as it is not related to the changes here, only the test changes. This PR depends on

[GitHub] [kafka] gharris1727 opened a new pull request, #13262: KAFKA-14727: Enable periodic offset commits for EOS source tasks

2023-02-16 Thread via GitHub
gharris1727 opened a new pull request, #13262: URL: https://github.com/apache/kafka/pull/13262 Source tasks in non-EOS mode periodically call SourceTask::commit even if no records are returned from poll. This change adds that behavior to EOS mode by considering empty batches to be

[jira] [Created] (KAFKA-14727) Connect EOS mode should periodically call task commit

2023-02-16 Thread Greg Harris (Jira)
Greg Harris created KAFKA-14727: --- Summary: Connect EOS mode should periodically call task commit Key: KAFKA-14727 URL: https://issues.apache.org/jira/browse/KAFKA-14727 Project: Kafka Issue

[GitHub] [kafka] bachmanity1 opened a new pull request, #13261: MINOR: after reading BYTES type it's possible to access data beyond its size

2023-02-16 Thread via GitHub
bachmanity1 opened a new pull request, #13261: URL: https://github.com/apache/kafka/pull/13261 After reading data of type `BYTES`, `COMPACT_BYTES`, `NULLABLE_BYTES` or `COMPACT_NULLABLE_BYTES` returned `ByteBuffer` might have a capacity that is larger than its limit, thus these data types

[GitHub] [kafka] dajac commented on a diff in pull request #13196: KAFKA-14673; Add high watermark listener to Partition/Log layers

2023-02-16 Thread via GitHub
dajac commented on code in PR #13196: URL: https://github.com/apache/kafka/pull/13196#discussion_r1108755781 ## core/src/main/scala/kafka/cluster/Partition.scala: ## @@ -285,6 +314,17 @@ class Partition(val topicPartition: TopicPartition, // If ReplicaAlterLogDir command is

[GitHub] [kafka] dajac commented on a diff in pull request #13196: KAFKA-14673; Add high watermark listener to Partition/Log layers

2023-02-16 Thread via GitHub
dajac commented on code in PR #13196: URL: https://github.com/apache/kafka/pull/13196#discussion_r1108755031 ## core/src/main/scala/kafka/cluster/Partition.scala: ## @@ -44,11 +44,40 @@ import org.apache.kafka.common.utils.Time import org.apache.kafka.common.{IsolationLevel,

[GitHub] [kafka] dajac commented on a diff in pull request #13196: KAFKA-14673; Add high watermark listener to Partition/Log layers

2023-02-16 Thread via GitHub
dajac commented on code in PR #13196: URL: https://github.com/apache/kafka/pull/13196#discussion_r1108753117 ## core/src/main/scala/kafka/cluster/Partition.scala: ## @@ -44,11 +44,40 @@ import org.apache.kafka.common.utils.Time import org.apache.kafka.common.{IsolationLevel,

[GitHub] [kafka] dajac commented on a diff in pull request #13196: KAFKA-14673; Add high watermark listener to Partition/Log layers

2023-02-16 Thread via GitHub
dajac commented on code in PR #13196: URL: https://github.com/apache/kafka/pull/13196#discussion_r1108752686 ## core/src/main/scala/kafka/cluster/Partition.scala: ## @@ -318,6 +358,25 @@ class Partition(val topicPartition: TopicPartition, def inSyncReplicaIds: Set[Int] =

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13252: KAFKA-14491: [11/N] Add metered wrapper for versioned stores

2023-02-16 Thread via GitHub
vcrfxia commented on code in PR #13252: URL: https://github.com/apache/kafka/pull/13252#discussion_r1108726927 ## streams/src/main/java/org/apache/kafka/streams/state/internals/MeteredVersionedKeyValueStore.java: ## @@ -0,0 +1,227 @@ +/* + * Licensed to the Apache Software

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13252: KAFKA-14491: [11/N] Add metered wrapper for versioned stores

2023-02-16 Thread via GitHub
vcrfxia commented on code in PR #13252: URL: https://github.com/apache/kafka/pull/13252#discussion_r1107700533 ## streams/src/main/java/org/apache/kafka/streams/state/internals/MeteredVersionedKeyValueStore.java: ## @@ -0,0 +1,226 @@ +/* + * Licensed to the Apache Software

[GitHub] [kafka] C0urante commented on pull request #13178: KAFKA-12468, KAFKA-13659, KAFKA-12566: Fix MM2 causing negative downstream lag

2023-02-16 Thread via GitHub
C0urante commented on PR #13178: URL: https://github.com/apache/kafka/pull/13178#issuecomment-1433313709 Hmmm... we make an effort to periodically invoke `SourceTask::commit` in non-EOS mode, even if there have been no new records written and there are no offsets to commit. I think we

[GitHub] [kafka] mimaison merged pull request #13219: MINOR: Simplify JUnit assertions in tests; remove accidental unnecessary code in tests

2023-02-16 Thread via GitHub
mimaison merged PR #13219: URL: https://github.com/apache/kafka/pull/13219 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] fvaleri commented on pull request #13127: KAFKA-14586: Moving StreamResetter to tools

2023-02-16 Thread via GitHub
fvaleri commented on PR #13127: URL: https://github.com/apache/kafka/pull/13127#issuecomment-1433155607 > Regarding moving to CommandDefaultOptions, is it better if we do it in a follow up PR as that is not directly connected to migrating to tools module. Hi @vamossagar12, I'm ok

[GitHub] [kafka] ijuma commented on pull request #13234: KAFKA-14706 Move/rewrite ShutdownableThread to server-common module.

2023-02-16 Thread via GitHub
ijuma commented on PR #13234: URL: https://github.com/apache/kafka/pull/13234#issuecomment-1433083812 I won't have a chance to review for a few more days - if @showuon can do it sooner, let's not block on me. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [kafka] ijuma commented on pull request #13205: KAFKA-14680: gradle version upgrade 7 -->> 8

2023-02-16 Thread via GitHub
ijuma commented on PR #13205: URL: https://github.com/apache/kafka/pull/13205#issuecomment-1433081403 Yeah, that's a security feature. I suggest filing a JIRA about disabling spotlessScalaCheck with the rationale and have a single PR for that change. -- This is an automated message from

[GitHub] [kafka] satishd merged pull request #13235: MINOR Added assertion checks in tests for ProducerStateManager.active Producers usages.

2023-02-16 Thread via GitHub
satishd merged PR #13235: URL: https://github.com/apache/kafka/pull/13235 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] satishd commented on pull request #13234: KAFKA-14706 Move/rewrite ShutdownableThread to server-common module.

2023-02-16 Thread via GitHub
satishd commented on PR #13234: URL: https://github.com/apache/kafka/pull/13234#issuecomment-1433080348 Thanks @ijuma and @showuon for the review. Resolved the conflicts and pushed the changes. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [kafka] satishd commented on pull request #13235: MINOR Added assertion checks in tests for ProducerStateManager.active Producers usages.

2023-02-16 Thread via GitHub
satishd commented on PR #13235: URL: https://github.com/apache/kafka/pull/13235#issuecomment-1433078952 Test failures are not related to this change. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [kafka] tinaselenge commented on pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-16 Thread via GitHub
tinaselenge commented on PR #13172: URL: https://github.com/apache/kafka/pull/13172#issuecomment-1433059514 Thank you @fvaleri and @clolov for reviewing the PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [kafka] clolov opened a new pull request, #13260: KAFKA-14661: Upgrade Zookeeper to 3.8.1

2023-02-16 Thread via GitHub
clolov opened a new pull request, #13260: URL: https://github.com/apache/kafka/pull/13260 Implementation of https://cwiki.apache.org/confluence/display/KAFKA/KIP-902%3A+Upgrade+Zookeeper+to+3.8.1 -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [kafka] vamossagar12 commented on pull request #13095: KAFKA-14580: Moving EndToEndLatency from core to tools module

2023-02-16 Thread via GitHub
vamossagar12 commented on PR #13095: URL: https://github.com/apache/kafka/pull/13095#issuecomment-1433009209 Tests passed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Commented] (KAFKA-14698) Received request api key LEADER_AND_ISR which is not enabled

2023-02-16 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689733#comment-17689733 ] Luke Chen commented on KAFKA-14698: --- [~akhileshchg] , are you still up to this issue? Need any help?  

[GitHub] [kafka] nizhikov commented on pull request #13247: KAFKA-14595 Move value objects of ReassignPartitionsCommand to java

2023-02-16 Thread via GitHub
nizhikov commented on PR #13247: URL: https://github.com/apache/kafka/pull/13247#issuecomment-1432995629 @mimaison Please, share your feedback. Are you ready to review and merge current changes (only case classes and options moved to java code) or should I continue work and rewrite the

[GitHub] [kafka] dejan2609 commented on pull request #13205: KAFKA-14680: gradle version upgrade 7 -->> 8

2023-02-16 Thread via GitHub
dejan2609 commented on PR #13205: URL: https://github.com/apache/kafka/pull/13205#issuecomment-1432981371 樂 Interesting, altough 'spotlessScalaCheck' is removed out of Jenkinsfile that task is still executed on Jenkins:

[GitHub] [kafka] clolov opened a new pull request, #13259: MINOR: Simplify JUnit assertions in src; remove accidental unnecessary code in src

2023-02-16 Thread via GitHub
clolov opened a new pull request, #13259: URL: https://github.com/apache/kafka/pull/13259 I ran IntelliJ IDEA's Code Inspection and corrected occurrences of the following: * https://www.jetbrains.com/help/idea/list-of-java-inspections.html#inheritance-issues (method is identical to its

[GitHub] [kafka] fvaleri commented on a diff in pull request #13214: KAFKA-14577: Move the scala ConsoleProducer from core to tools module

2023-02-16 Thread via GitHub
fvaleri commented on code in PR #13214: URL: https://github.com/apache/kafka/pull/13214#discussion_r1108345004 ## tools/src/main/java/org/apache/kafka/tools/MessageReader.java: ## @@ -0,0 +1,48 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + *

[GitHub] [kafka] omkreddy commented on a diff in pull request #13114: KAFKA-14084: SCRAM support in KRaft.

2023-02-16 Thread via GitHub
omkreddy commented on code in PR #13114: URL: https://github.com/apache/kafka/pull/13114#discussion_r1108339368 ## core/src/test/scala/unit/kafka/server/DescribeUserScramCredentialsRequestTest.scala: ## @@ -17,18 +17,22 @@ package kafka.server import java.util -import

[GitHub] [kafka] mimaison commented on a diff in pull request #13257: MINOR: Add ZK migration docs to the packaged docs

2023-02-16 Thread via GitHub
mimaison commented on code in PR #13257: URL: https://github.com/apache/kafka/pull/13257#discussion_r1108283525 ## docs/ops.html: ## @@ -3550,22 +3550,220 @@ Deploying Considerations -Kafka server's process.role should be set to either broker or controller but not

[GitHub] [kafka] mimaison commented on a diff in pull request #13256: MINOR Sync docs from kafka-site for 3.4 release branch

2023-02-16 Thread via GitHub
mimaison commented on code in PR #13256: URL: https://github.com/apache/kafka/pull/13256#discussion_r1108269059 ## docs/ops.html: ## @@ -3550,22 +3550,220 @@ Deploying Considerations -Kafka server's process.role should be set to either broker or controller but not

[jira] [Commented] (KAFKA-14304) ZooKeeper to KRaft Migration

2023-02-16 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689676#comment-17689676 ] Luke Chen commented on KAFKA-14304: --- [~mumrah] , I'd like to contribute to this feature to complete

[GitHub] [kafka] showuon commented on pull request #13258: KAFKA-14447: remove stale TODO comment

2023-02-16 Thread via GitHub
showuon commented on PR #13258: URL: https://github.com/apache/kafka/pull/13258#issuecomment-1432842837 @mumrah @akhileshchg , call for review. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [kafka] showuon opened a new pull request, #13258: KAFKA-14447: remove stale TODO comment

2023-02-16 Thread via GitHub
showuon opened a new pull request, #13258: URL: https://github.com/apache/kafka/pull/13258 Checked the code, and confirmed the controlled shutdown for ZK brokers during migration can either send to ZK controller, or send to KRaft controller via lifecycle manager based on the controller is

[jira] [Assigned] (KAFKA-14447) Controlled shutdown for ZK brokers during migration

2023-02-16 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen reassigned KAFKA-14447: - Assignee: Luke Chen > Controlled shutdown for ZK brokers during migration >

  1   2   >