[GitHub] [kafka] showuon commented on a diff in pull request #13297: Kafka-14743: update request metrics after callback

2023-02-24 Thread via GitHub
showuon commented on code in PR #13297: URL: https://github.com/apache/kafka/pull/13297#discussion_r1117875392 ## core/src/test/scala/unit/kafka/server/FetchRequestDownConversionConfigTest.scala: ## @@ -163,7 +164,9 @@ class FetchRequestDownConversionConfigTest extends

[GitHub] [kafka] philipnee commented on a diff in pull request #13301: KAFKA-14758: Extract inner classes from Fetcher for reuse in refactoring

2023-02-24 Thread via GitHub
philipnee commented on code in PR #13301: URL: https://github.com/apache/kafka/pull/13301#discussion_r1117866050 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/CompletedFetch.java: ## @@ -0,0 +1,356 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] philipnee commented on a diff in pull request #13301: KAFKA-14758: Extract inner classes from Fetcher for reuse in refactoring

2023-02-24 Thread via GitHub
philipnee commented on code in PR #13301: URL: https://github.com/apache/kafka/pull/13301#discussion_r1117808261 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/CompletedFetch.java: ## @@ -0,0 +1,356 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] satishd opened a new pull request, #13304: KAFKA-14726 Move/rewrite of LogReadInfo, LogOffsetSnapshot, LogStartOffsetIncrementReason to storage module

2023-02-24 Thread via GitHub
satishd opened a new pull request, #13304: URL: https://github.com/apache/kafka/pull/13304 KAFKA-14726 Move/rewrite of LogReadInfo, LogOffsetSnapshot, LogStartOffsetIncrementReason to storage module ### Committer Checklist (excluded from commit message) - [ ] Verify design and

[GitHub] [kafka] chia7712 commented on pull request #13205: KAFKA-14680: Upgrade gradle version from 7.6 to 8.0.1

2023-02-24 Thread via GitHub
chia7712 commented on PR #13205: URL: https://github.com/apache/kafka/pull/13205#issuecomment-1444898374 Should we disable `spotlessScala` temporarily? otherwise, the Gradle task related to `spotlessScala` can't work. For example, the common command `./gradlew clean build -x test`. --

[GitHub] [kafka] guozhangwang commented on a diff in pull request #13301: KAFKA-14758: Extract inner classes from Fetcher for reuse in refactoring

2023-02-24 Thread via GitHub
guozhangwang commented on code in PR #13301: URL: https://github.com/apache/kafka/pull/13301#discussion_r1117834119 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/CompletedFetch.java: ## @@ -0,0 +1,356 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13264: KAFKA-14491: [12/N] Relax requirement that KTable stores must be TimestampedKVStores

2023-02-24 Thread via GitHub
vcrfxia commented on code in PR #13264: URL: https://github.com/apache/kafka/pull/13264#discussion_r1117838013 ## streams/src/main/java/org/apache/kafka/streams/state/internals/KeyValueStoreWrapper.java: ## @@ -0,0 +1,149 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13264: KAFKA-14491: [12/N] Relax requirement that KTable stores must be TimestampedKVStores

2023-02-24 Thread via GitHub
vcrfxia commented on code in PR #13264: URL: https://github.com/apache/kafka/pull/13264#discussion_r1117829563 ## streams/src/test/java/org/apache/kafka/streams/state/internals/KeyValueStoreWrapperTest.java: ## @@ -0,0 +1,356 @@ +/* + * Licensed to the Apache Software

[jira] [Comment Edited] (KAFKA-14762) Remove 0_8_2_LATEST from rolling upgrade system test

2023-02-24 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693391#comment-17693391 ] Greg Harris edited comment on KAFKA-14762 at 2/25/23 12:54 AM: --- Based on

[jira] [Commented] (KAFKA-14762) Remove 0_8_2_LATEST from rolling upgrade system test

2023-02-24 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693391#comment-17693391 ] Greg Harris commented on KAFKA-14762: - Based on my understanding of the EOL policy:

[jira] [Commented] (KAFKA-14760) Move ThroughputThrottler, break connect-runtime dependency on tools

2023-02-24 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693389#comment-17693389 ] Greg Harris commented on KAFKA-14760: - I opened a ticket for the above idea: KAFKA-14762, since it

[jira] [Created] (KAFKA-14762) Remove 0_8_2_LATEST from rolling upgrade system test

2023-02-24 Thread Greg Harris (Jira)
Greg Harris created KAFKA-14762: --- Summary: Remove 0_8_2_LATEST from rolling upgrade system test Key: KAFKA-14762 URL: https://issues.apache.org/jira/browse/KAFKA-14762 Project: Kafka Issue

[GitHub] [kafka] kirktrue commented on a diff in pull request #12813: KAFKA-14317: ProduceRequest timeouts are logged as network exceptions

2023-02-24 Thread via GitHub
kirktrue commented on code in PR #12813: URL: https://github.com/apache/kafka/pull/12813#discussion_r1117823636 ## clients/src/main/java/org/apache/kafka/clients/producer/internals/Sender.java: ## @@ -641,7 +643,7 @@ private void completeBatch(ProducerBatch batch,

[jira] [Commented] (KAFKA-14760) Move ThroughputThrottler, break connect-runtime dependency on tools

2023-02-24 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693382#comment-17693382 ] Greg Harris commented on KAFKA-14760: - And for another alternative that _does_ allow us to start

[GitHub] [kafka] guozhangwang merged pull request #13021: KAFKA-14468: Implement CommitRequestManager to manage the commit and autocommit requests

2023-02-24 Thread via GitHub
guozhangwang merged PR #13021: URL: https://github.com/apache/kafka/pull/13021 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] guozhangwang commented on pull request #13231: KAFKA-14402: Update AddPartitionsToTxn protocol to batch and handle verifyOnly requests

2023-02-24 Thread via GitHub
guozhangwang commented on PR #13231: URL: https://github.com/apache/kafka/pull/13231#issuecomment-1444715595 @dajac @hachikuji if you do not have further comments, we can proceed and merge it then? -- This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Resolved] (KAFKA-14685) TierStateMachine interface for building remote aux log

2023-02-24 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-14685. - Fix Version/s: 3.5.0 Resolution: Fixed merged the PR to trunk. > TierStateMachine interface for

[jira] [Assigned] (KAFKA-14685) TierStateMachine interface for building remote aux log

2023-02-24 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao reassigned KAFKA-14685: --- Assignee: Matthew Wong > TierStateMachine interface for building remote aux log >

[GitHub] [kafka] philipnee opened a new pull request, #13303: KAFKA-14761 Adding integration test for the prototype consumer

2023-02-24 Thread via GitHub
philipnee opened a new pull request, #13303: URL: https://github.com/apache/kafka/pull/13303 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.* *Summary of

[GitHub] [kafka] guozhangwang commented on a diff in pull request #13300: KAFKA-10199: Add task updater metrics, part 2

2023-02-24 Thread via GitHub
guozhangwang commented on code in PR #13300: URL: https://github.com/apache/kafka/pull/13300#discussion_r1117803154 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/metrics/StreamsMetricsImpl.java: ## @@ -767,20 +768,6 @@ public static void

[jira] [Commented] (KAFKA-14760) Move ThroughputThrottler, break connect-runtime dependency on tools

2023-02-24 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693377#comment-17693377 ] Greg Harris commented on KAFKA-14760: - Looking into this more, it appears that this was done

[GitHub] [kafka] junrao merged pull request #13206: [KAFKA-14685] Refactor logic to handle OFFSET_MOVED_TO_TIERED_STORAGE error

2023-02-24 Thread via GitHub
junrao merged PR #13206: URL: https://github.com/apache/kafka/pull/13206 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Created] (KAFKA-14761) Integration Tests for the New Consumer Implementation

2023-02-24 Thread Philip Nee (Jira)
Philip Nee created KAFKA-14761: -- Summary: Integration Tests for the New Consumer Implementation Key: KAFKA-14761 URL: https://issues.apache.org/jira/browse/KAFKA-14761 Project: Kafka Issue

[jira] [Commented] (KAFKA-14750) Sink connector fails if a topic matching its topics.regex gets deleted

2023-02-24 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693369#comment-17693369 ] Chris Egerton commented on KAFKA-14750: --- Thanks for filing this, [~morozov]! I've done some local

[jira] [Created] (KAFKA-14760) Move ThroughputThrottler, break connect-runtime dependency on tools

2023-02-24 Thread Greg Harris (Jira)
Greg Harris created KAFKA-14760: --- Summary: Move ThroughputThrottler, break connect-runtime dependency on tools Key: KAFKA-14760 URL: https://issues.apache.org/jira/browse/KAFKA-14760 Project: Kafka

[GitHub] [kafka] mjsax commented on a diff in pull request #13264: KAFKA-14491: [12/N] Relax requirement that KTable stores must be TimestampedKVStores

2023-02-24 Thread via GitHub
mjsax commented on code in PR #13264: URL: https://github.com/apache/kafka/pull/13264#discussion_r1117773343 ## streams/src/main/java/org/apache/kafka/streams/kstream/internals/TimestampedKeyValueStoreMaterializer.java: ## @@ -33,7 +32,7 @@ public

[GitHub] [kafka] mjsax commented on a diff in pull request #13264: KAFKA-14491: [12/N] Relax requirement that KTable stores must be TimestampedKVStores

2023-02-24 Thread via GitHub
mjsax commented on code in PR #13264: URL: https://github.com/apache/kafka/pull/13264#discussion_r1117773343 ## streams/src/main/java/org/apache/kafka/streams/kstream/internals/TimestampedKeyValueStoreMaterializer.java: ## @@ -33,7 +32,7 @@ public

[GitHub] [kafka] mjsax commented on a diff in pull request #13264: KAFKA-14491: [12/N] Relax requirement that KTable stores must be TimestampedKVStores

2023-02-24 Thread via GitHub
mjsax commented on code in PR #13264: URL: https://github.com/apache/kafka/pull/13264#discussion_r1117769530 ## streams/src/test/java/org/apache/kafka/streams/state/internals/KeyValueStoreWrapperTest.java: ## @@ -0,0 +1,356 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] mjsax commented on a diff in pull request #13264: KAFKA-14491: [12/N] Relax requirement that KTable stores must be TimestampedKVStores

2023-02-24 Thread via GitHub
mjsax commented on code in PR #13264: URL: https://github.com/apache/kafka/pull/13264#discussion_r1117766784 ## streams/src/main/java/org/apache/kafka/streams/state/internals/KeyValueStoreWrapper.java: ## @@ -0,0 +1,204 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] mjsax commented on a diff in pull request #13264: KAFKA-14491: [12/N] Relax requirement that KTable stores must be TimestampedKVStores

2023-02-24 Thread via GitHub
mjsax commented on code in PR #13264: URL: https://github.com/apache/kafka/pull/13264#discussion_r1117760309 ## streams/src/main/java/org/apache/kafka/streams/state/internals/KeyValueStoreWrapper.java: ## @@ -0,0 +1,204 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] mjsax merged pull request #13252: KAFKA-14491: [11/N] Add metered wrapper for versioned stores

2023-02-24 Thread via GitHub
mjsax merged PR #13252: URL: https://github.com/apache/kafka/pull/13252 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] mjsax commented on a diff in pull request #13252: KAFKA-14491: [11/N] Add metered wrapper for versioned stores

2023-02-24 Thread via GitHub
mjsax commented on code in PR #13252: URL: https://github.com/apache/kafka/pull/13252#discussion_r1117748690 ## streams/src/test/java/org/apache/kafka/streams/state/internals/MeteredVersionedKeyValueStoreTest.java: ## @@ -0,0 +1,312 @@ +/* + * Licensed to the Apache Software

[GitHub] [kafka] gharris1727 opened a new pull request, #13302: KAFKA-14759: Move Mock, Schema, and Verifiable connectors to new test-plugins module

2023-02-24 Thread via GitHub
gharris1727 opened a new pull request, #13302: URL: https://github.com/apache/kafka/pull/13302 These connectors do not belong in connect-runtime, and there is special code to hide them from the REST API. Instead, these connectors should be excluded by the build process, and added to the

[jira] [Created] (KAFKA-14759) Move test-only connectors from connect-runtime to test-specific module

2023-02-24 Thread Greg Harris (Jira)
Greg Harris created KAFKA-14759: --- Summary: Move test-only connectors from connect-runtime to test-specific module Key: KAFKA-14759 URL: https://issues.apache.org/jira/browse/KAFKA-14759 Project: Kafka

[GitHub] [kafka] kirktrue commented on pull request #13301: KAFKA-14758: Extract inner classes from Fetcher for reuse in refactoring

2023-02-24 Thread via GitHub
kirktrue commented on PR #13301: URL: https://github.com/apache/kafka/pull/13301#issuecomment-1444580426 @hachikuji @rajinisivaram @guozhangwang @vvcephei @philipnee This is another PR that "simply" refactors out the inner classes from the `Fetcher`. I broke it out into a separate PR

[jira] [Resolved] (KAFKA-14540) DataOutputStreamWritable#writeByteBuffer writes the wrong portion of the parameterized buffer

2023-02-24 Thread Michael Marshall (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Marshall resolved KAFKA-14540. -- Resolution: Fixed Fixed by https://github.com/apache/kafka/pull/13032 >

[jira] [Updated] (KAFKA-14758) Extract inner classes from Fetcher for reuse in refactoring

2023-02-24 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-14758: -- Reviewer: Jason Gustafson > Extract inner classes from Fetcher for reuse in refactoring >

[GitHub] [kafka] kirktrue opened a new pull request, #13301: KAFKA-14758: Extract inner classes from Fetcher for reuse in refactoring

2023-02-24 Thread via GitHub
kirktrue opened a new pull request, #13301: URL: https://github.com/apache/kafka/pull/13301 The `Fetcher` class is used internally by the `KafkaConsumer` to fetch records from the brokers. There is ongoing work to create a new consumer implementation with a significantly refactored

[jira] [Reopened] (KAFKA-4106) Consumer / add configure method to PartitionAssignor interface

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-4106: > Consumer / add configure method to PartitionAssignor interface >

[jira] [Reopened] (KAFKA-3117) Fail test at: PlaintextConsumerTest. testAutoCommitOnRebalance

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-3117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-3117: > Fail test at: PlaintextConsumerTest. testAutoCommitOnRebalance >

[jira] [Resolved] (KAFKA-5452) Aggressive log compaction ratio appears to have no negative effect on log-compacted topics

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-5452. Resolution: Fixed > Aggressive log compaction ratio appears to have no negative effect on

[jira] [Resolved] (KAFKA-4106) Consumer / add configure method to PartitionAssignor interface

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-4106. Resolution: Fixed > Consumer / add configure method to PartitionAssignor interface >

[jira] [Resolved] (KAFKA-8177) Allow for separate connect instances to have sink connectors with the same name

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-8177. Resolution: Fixed > Allow for separate connect instances to have sink connectors with the

[jira] [Reopened] (KAFKA-8177) Allow for separate connect instances to have sink connectors with the same name

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-8177: > Allow for separate connect instances to have sink connectors with the same > name >

[jira] [Reopened] (KAFKA-4187) Adding a flag to prefix topics with mirror maker

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-4187: > Adding a flag to prefix topics with mirror maker >

[jira] [Resolved] (KAFKA-4187) Adding a flag to prefix topics with mirror maker

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-4187. Resolution: Fixed > Adding a flag to prefix topics with mirror maker >

[jira] [Resolved] (KAFKA-3117) Fail test at: PlaintextConsumerTest. testAutoCommitOnRebalance

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-3117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-3117. Resolution: Fixed > Fail test at: PlaintextConsumerTest. testAutoCommitOnRebalance >

[jira] [Reopened] (KAFKA-5452) Aggressive log compaction ratio appears to have no negative effect on log-compacted topics

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-5452: > Aggressive log compaction ratio appears to have no negative effect on > log-compacted

[jira] [Resolved] (KAFKA-6014) new consumer mirror maker halts after committing offsets to a deleted topic

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6014. Resolution: Fixed > new consumer mirror maker halts after committing offsets to a deleted

[jira] [Reopened] (KAFKA-6014) new consumer mirror maker halts after committing offsets to a deleted topic

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-6014: > new consumer mirror maker halts after committing offsets to a deleted topic >

[jira] [Reopened] (KAFKA-3410) Unclean leader election and "Halting because log truncation is not allowed"

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-3410: > Unclean leader election and "Halting because log truncation is not allowed" >

[jira] [Reopened] (KAFKA-8255) Replica fetcher thread exits with OffsetOutOfRangeException

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-8255: > Replica fetcher thread exits with OffsetOutOfRangeException >

[jira] [Reopened] (KAFKA-7698) Kafka Broker fail to start: ProducerFencedException thrown from producerstatemanager.scala!checkProducerEpoch

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-7698: > Kafka Broker fail to start: ProducerFencedException thrown from >

[jira] [Resolved] (KAFKA-3410) Unclean leader election and "Halting because log truncation is not allowed"

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-3410. Resolution: Fixed > Unclean leader election and "Halting because log truncation is not

[jira] [Resolved] (KAFKA-949) Integrate kafka into YARN

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-949. --- Resolution: Fixed > Integrate kafka into YARN > - > >

[jira] [Resolved] (KAFKA-5734) Heap (Old generation space) gradually increase

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-5734. Resolution: Fixed > Heap (Old generation space) gradually increase >

[jira] [Reopened] (KAFKA-5734) Heap (Old generation space) gradually increase

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-5734: > Heap (Old generation space) gradually increase >

[jira] [Resolved] (KAFKA-8622) Snappy Compression Not Working

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-8622. Resolution: Fixed > Snappy Compression Not Working > -- > >

[jira] [Reopened] (KAFKA-949) Integrate kafka into YARN

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-949: --- > Integrate kafka into YARN > - > > Key: KAFKA-949 >

[jira] [Resolved] (KAFKA-8255) Replica fetcher thread exits with OffsetOutOfRangeException

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-8255. Resolution: Fixed > Replica fetcher thread exits with OffsetOutOfRangeException >

[jira] [Reopened] (KAFKA-8622) Snappy Compression Not Working

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-8622: > Snappy Compression Not Working > -- > > Key:

[jira] [Resolved] (KAFKA-7698) Kafka Broker fail to start: ProducerFencedException thrown from producerstatemanager.scala!checkProducerEpoch

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-7698. Resolution: Fixed > Kafka Broker fail to start: ProducerFencedException thrown from >

[jira] [Reopened] (KAFKA-12563) Something wrong with MM2 metrics

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-12563: - > Something wrong with MM2 metrics > > >

[jira] [Resolved] (KAFKA-12563) Something wrong with MM2 metrics

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-12563. - Resolution: Fixed > Something wrong with MM2 metrics >

[jira] [Resolved] (KAFKA-13372) failed authentication due to: SSL handshake failed

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-13372. - Resolution: Fixed > failed authentication due to: SSL handshake failed >

[jira] [Reopened] (KAFKA-4329) The order of the parameters for creating the ZkUtils object is reversed

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-4329: > The order of the parameters for creating the ZkUtils object is reversed >

[jira] [Reopened] (KAFKA-10352) Error while reading checkpoint file /tmp/kafka-logs/cleaner-offset-checkpoint (kafka.server.LogDirFailureChannel)

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-10352: - > Error while reading checkpoint file /tmp/kafka-logs/cleaner-offset-checkpoint >

[jira] [Resolved] (KAFKA-10352) Error while reading checkpoint file /tmp/kafka-logs/cleaner-offset-checkpoint (kafka.server.LogDirFailureChannel)

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-10352. - Resolution: Fixed > Error while reading checkpoint file

[jira] [Resolved] (KAFKA-14398) Update EndToEndAuthorizerTest.scala to test with ZK and KRAFT quorum servers

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14398. - Resolution: Fixed > Update EndToEndAuthorizerTest.scala to test with ZK and KRAFT

[jira] [Resolved] (KAFKA-4329) The order of the parameters for creating the ZkUtils object is reversed

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-4329. Resolution: Fixed > The order of the parameters for creating the ZkUtils object is

[jira] [Reopened] (KAFKA-14398) Update EndToEndAuthorizerTest.scala to test with ZK and KRAFT quorum servers

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-14398: - > Update EndToEndAuthorizerTest.scala to test with ZK and KRAFT quorum servers >

[jira] [Reopened] (KAFKA-13372) failed authentication due to: SSL handshake failed

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-13372: - > failed authentication due to: SSL handshake failed >

[jira] [Resolved] (KAFKA-10704) Mirror maker with TLS at target

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-10704. - Resolution: Fixed > Mirror maker with TLS at target > --- >

[jira] [Reopened] (KAFKA-10704) Mirror maker with TLS at target

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-10704: - > Mirror maker with TLS at target > --- > >

[jira] [Assigned] (KAFKA-5870) Idempotent producer: a producerId reset causes undesirable behavior for inflight batches to other partitions

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-5870: -- Assignee: (was: Apurva Mehta) > Idempotent producer: a producerId reset causes

[jira] [Assigned] (KAFKA-5543) We don't remove the LastStableOffsetLag metric when a partition is moved away from a broker

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-5543: -- Assignee: (was: Apurva Mehta) > We don't remove the LastStableOffsetLag metric

[jira] [Assigned] (KAFKA-2939) Make AbstractConfig.logUnused() tunable for clients

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-2939: -- Assignee: (was: Mani Jindal) > Make AbstractConfig.logUnused() tunable for

[jira] [Assigned] (KAFKA-5053) Send Error messages along with FindCoordinatorResponse

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-5053: -- Assignee: (was: Apurva Mehta) > Send Error messages along with

[GitHub] [kafka] mattwong949 commented on a diff in pull request #13206: [KAFKA-14685] Refactor logic to handle OFFSET_MOVED_TO_TIERED_STORAGE error

2023-02-24 Thread via GitHub
mattwong949 commented on code in PR #13206: URL: https://github.com/apache/kafka/pull/13206#discussion_r1117568502 ## core/src/main/java/kafka/server/TierStateMachine.java: ## @@ -0,0 +1,58 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + *

[GitHub] [kafka] guozhangwang commented on a diff in pull request #13300: KAFKA-10199: Add task updater metrics, part 2

2023-02-24 Thread via GitHub
guozhangwang commented on code in PR #13300: URL: https://github.com/apache/kafka/pull/13300#discussion_r1117540370 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/metrics/StreamsMetricsImpl.java: ## @@ -863,45 +864,15 @@ public static void

[jira] [Created] (KAFKA-14758) Extract inner classes from Fetcher for reuse in refactoring

2023-02-24 Thread Kirk True (Jira)
Kirk True created KAFKA-14758: - Summary: Extract inner classes from Fetcher for reuse in refactoring Key: KAFKA-14758 URL: https://issues.apache.org/jira/browse/KAFKA-14758 Project: Kafka Issue

[jira] [Resolved] (KAFKA-14717) KafkaStreams can' get running if the rebalance happens before StreamThread gets shutdown completely

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14717. - Resolution: Fixed > KafkaStreams can' get running if the rebalance happens before

[GitHub] [kafka] guozhangwang commented on a diff in pull request #13300: KAFKA-10199: Add task updater metrics, part 2

2023-02-24 Thread via GitHub
guozhangwang commented on code in PR #13300: URL: https://github.com/apache/kafka/pull/13300#discussion_r1117540370 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/metrics/StreamsMetricsImpl.java: ## @@ -863,45 +864,15 @@ public static void

[jira] [Resolved] (KAFKA-14442) GlobalKTable restoration waits requestTimeout during application restart

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14442. - Resolution: Fixed > GlobalKTable restoration waits requestTimeout during application

[jira] [Reopened] (KAFKA-14442) GlobalKTable restoration waits requestTimeout during application restart

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-14442: - > GlobalKTable restoration waits requestTimeout during application restart >

[jira] [Reopened] (KAFKA-9250) Kafka streams stuck in rebalancing state after UnknownHostException

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-9250: > Kafka streams stuck in rebalancing state after UnknownHostException >

[jira] [Resolved] (KAFKA-4706) Unify StreamsKafkaClient instances

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-4706. Resolution: Fixed > Unify StreamsKafkaClient instances >

[jira] [Reopened] (KAFKA-3576) Unify KStream and KTable API

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-3576: > Unify KStream and KTable API > > > Key:

[jira] [Resolved] (KAFKA-3576) Unify KStream and KTable API

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-3576. Resolution: Fixed > Unify KStream and KTable API > > >

[jira] [Resolved] (KAFKA-13599) Upgrade RocksDB to 6.27.3

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-13599. - Resolution: Fixed > Upgrade RocksDB to 6.27.3 > - > >

[jira] [Reopened] (KAFKA-4706) Unify StreamsKafkaClient instances

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-4706: > Unify StreamsKafkaClient instances > -- > >

[jira] [Reopened] (KAFKA-13599) Upgrade RocksDB to 6.27.3

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-13599: - > Upgrade RocksDB to 6.27.3 > - > > Key:

[jira] [Resolved] (KAFKA-9250) Kafka streams stuck in rebalancing state after UnknownHostException

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-9250. Resolution: Fixed > Kafka streams stuck in rebalancing state after UnknownHostException >

[GitHub] [kafka] guozhangwang opened a new pull request, #13300: KAFKA-10199: Add task updater metrics, part 2

2023-02-24 Thread via GitHub
guozhangwang opened a new pull request, #13300: URL: https://github.com/apache/kafka/pull/13300 1. Added task-level metrics: * restore-rate, restore-total (active) * update-rate, update-total (standby) * restore-remaining-records-total (active) 2. Fixed some naming

[jira] [Commented] (KAFKA-14757) Kafka Cooperative Sticky Assignor results in significant duplicate consumption

2023-02-24 Thread Philip Nee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693323#comment-17693323 ] Philip Nee commented on KAFKA-14757: I mean, the point of onPartitionsRevoked is to ensure progress

[GitHub] [kafka] philipnee commented on pull request #13190: KAFKA-12639: exit upon expired timer to prevent tight looping

2023-02-24 Thread via GitHub
philipnee commented on PR #13190: URL: https://github.com/apache/kafka/pull/13190#issuecomment-1444268607 Just a bit a note here on this PR: Seems like we need to be more deliberate at handling the timeout, because the non-retriable errors are always expected to be thrown. (except for the

[GitHub] [kafka] gharris1727 commented on a diff in pull request #13291: KAFKA-14742: Throttle connectors in ExactlyOnceSourceIntegrationTest to fix flakey OOMEs

2023-02-24 Thread via GitHub
gharris1727 commented on code in PR #13291: URL: https://github.com/apache/kafka/pull/13291#discussion_r1117488058 ## connect/runtime/src/test/java/org/apache/kafka/connect/integration/ExactlyOnceSourceIntegrationTest.java: ## @@ -266,6 +267,7 @@ public void testPollBoundary()

[jira] [Commented] (KAFKA-14747) FK join should record discarded subscription responses

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693312#comment-17693312 ] Matthias J. Sax commented on KAFKA-14747: - Talking to [~guozhang] it seem we don't need a KIP :)

[jira] [Updated] (KAFKA-14747) FK join should record discarded subscription responses

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14747: Labels: beginner newbie (was: beginner needs-kip newbie) > FK join should record

[GitHub] [kafka] gharris1727 commented on a diff in pull request #13291: KAFKA-14742: Throttle connectors in ExactlyOnceSourceIntegrationTest to fix flakey OOMEs

2023-02-24 Thread via GitHub
gharris1727 commented on code in PR #13291: URL: https://github.com/apache/kafka/pull/13291#discussion_r1117479545 ## connect/runtime/src/test/java/org/apache/kafka/connect/integration/ExactlyOnceSourceIntegrationTest.java: ## @@ -81,6 +81,7 @@ import static

  1   2   >