[GitHub] [kafka] showuon commented on pull request #12912: MINOR: Fix some compiler warnings

2022-11-28 Thread GitBox
showuon commented on PR #12912: URL: https://github.com/apache/kafka/pull/12912#issuecomment-1330156517 @tinaselenge , thanks for the PR. So, which compiler warnings are you trying to fix here? Could you add some more info in PR description? Thanks. -- This is an automated message from th

[jira] [Commented] (KAFKA-13560) Load indexes and data in async manner in the critical path of replica fetcher threads.

2022-11-28 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17640417#comment-17640417 ] Luke Chen commented on KAFKA-13560: --- https://github.com/apache/kafka/pull/11390#discus

[jira] [Updated] (KAFKA-13560) Load indexes and data in async manner in the critical path of replica fetcher threads.

2022-11-28 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-13560: --- Description: https://github.com/apache/kafka/pull/11390#discussion_r762366976 https://githu

[GitHub] [kafka] satishd commented on a diff in pull request #11390: [KAFKA-13369] Follower fetch protocol changes for tiered storage.

2022-11-28 Thread GitBox
satishd commented on code in PR #11390: URL: https://github.com/apache/kafka/pull/11390#discussion_r1034345639 ## core/src/main/scala/kafka/log/remote/RemoteIndexCache.scala: ## @@ -0,0 +1,238 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or more + * con

[GitHub] [kafka] showuon commented on a diff in pull request #11390: [KAFKA-13369] Follower fetch protocol changes for tiered storage.

2022-11-28 Thread GitBox
showuon commented on code in PR #11390: URL: https://github.com/apache/kafka/pull/11390#discussion_r1034345625 ## core/src/main/scala/kafka/log/remote/RemoteIndexCache.scala: ## @@ -0,0 +1,284 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or more + * con

[GitHub] [kafka] satishd commented on pull request #11390: [KAFKA-13369] Follower fetch protocol changes for tiered storage.

2022-11-28 Thread GitBox
satishd commented on PR #11390: URL: https://github.com/apache/kafka/pull/11390#issuecomment-1330147705 Thanks @junrao for your comments. Addressed most of them, working on a few of the remaining comments. -- This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [kafka] satishd commented on pull request #11390: [KAFKA-13369] Follower fetch protocol changes for tiered storage.

2022-11-28 Thread GitBox
satishd commented on PR #11390: URL: https://github.com/apache/kafka/pull/11390#issuecomment-1330147549 Thanks @divijvaidya for your comments. Addressed them inline. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [kafka] satishd commented on pull request #11390: [KAFKA-13369] Follower fetch protocol changes for tiered storage.

2022-11-28 Thread GitBox
satishd commented on PR #11390: URL: https://github.com/apache/kafka/pull/11390#issuecomment-1330143560 Thanks @showuon for your latest comments. Addressed them inline, let me know if you have any comments. -- This is an automated message from the Apache Git Service. To respond to the me

[GitHub] [kafka] satishd commented on pull request #11390: [KAFKA-13369] Follower fetch protocol changes for tiered storage.

2022-11-28 Thread GitBox
satishd commented on PR #11390: URL: https://github.com/apache/kafka/pull/11390#issuecomment-1330143107 Thanks @junrao for your comments. Addressed most of them, working on a few of the remaining comments. -- This is an automated message from the Apache Git Service. To respond to the mes

[GitHub] [kafka] satishd commented on a diff in pull request #11390: [KAFKA-13369] Follower fetch protocol changes for tiered storage.

2022-11-28 Thread GitBox
satishd commented on code in PR #11390: URL: https://github.com/apache/kafka/pull/11390#discussion_r1034340498 ## core/src/main/scala/kafka/log/remote/RemoteIndexCache.scala: ## @@ -0,0 +1,284 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or more + * con

[GitHub] [kafka] showuon commented on a diff in pull request #12916: MINOR: fix the header size calculation

2022-11-28 Thread GitBox
showuon commented on code in PR #12916: URL: https://github.com/apache/kafka/pull/12916#discussion_r1034332922 ## clients/src/main/java/org/apache/kafka/common/requests/RequestHeader.java: ## @@ -118,7 +118,6 @@ public static RequestHeader parse(ByteBuffer buffer) {

[GitHub] [kafka] showuon commented on a diff in pull request #12916: MINOR: fix the header size calculation

2022-11-28 Thread GitBox
showuon commented on code in PR #12916: URL: https://github.com/apache/kafka/pull/12916#discussion_r1034332922 ## clients/src/main/java/org/apache/kafka/common/requests/RequestHeader.java: ## @@ -118,7 +118,6 @@ public static RequestHeader parse(ByteBuffer buffer) {

[GitHub] [kafka] showuon commented on a diff in pull request #12916: MINOR: fix the header size calculation

2022-11-28 Thread GitBox
showuon commented on code in PR #12916: URL: https://github.com/apache/kafka/pull/12916#discussion_r1034332922 ## clients/src/main/java/org/apache/kafka/common/requests/RequestHeader.java: ## @@ -118,7 +118,6 @@ public static RequestHeader parse(ByteBuffer buffer) {

[GitHub] [kafka] showuon commented on a diff in pull request #12916: MINOR: fix the header size calculation

2022-11-28 Thread GitBox
showuon commented on code in PR #12916: URL: https://github.com/apache/kafka/pull/12916#discussion_r1034332922 ## clients/src/main/java/org/apache/kafka/common/requests/RequestHeader.java: ## @@ -118,7 +118,6 @@ public static RequestHeader parse(ByteBuffer buffer) {

[GitHub] [kafka] showuon commented on pull request #12916: MINOR: fix the header size calculation

2022-11-28 Thread GitBox
showuon commented on PR #12916: URL: https://github.com/apache/kafka/pull/12916#issuecomment-1330131275 @divijvaidya @mimaison , please take a look. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [kafka] showuon commented on a diff in pull request #12916: MINOR: fix the header size calculation

2022-11-28 Thread GitBox
showuon commented on code in PR #12916: URL: https://github.com/apache/kafka/pull/12916#discussion_r1034332922 ## clients/src/main/java/org/apache/kafka/common/requests/RequestHeader.java: ## @@ -118,7 +118,6 @@ public static RequestHeader parse(ByteBuffer buffer) {

[GitHub] [kafka] showuon opened a new pull request, #12916: MINOR: fix the header size calculation

2022-11-28 Thread GitBox
showuon opened a new pull request, #12916: URL: https://github.com/apache/kafka/pull/12916 In https://github.com/apache/kafka/pull/12890/ , we have an improvement for the ObjectSerializationCache in request/response header, but the header size is not correct calculated. Fix it and add size

[jira] [Commented] (KAFKA-7739) Kafka Tiered Storage

2022-11-28 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17640344#comment-17640344 ] Luke Chen commented on KAFKA-7739: -- Thanks for the update and all the work for this feat

[jira] [Commented] (KAFKA-14421) OffsetFetchRequest throws NPE Exception

2022-11-28 Thread yws (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17640342#comment-17640342 ] yws commented on KAFKA-14421: - [~showuon] well, what a pity... > OffsetFetchRequest throws

[GitHub] [kafka] jolshan opened a new pull request, #12915: KAFKA-14417: Producer doesn't handle REQUEST_TIMED_OUT for InitProducerIdRequest, treats as fatal error

2022-11-28 Thread GitBox
jolshan opened a new pull request, #12915: URL: https://github.com/apache/kafka/pull/12915 There were a few options here. Originally we should have bumped the client request version and only sent the response if the client could handle it (since this protocol is actually gated on IBP and no

[jira] [Commented] (KAFKA-7739) Kafka Tiered Storage

2022-11-28 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17640324#comment-17640324 ] Satish Duggana commented on KAFKA-7739: --- The plan is to finish major part of this f

[jira] [Commented] (KAFKA-14379) consumer should refresh preferred read replica on update metadata

2022-11-28 Thread Jeff Kim (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17640278#comment-17640278 ] Jeff Kim commented on KAFKA-14379: -- updated from draft to open PR. > consumer should

[GitHub] [kafka] rajinisivaram commented on a diff in pull request #12914: KAFKA-14352: Rack-aware consumer partition assignment (KIP-881)

2022-11-28 Thread GitBox
rajinisivaram commented on code in PR #12914: URL: https://github.com/apache/kafka/pull/12914#discussion_r1034094654 ## clients/src/main/resources/common/message/ConsumerProtocolSubscription.json: ## @@ -21,7 +21,10 @@ // The current implementation assumes that future version

[GitHub] [kafka] rajinisivaram opened a new pull request, #12914: KAFKA-14352: Rack-aware consumer partition assignment (KIP-881)

2022-11-28 Thread GitBox
rajinisivaram opened a new pull request, #12914: URL: https://github.com/apache/kafka/pull/12914 This PR adds consumer group protocol changes for supporting rack-aware assignment for consumers. It also enables rack-aware assignment in the range assignor and sticky assignors so that default

[jira] [Commented] (KAFKA-14415) ThreadCache is getting slower with every additional state store

2022-11-28 Thread Mehrdad Karami (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17640271#comment-17640271 ] Mehrdad Karami commented on KAFKA-14415: Hi [~lbrutschy]  can you tell me which

[GitHub] [kafka] hachikuji commented on a diff in pull request #12910: MINOR: JoinGroup and SyncGroup callbacks should catch exceptions

2022-11-28 Thread GitBox
hachikuji commented on code in PR #12910: URL: https://github.com/apache/kafka/pull/12910#discussion_r1033987364 ## core/src/main/scala/kafka/coordinator/group/GroupMetadata.scala: ## @@ -546,9 +546,16 @@ private[group] class GroupMetadata(val groupId: String, initialState: Gro

[jira] [Resolved] (KAFKA-14422) Consumer rebalance stuck after new static member joins a group with members not supporting static members

2022-11-28 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-14422. - Fix Version/s: 3.4.0 3.3.2 3.2.4 Resolution: Fixed

[GitHub] [kafka] dajac commented on pull request #12909: KAFKA-14422; Consumer rebalance stuck after new static member joins a group with members not supporting static members

2022-11-28 Thread GitBox
dajac commented on PR #12909: URL: https://github.com/apache/kafka/pull/12909#issuecomment-1329635006 Merged to trunk, 3.3 and 3.2. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[GitHub] [kafka] dajac commented on a diff in pull request #12910: MINOR: JoinGroup and SyncGroup callbacks should catch exceptions

2022-11-28 Thread GitBox
dajac commented on code in PR #12910: URL: https://github.com/apache/kafka/pull/12910#discussion_r1033965897 ## core/src/main/scala/kafka/coordinator/group/GroupMetadata.scala: ## @@ -546,9 +546,16 @@ private[group] class GroupMetadata(val groupId: String, initialState: GroupSt

[jira] [Resolved] (KAFKA-14303) Producer.send without record key and batch.size=0 goes into infinite loop

2022-11-28 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-14303. - Fix Version/s: 3.4.0 3.3.2 Resolution: Fixed Merged the PR to 3.3 and trunk.

[GitHub] [kafka] dajac commented on a diff in pull request #12910: MINOR: JoinGroup and SyncGroup callbacks should catch exceptions

2022-11-28 Thread GitBox
dajac commented on code in PR #12910: URL: https://github.com/apache/kafka/pull/12910#discussion_r1033962116 ## core/src/main/scala/kafka/coordinator/group/GroupMetadata.scala: ## @@ -546,9 +546,16 @@ private[group] class GroupMetadata(val groupId: String, initialState: GroupSt

[GitHub] [kafka] dajac merged pull request #12909: KAFKA-14422; Consumer rebalance stuck after new static member joins a group with members not supporting static members

2022-11-28 Thread GitBox
dajac merged PR #12909: URL: https://github.com/apache/kafka/pull/12909 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.or

[jira] [Commented] (KAFKA-7205) KafkaConsumer / KafkaProducer should allow Reconfiguration of SSL Configuration

2022-11-28 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17640207#comment-17640207 ] Kirk True commented on KAFKA-7205: -- [~streamesk] - thanks for the PR! Per [~omkreddy]'s

[jira] [Resolved] (KAFKA-14393) Change default size based retention for the cluster metadata partition

2022-11-28 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio resolved KAFKA-14393. Resolution: Fixed > Change default size based retention for the cl

[GitHub] [kafka] jsancio merged pull request #12884: KAFKA-14393; Default metadata retention by bytes

2022-11-28 Thread GitBox
jsancio merged PR #12884: URL: https://github.com/apache/kafka/pull/12884 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.

[GitHub] [kafka] jsancio commented on pull request #12884: KAFKA-14393; Default metadata retention by bytes

2022-11-28 Thread GitBox
jsancio commented on PR #12884: URL: https://github.com/apache/kafka/pull/12884#issuecomment-1329572351 Unrelated test failures. Merging. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

[GitHub] [kafka] hachikuji commented on a diff in pull request #12910: MINOR: JoinGroup and SyncGroup callbacks should catch exceptions

2022-11-28 Thread GitBox
hachikuji commented on code in PR #12910: URL: https://github.com/apache/kafka/pull/12910#discussion_r1033867871 ## core/src/main/scala/kafka/coordinator/group/GroupMetadata.scala: ## @@ -546,9 +546,16 @@ private[group] class GroupMetadata(val groupId: String, initialState: Gro

[jira] [Commented] (KAFKA-14379) consumer should refresh preferred read replica on update metadata

2022-11-28 Thread Jeff Kim (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17640158#comment-17640158 ] Jeff Kim commented on KAFKA-14379: -- [~showuon] yes, that is the current plan. can you s

[GitHub] [kafka] jeffkbkim commented on a diff in pull request #12897: KAFKA-14379: consumer should refresh preferred read replica on update metadata [WIP]

2022-11-28 Thread GitBox
jeffkbkim commented on code in PR #12897: URL: https://github.com/apache/kafka/pull/12897#discussion_r1033847041 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/FetcherTest.java: ## @@ -5157,11 +5225,6 @@ private void buildFetcher(MetricConfig metricConfig

[GitHub] [kafka] divijvaidya commented on a diff in pull request #12908: MINOR: Prevent NPE in SmokeTestDriver (fix flaky test)

2022-11-28 Thread GitBox
divijvaidya commented on code in PR #12908: URL: https://github.com/apache/kafka/pull/12908#discussion_r1033816997 ## streams/src/test/java/org/apache/kafka/streams/tests/SmokeTestDriver.java: ## @@ -470,6 +461,18 @@ public static VerificationResult verify(final String kafka,

[GitHub] [kafka] lucasbru commented on a diff in pull request #12908: MINOR: Prevent NPE in SmokeTestDriver (fix flaky test)

2022-11-28 Thread GitBox
lucasbru commented on code in PR #12908: URL: https://github.com/apache/kafka/pull/12908#discussion_r1033809187 ## streams/src/test/java/org/apache/kafka/streams/tests/SmokeTestDriver.java: ## @@ -470,6 +461,18 @@ public static VerificationResult verify(final String kafka,

[jira] [Commented] (KAFKA-12679) Rebalancing a restoring or running task may cause directory livelocking with newly created task

2022-11-28 Thread Lucas Brutschy (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17640125#comment-17640125 ] Lucas Brutschy commented on KAFKA-12679: I addressed this in the new state resto

[GitHub] [kafka] cadonna merged pull request #12875: KAFKA-12679: Handle lock exceptions in state updater

2022-11-28 Thread GitBox
cadonna merged PR #12875: URL: https://github.com/apache/kafka/pull/12875 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.

[GitHub] [kafka] cadonna commented on pull request #12875: KAFKA-12679: Handle lock exceptions in state updater

2022-11-28 Thread GitBox
cadonna commented on PR #12875: URL: https://github.com/apache/kafka/pull/12875#issuecomment-1329368142 Build failures are not related: ``` Build / JDK 17 and Scala 2.13 / kafka.network.SocketServerTest.processNewResponseException() Build / JDK 17 and Scala 2.13 / org.apache.kafka.

[GitHub] [kafka] tinaselenge opened a new pull request, #12912: MINOR: Fix some compiler warnings

2022-11-28 Thread GitBox
tinaselenge opened a new pull request, #12912: URL: https://github.com/apache/kafka/pull/12912 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.* *Summary of tes

[GitHub] [kafka] mumrah commented on pull request #12871: Add the ZK reading and writing logic for KIP-866

2022-11-28 Thread GitBox
mumrah commented on PR #12871: URL: https://github.com/apache/kafka/pull/12871#issuecomment-1329333039 @dengziming please feel free to review this change in this PR. I needed to merge to the integration branch since some other work depends on it. Once the code has stabilized a bit, we'll do

[GitHub] [kafka] mumrah merged pull request #12871: Add the ZK reading and writing logic for KIP-866

2022-11-28 Thread GitBox
mumrah merged PR #12871: URL: https://github.com/apache/kafka/pull/12871 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.o

[GitHub] [kafka] satishd commented on a diff in pull request #11390: [KAFKA-13369] Follower fetch protocol changes for tiered storage.

2022-11-28 Thread GitBox
satishd commented on code in PR #11390: URL: https://github.com/apache/kafka/pull/11390#discussion_r1033492033 ## core/src/main/scala/kafka/log/AbstractIndex.scala: ## @@ -36,7 +36,7 @@ import org.apache.kafka.common.utils.{ByteBufferUnmapper, OperatingSystem, Utils * @param

[GitHub] [kafka] mimaison commented on pull request #10838: MINOR: small fix and clean up for DynamicConfigManager

2022-11-28 Thread GitBox
mimaison commented on PR #10838: URL: https://github.com/apache/kafka/pull/10838#issuecomment-1329291414 @showuon Is this still something you want to do? If so can you rebase it? Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

[jira] [Updated] (KAFKA-14423) Optimize CPU bottleneck caused by metrics capture

2022-11-28 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divij Vaidya updated KAFKA-14423: - Attachment: Screenshot 2022-11-28 at 15.26.30.png > Optimize CPU bottleneck caused by metrics ca

[jira] [Updated] (KAFKA-14423) Optimize CPU bottleneck caused by metrics capture

2022-11-28 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divij Vaidya updated KAFKA-14423: - Attachment: flamegraph1.html > Optimize CPU bottleneck caused by metrics capture > -

[GitHub] [kafka] divijvaidya opened a new pull request, #12911: KAFKA-14418: Do not allow modifying partition of internal topics from admin commands

2022-11-28 Thread GitBox
divijvaidya opened a new pull request, #12911: URL: https://github.com/apache/kafka/pull/12911 Today a user can change the number of partitions of `__consumer_offsets` topic by changing the configuration value for `offsets.topic.num.partitions` or manually by using `./bin/kafka-topics.sh`.

[GitHub] [kafka] mimaison commented on pull request #11509: KAFKA-13370: add unit test for offset-commit metrics

2022-11-28 Thread GitBox
mimaison commented on PR #11509: URL: https://github.com/apache/kafka/pull/11509#issuecomment-1329190796 Thanks @showuon for the PR. It looks good, can you rebase it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [kafka] mimaison merged pull request #12890: KAFKA-14414: Remove unnecessary usage of ObjectSerializationCache

2022-11-28 Thread GitBox
mimaison merged PR #12890: URL: https://github.com/apache/kafka/pull/12890 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[jira] [Resolved] (KAFKA-14299) Benchmark and stabilize state updater

2022-11-28 Thread Lucas Brutschy (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucas Brutschy resolved KAFKA-14299. Assignee: Lucas Brutschy Resolution: Fixed > Benchmark and stabilize state updater >

[GitHub] [kafka] satishd commented on a diff in pull request #11390: [KAFKA-13369] Follower fetch protocol changes for tiered storage.

2022-11-28 Thread GitBox
satishd commented on code in PR #11390: URL: https://github.com/apache/kafka/pull/11390#discussion_r1033516642 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -289,13 +296,27 @@ class UnifiedLog(@volatile var logStartOffset: Long, @volatile var partitionMetadataFil

[GitHub] [kafka] satishd commented on a diff in pull request #11390: [KAFKA-13369] Follower fetch protocol changes for tiered storage.

2022-11-28 Thread GitBox
satishd commented on code in PR #11390: URL: https://github.com/apache/kafka/pull/11390#discussion_r1033515905 ## core/src/main/scala/kafka/log/remote/RemoteIndexCache.scala: ## @@ -0,0 +1,284 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or more + * con

[GitHub] [kafka] sudeshwasnik closed pull request #12784: KAFKA-14339 : Do not perform prodcuerCommit on serializationError when trying offsetWriter flush

2022-11-28 Thread GitBox
sudeshwasnik closed pull request #12784: KAFKA-14339 : Do not perform prodcuerCommit on serializationError when trying offsetWriter flush URL: https://github.com/apache/kafka/pull/12784 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[GitHub] [kafka] sudeshwasnik commented on pull request #12784: KAFKA-14339 : Do not perform prodcuerCommit on serializationError when trying offsetWriter flush

2022-11-28 Thread GitBox
sudeshwasnik commented on PR #12784: URL: https://github.com/apache/kafka/pull/12784#issuecomment-1329023764 Closing this PR. Can reassign this ticket. Shouldn't block on my prioritizations. -- This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [kafka] satishd commented on a diff in pull request #11390: [KAFKA-13369] Follower fetch protocol changes for tiered storage.

2022-11-28 Thread GitBox
satishd commented on code in PR #11390: URL: https://github.com/apache/kafka/pull/11390#discussion_r1033493533 ## core/src/main/scala/kafka/log/remote/RemoteIndexCache.scala: ## @@ -0,0 +1,284 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or more + * con

[GitHub] [kafka] satishd commented on a diff in pull request #11390: [KAFKA-13369] Follower fetch protocol changes for tiered storage.

2022-11-28 Thread GitBox
satishd commented on code in PR #11390: URL: https://github.com/apache/kafka/pull/11390#discussion_r1033492033 ## core/src/main/scala/kafka/log/AbstractIndex.scala: ## @@ -36,7 +36,7 @@ import org.apache.kafka.common.utils.{ByteBufferUnmapper, OperatingSystem, Utils * @param

[GitHub] [kafka] cadonna commented on pull request #12875: KAFKA-12679: Handle lock exceptions in state updater

2022-11-28 Thread GitBox
cadonna commented on PR #12875: URL: https://github.com/apache/kafka/pull/12875#issuecomment-1328982847 @lucasbru Could you please resolve the merge conflicts that I introduces by merging your PR #12904? -- This is an automated message from the Apache Git Service. To respond to the messag

[GitHub] [kafka] cadonna merged pull request #12904: KAFKA-14299: Handle double rebalances better

2022-11-28 Thread GitBox
cadonna merged PR #12904: URL: https://github.com/apache/kafka/pull/12904 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.

[GitHub] [kafka] cadonna commented on pull request #12904: KAFKA-14299: Handle double rebalances better

2022-11-28 Thread GitBox
cadonna commented on PR #12904: URL: https://github.com/apache/kafka/pull/12904#issuecomment-1328978349 Build failures are unrelated: ``` Build / JDK 11 and Scala 2.13 / org.apache.kafka.clients.consumer.StickyAssignorTest.testLargeAssignmentAndGroupWithNonEqualSubscription() Build

[jira] [Created] (KAFKA-14423) Optimize CPU bottleneck caused by metrics capture

2022-11-28 Thread Divij Vaidya (Jira)
Divij Vaidya created KAFKA-14423: Summary: Optimize CPU bottleneck caused by metrics capture Key: KAFKA-14423 URL: https://issues.apache.org/jira/browse/KAFKA-14423 Project: Kafka Issue Type:

[GitHub] [kafka] dajac commented on a diff in pull request #12748: KAFKA-13715: add generationId field in subscription

2022-11-28 Thread GitBox
dajac commented on code in PR #12748: URL: https://github.com/apache/kafka/pull/12748#discussion_r1033405223 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractStickyAssignor.java: ## @@ -162,6 +162,28 @@ private boolean allSubscriptionsEqual(Set allTo

[GitHub] [kafka] mimaison commented on pull request #12899: KAFKA-14413: Separate MirrorMaker configurations for each connector

2022-11-28 Thread GitBox
mimaison commented on PR #12899: URL: https://github.com/apache/kafka/pull/12899#issuecomment-1328885642 @showuon Thanks for the review and good catch! I double checked and all tests should be there now. -- This is an automated message from the Apache Git Service. To respond to the messag

[GitHub] [kafka] dajac opened a new pull request, #12910: MINOR: JoinGroup and SyncGroup callbacks should catch exceptions

2022-11-28 Thread GitBox
dajac opened a new pull request, #12910: URL: https://github.com/apache/kafka/pull/12910 We recently had a bug causing the JoinGroup callback to thrown an exception (https://github.com/apache/kafka/pull/12909). When it happens, the exception is propagated to the caller and the JoinGroup cal

[GitHub] [kafka] divijvaidya commented on pull request #12890: KAFKA-14414: Remove unnecessary usage of ObjectSerializationCache

2022-11-28 Thread GitBox
divijvaidya commented on PR #12890: URL: https://github.com/apache/kafka/pull/12890#issuecomment-1328810024 Test failures are unrelated. ``` Build / JDK 17 and Scala 2.13 / org.apache.kafka.clients.consumer.internals.CooperativeConsumerCoordinatorTest.testOutdatedCoordinatorAssignment(

[GitHub] [kafka] dajac opened a new pull request, #12909: KAFKA-14422; Consumer rebalance stuck after new static member joins a group with members not supporting static members

2022-11-28 Thread GitBox
dajac opened a new pull request, #12909: URL: https://github.com/apache/kafka/pull/12909 When a consumer group on a version prior to 2.3 is rolled upgraded to a newer version and static membership is enabled in the meantime, the consumer group remains stuck, iff the leader is still on the o

[GitHub] [kafka] divijvaidya opened a new pull request, #12908: MINOR: Prevent NPE in SmokeTestDriver (fix flaky test)

2022-11-28 Thread GitBox
divijvaidya opened a new pull request, #12908: URL: https://github.com/apache/kafka/pull/12908 `SmokeTestDriverIntegrationTest.java` can be flaky because a NullPointerException prevents [the retry mechanism](https://github.com/apache/kafka/blob/trunk/streams/src/test/java/org/apache/kafka/s

[jira] [Assigned] (KAFKA-14421) OffsetFetchRequest throws NPE Exception

2022-11-28 Thread yws (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yws reassigned KAFKA-14421: --- Assignee: yws > OffsetFetchRequest throws NPE Exception > --- > >

[jira] [Created] (KAFKA-14422) Consumer rebalance stuck after new static member joins a group with members not supporting static members

2022-11-28 Thread David Jacot (Jira)
David Jacot created KAFKA-14422: --- Summary: Consumer rebalance stuck after new static member joins a group with members not supporting static members Key: KAFKA-14422 URL: https://issues.apache.org/jira/browse/KAFKA-