[GitHub] [kafka] satishd commented on a diff in pull request #13535: KAFKA-9579 Fetch implementation for records in the remote storage through a specific purgatory.

2023-04-19 Thread via GitHub
satishd commented on code in PR #13535: URL: https://github.com/apache/kafka/pull/13535#discussion_r1171245421 ## core/src/main/java/kafka/log/remote/RemoteLogManager.java: ## @@ -600,6 +622,176 @@ public String toString() { } } +public FetchDataInfo read(Rem

[GitHub] [kafka] rvansa opened a new pull request, #13619: Initial support for OpenJDK CRaC snapshotting

2023-04-19 Thread via GitHub
rvansa opened a new pull request, #13619: URL: https://github.com/apache/kafka/pull/13619 This change intends to support an application using Vertx GRPC server to perform the Checkpoint and Restore on JVM implementing this, specifically using [OpenJDK CRaC](https://github.com/openjdk/crac/t

[GitHub] [kafka] hudeqi commented on pull request #13618: MINOR: Fixing typos in the ConsumerCoordinators

2023-04-19 Thread via GitHub
hudeqi commented on PR #13618: URL: https://github.com/apache/kafka/pull/13618#issuecomment-1515775034 In fact, it seems that there are many such grammatical problems in the kafka project? I think only those typos like "many" written as "manyy" need to be corrected? This is just my personal

[GitHub] [kafka] ijuma commented on a diff in pull request #13280: KAFKA-14735: Improve KRaft metadata image change performance at high …

2023-04-19 Thread via GitHub
ijuma commented on code in PR #13280: URL: https://github.com/apache/kafka/pull/13280#discussion_r1172120422 ## server-common/src/main/java/org/apache/kafka/server/immutable/pcollections/PCollectionsImmutableMap.java: ## @@ -0,0 +1,223 @@ +/* + * Licensed to the Apache Software

[GitHub] [kafka] ijuma commented on a diff in pull request #13280: KAFKA-14735: Improve KRaft metadata image change performance at high …

2023-04-19 Thread via GitHub
ijuma commented on code in PR #13280: URL: https://github.com/apache/kafka/pull/13280#discussion_r1172120422 ## server-common/src/main/java/org/apache/kafka/server/immutable/pcollections/PCollectionsImmutableMap.java: ## @@ -0,0 +1,223 @@ +/* + * Licensed to the Apache Software

[GitHub] [kafka] philipnee commented on a diff in pull request #13550: KAFKA-14639 - A single partition may be revoked and assign during a single round of rebalance

2023-04-19 Thread via GitHub
philipnee commented on code in PR #13550: URL: https://github.com/apache/kafka/pull/13550#discussion_r1172072549 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractCoordinator.java: ## @@ -835,6 +839,8 @@ public void handle(SyncGroupResponse syncRespons

[GitHub] [kafka] philipnee opened a new pull request, #13618: MINOR: Fixing typos in the ConsumerCoordinators

2023-04-19 Thread via GitHub
philipnee opened a new pull request, #13618: URL: https://github.com/apache/kafka/pull/13618 Not very much really, just fixing some typos. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

[GitHub] [kafka] jolshan commented on a diff in pull request #13607: KAFKA-14916: Fix code that assumes transactional ID implies all records are transactional

2023-04-19 Thread via GitHub
jolshan commented on code in PR #13607: URL: https://github.com/apache/kafka/pull/13607#discussion_r1172068360 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -565,6 +565,12 @@ class KafkaApis(val requestChannel: RequestChannel, requestHelper.sendErrorRespons

[GitHub] [kafka] dengziming merged pull request #13432: KAFKA-14821 Implement the listOffsets API with AdminApiDriver

2023-04-19 Thread via GitHub
dengziming merged PR #13432: URL: https://github.com/apache/kafka/pull/13432 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apac

[GitHub] [kafka] hudeqi opened a new pull request, #13617: MINOR:code optimization in QuorumController

2023-04-19 Thread via GitHub
hudeqi opened a new pull request, #13617: URL: https://github.com/apache/kafka/pull/13617 1. add hint in switch item "BROKER_LOGGER" in ConfigResourceExistenceChecker, otherwise, it will be classified as default break and deleted directly. I don’t know if adding hint is better than deleting

[GitHub] [kafka] dengziming commented on pull request #13432: KAFKA-14821 Implement the listOffsets API with AdminApiDriver

2023-04-19 Thread via GitHub
dengziming commented on PR #13432: URL: https://github.com/apache/kafka/pull/13432#issuecomment-1515639065 Notable changes better than old logic: 1. Retry lookup stage on receiving `NOT_LEADER_OR_FOLLOWER` and `LEADER_NOT_AVAILABLE`, whereas in the past we failed the partition directly w

[jira] [Updated] (KAFKA-14922) kafka-streams-application-reset deletes topics not belonging to specified application-id

2023-04-19 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14922: Component/s: streams tools > kafka-streams-application-reset deletes topi

[jira] [Commented] (KAFKA-14922) kafka-streams-application-reset deletes topics not belonging to specified application-id

2023-04-19 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17714354#comment-17714354 ] Matthias J. Sax commented on KAFKA-14922: - Thanks for creating this ticket. It's

[GitHub] [kafka] ykubota commented on a diff in pull request #13532: KAFKA-14887: No shutdown for ZK session expiration in feature processing

2023-04-19 Thread via GitHub
ykubota commented on code in PR #13532: URL: https://github.com/apache/kafka/pull/13532#discussion_r1171979375 ## core/src/main/scala/kafka/server/FinalizedFeatureChangeListener.scala: ## @@ -160,10 +160,12 @@ class FinalizedFeatureChangeListener(private val finalizedFeatureCac

[GitHub] [kafka] rreddy-22 opened a new pull request, #13616: KAFKA-14514: Add Optimized Uniform Assignor (KIP-848)

2023-04-19 Thread via GitHub
rreddy-22 opened a new pull request, #13616: URL: https://github.com/apache/kafka/pull/13616 Part of KIP-848 https://cwiki.apache.org/confluence/display/KAFKA/KIP-848%3A+The+Next+Generation+of+the+Consumer+Rebalance+Protocol As a part of the new protocol, there will be assignors on

[GitHub] [kafka] artemlivshits commented on a diff in pull request #13607: KAFKA-14916: Fix code that assumes transactional ID implies all records are transactional

2023-04-19 Thread via GitHub
artemlivshits commented on code in PR #13607: URL: https://github.com/apache/kafka/pull/13607#discussion_r1171959120 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -565,6 +565,12 @@ class KafkaApis(val requestChannel: RequestChannel, requestHelper.sendErrorR

[GitHub] [kafka] mjsax commented on pull request #13609: KAFKA-14834: [11/N] Update table joins to identify out-of-order records with `isLatest`

2023-04-19 Thread via GitHub
mjsax commented on PR #13609: URL: https://github.com/apache/kafka/pull/13609#issuecomment-1515524362 Merged to `trunk` and cherry-picked to `3.5` branch. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [kafka] cmccabe commented on a diff in pull request #13407: KAFKA-14805 KRaft controller supports pre-migration mode

2023-04-19 Thread via GitHub
cmccabe commented on code in PR #13407: URL: https://github.com/apache/kafka/pull/13407#discussion_r1171950976 ## metadata/src/test/java/org/apache/kafka/image/publisher/SnapshotGeneratorTest.java: ## @@ -48,7 +48,7 @@ public class SnapshotGeneratorTest { static class MockE

[GitHub] [kafka] cmccabe commented on a diff in pull request #13407: KAFKA-14805 KRaft controller supports pre-migration mode

2023-04-19 Thread via GitHub
cmccabe commented on code in PR #13407: URL: https://github.com/apache/kafka/pull/13407#discussion_r1171950562 ## metadata/src/main/java/org/apache/kafka/controller/QuorumController.java: ## @@ -869,19 +906,30 @@ public CompletableFuture acceptBatch(List recordBatch)

[GitHub] [kafka] cmccabe merged pull request #13532: KAFKA-14887: No shutdown for ZK session expiration in feature processing

2023-04-19 Thread via GitHub
cmccabe merged PR #13532: URL: https://github.com/apache/kafka/pull/13532 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.

[GitHub] [kafka] cmccabe commented on a diff in pull request #13532: KAFKA-14887: No shutdown for ZK session expiration in feature processing

2023-04-19 Thread via GitHub
cmccabe commented on code in PR #13532: URL: https://github.com/apache/kafka/pull/13532#discussion_r1171947569 ## core/src/main/scala/kafka/server/FinalizedFeatureChangeListener.scala: ## @@ -160,10 +160,12 @@ class FinalizedFeatureChangeListener(private val finalizedFeatureCac

[GitHub] [kafka] jolshan commented on a diff in pull request #12149: KAFKA-13668: Retry upon missing initProducerId due to authorization error

2023-04-19 Thread via GitHub
jolshan commented on code in PR #12149: URL: https://github.com/apache/kafka/pull/12149#discussion_r1171947129 ## clients/src/test/java/org/apache/kafka/clients/producer/internals/SenderTest.java: ## @@ -2175,7 +2182,7 @@ public void testClusterAuthorizationExceptionInProduceRe

[GitHub] [kafka] philipnee commented on a diff in pull request #12149: KAFKA-13668: Retry upon missing initProducerId due to authorization error

2023-04-19 Thread via GitHub
philipnee commented on code in PR #12149: URL: https://github.com/apache/kafka/pull/12149#discussion_r1171946214 ## clients/src/test/java/org/apache/kafka/clients/producer/internals/SenderTest.java: ## @@ -2175,7 +2182,7 @@ public void testClusterAuthorizationExceptionInProduce

[GitHub] [kafka] cmccabe commented on a diff in pull request #13461: KAFKA-14840: Support for snapshots during ZK migration

2023-04-19 Thread via GitHub
cmccabe commented on code in PR #13461: URL: https://github.com/apache/kafka/pull/13461#discussion_r1171945830 ## core/src/main/scala/kafka/zk/migration/ZkConfigMigrationClient.scala: ## @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] [kafka] cmccabe commented on a diff in pull request #13461: KAFKA-14840: Support for snapshots during ZK migration

2023-04-19 Thread via GitHub
cmccabe commented on code in PR #13461: URL: https://github.com/apache/kafka/pull/13461#discussion_r1171945520 ## core/src/main/scala/kafka/zk/migration/ZkConfigMigrationClient.scala: ## @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] [kafka] cmccabe commented on a diff in pull request #13461: KAFKA-14840: Support for snapshots during ZK migration

2023-04-19 Thread via GitHub
cmccabe commented on code in PR #13461: URL: https://github.com/apache/kafka/pull/13461#discussion_r1171945520 ## core/src/main/scala/kafka/zk/migration/ZkConfigMigrationClient.scala: ## @@ -0,0 +1,250 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] [kafka] cmccabe commented on a diff in pull request #13461: KAFKA-14840: Support for snapshots during ZK migration

2023-04-19 Thread via GitHub
cmccabe commented on code in PR #13461: URL: https://github.com/apache/kafka/pull/13461#discussion_r1171945097 ## metadata/src/main/java/org/apache/kafka/metadata/migration/KRaftMigrationDriver.java: ## @@ -174,12 +173,12 @@ private boolean areZkBrokersReadyForMigration() {

[GitHub] [kafka] mjsax merged pull request #13609: KAFKA-14834: [11/N] Update table joins to identify out-of-order records with `isLatest`

2023-04-19 Thread via GitHub
mjsax merged PR #13609: URL: https://github.com/apache/kafka/pull/13609 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.or

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13615: KAFKA-14834: [12/N] Minor code cleanups relating to versioned stores

2023-04-19 Thread via GitHub
vcrfxia commented on code in PR #13615: URL: https://github.com/apache/kafka/pull/13615#discussion_r1171934110 ## streams/src/main/java/org/apache/kafka/streams/state/KeyValueStore.java: ## @@ -36,6 +37,7 @@ * @param value The value to update, it can be {@code null};

[GitHub] [kafka] cmccabe commented on a diff in pull request #13461: KAFKA-14840: Support for snapshots during ZK migration

2023-04-19 Thread via GitHub
cmccabe commented on code in PR #13461: URL: https://github.com/apache/kafka/pull/13461#discussion_r1171943462 ## core/src/main/scala/kafka/zk/migration/ZkAclMigrationClient.scala: ## @@ -0,0 +1,115 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more +

[GitHub] [kafka] cmccabe commented on a diff in pull request #13461: KAFKA-14840: Support for snapshots during ZK migration

2023-04-19 Thread via GitHub
cmccabe commented on code in PR #13461: URL: https://github.com/apache/kafka/pull/13461#discussion_r1171941841 ## metadata/src/main/java/org/apache/kafka/metadata/migration/KRaftMigrationZkWriter.java: ## @@ -0,0 +1,333 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [kafka] cmccabe commented on a diff in pull request #13461: KAFKA-14840: Support for snapshots during ZK migration

2023-04-19 Thread via GitHub
cmccabe commented on code in PR #13461: URL: https://github.com/apache/kafka/pull/13461#discussion_r1171941706 ## metadata/src/main/java/org/apache/kafka/metadata/migration/KRaftMigrationZkWriter.java: ## @@ -0,0 +1,333 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [kafka] mjsax merged pull request #13610: MINOR: update comments for FK join processor renames

2023-04-19 Thread via GitHub
mjsax merged PR #13610: URL: https://github.com/apache/kafka/pull/13610 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.or

[GitHub] [kafka] cmccabe commented on pull request #13461: KAFKA-14840: Support for snapshots during ZK migration

2023-04-19 Thread via GitHub
cmccabe commented on PR #13461: URL: https://github.com/apache/kafka/pull/13461#issuecomment-1515504502 Thanks for this @mumrah . Can we have a ZkConfigMigrationClientTest and so on, for the other new migrationclient classes? Should we wrap the calls to `quotaEntityConsumer.acc

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13552: KAFKA-14834: [6/N] Add tracking of versioned tables into graph nodes

2023-04-19 Thread via GitHub
vcrfxia commented on code in PR #13552: URL: https://github.com/apache/kafka/pull/13552#discussion_r1171939132 ## streams/src/main/java/org/apache/kafka/streams/kstream/internals/CogroupedStreamAggregateBuilder.java: ## @@ -73,6 +74,7 @@ KTable build(final Map, Aggregator

[GitHub] [kafka] cmccabe commented on a diff in pull request #13461: KAFKA-14840: Support for snapshots during ZK migration

2023-04-19 Thread via GitHub
cmccabe commented on code in PR #13461: URL: https://github.com/apache/kafka/pull/13461#discussion_r1171935467 ## metadata/src/test/java/org/apache/kafka/metadata/migration/CapturingTopicMigrationClient.java: ## @@ -0,0 +1,66 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] cmccabe commented on a diff in pull request #13461: KAFKA-14840: Support for snapshots during ZK migration

2023-04-19 Thread via GitHub
cmccabe commented on code in PR #13461: URL: https://github.com/apache/kafka/pull/13461#discussion_r1171935467 ## metadata/src/test/java/org/apache/kafka/metadata/migration/CapturingTopicMigrationClient.java: ## @@ -0,0 +1,66 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] cmccabe commented on a diff in pull request #13461: KAFKA-14840: Support for snapshots during ZK migration

2023-04-19 Thread via GitHub
cmccabe commented on code in PR #13461: URL: https://github.com/apache/kafka/pull/13461#discussion_r1171934758 ## core/src/main/scala/kafka/zk/ZkMigrationClient.scala: ## @@ -16,71 +16,79 @@ */ package kafka.zk -import kafka.api.LeaderAndIsr -import kafka.controller.{Leader

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13615: KAFKA-14834: [12/N] Minor code cleanups relating to versioned stores

2023-04-19 Thread via GitHub
vcrfxia commented on code in PR #13615: URL: https://github.com/apache/kafka/pull/13615#discussion_r1171934110 ## streams/src/main/java/org/apache/kafka/streams/state/KeyValueStore.java: ## @@ -36,6 +37,7 @@ * @param value The value to update, it can be {@code null};

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13615: KAFKA-14834: [12/N] Minor code cleanups relating to versioned stores

2023-04-19 Thread via GitHub
vcrfxia commented on code in PR #13615: URL: https://github.com/apache/kafka/pull/13615#discussion_r1171934110 ## streams/src/main/java/org/apache/kafka/streams/state/KeyValueStore.java: ## @@ -36,6 +37,7 @@ * @param value The value to update, it can be {@code null};

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13188: KAFKA-14491: [5/N] Basic operations for RocksDB versioned store

2023-04-19 Thread via GitHub
vcrfxia commented on code in PR #13188: URL: https://github.com/apache/kafka/pull/13188#discussion_r1171931840 ## streams/src/main/java/org/apache/kafka/streams/state/VersionedKeyValueStore.java: ## @@ -0,0 +1,99 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13564: KAFKA-14834: [8/N] Propagate `isLatest` as part of `Change`

2023-04-19 Thread via GitHub
vcrfxia commented on code in PR #13564: URL: https://github.com/apache/kafka/pull/13564#discussion_r1171930596 ## streams/src/main/java/org/apache/kafka/streams/kstream/internals/KTableKTableInnerJoin.java: ## @@ -139,7 +139,7 @@ public void process(final Record> record) {

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13564: KAFKA-14834: [8/N] Propagate `isLatest` as part of `Change`

2023-04-19 Thread via GitHub
vcrfxia commented on code in PR #13564: URL: https://github.com/apache/kafka/pull/13564#discussion_r1171930805 ## streams/src/main/java/org/apache/kafka/streams/kstream/internals/KTableRepartitionMap.java: ## @@ -154,27 +154,25 @@ public void process(final Record> record) {

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13564: KAFKA-14834: [8/N] Propagate `isLatest` as part of `Change`

2023-04-19 Thread via GitHub
vcrfxia commented on code in PR #13564: URL: https://github.com/apache/kafka/pull/13564#discussion_r1171929315 ## streams/src/main/java/org/apache/kafka/streams/kstream/internals/KTableKTableInnerJoin.java: ## @@ -139,7 +139,7 @@ public void process(final Record> record) {

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13564: KAFKA-14834: [8/N] Propagate `isLatest` as part of `Change`

2023-04-19 Thread via GitHub
vcrfxia commented on code in PR #13564: URL: https://github.com/apache/kafka/pull/13564#discussion_r1171926280 ## streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamAggregate.java: ## @@ -118,10 +120,13 @@ public void process(final Record record) {

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13564: KAFKA-14834: [8/N] Propagate `isLatest` as part of `Change`

2023-04-19 Thread via GitHub
vcrfxia commented on code in PR #13564: URL: https://github.com/apache/kafka/pull/13564#discussion_r1171926005 ## streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamAggregate.java: ## @@ -118,10 +120,13 @@ public void process(final Record record) {

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13564: KAFKA-14834: [8/N] Propagate `isLatest` as part of `Change`

2023-04-19 Thread via GitHub
vcrfxia commented on code in PR #13564: URL: https://github.com/apache/kafka/pull/13564#discussion_r1171925337 ## streams/src/main/java/org/apache/kafka/streams/kstream/internals/KTableAggregate.java: ## @@ -116,10 +118,13 @@ public void process(final Record> record) {

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13522: KAFKA-14834: [5/N] Drop out-of-order records from FK join with versioned tables

2023-04-19 Thread via GitHub
vcrfxia commented on code in PR #13522: URL: https://github.com/apache/kafka/pull/13522#discussion_r1171919730 ## streams/src/test/java/org/apache/kafka/streams/integration/KTableKTableForeignKeyVersionedJoinIntegrationTest.java: ## @@ -0,0 +1,301 @@ +/* + * Licensed to the Apac

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13522: KAFKA-14834: [5/N] Drop out-of-order records from FK join with versioned tables

2023-04-19 Thread via GitHub
vcrfxia commented on code in PR #13522: URL: https://github.com/apache/kafka/pull/13522#discussion_r1171919367 ## streams/src/test/java/org/apache/kafka/streams/integration/KTableKTableForeignKeyJoinIntegrationTest.java: ## @@ -249,62 +272,62 @@ public void doJoinFromLeftThenDel

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13522: KAFKA-14834: [5/N] Drop out-of-order records from FK join with versioned tables

2023-04-19 Thread via GitHub
vcrfxia commented on code in PR #13522: URL: https://github.com/apache/kafka/pull/13522#discussion_r1171919015 ## streams/src/test/java/org/apache/kafka/streams/integration/KTableKTableForeignKeyJoinIntegrationTest.java: ## @@ -140,9 +163,9 @@ public void doJoinFromLeftThenDelet

[GitHub] [kafka] vcrfxia commented on pull request #13509: KAFKA-14834: [3/N] Timestamped lookups for stream-table joins

2023-04-19 Thread via GitHub
vcrfxia commented on PR #13509: URL: https://github.com/apache/kafka/pull/13509#issuecomment-1515473590 Closing the loop here: versioned stores are disallowed for GlobalKTables in https://github.com/apache/kafka/pull/13565, so we should be all set. -- This is an automated message from the

[GitHub] [kafka] vcrfxia opened a new pull request, #13615: KAFKA-14834: [12/N] Minor code cleanups relating to versioned stores

2023-04-19 Thread via GitHub
vcrfxia opened a new pull request, #13615: URL: https://github.com/apache/kafka/pull/13615 (This PR is stacked on https://github.com/apache/kafka/pull/13609. Only commits starting from `whitespace cleanup` need to be reviewed separately.) This PR contains various minor/non-functional

[GitHub] [kafka] rreddy-22 commented on a diff in pull request #13443: KAFKA-14514: Add Server Side Sticky Range Assignor (KIP-848)

2023-04-19 Thread via GitHub
rreddy-22 commented on code in PR #13443: URL: https://github.com/apache/kafka/pull/13443#discussion_r1171913729 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/assignor/RangeAssignor.java: ## @@ -0,0 +1,240 @@ +/* + * Licensed to the Apache Software Founda

[GitHub] [kafka] jolshan commented on a diff in pull request #12149: KAFKA-13668: Retry upon missing initProducerId due to authorization error

2023-04-19 Thread via GitHub
jolshan commented on code in PR #12149: URL: https://github.com/apache/kafka/pull/12149#discussion_r1171913050 ## clients/src/test/java/org/apache/kafka/clients/producer/internals/SenderTest.java: ## @@ -2189,7 +2196,7 @@ public void testCancelInFlightRequestAfterFatalError() t

[GitHub] [kafka] jolshan commented on a diff in pull request #12149: KAFKA-13668: Retry upon missing initProducerId due to authorization error

2023-04-19 Thread via GitHub
jolshan commented on code in PR #12149: URL: https://github.com/apache/kafka/pull/12149#discussion_r1171912717 ## clients/src/test/java/org/apache/kafka/clients/producer/internals/SenderTest.java: ## @@ -2175,7 +2182,7 @@ public void testClusterAuthorizationExceptionInProduceRe

[GitHub] [kafka] philipnee commented on a diff in pull request #12149: KAFKA-13668: Retry upon missing initProducerId due to authorization error

2023-04-19 Thread via GitHub
philipnee commented on code in PR #12149: URL: https://github.com/apache/kafka/pull/12149#discussion_r1171904037 ## clients/src/main/java/org/apache/kafka/clients/producer/internals/TransactionManager.java: ## @@ -1294,7 +1309,10 @@ public void handleResponse(AbstractResponse re

[jira] [Commented] (KAFKA-8154) Buffer Overflow exceptions between brokers and with clients

2023-04-19 Thread keith.paulson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17714323#comment-17714323 ] keith.paulson commented on KAFKA-8154: -- I'm getting this error now, kafka 3.4 with B

[GitHub] [kafka] philipnee commented on a diff in pull request #12149: KAFKA-13668: Retry upon missing initProducerId due to authorization error

2023-04-19 Thread via GitHub
philipnee commented on code in PR #12149: URL: https://github.com/apache/kafka/pull/12149#discussion_r1171873787 ## clients/src/main/java/org/apache/kafka/clients/producer/internals/TransactionManager.java: ## @@ -1294,7 +1309,10 @@ public void handleResponse(AbstractResponse re

[GitHub] [kafka] jolshan commented on a diff in pull request #12149: KAFKA-13668: Retry upon missing initProducerId due to authorization error

2023-04-19 Thread via GitHub
jolshan commented on code in PR #12149: URL: https://github.com/apache/kafka/pull/12149#discussion_r1171872077 ## clients/src/main/java/org/apache/kafka/clients/producer/internals/TransactionManager.java: ## @@ -1294,7 +1309,10 @@ public void handleResponse(AbstractResponse resp

[GitHub] [kafka] jolshan commented on a diff in pull request #13608: KAFKA-14884: Include check transaction is still ongoing right before append

2023-04-19 Thread via GitHub
jolshan commented on code in PR #13608: URL: https://github.com/apache/kafka/pull/13608#discussion_r1171868072 ## core/src/main/scala/kafka/server/ReplicaManager.scala: ## @@ -1051,6 +1060,8 @@ class ReplicaManager(val config: KafkaConfig, } else { try {

[GitHub] [kafka] philipnee commented on a diff in pull request #12149: KAFKA-13668: Retry upon missing initProducerId due to authorization error

2023-04-19 Thread via GitHub
philipnee commented on code in PR #12149: URL: https://github.com/apache/kafka/pull/12149#discussion_r1171855134 ## clients/src/main/java/org/apache/kafka/clients/producer/KafkaProducer.java: ## @@ -618,7 +618,8 @@ private TransactionManager configureTransactionState(ProducerCo

[GitHub] [kafka] jolshan commented on a diff in pull request #12149: KAFKA-13668: Retry upon missing initProducerId due to authorization error

2023-04-19 Thread via GitHub
jolshan commented on code in PR #12149: URL: https://github.com/apache/kafka/pull/12149#discussion_r1171818667 ## clients/src/main/java/org/apache/kafka/clients/producer/KafkaProducer.java: ## @@ -618,7 +618,8 @@ private TransactionManager configureTransactionState(ProducerConf

[GitHub] [kafka] jolshan commented on a diff in pull request #12149: KAFKA-13668: Retry upon missing initProducerId due to authorization error

2023-04-19 Thread via GitHub
jolshan commented on code in PR #12149: URL: https://github.com/apache/kafka/pull/12149#discussion_r1171816496 ## clients/src/main/java/org/apache/kafka/clients/producer/internals/Sender.java: ## @@ -300,9 +301,13 @@ void runOnce() { try { transacti

[GitHub] [kafka] rreddy-22 commented on a diff in pull request #13443: KAFKA-14514: Add Server Side Sticky Range Assignor (KIP-848)

2023-04-19 Thread via GitHub
rreddy-22 commented on code in PR #13443: URL: https://github.com/apache/kafka/pull/13443#discussion_r1171783796 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/assignor/RangeAssignor.java: ## @@ -0,0 +1,240 @@ +/* + * Licensed to the Apache Software Founda

[GitHub] [kafka] rreddy-22 commented on a diff in pull request #13443: KAFKA-14514: Add Server Side Sticky Range Assignor (KIP-848)

2023-04-19 Thread via GitHub
rreddy-22 commented on code in PR #13443: URL: https://github.com/apache/kafka/pull/13443#discussion_r1171781883 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/assignor/RangeAssignor.java: ## @@ -0,0 +1,240 @@ +/* + * Licensed to the Apache Software Founda

[GitHub] [kafka] philipnee commented on a diff in pull request #13550: KAFKA-14639 - A single partition may be revoked and assign during a single round of rebalance

2023-04-19 Thread via GitHub
philipnee commented on code in PR #13550: URL: https://github.com/apache/kafka/pull/13550#discussion_r1171780417 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractCoordinator.java: ## @@ -835,6 +839,8 @@ public void handle(SyncGroupResponse syncRespons

[GitHub] [kafka] rreddy-22 commented on a diff in pull request #13443: KAFKA-14514: Add Server Side Sticky Range Assignor (KIP-848)

2023-04-19 Thread via GitHub
rreddy-22 commented on code in PR #13443: URL: https://github.com/apache/kafka/pull/13443#discussion_r1171778657 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/assignor/RangeAssignor.java: ## @@ -0,0 +1,240 @@ +/* + * Licensed to the Apache Software Founda

[GitHub] [kafka] rreddy-22 commented on a diff in pull request #13443: KAFKA-14514: Add Server Side Sticky Range Assignor (KIP-848)

2023-04-19 Thread via GitHub
rreddy-22 commented on code in PR #13443: URL: https://github.com/apache/kafka/pull/13443#discussion_r1171777998 ## group-coordinator/src/test/java/org/apache/kafka/coordinator/group/assignor/RangeAssignorTest.java: ## @@ -0,0 +1,416 @@ +/* + * Licensed to the Apache Software Fo

[GitHub] [kafka] dajac commented on a diff in pull request #13550: KAFKA-14639 - A single partition may be revoked and assign during a single round of rebalance

2023-04-19 Thread via GitHub
dajac commented on code in PR #13550: URL: https://github.com/apache/kafka/pull/13550#discussion_r1171774551 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractCoordinator.java: ## @@ -835,6 +839,8 @@ public void handle(SyncGroupResponse syncResponse,

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13592: KAFKA-14862: Outer stream-stream join does not output all results with multiple input partitions

2023-04-19 Thread via GitHub
vcrfxia commented on code in PR #13592: URL: https://github.com/apache/kafka/pull/13592#discussion_r1171766477 ## streams/src/test/java/org/apache/kafka/streams/integration/KStreamKStreamIntegrationTest.java: ## @@ -0,0 +1,186 @@ +/* + * Licensed to the Apache Software Foundatio

[GitHub] [kafka] philipnee commented on a diff in pull request #12149: KAFKA-13668: Retry upon missing initProducerId due to authorization error

2023-04-19 Thread via GitHub
philipnee commented on code in PR #12149: URL: https://github.com/apache/kafka/pull/12149#discussion_r1171764467 ## clients/src/main/java/org/apache/kafka/clients/producer/internals/Sender.java: ## @@ -300,9 +301,13 @@ void runOnce() { try { transac

[GitHub] [kafka] philipnee commented on a diff in pull request #12149: KAFKA-13668: Retry upon missing initProducerId due to authorization error

2023-04-19 Thread via GitHub
philipnee commented on code in PR #12149: URL: https://github.com/apache/kafka/pull/12149#discussion_r1171757259 ## clients/src/main/java/org/apache/kafka/clients/producer/internals/Sender.java: ## @@ -300,9 +301,13 @@ void runOnce() { try { transac

[GitHub] [kafka] jlprat merged pull request #11478: KAFKA-13299: Accept duplicate listener on port for IPv4/IPv6

2023-04-19 Thread via GitHub
jlprat merged PR #11478: URL: https://github.com/apache/kafka/pull/11478 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.o

[GitHub] [kafka] jlprat commented on pull request #11478: KAFKA-13299: Accept duplicate listener on port for IPv4/IPv6

2023-04-19 Thread via GitHub
jlprat commented on PR #11478: URL: https://github.com/apache/kafka/pull/11478#issuecomment-1515213471 To the best of my knowledge, test failures seem to be all unrelated to the change in this PR. -- This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [kafka] philipnee commented on a diff in pull request #13550: KAFKA-14639 - A single partition may be revoked and assign during a single round of rebalance

2023-04-19 Thread via GitHub
philipnee commented on code in PR #13550: URL: https://github.com/apache/kafka/pull/13550#discussion_r1171712519 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractCoordinator.java: ## @@ -835,6 +839,8 @@ public void handle(SyncGroupResponse syncRespons

[GitHub] [kafka] mumrah merged pull request #13606: KAFKA-14918 Only send controller RPCs to migrating ZK brokers

2023-04-19 Thread via GitHub
mumrah merged PR #13606: URL: https://github.com/apache/kafka/pull/13606 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.o

[GitHub] [kafka] jolshan commented on pull request #13607: KAFKA-14916: Fix code that assumes transactional ID implies all records are transactional

2023-04-19 Thread via GitHub
jolshan commented on PR #13607: URL: https://github.com/apache/kafka/pull/13607#issuecomment-151533 I believe the connect mirror failures are known -- so no issues from the testing front. -- This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [kafka] jeffkbkim commented on a diff in pull request #13537: KAFKA-14462; [7/N] Add ClientAssignor, Assignment, TopicMetadata and VersionedMetadata

2023-04-19 Thread via GitHub
jeffkbkim commented on code in PR #13537: URL: https://github.com/apache/kafka/pull/13537#discussion_r1171626106 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/consumer/VersionedMetadata.java: ## @@ -0,0 +1,85 @@ +/* + * Licensed to the Apache Software Fou

[GitHub] [kafka] jolshan commented on a diff in pull request #13537: KAFKA-14462; [7/N] Add ClientAssignor, Assignment, TopicMetadata and VersionedMetadata

2023-04-19 Thread via GitHub
jolshan commented on code in PR #13537: URL: https://github.com/apache/kafka/pull/13537#discussion_r1171634759 ## group-coordinator/src/test/java/org/apache/kafka/coordinator/group/consumer/AssignmentTest.java: ## @@ -0,0 +1,137 @@ +/* + * Licensed to the Apache Software Foundat

[GitHub] [kafka] mimaison commented on pull request #13614: KAFKA-14586: Adding redirection for StreamsResetter

2023-04-19 Thread via GitHub
mimaison commented on PR #13614: URL: https://github.com/apache/kafka/pull/13614#issuecomment-1515084652 Not merging immediately to let @mjsax a chance to review. Feel free to merge to trunk and 3.5, otherwise I'll do it when I come online tomorrow. -- This is an automated message from

[jira] [Resolved] (KAFKA-4327) Move Reset Tool from core to streams

2023-04-19 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-4327. Fix Version/s: (was: 4.0.0) Resolution: Fixed This was resolved via https://issu

[GitHub] [kafka] jolshan commented on a diff in pull request #13537: KAFKA-14462; [7/N] Add ClientAssignor, Assignment, TopicMetadata and VersionedMetadata

2023-04-19 Thread via GitHub
jolshan commented on code in PR #13537: URL: https://github.com/apache/kafka/pull/13537#discussion_r1171629591 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/consumer/Assignment.java: ## @@ -0,0 +1,144 @@ +/* + * Licensed to the Apache Software Foundation

[jira] [Assigned] (KAFKA-4327) Move Reset Tool from core to streams

2023-04-19 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-4327: -- Assignee: (was: Jorge Esteban Quilcate Otoya) > Move Reset Tool from core to strea

[GitHub] [kafka] jolshan commented on a diff in pull request #13537: KAFKA-14462; [7/N] Add ClientAssignor, Assignment, TopicMetadata and VersionedMetadata

2023-04-19 Thread via GitHub
jolshan commented on code in PR #13537: URL: https://github.com/apache/kafka/pull/13537#discussion_r1171628212 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/consumer/ClientAssignor.java: ## @@ -0,0 +1,150 @@ +/* + * Licensed to the Apache Software Foundat

[GitHub] [kafka] jolshan commented on a diff in pull request #13537: KAFKA-14462; [7/N] Add ClientAssignor, Assignment, TopicMetadata and VersionedMetadata

2023-04-19 Thread via GitHub
jolshan commented on code in PR #13537: URL: https://github.com/apache/kafka/pull/13537#discussion_r1171626917 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/consumer/TopicMetadata.java: ## @@ -0,0 +1,109 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] [kafka] jolshan commented on a diff in pull request #13537: KAFKA-14462; [7/N] Add ClientAssignor, Assignment, TopicMetadata and VersionedMetadata

2023-04-19 Thread via GitHub
jolshan commented on code in PR #13537: URL: https://github.com/apache/kafka/pull/13537#discussion_r1171626201 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/consumer/TopicMetadata.java: ## @@ -0,0 +1,109 @@ +/* + * Licensed to the Apache Software Foundati

[jira] [Updated] (KAFKA-14868) Remove some forgotten metrics when the replicaManager is closed

2023-04-19 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison updated KAFKA-14868: --- Fix Version/s: 3.6.0 (was: 3.5.0) > Remove some forgotten metrics whe

[GitHub] [kafka] mimaison merged pull request #13471: KAFKA-14868:Remove some forgotten metrics when the replicaManager is closed

2023-04-19 Thread via GitHub
mimaison merged PR #13471: URL: https://github.com/apache/kafka/pull/13471 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[GitHub] [kafka] divijvaidya commented on pull request #13312: KAFKA-14766: Improve performance of VarInt encoding and decoding

2023-04-19 Thread via GitHub
divijvaidya commented on PR #13312: URL: https://github.com/apache/kafka/pull/13312#issuecomment-1515034487 @ijuma I tried end to end benchmarks w/ and w/o this change but I didn't observe any noticeable change in end to end latency or throughput (because the bottle neck in end to end tests

[jira] [Assigned] (KAFKA-14669) Include MirrorMaker connector configurations in docs

2023-04-19 Thread Gantigmaa Selenge (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gantigmaa Selenge reassigned KAFKA-14669: - Assignee: Gantigmaa Selenge > Include MirrorMaker connector configurations in d

[GitHub] [kafka] dajac commented on pull request #13537: KAFKA-14462; [7/N] Add ClientAssignor, Assignment, TopicMetadata and VersionedMetadata

2023-04-19 Thread via GitHub
dajac commented on PR #13537: URL: https://github.com/apache/kafka/pull/13537#issuecomment-1515007003 @dengziming @showuon I have a few PRs in-flight for KIP-848 if you are interested to help with reviews on that front. -- This is an automated message from the Apache Git Service. To respo

[GitHub] [kafka] gharris1727 commented on a diff in pull request #13429: KAFKA-14666: Add MM2 in-memory offset translation index for offsets behind replication

2023-04-19 Thread via GitHub
gharris1727 commented on code in PR #13429: URL: https://github.com/apache/kafka/pull/13429#discussion_r1171513542 ## connect/mirror/src/main/java/org/apache/kafka/connect/mirror/OffsetSyncStore.java: ## @@ -139,10 +171,103 @@ public void close() { protected void handleReco

[GitHub] [kafka] dimitarndimitrov commented on pull request #13432: KAFKA-14821 Implement the listOffsets API with AdminApiDriver

2023-04-19 Thread via GitHub
dimitarndimitrov commented on PR #13432: URL: https://github.com/apache/kafka/pull/13432#issuecomment-1514934648 > please also change the description to include the modifications you made @dengziming I have updated the PR description a bit and added a "review modifications" section. I

[GitHub] [kafka] dimitarndimitrov commented on a diff in pull request #13432: KAFKA-14821 Implement the listOffsets API with AdminApiDriver

2023-04-19 Thread via GitHub
dimitarndimitrov commented on code in PR #13432: URL: https://github.com/apache/kafka/pull/13432#discussion_r1171490648 ## clients/src/main/java/org/apache/kafka/clients/admin/internals/ListOffsetsHandler.java: ## @@ -0,0 +1,212 @@ +/* + * Licensed to the Apache Software Foundat

[jira] [Commented] (KAFKA-14586) Move StreamsResetter to tools

2023-04-19 Thread Sagar Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17714140#comment-17714140 ] Sagar Rao commented on KAFKA-14586: --- Thanks [~fvaleri] , I created the PR.  > Move St

[GitHub] [kafka] vamossagar12 opened a new pull request, #13614: KAFKA-14586: Adding redirection for StreamsResetter

2023-04-19 Thread via GitHub
vamossagar12 opened a new pull request, #13614: URL: https://github.com/apache/kafka/pull/13614 Adding Redirection for StreamsResetter. The erstwhile StreamsResetter resided in core/src/main/scala/kafka/tools package and that's where I added this class. I tried to run the main method but

[jira] [Updated] (KAFKA-14922) kafka-streams-application-reset deletes topics not belonging to specified application-id

2023-04-19 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-14922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jørgen updated KAFKA-14922: --- Description: Slack-thread: [https://confluentcommunity.slack.com/archives/C48AHTCUQ/p1681908267206849] Whe

[jira] [Updated] (KAFKA-14922) kafka-streams-application-reset deletes topics not belonging to specified application-id

2023-04-19 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-14922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jørgen updated KAFKA-14922: --- Description: Slack-thread: [https://confluentcommunity.slack.com/archives/C48AHTCUQ/p1681908267206849] Whe

[jira] [Created] (KAFKA-14922) kafka-streams-application-reset deletes topics not belonging to specified application-id

2023-04-19 Thread Jira
Jørgen created KAFKA-14922: -- Summary: kafka-streams-application-reset deletes topics not belonging to specified application-id Key: KAFKA-14922 URL: https://issues.apache.org/jira/browse/KAFKA-14922 Project:

[jira] [Commented] (KAFKA-14084) Support SCRAM when using KRaft mode

2023-04-19 Thread Proven Provenzano (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17714103#comment-17714103 ] Proven Provenzano commented on KAFKA-14084: --- PR added for migrating SCRAM reco

  1   2   >