[GitHub] [kafka] dajac commented on pull request #10743: KIP-699: Work in progress

2021-06-04 Thread GitBox
dajac commented on pull request #10743: URL: https://github.com/apache/kafka/pull/10743#issuecomment-855188637 @mimaison Could you briefly describe the core changes that you have made in the PR? That would be helpful to dive into it. Thanks! -- This is an automated message from the

[GitHub] [kafka] gonzur commented on pull request #10824: KAFKA-12718 [WIP]: SessionWindows are closed too early

2021-06-04 Thread GitBox
gonzur commented on pull request #10824: URL: https://github.com/apache/kafka/pull/10824#issuecomment-855168047 @mjsax pull request is up. Will be back later if there are any problems with the build. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [kafka] gonzur opened a new pull request #10824: KAFKA-12718: SessionWindows are closed too early

2021-06-04 Thread GitBox
gonzur opened a new pull request #10824: URL: https://github.com/apache/kafka/pull/10824 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.* Now factors in

[GitHub] [kafka] socutes commented on a change in pull request #10815: KAFKA-12885: Add the --timeout property to kafka-leader-election.sh

2021-06-04 Thread GitBox
socutes commented on a change in pull request #10815: URL: https://github.com/apache/kafka/pull/10815#discussion_r645914909 ## File path: core/src/main/scala/kafka/admin/LeaderElectionCommand.scala ## @@ -283,6 +284,14 @@ private final class LeaderElectionCommandOptions(args:

[GitHub] [kafka] showuon commented on pull request #10820: KAFKA-12892: disable testChrootExistsAndRootIsLocked

2021-06-04 Thread GitBox
showuon commented on pull request #10820: URL: https://github.com/apache/kafka/pull/10820#issuecomment-855153747 Triggering another test to make sure disabling the test won't break the build. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [kafka] junrao commented on a change in pull request #10823: KAFKA-12897: KRaft multi-partition placement on single broker

2021-06-04 Thread GitBox
junrao commented on a change in pull request #10823: URL: https://github.com/apache/kafka/pull/10823#discussion_r645905158 ## File path: metadata/src/main/java/org/apache/kafka/controller/StripedReplicaPlacer.java ## @@ -412,14 +433,9 @@ public StripedReplicaPlacer(Random

[GitHub] [kafka] hachikuji commented on a change in pull request #10793: KAFKA-12338: Remove useless MetadataParser

2021-06-04 Thread GitBox
hachikuji commented on a change in pull request #10793: URL: https://github.com/apache/kafka/pull/10793#discussion_r645883390 ## File path: server-common/src/main/java/org/apache/kafka/server/common/serialization/AbstractApiMessageSerde.java ## @@ -69,16 +75,44 @@ public void

[jira] [Updated] (KAFKA-12370) Refactor KafkaStreams exposed metadata hierarchy

2021-06-04 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12370: -- Description: Currently in KafkaStreams we have two groups of metadata getter: 1. {code}

[GitHub] [kafka] guozhangwang commented on pull request #9441: KAFKA-10614: Ensure group state (un)load is executed in the submitted order

2021-06-04 Thread GitBox
guozhangwang commented on pull request #9441: URL: https://github.com/apache/kafka/pull/9441#issuecomment-855018136 Made another pass on the patch. LGTM! I think we can merge after resolved the conflicts. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [kafka] guozhangwang commented on a change in pull request #9441: KAFKA-10614: Ensure group state (un)load is executed in the submitted order

2021-06-04 Thread GitBox
guozhangwang commented on a change in pull request #9441: URL: https://github.com/apache/kafka/pull/9441#discussion_r645870784 ## File path: core/src/main/scala/kafka/server/KafkaApis.scala ## @@ -279,30 +279,33 @@ class KafkaApis(val requestChannel: RequestChannel,

[GitHub] [kafka] guozhangwang commented on a change in pull request #10731: KAFKA-12815: Update JavaDocs of ValueTransformerWithKey

2021-06-04 Thread GitBox
guozhangwang commented on a change in pull request #10731: URL: https://github.com/apache/kafka/pull/10731#discussion_r645869785 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KTableTransformValues.java ## @@ -158,7 +158,11 @@ public void

[GitHub] [kafka] rondagostino opened a new pull request #10823: KAFKA-12897: KRaft multi-partition placement on single broker

2021-06-04 Thread GitBox
rondagostino opened a new pull request #10823: URL: https://github.com/apache/kafka/pull/10823 https://github.com/apache/kafka/pull/10494 introduced a bug in the KRaft controller where the controller will loop forever in `StripedReplicaPlacer` trying to identify the racks on which to

[jira] [Updated] (KAFKA-12897) KRaft Controller cannot create topic with multiple partitions on a single broker cluster

2021-06-04 Thread Ron Dagostino (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Dagostino updated KAFKA-12897: -- Description: https://github.com/apache/kafka/pull/10494 introduced a bug in the KRaft

[jira] [Updated] (KAFKA-12897) KRaft Controller cannot create topic with multiple partitions on a single broker cluster

2021-06-04 Thread Ron Dagostino (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Dagostino updated KAFKA-12897: -- Summary: KRaft Controller cannot create topic with multiple partitions on a single broker

[GitHub] [kafka] mumrah commented on pull request #10809: MINOR: Style fixes to KafkaRaftClient

2021-06-04 Thread GitBox
mumrah commented on pull request #10809: URL: https://github.com/apache/kafka/pull/10809#issuecomment-854951503 @ijuma i'll send something out on the devs list -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [kafka] ijuma commented on pull request #10809: MINOR: Style fixes to KafkaRaftClient

2021-06-04 Thread GitBox
ijuma commented on pull request #10809: URL: https://github.com/apache/kafka/pull/10809#issuecomment-854951206 @mumrah We haven't and it would be good to do. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [kafka] mumrah edited a comment on pull request #10809: MINOR: Style fixes to KafkaRaftClient

2021-06-04 Thread GitBox
mumrah edited a comment on pull request #10809: URL: https://github.com/apache/kafka/pull/10809#issuecomment-854947155 @ijuma we should be able to configure the repo to require an approval from a committer for `trunk` PRs, have we looked into this? Similarly, we can set up CODEOWNERS for

[GitHub] [kafka] mumrah commented on pull request #10809: MINOR: Style fixes to KafkaRaftClient

2021-06-04 Thread GitBox
mumrah commented on pull request #10809: URL: https://github.com/apache/kafka/pull/10809#issuecomment-854947155 @ijuma we should be able to configure the repo to require an approval from a committer, have we looked into this? Similarly, we can set up CODEOWNERS for different areas of the

[GitHub] [kafka] kpatelatwork opened a new pull request #10822: WIP: Kafka 4793 -Connect API to restart connector and tasks

2021-06-04 Thread GitBox
kpatelatwork opened a new pull request #10822: URL: https://github.com/apache/kafka/pull/10822 Implements [KIP-745](https://cwiki.apache.org/confluence/display/KAFKA/KIP-745%3A+Connect+API+to+restart+connector+and+tasks) Testing strategy - [ ] Unit tests added for all possible

[jira] [Commented] (KAFKA-12847) Dockerfile needed for kafka system tests needs changes

2021-06-04 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17357532#comment-17357532 ] Chia-Ping Tsai commented on KAFKA-12847: {quote} string literal "UID" itself whose value can't

[jira] [Updated] (KAFKA-12847) Dockerfile needed for kafka system tests needs changes

2021-06-04 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai updated KAFKA-12847: --- Attachment: 截圖 2021-06-05 上午1.53.17.png > Dockerfile needed for kafka system tests needs

[jira] [Commented] (KAFKA-12847) Dockerfile needed for kafka system tests needs changes

2021-06-04 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17357529#comment-17357529 ] Chia-Ping Tsai commented on KAFKA-12847: {quote} Are you able to run sysTests as is after

[GitHub] [kafka] mimaison commented on pull request #10743: KIP-699: Work in progress

2021-06-04 Thread GitBox
mimaison commented on pull request #10743: URL: https://github.com/apache/kafka/pull/10743#issuecomment-854895087 @rajinisivaram @tombentley @dajac Can you take a look? Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [kafka] soarez opened a new pull request #10821: KAFKA-12892: Use dedicated root in ZK ACL test

2021-06-04 Thread GitBox
soarez opened a new pull request #10821: URL: https://github.com/apache/kafka/pull/10821 Having the `testChrootExistsAndRootIsLocked` test in a separate `ZookeeperTestHarness` isn't enough to prevent the ACL changes to the ZK root from affecting other integration tests. So instead, let's

[GitHub] [kafka] junrao merged pull request #10819: MINOR: LogLoader: Add log identifier in few missing areas

2021-06-04 Thread GitBox
junrao merged pull request #10819: URL: https://github.com/apache/kafka/pull/10819 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [kafka] hachikuji commented on pull request #10814: KAFKA-12888; Add transaction tool from KIP-664

2021-06-04 Thread GitBox
hachikuji commented on pull request #10814: URL: https://github.com/apache/kafka/pull/10814#issuecomment-854841705 @abbccdda Thanks. Fallout from the upgrade to argparse4j. I will push another commit today to fix it. -- This is an automated message from the Apache Git Service. To

[jira] [Commented] (KAFKA-12896) Group rebalance loop caused by repeated group leader JoinGroups

2021-06-04 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17357446#comment-17357446 ] David Jacot commented on KAFKA-12896: - I have found a bug while investigating this one:

[jira] [Assigned] (KAFKA-12896) Group rebalance loop caused by repeated group leader JoinGroups

2021-06-04 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot reassigned KAFKA-12896: --- Assignee: David Jacot > Group rebalance loop caused by repeated group leader JoinGroups >

[jira] [Created] (KAFKA-12898) Owned partitions in the subscription must be sorted

2021-06-04 Thread David Jacot (Jira)
David Jacot created KAFKA-12898: --- Summary: Owned partitions in the subscription must be sorted Key: KAFKA-12898 URL: https://issues.apache.org/jira/browse/KAFKA-12898 Project: Kafka Issue

[GitHub] [kafka] guozhangwang merged pull request #10646: KAFKA-8897 Follow-up: Consolidate the global state stores

2021-06-04 Thread GitBox
guozhangwang merged pull request #10646: URL: https://github.com/apache/kafka/pull/10646 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [kafka] wenbingshen commented on a change in pull request #10815: KAFKA-12885: Add the --timeout property to kafka-leader-election.sh

2021-06-04 Thread GitBox
wenbingshen commented on a change in pull request #10815: URL: https://github.com/apache/kafka/pull/10815#discussion_r645660141 ## File path: core/src/main/scala/kafka/admin/LeaderElectionCommand.scala ## @@ -283,6 +284,14 @@ private final class

[GitHub] [kafka] satishd commented on a change in pull request #10271: KAFKA-12429: Added serdes for the default implementation of RLMM based on an internal topic as storage.

2021-06-04 Thread GitBox
satishd commented on a change in pull request #10271: URL: https://github.com/apache/kafka/pull/10271#discussion_r645659750 ## File path: raft/src/main/java/org/apache/kafka/raft/metadata/AbstractApiMessageSerde.java ## @@ -0,0 +1,93 @@ +/* + * Licensed to the Apache Software

[jira] [Updated] (KAFKA-12897) KRaft Controller cannot create topic with replication factor greater than number of racks

2021-06-04 Thread Ron Dagostino (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Dagostino updated KAFKA-12897: -- Description: https://github.com/apache/kafka/pull/10494 introduced a bug in the KRaft

[jira] [Updated] (KAFKA-12897) KRaft Controller cannot create topic with replication factor greater than number of racks

2021-06-04 Thread Ron Dagostino (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Dagostino updated KAFKA-12897: -- Summary: KRaft Controller cannot create topic with replication factor greater than number of

[jira] [Updated] (KAFKA-12897) ca

2021-06-04 Thread Ron Dagostino (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Dagostino updated KAFKA-12897: -- Description: https://github.com/apache/kafka/pull/10494 introduced a bug in the KRaft

[jira] [Updated] (KAFKA-12897) KRaft Controller cannot create topic with more replicas than racks

2021-06-04 Thread Ron Dagostino (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Dagostino updated KAFKA-12897: -- Summary: KRaft Controller cannot create topic with more replicas than racks (was: KRaft

[jira] [Created] (KAFKA-12897) KRaft Controller cannot create topic with more partitions than racks

2021-06-04 Thread Ron Dagostino (Jira)
Ron Dagostino created KAFKA-12897: - Summary: KRaft Controller cannot create topic with more partitions than racks Key: KAFKA-12897 URL: https://issues.apache.org/jira/browse/KAFKA-12897 Project:

[GitHub] [kafka] ryannedolan commented on a change in pull request #10805: KAFKA-12436 KIP-720 Deprecate MirrorMaker v1

2021-06-04 Thread GitBox
ryannedolan commented on a change in pull request #10805: URL: https://github.com/apache/kafka/pull/10805#discussion_r645646248 ## File path: core/src/main/scala/kafka/tools/MirrorMaker.scala ## @@ -58,7 +58,10 @@ import scala.util.{Failure, Success, Try} *

[jira] [Assigned] (KAFKA-12892) InvalidACLException thrown in tests caused jenkins build unstable

2021-06-04 Thread Igor Soarez (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Soarez reassigned KAFKA-12892: --- Assignee: Igor Soarez > InvalidACLException thrown in tests caused jenkins build unstable

[jira] [Created] (KAFKA-12896) Group rebalance loop caused by repeated group leader JoinGroups

2021-06-04 Thread Lucas Bradstreet (Jira)
Lucas Bradstreet created KAFKA-12896: Summary: Group rebalance loop caused by repeated group leader JoinGroups Key: KAFKA-12896 URL: https://issues.apache.org/jira/browse/KAFKA-12896 Project:

[jira] [Created] (KAFKA-12895) KIP-751: Drop support for Scala 2.12 in Kafka 4.0 (deprecate in 3.0)

2021-06-04 Thread Ismael Juma (Jira)
Ismael Juma created KAFKA-12895: --- Summary: KIP-751: Drop support for Scala 2.12 in Kafka 4.0 (deprecate in 3.0) Key: KAFKA-12895 URL: https://issues.apache.org/jira/browse/KAFKA-12895 Project: Kafka

[jira] [Created] (KAFKA-12894) KIP-750: Drop support for Java 8 in Kafka 4.0 (deprecate in 3.0)

2021-06-04 Thread Ismael Juma (Jira)
Ismael Juma created KAFKA-12894: --- Summary: KIP-750: Drop support for Java 8 in Kafka 4.0 (deprecate in 3.0) Key: KAFKA-12894 URL: https://issues.apache.org/jira/browse/KAFKA-12894 Project: Kafka

[jira] [Commented] (KAFKA-12893) MM2 fails to replicate if starting two+ nodes same time

2021-06-04 Thread Daniel Urban (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17357372#comment-17357372 ] Daniel Urban commented on KAFKA-12893: -- You might be hitting the issue of MM2 not running the

[jira] [Created] (KAFKA-12893) MM2 fails to replicate if starting two+ nodes same time

2021-06-04 Thread Tommi Vainikainen (Jira)
Tommi Vainikainen created KAFKA-12893: - Summary: MM2 fails to replicate if starting two+ nodes same time Key: KAFKA-12893 URL: https://issues.apache.org/jira/browse/KAFKA-12893 Project: Kafka

[jira] [Commented] (KAFKA-12892) InvalidACLException thrown in tests caused jenkins build unstable

2021-06-04 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17357362#comment-17357362 ] Luke Chen commented on KAFKA-12892: --- I tried to set the original root acl back, but it failed. That

[GitHub] [kafka] showuon commented on pull request #10820: KAFKA-12892: disable testChrootExistsAndRootIsLocked

2021-06-04 Thread GitBox
showuon commented on pull request #10820: URL: https://github.com/apache/kafka/pull/10820#issuecomment-854725411 @ijuma , KAFKA-12892 is the JIRA ticket. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Updated] (KAFKA-12892) InvalidACLException thrown in tests caused jenkins build unstable

2021-06-04 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen updated KAFKA-12892: -- Description: In KAFKA-12866, we fixed the issue that Kafka required ZK root access even when using a

[GitHub] [kafka] ijuma commented on pull request #10820: KAFKA-12892: disable testChrootExistsAndRootIsLocked

2021-06-04 Thread GitBox
ijuma commented on pull request #10820: URL: https://github.com/apache/kafka/pull/10820#issuecomment-854724264 @omkreddy I will leave it to you to review this since you reviewed the original PR. If this is failing often, it makes sense to disable temporarily, but we need a JIRA to fix the

[GitHub] [kafka] showuon commented on pull request #10820: KAFKA-12892: disable testChrootExistsAndRootIsLocked

2021-06-04 Thread GitBox
showuon commented on pull request #10820: URL: https://github.com/apache/kafka/pull/10820#issuecomment-854722099 @ijuma @omkreddy , could you take a look? This test keeps failing the jenkins build, I think we should disable it before we know how to avoid breaking jenkins build. Thanks.

[GitHub] [kafka] showuon opened a new pull request #10820: KAFKA-12892: disable testChrootExistsAndRootIsLocked

2021-06-04 Thread GitBox
showuon opened a new pull request #10820: URL: https://github.com/apache/kafka/pull/10820 Detail is described in https://issues.apache.org/jira/browse/KAFKA-12892. Thanks. ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ]

[jira] [Created] (KAFKA-12892) InvalidACLException thrown in tests caused jenkins build unstable

2021-06-04 Thread Luke Chen (Jira)
Luke Chen created KAFKA-12892: - Summary: InvalidACLException thrown in tests caused jenkins build unstable Key: KAFKA-12892 URL: https://issues.apache.org/jira/browse/KAFKA-12892 Project: Kafka

[GitHub] [kafka] showuon commented on a change in pull request #10794: KAFKA-12677: parse envelope response to check if not_controller error existed

2021-06-04 Thread GitBox
showuon commented on a change in pull request #10794: URL: https://github.com/apache/kafka/pull/10794#discussion_r645522757 ## File path: build.gradle ## @@ -829,6 +829,7 @@ project(':core') { testImplementation(libs.jfreechart) { exclude group: 'junit', module:

[jira] [Commented] (KAFKA-12847) Dockerfile needed for kafka system tests needs changes

2021-06-04 Thread Abhijit Mane (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17357273#comment-17357273 ] Abhijit Mane commented on KAFKA-12847: -- Thanks [~chia7712] I guess my detailed explanation was not

[GitHub] [kafka] kowshik commented on pull request #10819: MINOR: LogLoader: Add log identifier in few missing areas

2021-06-04 Thread GitBox
kowshik commented on pull request #10819: URL: https://github.com/apache/kafka/pull/10819#issuecomment-854621853 @junrao Please could you help review this small change? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [kafka] kowshik opened a new pull request #10819: MINOR: LogLoader: Add log identifier at few missing areas

2021-06-04 Thread GitBox
kowshik opened a new pull request #10819: URL: https://github.com/apache/kafka/pull/10819 While reading the code, I noticed that `LogLoader` had a few points where the log identifier was not printed as part of the log message. I've fixed it in this PR. **Tests:** Rely on

[GitHub] [kafka] kowshik edited a comment on pull request #10280: KAFKA-12554: Refactor Log layer

2021-06-04 Thread GitBox
kowshik edited a comment on pull request #10280: URL: https://github.com/apache/kafka/pull/10280#issuecomment-854616475 @junrao Thanks for the review! I've addressed your comments in e201295e03e0ea8a7102983888d1a7afc66d384a, and have also rebased this PR onto most recent commit in

[GitHub] [kafka] kowshik edited a comment on pull request #10280: KAFKA-12554: Refactor Log layer

2021-06-04 Thread GitBox
kowshik edited a comment on pull request #10280: URL: https://github.com/apache/kafka/pull/10280#issuecomment-854616475 @junrao Thanks for the review! I've addressed your comments in e201295e03e0ea8a7102983888d1a7afc66d384a, and have also rebased this PR onto most recent commit in

[GitHub] [kafka] kowshik commented on pull request #10280: KAFKA-12554: Refactor Log layer

2021-06-04 Thread GitBox
kowshik commented on pull request #10280: URL: https://github.com/apache/kafka/pull/10280#issuecomment-854616475 @junrao Thanks for the review! I've addressed the comments in e201295e03e0ea8a7102983888d1a7afc66d384a, and have also rebased this PR onto most recent commit in `trunk`. It is

[GitHub] [kafka] sarwarbhuiyan commented on pull request #7499: KAFKA-5682: Include partitions in exceptions raised during consumer record deserialization/validation

2021-06-04 Thread GitBox
sarwarbhuiyan commented on pull request #7499: URL: https://github.com/apache/kafka/pull/7499#issuecomment-854551022 KIP passed voting -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Created] (KAFKA-12891) Add --files and --file-separator options to the ConsoleProducer

2021-06-04 Thread Wenbing Shen (Jira)
Wenbing Shen created KAFKA-12891: Summary: Add --files and --file-separator options to the ConsoleProducer Key: KAFKA-12891 URL: https://issues.apache.org/jira/browse/KAFKA-12891 Project: Kafka

[GitHub] [kafka] kowshik commented on a change in pull request #10280: KAFKA-12554: Refactor Log layer

2021-06-04 Thread GitBox
kowshik commented on a change in pull request #10280: URL: https://github.com/apache/kafka/pull/10280#discussion_r645441207 ## File path: core/src/main/scala/kafka/log/LogLoader.scala ## @@ -246,17 +262,17 @@ object LogLoader extends Logging { return fn } catch

[GitHub] [kafka] kowshik commented on a change in pull request #10280: KAFKA-12554: Refactor Log layer

2021-06-04 Thread GitBox
kowshik commented on a change in pull request #10280: URL: https://github.com/apache/kafka/pull/10280#discussion_r645439645 ## File path: core/src/test/scala/unit/kafka/log/LocalLogTest.scala ## @@ -0,0 +1,734 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] [kafka] kowshik commented on a change in pull request #10280: KAFKA-12554: Refactor Log layer

2021-06-04 Thread GitBox
kowshik commented on a change in pull request #10280: URL: https://github.com/apache/kafka/pull/10280#discussion_r645439534 ## File path: core/src/test/scala/unit/kafka/log/LocalLogTest.scala ## @@ -0,0 +1,734 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] [kafka] kowshik commented on a change in pull request #10280: KAFKA-12554: Refactor Log layer

2021-06-04 Thread GitBox
kowshik commented on a change in pull request #10280: URL: https://github.com/apache/kafka/pull/10280#discussion_r645437580 ## File path: core/src/test/scala/unit/kafka/log/LocalLogTest.scala ## @@ -0,0 +1,734 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] [kafka] kowshik commented on a change in pull request #10280: KAFKA-12554: Refactor Log layer

2021-06-04 Thread GitBox
kowshik commented on a change in pull request #10280: URL: https://github.com/apache/kafka/pull/10280#discussion_r645437282 ## File path: core/src/main/scala/kafka/log/Log.scala ## @@ -1500,50 +1325,67 @@ class Log(@volatile private var _dir: File, } } -

[GitHub] [kafka] kowshik commented on a change in pull request #10280: KAFKA-12554: Refactor Log layer

2021-06-04 Thread GitBox
kowshik commented on a change in pull request #10280: URL: https://github.com/apache/kafka/pull/10280#discussion_r645434947 ## File path: core/src/main/scala/kafka/log/Log.scala ## @@ -1500,50 +1325,67 @@ class Log(@volatile private var _dir: File, } } -

[GitHub] [kafka] kowshik commented on a change in pull request #10280: KAFKA-12554: Refactor Log layer

2021-06-04 Thread GitBox
kowshik commented on a change in pull request #10280: URL: https://github.com/apache/kafka/pull/10280#discussion_r643465477 ## File path: core/src/test/scala/unit/kafka/log/LocalLogTest.scala ## @@ -0,0 +1,734 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] [kafka] jlprat commented on a change in pull request #10810: MINOR: Improve Kafka Streams JavaDocs with regard to record metadata

2021-06-04 Thread GitBox
jlprat commented on a change in pull request #10810: URL: https://github.com/apache/kafka/pull/10810#discussion_r645405935 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/ProcessorContext.java ## @@ -158,32 +165,52 @@ Cancellable schedule(final Duration

[GitHub] [kafka] ijuma commented on pull request #9302: KAFKA-10149: Allow auto preferred leader election when partitions are reassigning

2021-06-04 Thread GitBox
ijuma commented on pull request #9302: URL: https://github.com/apache/kafka/pull/9302#issuecomment-854395748 Is this still relevant? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [kafka] ijuma merged pull request #10471: KAFKA-12597: remove deprecated zookeeper option in ReassignPartitionsCommand

2021-06-04 Thread GitBox
ijuma merged pull request #10471: URL: https://github.com/apache/kafka/pull/10471 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [kafka] showuon commented on a change in pull request #10794: KAFKA-12677: parse envelope response to check if not_controller error existed

2021-06-04 Thread GitBox
showuon commented on a change in pull request #10794: URL: https://github.com/apache/kafka/pull/10794#discussion_r645321936 ## File path: build.gradle ## @@ -829,6 +829,7 @@ project(':core') { testImplementation(libs.jfreechart) { exclude group: 'junit', module:

[GitHub] [kafka] socutes commented on pull request #10815: KAFKA-12885: Add the --timeout property to kafka-leader-election.sh

2021-06-04 Thread GitBox
socutes commented on pull request #10815: URL: https://github.com/apache/kafka/pull/10815#issuecomment-854395260 @showuon , please help review this PR. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [kafka] ijuma commented on a change in pull request #10794: KAFKA-12677: parse envelope response to check if not_controller error existed

2021-06-04 Thread GitBox
ijuma commented on a change in pull request #10794: URL: https://github.com/apache/kafka/pull/10794#discussion_r645318499 ## File path: build.gradle ## @@ -829,6 +829,7 @@ project(':core') { testImplementation(libs.jfreechart) { exclude group: 'junit', module:

[GitHub] [kafka] abbccdda commented on pull request #10809: MINOR: Style fixes to KafkaRaftClient

2021-06-04 Thread GitBox
abbccdda commented on pull request #10809: URL: https://github.com/apache/kafka/pull/10809#issuecomment-854402436 @ijuma That's a good call, should I revert it? It was just a styling change PR. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [kafka] mjsax commented on a change in pull request #10813: KAFKA-9559: Change default serde to be `null`

2021-06-04 Thread GitBox
mjsax commented on a change in pull request #10813: URL: https://github.com/apache/kafka/pull/10813#discussion_r645299252 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/ChangedSerializer.java ## @@ -40,7 +40,10 @@ public ChangedSerializer(final

[GitHub] [kafka] mjsax commented on pull request #10813: KAFKA-9559: Change default serde to be `null`

2021-06-04 Thread GitBox
mjsax commented on pull request #10813: URL: https://github.com/apache/kafka/pull/10813#issuecomment-854379331 How confident are we, that we covered most cases to avoid NPE and throw ConfigException? Seems it's still many places that we need to cover, and I am wondering if we follow the

[GitHub] [kafka] ijuma commented on pull request #10471: KAFKA-12597: remove deprecated zookeeper option in ReassignPartitionsCommand

2021-06-04 Thread GitBox
ijuma commented on pull request #10471: URL: https://github.com/apache/kafka/pull/10471#issuecomment-854399316 Unrelated test failures: > Build / JDK 11 and Scala 2.13 / kafka.server.RaftClusterTest.testCreateClusterAndCreateListDeleteTopic() | 16 sec | 1 > -- | -- | -- >

[GitHub] [kafka] ijuma commented on pull request #10809: MINOR: Style fixes to KafkaRaftClient

2021-06-04 Thread GitBox
ijuma commented on pull request #10809: URL: https://github.com/apache/kafka/pull/10809#issuecomment-854385011 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries

[GitHub] [kafka] ijuma commented on a change in pull request #10805: KAFKA-12436 KIP-720 Deprecate MirrorMaker v1

2021-06-04 Thread GitBox
ijuma commented on a change in pull request #10805: URL: https://github.com/apache/kafka/pull/10805#discussion_r645317670 ## File path: core/src/main/scala/kafka/tools/MirrorMaker.scala ## @@ -58,7 +58,10 @@ import scala.util.{Failure, Success, Try} *

[GitHub] [kafka] ijuma edited a comment on pull request #10471: KAFKA-12597: remove deprecated zookeeper option in ReassignPartitionsCommand

2021-06-04 Thread GitBox
ijuma edited a comment on pull request #10471: URL: https://github.com/apache/kafka/pull/10471#issuecomment-854399316 Unrelated test failures: > Build / JDK 11 and Scala 2.13 / kafka.server.RaftClusterTest.testCreateClusterAndCreateListDeleteTopic() > Build / JDK 11 and Scala

[GitHub] [kafka] dongjinleekr commented on pull request #10678: TRIVIAL: Fix type inconsistencies, unthrown exceptions, etc

2021-06-04 Thread GitBox
dongjinleekr commented on pull request #10678: URL: https://github.com/apache/kafka/pull/10678#issuecomment-853838170 @ableegoldman Could you have a look? :pray: -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [kafka] ryannedolan commented on pull request #10652: KAFKA-9726 IdentityReplicationPolicy

2021-06-04 Thread GitBox
ryannedolan commented on pull request #10652: URL: https://github.com/apache/kafka/pull/10652#issuecomment-854215843 None of the failing tests are related. Ready to merge. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [kafka] dongjinleekr commented on pull request #10428: KAFKA-12572: Add import ordering checkstyle rule and configure an automatic formatter

2021-06-04 Thread GitBox
dongjinleekr commented on pull request #10428: URL: https://github.com/apache/kafka/pull/10428#issuecomment-853821984 @cadonna Here it is, with the following: 1. making server-common to ignore import orders. 2. rebasing onto the latest trunk. +1. It seems like we can make the

[GitHub] [kafka] hachikuji commented on a change in pull request #10793: KAFKA-12338: Remove useless MetadataParser

2021-06-04 Thread GitBox
hachikuji commented on a change in pull request #10793: URL: https://github.com/apache/kafka/pull/10793#discussion_r645084226 ## File path: server-common/src/main/java/org/apache/kafka/server/common/serialization/AbstractApiMessageSerde.java ## @@ -69,16 +76,42 @@ public void

[GitHub] [kafka] dejan2609 commented on pull request #10428: KAFKA-12572: Add import ordering checkstyle rule and configure an automatic formatter

2021-06-04 Thread GitBox
dejan2609 commented on pull request #10428: URL: https://github.com/apache/kafka/pull/10428#issuecomment-853411084 Shameless plug and related to CheckStyle: ⏩ #10698 (needs a review / approval). -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [kafka] dengziming commented on a change in pull request #10793: KAFKA-12338: Remove useless MetadataParser

2021-06-04 Thread GitBox
dengziming commented on a change in pull request #10793: URL: https://github.com/apache/kafka/pull/10793#discussion_r645205625 ## File path: server-common/src/main/java/org/apache/kafka/server/common/serialization/AbstractApiMessageSerde.java ## @@ -69,16 +76,42 @@ public

[GitHub] [kafka] dejan2609 commented on pull request #10698: KAFKA-12770: introduce `checkstyleVersion` build option (for overriding CheckStyle project-defined dependency version)

2021-06-04 Thread GitBox
dejan2609 commented on pull request #10698: URL: https://github.com/apache/kafka/pull/10698#issuecomment-853408053 Just tagging @ijuma here again (to come back up to the surface). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [kafka] guozhangwang commented on a change in pull request #10609: KAFKA-12648: Pt. 1 - Add NamedTopology to protocol and state directory structure

2021-06-04 Thread GitBox
guozhangwang commented on a change in pull request #10609: URL: https://github.com/apache/kafka/pull/10609#discussion_r644343550 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/assignment/SubscriptionInfo.java ## @@ -125,6 +130,29 @@ public

[GitHub] [kafka] dengziming commented on pull request #10793: KAFKA-12338: Remove useless MetadataParser

2021-06-04 Thread GitBox
dengziming commented on pull request #10793: URL: https://github.com/apache/kafka/pull/10793#issuecomment-853911013 @hachikuji Thanks for the remindings, I think the validations in `read` are useful and I copied them to `MetadataRecordSerde`, but not sure whether the

[GitHub] [kafka] dongjinleekr commented on a change in pull request #10507: KAFKA-8410: Migrating stateful operators to new Processor API

2021-06-04 Thread GitBox
dongjinleekr commented on a change in pull request #10507: URL: https://github.com/apache/kafka/pull/10507#discussion_r644545454 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/AbstractStream.java ## @@ -16,6 +16,10 @@ */ package

[GitHub] [kafka] cadonna commented on a change in pull request #10428: KAFKA-12572: Add import ordering checkstyle rule and configure an automatic formatter

2021-06-04 Thread GitBox
cadonna commented on a change in pull request #10428: URL: https://github.com/apache/kafka/pull/10428#discussion_r644711679 ## File path: core/src/main/java/kafka/metrics/FilteringJmxReporter.java ## @@ -51,7 +50,7 @@ public void updatePredicate(Predicate predicate) {

[GitHub] [kafka] vvcephei commented on a change in pull request #10810: MINOR: Improve Kafka Streams JavaDocs with regard to record metadata

2021-06-04 Thread GitBox
vvcephei commented on a change in pull request #10810: URL: https://github.com/apache/kafka/pull/10810#discussion_r645023265 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/ProcessorContext.java ## @@ -158,32 +165,52 @@ Cancellable schedule(final

[GitHub] [kafka] tombentley commented on a change in pull request #9441: KAFKA-10614: Ensure group state (un)load is executed in the submitted order

2021-06-04 Thread GitBox
tombentley commented on a change in pull request #9441: URL: https://github.com/apache/kafka/pull/9441#discussion_r644571665 ## File path: core/src/main/scala/kafka/server/KafkaApis.scala ## @@ -279,30 +279,33 @@ class KafkaApis(val requestChannel: RequestChannel, new

[GitHub] [kafka] guozhangwang commented on pull request #10646: KAFKA-8897 Follow-up: Consolidate the global state stores

2021-06-04 Thread GitBox
guozhangwang commented on pull request #10646: URL: https://github.com/apache/kafka/pull/10646#issuecomment-854262242 @cadonna 1. Filed a ticket for KStreams to enforce shutdown on illegal-X exceptions as a future work. 2. Let the global state mgr to do closing before throwing

[GitHub] [kafka] vamossagar12 commented on a change in pull request #10798: KAFKA-9168: Adding direct byte buffer support to rocksdb state store

2021-06-04 Thread GitBox
vamossagar12 commented on a change in pull request #10798: URL: https://github.com/apache/kafka/pull/10798#discussion_r644616944 ## File path: streams/src/main/java/org/apache/kafka/streams/state/internals/RocksDBStore.java ## @@ -505,6 +506,14 @@ private void

[GitHub] [kafka] mjsax commented on a change in pull request #10810: MINOR: Improve Kafka Streams JavaDocs with regard to record metadata

2021-06-04 Thread GitBox
mjsax commented on a change in pull request #10810: URL: https://github.com/apache/kafka/pull/10810#discussion_r644509797 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/ProcessorContext.java ## @@ -158,32 +165,52 @@ Cancellable schedule(final Duration

[GitHub] [kafka] mdedetrich edited a comment on pull request #10648: KAFKA-9726: Add IdentityReplicationPolicy for MM2

2021-06-04 Thread GitBox
mdedetrich edited a comment on pull request #10648: URL: https://github.com/apache/kafka/pull/10648#issuecomment-835180661 @mimaison I have just renamed `LegacyReplicationPolicy` to `IdentityReplicationPolicy` and forced pushed the branch. @ryannedolan I will have a look at

[GitHub] [kafka] jlprat commented on pull request #10784: KAFKA-12862: Update Scala fmt library and apply fixes

2021-06-04 Thread GitBox
jlprat commented on pull request #10784: URL: https://github.com/apache/kafka/pull/10784#issuecomment-854078089 Any chance any of you has time to check this? cc @mjsax @vvcephei @guozhangwang Thanks! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [kafka] showuon commented on pull request #10471: KAFKA-12597: remove deprecated zookeeper option in ReassignPartitionsCommand

2021-06-04 Thread GitBox
showuon commented on pull request #10471: URL: https://github.com/apache/kafka/pull/10471#issuecomment-853665420 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [kafka] showuon edited a comment on pull request #10794: KAFKA-12677: parse envelope response to check if not_controller error existed

2021-06-04 Thread GitBox
showuon edited a comment on pull request #10794: URL: https://github.com/apache/kafka/pull/10794#issuecomment-853761494 @hachikuji @mumrah @abbccdda @cmccabe , call for review since the tests keep failing. Thank you. -- This is an automated message from the Apache Git Service. To

  1   2   >