[GitHub] [kafka] chia7712 opened a new pull request #9128: KAFKA-7540 reduce session timeout to evict dead member in time and so…

2020-08-05 Thread GitBox
chia7712 opened a new pull request #9128: URL: https://github.com/apache/kafka/pull/9128 issue: https://issues.apache.org/jira/browse/KAFKA-7540 In short, the LEAVE_GROUP is sent to a shutdown broker so the dead member which is left in the group obstructs broker from completing rebal

[GitHub] [kafka] chia7712 commented on pull request #9128: KAFKA-7540 reduce session timeout to evict dead member in time and so…

2020-08-05 Thread GitBox
chia7712 commented on pull request #9128: URL: https://github.com/apache/kafka/pull/9128#issuecomment-669020702 I have looped the test 40 times. all pass This is an automated message from the Apache Git Service. To respond to

[GitHub] [kafka] omkreddy commented on pull request #9050: KAFKA-10193: Add preemption for controller events that have callbacks

2020-08-05 Thread GitBox
omkreddy commented on pull request #9050: URL: https://github.com/apache/kafka/pull/9050#issuecomment-669040004 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [kafka] kowshik commented on a change in pull request #9001: KAFKA-10028: Implement write path for feature versioning system (KIP-584)

2020-08-05 Thread GitBox
kowshik commented on a change in pull request #9001: URL: https://github.com/apache/kafka/pull/9001#discussion_r465565925 ## File path: core/src/main/scala/kafka/controller/KafkaController.scala ## @@ -266,6 +275,178 @@ class KafkaController(val config: KafkaConfig, } }

[GitHub] [kafka] kowshik commented on a change in pull request #9001: KAFKA-10028: Implement write path for feature versioning system (KIP-584)

2020-08-05 Thread GitBox
kowshik commented on a change in pull request #9001: URL: https://github.com/apache/kafka/pull/9001#discussion_r463934710 ## File path: core/src/main/scala/kafka/controller/KafkaController.scala ## @@ -266,6 +275,179 @@ class KafkaController(val config: KafkaConfig, } }

[GitHub] [kafka] kowshik commented on a change in pull request #9001: KAFKA-10028: Implement write path for feature versioning system (KIP-584)

2020-08-05 Thread GitBox
kowshik commented on a change in pull request #9001: URL: https://github.com/apache/kafka/pull/9001#discussion_r465570359 ## File path: core/src/main/scala/kafka/server/KafkaApis.scala ## @@ -2945,6 +2948,130 @@ class KafkaApis(val requestChannel: RequestChannel, } }

[GitHub] [kafka] kowshik commented on a change in pull request #9001: KAFKA-10028: Implement write path for feature versioning system (KIP-584)

2020-08-05 Thread GitBox
kowshik commented on a change in pull request #9001: URL: https://github.com/apache/kafka/pull/9001#discussion_r465572011 ## File path: clients/src/main/resources/common/message/UpdateFeaturesResponse.json ## @@ -0,0 +1,33 @@ +// Licensed to the Apache Software Foundation (ASF)

[GitHub] [kafka] kowshik commented on a change in pull request #9001: KAFKA-10028: Implement write path for feature versioning system (KIP-584)

2020-08-05 Thread GitBox
kowshik commented on a change in pull request #9001: URL: https://github.com/apache/kafka/pull/9001#discussion_r465572011 ## File path: clients/src/main/resources/common/message/UpdateFeaturesResponse.json ## @@ -0,0 +1,33 @@ +// Licensed to the Apache Software Foundation (ASF)

[GitHub] [kafka] kowshik commented on a change in pull request #9001: KAFKA-10028: Implement write path for feature versioning system (KIP-584)

2020-08-05 Thread GitBox
kowshik commented on a change in pull request #9001: URL: https://github.com/apache/kafka/pull/9001#discussion_r465572011 ## File path: clients/src/main/resources/common/message/UpdateFeaturesResponse.json ## @@ -0,0 +1,33 @@ +// Licensed to the Apache Software Foundation (ASF)

[jira] [Issue Comment Deleted] (KAFKA-10095) In LogCleanerManagerTest replace get().nonEmpty call with contains

2020-08-05 Thread Thomas Reuhl (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Reuhl updated KAFKA-10095: - Comment: was deleted (was: {{I'm a newbie to kafka and would like to pick up the issue. One idea

[jira] [Created] (KAFKA-10363) Broker try to connect to a new cluster when there are changes in zookeeper.connect properties

2020-08-05 Thread Alexey Kornev (Jira)
Alexey Kornev created KAFKA-10363: - Summary: Broker try to connect to a new cluster when there are changes in zookeeper.connect properties Key: KAFKA-10363 URL: https://issues.apache.org/jira/browse/KAFKA-10363

[jira] [Updated] (KAFKA-10363) Broker try to connect to a new cluster when there are changes in zookeeper.connect properties

2020-08-05 Thread Alexey Kornev (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kornev updated KAFKA-10363: -- Description: We've just successfully set up a Kafka cluster consists of 3 brokers and faced w

[GitHub] [kafka] cmccabe commented on a change in pull request #9100: Add AlterISR RPC and use it for ISR modifications

2020-08-05 Thread GitBox
cmccabe commented on a change in pull request #9100: URL: https://github.com/apache/kafka/pull/9100#discussion_r465708837 ## File path: core/src/main/scala/kafka/cluster/Partition.scala ## @@ -1212,17 +1221,32 @@ class Partition(val topicPartition: TopicPartition, private

[GitHub] [kafka] cmccabe commented on a change in pull request #9100: Add AlterISR RPC and use it for ISR modifications

2020-08-05 Thread GitBox
cmccabe commented on a change in pull request #9100: URL: https://github.com/apache/kafka/pull/9100#discussion_r465711962 ## File path: core/src/main/scala/kafka/controller/KafkaController.scala ## @@ -1771,6 +1775,127 @@ class KafkaController(val config: KafkaConfig, }

[GitHub] [kafka] dongjinleekr commented on pull request #8117: KAFKA-8403: Suppress needs a Materialized variant

2020-08-05 Thread GitBox
dongjinleekr commented on pull request #8117: URL: https://github.com/apache/kafka/pull/8117#issuecomment-669182284 Hello. I updated the [KIP](https://cwiki.apache.org/confluence/display/KAFKA/KIP-508%3A+Make+Suppression+State+Queriable) and rebased the PR onto the latest trunk. Please hav

[GitHub] [kafka] cmccabe commented on a change in pull request #9100: Add AlterISR RPC and use it for ISR modifications

2020-08-05 Thread GitBox
cmccabe commented on a change in pull request #9100: URL: https://github.com/apache/kafka/pull/9100#discussion_r465712943 ## File path: core/src/main/scala/kafka/server/BrokerToControllerChannelManager.scala ## @@ -113,8 +113,8 @@ class BrokerToControllerChannelManager(metadat

[GitHub] [kafka] cmccabe commented on a change in pull request #9100: Add AlterISR RPC and use it for ISR modifications

2020-08-05 Thread GitBox
cmccabe commented on a change in pull request #9100: URL: https://github.com/apache/kafka/pull/9100#discussion_r465715770 ## File path: core/src/main/scala/kafka/server/AlterIsrChannelManager.scala ## @@ -0,0 +1,121 @@ +package kafka.server Review comment: It would be g

[GitHub] [kafka] dongjinleekr commented on pull request #7898: KAFKA-9366: Change log4j dependency into log4j2

2020-08-05 Thread GitBox
dongjinleekr commented on pull request #7898: URL: https://github.com/apache/kafka/pull/7898#issuecomment-669229785 Here is the KIP - [KIP-653: Upgrade log4j to log4j2](https://cwiki.apache.org/confluence/display/KAFKA/KIP-653%3A+Upgrade+log4j+to+log4j2) @omkreddy Could you have a lo

[GitHub] [kafka] lct45 commented on a change in pull request #9039: KAFKA-5636: SlidingWindows (KIP-450)

2020-08-05 Thread GitBox
lct45 commented on a change in pull request #9039: URL: https://github.com/apache/kafka/pull/9039#discussion_r465756356 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -0,0 +1,391 @@ +/* + * Licensed to th

[GitHub] [kafka] ijuma commented on pull request #9129: MINOR: Update jmh to 1.24 for async profiler support

2020-08-05 Thread GitBox
ijuma commented on pull request #9129: URL: https://github.com/apache/kafka/pull/9129#issuecomment-669221375 Actually, it looks like I need to improve the jmh script to make this easier to use. Will also update the README. So, please don't review it yet. --

[GitHub] [kafka] mumrah commented on a change in pull request #9100: Add AlterISR RPC and use it for ISR modifications

2020-08-05 Thread GitBox
mumrah commented on a change in pull request #9100: URL: https://github.com/apache/kafka/pull/9100#discussion_r465743922 ## File path: core/src/main/scala/kafka/controller/KafkaController.scala ## @@ -1771,6 +1775,127 @@ class KafkaController(val config: KafkaConfig, }

[GitHub] [kafka] rondagostino commented on a change in pull request #9032: KAFKA-10259: KIP-554 Broker-side SCRAM Config API

2020-08-05 Thread GitBox
rondagostino commented on a change in pull request #9032: URL: https://github.com/apache/kafka/pull/9032#discussion_r465744271 ## File path: clients/src/main/java/org/apache/kafka/clients/admin/KafkaAdminClient.java ## @@ -4071,6 +4081,168 @@ void handleFailure(Throwable throw

[GitHub] [kafka] johnthotekat commented on pull request #9120: KAFKA-10316: Consider renaming getter method for Interactive Queries

2020-08-05 Thread GitBox
johnthotekat commented on pull request #9120: URL: https://github.com/apache/kafka/pull/9120#issuecomment-669241684 @mjsax One of the test failed for me in local, This one - KafkaAdminClientTest#testMetadataRetries. It's unrelated to the changes in this PR. Rest of the tests PASSED

[GitHub] [kafka] johnthotekat edited a comment on pull request #9120: KAFKA-10316: Consider renaming getter method for Interactive Queries

2020-08-05 Thread GitBox
johnthotekat edited a comment on pull request #9120: URL: https://github.com/apache/kafka/pull/9120#issuecomment-669241684 @mjsax One of the test failed for me in local, This one - KafkaAdminClientTest#testMetadataRetries. It's unrelated to the changes in this PR. Rest of the tests

[GitHub] [kafka] mumrah commented on a change in pull request #9100: Add AlterISR RPC and use it for ISR modifications

2020-08-05 Thread GitBox
mumrah commented on a change in pull request #9100: URL: https://github.com/apache/kafka/pull/9100#discussion_r465746162 ## File path: core/src/main/scala/kafka/controller/KafkaController.scala ## @@ -1771,6 +1776,141 @@ class KafkaController(val config: KafkaConfig, }

[GitHub] [kafka] ijuma opened a new pull request #9129: MINOR: Update jmh to 1.24 for async profiler support

2020-08-05 Thread GitBox
ijuma opened a new pull request #9129: URL: https://github.com/apache/kafka/pull/9129 Highlights: * async-profiler integration. Can be used with -prof async, pass -prof async:help to look for the accepted options. * perf c2c [2] integration. Can be used with -prof perfc2c, if

[GitHub] [kafka] johnthotekat edited a comment on pull request #9120: KAFKA-10316: Consider renaming getter method for Interactive Queries

2020-08-05 Thread GitBox
johnthotekat edited a comment on pull request #9120: URL: https://github.com/apache/kafka/pull/9120#issuecomment-669241684 @mjsax One of the test failed for me in local, This one - KafkaAdminClientTest#testMetadataRetries. It's unrelated to the changes in this PR. Rest of the tests

[GitHub] [kafka] mumrah commented on a change in pull request #9100: Add AlterISR RPC and use it for ISR modifications

2020-08-05 Thread GitBox
mumrah commented on a change in pull request #9100: URL: https://github.com/apache/kafka/pull/9100#discussion_r465748504 ## File path: core/src/main/scala/kafka/server/AlterIsrChannelManager.scala ## @@ -0,0 +1,121 @@ +package kafka.server Review comment: Yea, maybe jus

[GitHub] [kafka] mumrah commented on a change in pull request #9100: Add AlterISR RPC and use it for ISR modifications

2020-08-05 Thread GitBox
mumrah commented on a change in pull request #9100: URL: https://github.com/apache/kafka/pull/9100#discussion_r465748120 ## File path: core/src/main/scala/kafka/controller/KafkaController.scala ## @@ -1771,6 +1776,141 @@ class KafkaController(val config: KafkaConfig, }

[jira] [Commented] (KAFKA-10339) MirrorMaker2 Exactly-once Semantics

2020-08-05 Thread Ryanne Dolan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17171519#comment-17171519 ] Ryanne Dolan commented on KAFKA-10339: -- I think what you mean is that a read-proces

[GitHub] [kafka] mumrah commented on a change in pull request #9100: Add AlterISR RPC and use it for ISR modifications

2020-08-05 Thread GitBox
mumrah commented on a change in pull request #9100: URL: https://github.com/apache/kafka/pull/9100#discussion_r465749546 ## File path: core/src/main/scala/kafka/server/AlterIsrChannelManager.scala ## @@ -0,0 +1,132 @@ +package kafka.server + +import java.util +import java.util.

[GitHub] [kafka] mumrah commented on a change in pull request #9100: Add AlterISR RPC and use it for ISR modifications

2020-08-05 Thread GitBox
mumrah commented on a change in pull request #9100: URL: https://github.com/apache/kafka/pull/9100#discussion_r465749546 ## File path: core/src/main/scala/kafka/server/AlterIsrChannelManager.scala ## @@ -0,0 +1,132 @@ +package kafka.server + +import java.util +import java.util.

[GitHub] [kafka] mumrah commented on a change in pull request #9100: Add AlterISR RPC and use it for ISR modifications

2020-08-05 Thread GitBox
mumrah commented on a change in pull request #9100: URL: https://github.com/apache/kafka/pull/9100#discussion_r465750445 ## File path: core/src/main/scala/kafka/server/AlterIsrChannelManager.scala ## @@ -0,0 +1,132 @@ +package kafka.server + +import java.util +import java.util.

[GitHub] [kafka] mumrah commented on a change in pull request #9100: Add AlterISR RPC and use it for ISR modifications

2020-08-05 Thread GitBox
mumrah commented on a change in pull request #9100: URL: https://github.com/apache/kafka/pull/9100#discussion_r465750632 ## File path: core/src/main/scala/kafka/server/AlterIsrChannelManager.scala ## @@ -0,0 +1,132 @@ +package kafka.server + +import java.util +import java.util.

[GitHub] [kafka] rondagostino commented on a change in pull request #9032: KAFKA-10259: KIP-554 Broker-side SCRAM Config API

2020-08-05 Thread GitBox
rondagostino commented on a change in pull request #9032: URL: https://github.com/apache/kafka/pull/9032#discussion_r465751005 ## File path: clients/src/main/java/org/apache/kafka/clients/admin/KafkaAdminClient.java ## @@ -4071,6 +4081,168 @@ void handleFailure(Throwable throw

[GitHub] [kafka] lct45 commented on a change in pull request #9039: KAFKA-5636: SlidingWindows (KIP-450)

2020-08-05 Thread GitBox
lct45 commented on a change in pull request #9039: URL: https://github.com/apache/kafka/pull/9039#discussion_r465751597 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamSlidingWindowAggregate.java ## @@ -0,0 +1,391 @@ +/* + * Licensed to th

[GitHub] [kafka] hachikuji opened a new pull request #9130: [DRAFT] Kafka Raft Implementation (KIP-595)

2020-08-05 Thread GitBox
hachikuji opened a new pull request #9130: URL: https://github.com/apache/kafka/pull/9130 This is a draft of the changes needed for KIP-595. The draft tag will be removed in the upcoming weeks if/when the KIP is adopted. Note that there are still a few significant protocol differences from

[GitHub] [kafka] mumrah commented on pull request #7222: KAFKA-8806 Reduce calls to validateOffsetsIfNeeded

2020-08-05 Thread GitBox
mumrah commented on pull request #7222: URL: https://github.com/apache/kafka/pull/7222#issuecomment-669259920 Reviving this PR cc @hachikuji @ijuma @andrewchoi5 This is an automated message from the Apache Git Service. To re

[jira] [Updated] (KAFKA-10334) Transactions not working properly

2020-08-05 Thread Luis Araujo (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luis Araujo updated KAFKA-10334: Description: I'm using transactions provided by Kafka Producer API in a Scala project built with

[jira] [Updated] (KAFKA-10334) Transactions not working properly

2020-08-05 Thread Luis Araujo (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luis Araujo updated KAFKA-10334: Description: I'm using transactions provided by Kafka Producer API in a Scala project built with

[jira] [Updated] (KAFKA-10334) Transactions not working properly

2020-08-05 Thread Luis Araujo (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luis Araujo updated KAFKA-10334: Description: I'm using transactions provided by Kafka Producer API in a Scala project built with

[jira] [Updated] (KAFKA-10334) Transactions not working properly

2020-08-05 Thread Luis Araujo (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luis Araujo updated KAFKA-10334: Description: I'm using transactions provided by Kafka Producer API in a Scala project built with

[jira] [Updated] (KAFKA-10334) Transactions not working properly

2020-08-05 Thread Luis Araujo (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luis Araujo updated KAFKA-10334: Description: I'm using transactions provided by Kafka Producer API in a Scala project built with

[jira] [Updated] (KAFKA-10334) Transactions not working properly

2020-08-05 Thread Luis Araujo (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luis Araujo updated KAFKA-10334: Description: I'm using transactions provided by Kafka Producer API in a Scala project built with

[jira] [Updated] (KAFKA-10334) Transactions not working properly

2020-08-05 Thread Luis Araujo (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luis Araujo updated KAFKA-10334: Description: I'm using transactions provided by Kafka Producer API in a Scala project built with

[jira] [Commented] (KAFKA-10334) Transactions not working properly

2020-08-05 Thread Luis Araujo (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17171586#comment-17171586 ] Luis Araujo commented on KAFKA-10334: - After creating this issue, I tested the await

[jira] [Updated] (KAFKA-10334) Transactions not working properly

2020-08-05 Thread Luis Araujo (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luis Araujo updated KAFKA-10334: Description: I'm using transactions provided by Kafka Producer API in a Scala project built with

[jira] [Comment Edited] (KAFKA-10339) MirrorMaker2 Exactly-once Semantics

2020-08-05 Thread Ning Zhang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17171612#comment-17171612 ] Ning Zhang edited comment on KAFKA-10339 at 8/5/20, 4:44 PM: -

[jira] [Commented] (KAFKA-10339) MirrorMaker2 Exactly-once Semantics

2020-08-05 Thread Ning Zhang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17171612#comment-17171612 ] Ning Zhang commented on KAFKA-10339: thanks for the input. I think that sounds a wor

[jira] [Comment Edited] (KAFKA-10339) MirrorMaker2 Exactly-once Semantics

2020-08-05 Thread Ning Zhang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17171612#comment-17171612 ] Ning Zhang edited comment on KAFKA-10339 at 8/5/20, 4:47 PM: -

[GitHub] [kafka] junrao commented on a change in pull request #8657: KAFKA-8334 Make sure the thread which tries to complete delayed reque…

2020-08-05 Thread GitBox
junrao commented on a change in pull request #8657: URL: https://github.com/apache/kafka/pull/8657#discussion_r465867406 ## File path: core/src/main/scala/kafka/coordinator/group/GroupCoordinator.scala ## @@ -369,6 +370,32 @@ class GroupCoordinator(val brokerId: Int, }

[GitHub] [kafka] guozhangwang commented on pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-08-05 Thread GitBox
guozhangwang commented on pull request #8964: URL: https://github.com/apache/kafka/pull/8964#issuecomment-669308138 System test green: https://jenkins.confluent.io/job/system-test-kafka-branch-builder/4093/ Ready for a final review and merge cc @mjsax -

[GitHub] [kafka] dielhennr commented on a change in pull request #9101: KAFKA-10325: KIP-649 implementation

2020-08-05 Thread GitBox
dielhennr commented on a change in pull request #9101: URL: https://github.com/apache/kafka/pull/9101#discussion_r465867372 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/DynamicConsumerConfig.java ## @@ -0,0 +1,168 @@ +/* + * Licensed to the A

[GitHub] [kafka] guozhangwang commented on pull request #9127: MINOR: fix HTML

2020-08-05 Thread GitBox
guozhangwang commented on pull request #9127: URL: https://github.com/apache/kafka/pull/9127#issuecomment-669320718 LGTM! This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[GitHub] [kafka] guozhangwang commented on pull request #9127: MINOR: fix HTML

2020-08-05 Thread GitBox
guozhangwang commented on pull request #9127: URL: https://github.com/apache/kafka/pull/9127#issuecomment-669320891 The kafka-site has already been updated, so yes you do need to have a separate PR for it :P This is an autom

[GitHub] [kafka] dajac commented on a change in pull request #9114: KAFKA-10162; Use Token Bucket algorithm for controller mutation quota (KIP-599, Part III)

2020-08-05 Thread GitBox
dajac commented on a change in pull request #9114: URL: https://github.com/apache/kafka/pull/9114#discussion_r465886919 ## File path: clients/src/test/java/org/apache/kafka/common/metrics/SensorTest.java ## @@ -209,4 +212,95 @@ public void shouldReturnPresenceOfMetrics() {

[GitHub] [kafka] dajac commented on a change in pull request #9114: KAFKA-10162; Use Token Bucket algorithm for controller mutation quota (KIP-599, Part III)

2020-08-05 Thread GitBox
dajac commented on a change in pull request #9114: URL: https://github.com/apache/kafka/pull/9114#discussion_r46517 ## File path: clients/src/test/java/org/apache/kafka/common/metrics/SensorTest.java ## @@ -209,4 +212,95 @@ public void shouldReturnPresenceOfMetrics() {

[GitHub] [kafka] dajac commented on a change in pull request #9114: KAFKA-10162; Use Token Bucket algorithm for controller mutation quota (KIP-599, Part III)

2020-08-05 Thread GitBox
dajac commented on a change in pull request #9114: URL: https://github.com/apache/kafka/pull/9114#discussion_r465889286 ## File path: core/src/main/scala/kafka/server/ControllerMutationQuotaManager.scala ## @@ -156,6 +174,24 @@ class ControllerMutationQuotaManager(private val c

[GitHub] [kafka] dajac commented on a change in pull request #9114: KAFKA-10162; Use Token Bucket algorithm for controller mutation quota (KIP-599, Part III)

2020-08-05 Thread GitBox
dajac commented on a change in pull request #9114: URL: https://github.com/apache/kafka/pull/9114#discussion_r465889447 ## File path: clients/src/main/java/org/apache/kafka/common/metrics/stats/TokenBucket.java ## @@ -0,0 +1,87 @@ +/* + * Licensed to the Apache Software Founda

[GitHub] [kafka] dajac commented on a change in pull request #9114: KAFKA-10162; Use Token Bucket algorithm for controller mutation quota (KIP-599, Part III)

2020-08-05 Thread GitBox
dajac commented on a change in pull request #9114: URL: https://github.com/apache/kafka/pull/9114#discussion_r465889824 ## File path: clients/src/main/java/org/apache/kafka/common/metrics/stats/TokenBucket.java ## @@ -0,0 +1,87 @@ +/* + * Licensed to the Apache Software Founda

[GitHub] [kafka] kkonstantine closed pull request #8513: MINOR: jackson 2.10.3

2020-08-05 Thread GitBox
kkonstantine closed pull request #8513: URL: https://github.com/apache/kafka/pull/8513 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Commented] (KAFKA-10339) MirrorMaker2 Exactly-once Semantics

2020-08-05 Thread Ryanne Dolan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17171642#comment-17171642 ] Ryanne Dolan commented on KAFKA-10339: -- I believe your proposed task.loadOffsets()

[GitHub] [kafka] kkonstantine commented on pull request #8513: MINOR: jackson 2.10.3

2020-08-05 Thread GitBox
kkonstantine commented on pull request #8513: URL: https://github.com/apache/kafka/pull/8513#issuecomment-669328325 Closing here in favor of https://github.com/apache/kafka/pull/9058 Thanks for suggesting the version upgrade @sullis -

[GitHub] [kafka] junrao commented on pull request #8657: KAFKA-8334 Make sure the thread which tries to complete delayed reque…

2020-08-05 Thread GitBox
junrao commented on pull request #8657: URL: https://github.com/apache/kafka/pull/8657#issuecomment-669330984 @chia7712 : The following is my thought after thinking about this a bit more. The changes that we made in DelayedJoin is complicated and it still doesn't completely solve the deadl

[jira] [Updated] (KAFKA-10162) Use Token Bucket algorithm for controller mutation quota

2020-08-05 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-10162: Summary: Use Token Bucket algorithm for controller mutation quota (was: Update Rate implementatio

[jira] [Created] (KAFKA-10364) Use Token Bucket for all quotas

2020-08-05 Thread David Jacot (Jira)
David Jacot created KAFKA-10364: --- Summary: Use Token Bucket for all quotas Key: KAFKA-10364 URL: https://issues.apache.org/jira/browse/KAFKA-10364 Project: Kafka Issue Type: Sub-task

[GitHub] [kafka] dajac commented on pull request #9114: KAFKA-10162; Use Token Bucket algorithm for controller mutation quota (KIP-599, Part III)

2020-08-05 Thread GitBox
dajac commented on pull request #9114: URL: https://github.com/apache/kafka/pull/9114#issuecomment-669343564 @junrao Thanks for your comments. I just pushed an update which addressed them. This is an automated message from t

[GitHub] [kafka] mumrah edited a comment on pull request #7222: KAFKA-8806 Reduce calls to validateOffsetsIfNeeded

2020-08-05 Thread GitBox
mumrah edited a comment on pull request #7222: URL: https://github.com/apache/kafka/pull/7222#issuecomment-669345762 ![image](https://user-images.githubusercontent.com/55116/89447599-3e2aac80-d724-11ea-8d0d-a4a4857f230c.png) Failed run https://builds.apache.org/job/kafka-pr-jdk14-sca

[GitHub] [kafka] mumrah commented on pull request #7222: KAFKA-8806 Reduce calls to validateOffsetsIfNeeded

2020-08-05 Thread GitBox
mumrah commented on pull request #7222: URL: https://github.com/apache/kafka/pull/7222#issuecomment-669345762 ![image](https://user-images.githubusercontent.com/55116/89447599-3e2aac80-d724-11ea-8d0d-a4a4857f230c.png) Th

[GitHub] [kafka] mumrah commented on pull request #7222: KAFKA-8806 Reduce calls to validateOffsetsIfNeeded

2020-08-05 Thread GitBox
mumrah commented on pull request #7222: URL: https://github.com/apache/kafka/pull/7222#issuecomment-669345934 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [kafka] dielhennr commented on a change in pull request #9101: KAFKA-10325: KIP-649 implementation

2020-08-05 Thread GitBox
dielhennr commented on a change in pull request #9101: URL: https://github.com/apache/kafka/pull/9101#discussion_r465907401 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/DynamicConsumerConfig.java ## @@ -0,0 +1,168 @@ +/* + * Licensed to the A

[GitHub] [kafka] dajac commented on a change in pull request #9103: Add redirection for (Incremental)AlterConfig

2020-08-05 Thread GitBox
dajac commented on a change in pull request #9103: URL: https://github.com/apache/kafka/pull/9103#discussion_r465908873 ## File path: core/src/main/scala/kafka/server/KafkaApis.scala ## @@ -2982,12 +3089,33 @@ class KafkaApis(val requestChannel: RequestChannel,

[jira] [Commented] (KAFKA-10339) MirrorMaker2 Exactly-once Semantics

2020-08-05 Thread Ning Zhang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17171670#comment-17171670 ] Ning Zhang commented on KAFKA-10339: it is true that SinkTaskContext.offsets() has b

[GitHub] [kafka] junrao commented on a change in pull request #9114: KAFKA-10162; Use Token Bucket algorithm for controller mutation quota (KIP-599, Part III)

2020-08-05 Thread GitBox
junrao commented on a change in pull request #9114: URL: https://github.com/apache/kafka/pull/9114#discussion_r465921001 ## File path: clients/src/test/java/org/apache/kafka/common/metrics/TokenBucketTest.java ## @@ -0,0 +1,93 @@ +/* + * Licensed to the Apache Software Foundat

[GitHub] [kafka] junrao commented on pull request #9114: KAFKA-10162; Use Token Bucket algorithm for controller mutation quota (KIP-599, Part III)

2020-08-05 Thread GitBox
junrao commented on pull request #9114: URL: https://github.com/apache/kafka/pull/9114#issuecomment-669378432 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[GitHub] [kafka] dhruvilshah3 commented on a change in pull request #9110: MINOR: Ensure a reason is logged for all segment deletion operations

2020-08-05 Thread GitBox
dhruvilshah3 commented on a change in pull request #9110: URL: https://github.com/apache/kafka/pull/9110#discussion_r465939741 ## File path: core/src/main/scala/kafka/log/Log.scala ## @@ -2227,14 +2210,17 @@ class Log(@volatile private var _dir: File, * @param segments The

[GitHub] [kafka] dielhennr commented on a change in pull request #9101: KAFKA-10325: KIP-649 implementation

2020-08-05 Thread GitBox
dielhennr commented on a change in pull request #9101: URL: https://github.com/apache/kafka/pull/9101#discussion_r465907401 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/DynamicConsumerConfig.java ## @@ -0,0 +1,168 @@ +/* + * Licensed to the A

[GitHub] [kafka] rajinisivaram commented on a change in pull request #9032: KAFKA-10259: KIP-554 Broker-side SCRAM Config API

2020-08-05 Thread GitBox
rajinisivaram commented on a change in pull request #9032: URL: https://github.com/apache/kafka/pull/9032#discussion_r465952166 ## File path: core/src/main/scala/kafka/admin/ConfigCommand.scala ## @@ -508,7 +563,15 @@ object ConfigCommand extends Config { val entityStr

[GitHub] [kafka] dajac commented on a change in pull request #9114: KAFKA-10162; Use Token Bucket algorithm for controller mutation quota (KIP-599, Part III)

2020-08-05 Thread GitBox
dajac commented on a change in pull request #9114: URL: https://github.com/apache/kafka/pull/9114#discussion_r465968369 ## File path: clients/src/test/java/org/apache/kafka/common/metrics/SensorTest.java ## @@ -209,4 +212,95 @@ public void shouldReturnPresenceOfMetrics() {

[GitHub] [kafka] dajac commented on pull request #9114: KAFKA-10162; Use Token Bucket algorithm for controller mutation quota (KIP-599, Part III)

2020-08-05 Thread GitBox
dajac commented on pull request #9114: URL: https://github.com/apache/kafka/pull/9114#issuecomment-669465274 @junrao Thanks. I have updated the PR. This is an automated message from the Apache Git Service. To respond to the m

[GitHub] [kafka] guozhangwang commented on a change in pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-08-05 Thread GitBox
guozhangwang commented on a change in pull request #9047: URL: https://github.com/apache/kafka/pull/9047#discussion_r465923769 ## File path: docs/streams/developer-guide/config-streams.html ## @@ -326,13 +321,18 @@ bootstrap.serversstate.cleanup.delay.ms Low

[GitHub] [kafka] mjsax merged pull request #9126: MINOR: Code cleanup in StreamsResetter

2020-08-05 Thread GitBox
mjsax merged pull request #9126: URL: https://github.com/apache/kafka/pull/9126 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] junrao commented on a change in pull request #9114: KAFKA-10162; Use Token Bucket algorithm for controller mutation quota (KIP-599, Part III)

2020-08-05 Thread GitBox
junrao commented on a change in pull request #9114: URL: https://github.com/apache/kafka/pull/9114#discussion_r465989800 ## File path: clients/src/main/java/org/apache/kafka/common/metrics/stats/TokenBucket.java ## @@ -0,0 +1,101 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] [kafka] mjsax commented on pull request #9127: MINOR: fix HTML

2020-08-05 Thread GitBox
mjsax commented on pull request #9127: URL: https://github.com/apache/kafka/pull/9127#issuecomment-669498317 Found one more tiny issue. Will merge if no objections raise. kafka-site PR: https://github.com/apache/kafka-site/pull/283 ---

[GitHub] [kafka] junrao commented on pull request #9114: KAFKA-10162; Use Token Bucket algorithm for controller mutation quota (KIP-599, Part III)

2020-08-05 Thread GitBox
junrao commented on pull request #9114: URL: https://github.com/apache/kafka/pull/9114#issuecomment-669499409 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[GitHub] [kafka] junrao commented on pull request #9114: KAFKA-10162; Use Token Bucket algorithm for controller mutation quota (KIP-599, Part III)

2020-08-05 Thread GitBox
junrao commented on pull request #9114: URL: https://github.com/apache/kafka/pull/9114#issuecomment-669499767 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [kafka] junrao commented on pull request #9114: KAFKA-10162; Use Token Bucket algorithm for controller mutation quota (KIP-599, Part III)

2020-08-05 Thread GitBox
junrao commented on pull request #9114: URL: https://github.com/apache/kafka/pull/9114#issuecomment-669500012 test this please This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [kafka] mjsax merged pull request #9067: MINOR: Streams integration tests should not call exit

2020-08-05 Thread GitBox
mjsax merged pull request #9067: URL: https://github.com/apache/kafka/pull/9067 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] dajac commented on a change in pull request #9114: KAFKA-10162; Use Token Bucket algorithm for controller mutation quota (KIP-599, Part III)

2020-08-05 Thread GitBox
dajac commented on a change in pull request #9114: URL: https://github.com/apache/kafka/pull/9114#discussion_r465997810 ## File path: clients/src/main/java/org/apache/kafka/common/metrics/stats/TokenBucket.java ## @@ -0,0 +1,101 @@ +/* + * Licensed to the Apache Software Found

[GitHub] [kafka] dajac commented on a change in pull request #9114: KAFKA-10162; Use Token Bucket algorithm for controller mutation quota (KIP-599, Part III)

2020-08-05 Thread GitBox
dajac commented on a change in pull request #9114: URL: https://github.com/apache/kafka/pull/9114#discussion_r465997624 ## File path: clients/src/main/java/org/apache/kafka/common/metrics/stats/TokenBucket.java ## @@ -0,0 +1,101 @@ +/* + * Licensed to the Apache Software Found

[GitHub] [kafka] abbccdda commented on a change in pull request #9060: KAFKA-9274: Remove `retries` from InternalTopicManager

2020-08-05 Thread GitBox
abbccdda commented on a change in pull request #9060: URL: https://github.com/apache/kafka/pull/9060#discussion_r465999685 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamsPartitionAssignor.java ## @@ -373,8 +373,15 @@ public GroupAssignm

[GitHub] [kafka] mjsax commented on pull request #9067: MINOR: Streams integration tests should not call exit

2020-08-05 Thread GitBox
mjsax commented on pull request #9067: URL: https://github.com/apache/kafka/pull/9067#issuecomment-669509500 Merged to `trunk` and cherry-picked to `2.6` branch. This is an automated message from the Apache Git Service. To re

[GitHub] [kafka] junrao commented on pull request #9114: KAFKA-10162; Use Token Bucket algorithm for controller mutation quota (KIP-599, Part III)

2020-08-05 Thread GitBox
junrao commented on pull request #9114: URL: https://github.com/apache/kafka/pull/9114#issuecomment-669510023 test this please This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [kafka] junrao commented on pull request #9114: KAFKA-10162; Use Token Bucket algorithm for controller mutation quota (KIP-599, Part III)

2020-08-05 Thread GitBox
junrao commented on pull request #9114: URL: https://github.com/apache/kafka/pull/9114#issuecomment-669509903 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [kafka] dajac commented on pull request #9114: KAFKA-10162; Use Token Bucket algorithm for controller mutation quota (KIP-599, Part III)

2020-08-05 Thread GitBox
dajac commented on pull request #9114: URL: https://github.com/apache/kafka/pull/9114#issuecomment-669512698 Sure. I will update the KIP and the mailing list tomorrow. Thanks, Jun! This is an automated message from the Apache

[GitHub] [kafka] mjsax commented on a change in pull request #9060: KAFKA-9274: Remove `retries` from InternalTopicManager

2020-08-05 Thread GitBox
mjsax commented on a change in pull request #9060: URL: https://github.com/apache/kafka/pull/9060#discussion_r466006589 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamsPartitionAssignor.java ## @@ -373,8 +373,15 @@ public GroupAssignment

[GitHub] [kafka] mjsax merged pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-08-05 Thread GitBox
mjsax merged pull request #9047: URL: https://github.com/apache/kafka/pull/9047 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Created] (KAFKA-10365) Cannot delete topic in Windows

2020-08-05 Thread Nilesh Balu Jorwar (Jira)
Nilesh Balu Jorwar created KAFKA-10365: -- Summary: Cannot delete topic in Windows Key: KAFKA-10365 URL: https://issues.apache.org/jira/browse/KAFKA-10365 Project: Kafka Issue Type: Bug

[GitHub] [kafka] mjsax commented on pull request #9120: KAFKA-10316: Consider renaming getter method for Interactive Queries

2020-08-05 Thread GitBox
mjsax commented on pull request #9120: URL: https://github.com/apache/kafka/pull/9120#issuecomment-669529543 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [kafka] mjsax commented on pull request #9120: KAFKA-10316: Consider renaming getter method for Interactive Queries

2020-08-05 Thread GitBox
mjsax commented on pull request #9120: URL: https://github.com/apache/kafka/pull/9120#issuecomment-669530846 Retest this please. This is an automated message from the Apache Git Service. To respond to the message, please log

  1   2   >