[GitHub] [kafka] showuon commented on pull request #9888: KAFKA-12194: use stateListener to catch each state change

2021-01-14 Thread GitBox
showuon commented on pull request #9888: URL: https://github.com/apache/kafka/pull/9888#issuecomment-760714184 @cadonna , thanks for the comments. I've updated in this commit: https://github.com/apache/kafka/pull/9888/commits/46898d994bb3c3495aea967ace9a07549f7fc1e5. Thanks.

[GitHub] [kafka] showuon commented on a change in pull request #9888: KAFKA-12194: use stateListener to catch each state change

2021-01-14 Thread GitBox
showuon commented on a change in pull request #9888: URL: https://github.com/apache/kafka/pull/9888#discussion_r557960104 ## File path: streams/src/test/java/org/apache/kafka/streams/integration/AdjustStreamThreadCountTest.java ## @@ -90,24 +91,64 @@ public void setup() {

[GitHub] [kafka] showuon commented on a change in pull request #9888: KAFKA-12194: use stateListener to catch each state change

2021-01-14 Thread GitBox
showuon commented on a change in pull request #9888: URL: https://github.com/apache/kafka/pull/9888#discussion_r557960104 ## File path: streams/src/test/java/org/apache/kafka/streams/integration/AdjustStreamThreadCountTest.java ## @@ -90,24 +91,64 @@ public void setup() {

[GitHub] [kafka] showuon commented on a change in pull request #9888: KAFKA-12194: use stateListener to catch each state change

2021-01-14 Thread GitBox
showuon commented on a change in pull request #9888: URL: https://github.com/apache/kafka/pull/9888#discussion_r557939529 ## File path: streams/src/test/java/org/apache/kafka/streams/integration/AdjustStreamThreadCountTest.java ## @@ -90,24 +91,64 @@ public void setup() {

[GitHub] [kafka] showuon commented on a change in pull request #9888: KAFKA-12194: use stateListener to catch each state change

2021-01-14 Thread GitBox
showuon commented on a change in pull request #9888: URL: https://github.com/apache/kafka/pull/9888#discussion_r557937603 ## File path: streams/src/test/java/org/apache/kafka/streams/integration/AdjustStreamThreadCountTest.java ## @@ -119,37 +160,47 @@ public void shouldAddStr

[jira] [Resolved] (KAFKA-12191) SslTransportTls12Tls13Test can replace 'assumeTrue' by (junit 5) conditional test

2021-01-14 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-12191. Fix Version/s: 2.8.0 Resolution: Fixed > SslTransportTls12Tls13Test can replace 'as

[GitHub] [kafka] chia7712 merged pull request #9899: KAFKA-12191 SslTransportTls12Tls13Test can replace 'assumeTrue' by (j…

2021-01-14 Thread GitBox
chia7712 merged pull request #9899: URL: https://github.com/apache/kafka/pull/9899 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[jira] [Resolved] (KAFKA-12189) ShellTest can replace 'assumeTrue' by (junit 5) conditional test

2021-01-14 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-12189. Fix Version/s: 2.8.0 Resolution: Fixed > ShellTest can replace 'assumeTrue' by (jun

[GitHub] [kafka] chia7712 merged pull request #9898: KAFKA-12189 ShellTest can replace 'assumeTrue' by (junit 5) condition…

2021-01-14 Thread GitBox
chia7712 merged pull request #9898: URL: https://github.com/apache/kafka/pull/9898 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [kafka] chia7712 commented on a change in pull request #9887: KAFKA-12195 Fix synchronization issue happening in KafkaStreams

2021-01-14 Thread GitBox
chia7712 commented on a change in pull request #9887: URL: https://github.com/apache/kafka/pull/9887#discussion_r557882254 ## File path: streams/src/main/java/org/apache/kafka/streams/KafkaStreams.java ## @@ -989,16 +989,20 @@ private StreamThread createAndAddStreamThread(final

[jira] [Commented] (KAFKA-12199) Migrate connect:runtime module to JUnit 5

2021-01-14 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17265720#comment-17265720 ] Chia-Ping Tsai commented on KAFKA-12199: [~ijuma] PowerMock does not yet have na

[jira] [Resolved] (KAFKA-12203) Migrate connect:mirror-client module to JUnit 5

2021-01-14 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-12203. Fix Version/s: 2.8.0 Resolution: Fixed > Migrate connect:mirror-client module to JU

[GitHub] [kafka] chia7712 merged pull request #9889: KAFKA-12203 Migrate connect:mirror-client module to JUnit 5

2021-01-14 Thread GitBox
chia7712 merged pull request #9889: URL: https://github.com/apache/kafka/pull/9889 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [kafka] chia7712 commented on pull request #9889: KAFKA-12203 Migrate connect:mirror-client module to JUnit 5

2021-01-14 Thread GitBox
chia7712 commented on pull request #9889: URL: https://github.com/apache/kafka/pull/9889#issuecomment-760659526 ``` org.apache.kafka.streams.integration.AdjustStreamThreadCountTest.shouldAddAndRemoveStreamThreadsWhileKeepingNamesCorrect ``` It is traced by #9888 and #9887 ---

[GitHub] [kafka] abbccdda commented on a change in pull request #9871: KAFKA-12161; Support raft observers with optional id

2021-01-14 Thread GitBox
abbccdda commented on a change in pull request #9871: URL: https://github.com/apache/kafka/pull/9871#discussion_r557858498 ## File path: raft/src/main/java/org/apache/kafka/raft/QuorumState.java ## @@ -125,9 +125,16 @@ public void initialize(OffsetAndEpoch logEndOffsetAndEpoch

[GitHub] [kafka] chia7712 commented on pull request #9890: KAFKA-12198: Migrate connect:json module to JUnit 5

2021-01-14 Thread GitBox
chia7712 commented on pull request #9890: URL: https://github.com/apache/kafka/pull/9890#issuecomment-760616110 @dengziming Could you fix the conflicting files? thanks! This is an automated message from the Apache Git Service

[GitHub] [kafka] hachikuji commented on a change in pull request #9816: KAFKA-10761: Kafka Raft update log start offset

2021-01-14 Thread GitBox
hachikuji commented on a change in pull request #9816: URL: https://github.com/apache/kafka/pull/9816#discussion_r557828817 ## File path: raft/src/main/java/org/apache/kafka/raft/KafkaRaftClient.java ## @@ -963,49 +979,111 @@ private FetchResponseData tryCompleteFetchRequest(

[GitHub] [kafka] hachikuji commented on a change in pull request #9816: KAFKA-10761: Kafka Raft update log start offset

2021-01-14 Thread GitBox
hachikuji commented on a change in pull request #9816: URL: https://github.com/apache/kafka/pull/9816#discussion_r557829548 ## File path: raft/src/main/java/org/apache/kafka/raft/KafkaRaftClient.java ## @@ -2216,7 +2316,7 @@ public void complete() { // These fields are

[GitHub] [kafka] hachikuji commented on a change in pull request #9816: KAFKA-10761: Kafka Raft update log start offset

2021-01-14 Thread GitBox
hachikuji commented on a change in pull request #9816: URL: https://github.com/apache/kafka/pull/9816#discussion_r557818816 ## File path: core/src/main/scala/kafka/raft/KafkaMetadataLog.scala ## @@ -147,18 +221,102 @@ class KafkaMetadataLog( } override def createSnapsho

[GitHub] [kafka] showuon commented on pull request #9888: KAFKA-12194: use stateListener to catch each state change

2021-01-14 Thread GitBox
showuon commented on pull request #9888: URL: https://github.com/apache/kafka/pull/9888#issuecomment-760605267 Test will fail, will work it later. Don't review yet. Thanks. This is an automated message from the Apache Git Ser

[GitHub] [kafka] abbccdda commented on a change in pull request #9600: KAFKA-10674: Controller API version bond with forwardable APIs

2021-01-14 Thread GitBox
abbccdda commented on a change in pull request #9600: URL: https://github.com/apache/kafka/pull/9600#discussion_r557825070 ## File path: core/src/main/scala/kafka/server/KafkaApis.scala ## @@ -139,8 +138,11 @@ class KafkaApis(val requestChannel: RequestChannel, request: Re

[GitHub] [kafka] showuon commented on pull request #9733: KAFKA-10017: fix 2 issues in EosBetaUpgradeIntegrationTest

2021-01-14 Thread GitBox
showuon commented on pull request #9733: URL: https://github.com/apache/kafka/pull/9733#issuecomment-760604903 @mjsax , I've reverted my change for the state change. Now, there's only the exception handler improvement change. And for the state change fix, after the holidays, I think

[GitHub] [kafka] hachikuji commented on a change in pull request #9816: KAFKA-10761: Kafka Raft update log start offset

2021-01-14 Thread GitBox
hachikuji commented on a change in pull request #9816: URL: https://github.com/apache/kafka/pull/9816#discussion_r557643619 ## File path: core/src/main/scala/kafka/raft/KafkaMetadataLog.scala ## @@ -16,28 +16,41 @@ */ package kafka.raft +import java.nio.file.Files import

[GitHub] [kafka] abbccdda commented on a change in pull request #9600: KAFKA-10674: Controller API version bond with forwardable APIs

2021-01-14 Thread GitBox
abbccdda commented on a change in pull request #9600: URL: https://github.com/apache/kafka/pull/9600#discussion_r557823644 ## File path: core/src/main/scala/kafka/server/ForwardingManager.scala ## @@ -77,7 +79,7 @@ class ForwardingManagerImpl( override def forwardRequest(

[GitHub] [kafka] showuon commented on pull request #9733: KAFKA-10017: fix 2 issues in EosBetaUpgradeIntegrationTest

2021-01-14 Thread GitBox
showuon commented on pull request #9733: URL: https://github.com/apache/kafka/pull/9733#issuecomment-760597684 OK, working on it now. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [kafka] abbccdda commented on a change in pull request #9600: KAFKA-10674: Controller API version bond with forwardable APIs

2021-01-14 Thread GitBox
abbccdda commented on a change in pull request #9600: URL: https://github.com/apache/kafka/pull/9600#discussion_r557810929 ## File path: clients/src/main/java/org/apache/kafka/clients/NodeApiVersions.java ## @@ -123,21 +125,25 @@ public short latestUsableVersion(ApiKeys apiKey)

[GitHub] [kafka] hachikuji commented on a change in pull request #9883: MINOR: Generalize server startup to make way for KIP-500

2021-01-14 Thread GitBox
hachikuji commented on a change in pull request #9883: URL: https://github.com/apache/kafka/pull/9883#discussion_r557807090 ## File path: core/src/main/scala/kafka/server/KafkaRaftServer.scala ## @@ -0,0 +1,98 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under on

[GitHub] [kafka] hachikuji merged pull request #9881: MINOR: Initialize QuorumState lazily in RaftClient.initialize()

2021-01-14 Thread GitBox
hachikuji merged pull request #9881: URL: https://github.com/apache/kafka/pull/9881 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [kafka] cmccabe commented on a change in pull request #9883: MINOR: Generalize server startup to make way for KIP-500

2021-01-14 Thread GitBox
cmccabe commented on a change in pull request #9883: URL: https://github.com/apache/kafka/pull/9883#discussion_r557799746 ## File path: core/src/main/scala/kafka/server/KafkaRaftServer.scala ## @@ -0,0 +1,98 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one

[GitHub] [kafka] hachikuji commented on a change in pull request #9600: KAFKA-10674: Controller API version bond with forwardable APIs

2021-01-14 Thread GitBox
hachikuji commented on a change in pull request #9600: URL: https://github.com/apache/kafka/pull/9600#discussion_r557783391 ## File path: clients/src/main/java/org/apache/kafka/clients/NodeApiVersions.java ## @@ -123,21 +125,25 @@ public short latestUsableVersion(ApiKeys apiKey

[GitHub] [kafka] bob-barrett opened a new pull request #9902: KAFKA-12193: Re-resolve IPs after a client disconnects

2021-01-14 Thread GitBox
bob-barrett opened a new pull request #9902: URL: https://github.com/apache/kafka/pull/9902 This patch changes the NetworkClient behavior to resolve the target node's hostname after disconnecting from an established connection, rather than waiting until the previously-resolved addresses ar

[GitHub] [kafka] ijuma commented on pull request #9889: KAFKA-12203 Migrate connect:mirror-client module to JUnit 5

2021-01-14 Thread GitBox
ijuma commented on pull request #9889: URL: https://github.com/apache/kafka/pull/9889#issuecomment-760552078 The failed Streams tests seem unrelated, but they seem to be failing very often. This is an automated message from

[GitHub] [kafka] ijuma merged pull request #9892: KAFKA-12201: Migrate connect:basic-auth-extensio module to JUnit 5

2021-01-14 Thread GitBox
ijuma merged pull request #9892: URL: https://github.com/apache/kafka/pull/9892 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Resolved] (KAFKA-10896) TimeoutException when Producer try to send message to Kafka Broker

2021-01-14 Thread Nguyen Cong Hieu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nguyen Cong Hieu resolved KAFKA-10896. -- Resolution: Not A Bug > TimeoutException when Producer try to send message to Kafka Br

[GitHub] [kafka] cmccabe opened a new pull request #9901: KAFKA-12209: Add the timeline data structures for the KIP-631 controller

2021-01-14 Thread GitBox
cmccabe opened a new pull request #9901: URL: https://github.com/apache/kafka/pull/9901 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [kafka] wcarlson5 commented on a change in pull request #9887: KAFKA-12195 Fix synchronization issue happening in KafkaStreams

2021-01-14 Thread GitBox
wcarlson5 commented on a change in pull request #9887: URL: https://github.com/apache/kafka/pull/9887#discussion_r557739729 ## File path: streams/src/main/java/org/apache/kafka/streams/KafkaStreams.java ## @@ -989,16 +989,20 @@ private StreamThread createAndAddStreamThread(fina

[jira] [Created] (KAFKA-12209) Add the timeline data structures for the KIP-631 controller

2021-01-14 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-12209: Summary: Add the timeline data structures for the KIP-631 controller Key: KAFKA-12209 URL: https://issues.apache.org/jira/browse/KAFKA-12209 Project: Kafka

[jira] [Resolved] (KAFKA-12183) Add the KIP-631 metadata record definitions

2021-01-14 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-12183. -- Fix Version/s: 2.8.0 Resolution: Fixed > Add the KIP-631 metadata record definitions >

[GitHub] [kafka] cmccabe opened a new pull request #9900: KAFKA-12208: Rename AdminManager to ZkAdminManager

2021-01-14 Thread GitBox
cmccabe opened a new pull request #9900: URL: https://github.com/apache/kafka/pull/9900 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Created] (KAFKA-12208) Rename AdminManager to ZkAdminManager

2021-01-14 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-12208: Summary: Rename AdminManager to ZkAdminManager Key: KAFKA-12208 URL: https://issues.apache.org/jira/browse/KAFKA-12208 Project: Kafka Issue Type: Improvement

[GitHub] [kafka] hachikuji commented on a change in pull request #9871: KAFKA-12161; Support raft observers with optional id

2021-01-14 Thread GitBox
hachikuji commented on a change in pull request #9871: URL: https://github.com/apache/kafka/pull/9871#discussion_r557725416 ## File path: raft/src/test/java/org/apache/kafka/raft/KafkaRaftClientTest.java ## @@ -2182,6 +2182,46 @@ public void testHandleCommitCallbackFiresInCand

[GitHub] [kafka] hachikuji commented on a change in pull request #9871: KAFKA-12161; Support raft observers with optional id

2021-01-14 Thread GitBox
hachikuji commented on a change in pull request #9871: URL: https://github.com/apache/kafka/pull/9871#discussion_r557725206 ## File path: raft/src/main/java/org/apache/kafka/raft/QuorumState.java ## @@ -125,9 +125,16 @@ public void initialize(OffsetAndEpoch logEndOffsetAndEpoc

[GitHub] [kafka] abbccdda commented on a change in pull request #9871: KAFKA-12161; Support raft observers with optional id

2021-01-14 Thread GitBox
abbccdda commented on a change in pull request #9871: URL: https://github.com/apache/kafka/pull/9871#discussion_r557722131 ## File path: raft/src/test/java/org/apache/kafka/raft/KafkaRaftClientTest.java ## @@ -2182,6 +2182,46 @@ public void testHandleCommitCallbackFiresInCandi

[GitHub] [kafka] ableegoldman commented on pull request #9887: KAFKA-12195 Fix synchronization issue happening in KafkaStreams

2021-01-14 Thread GitBox
ableegoldman commented on pull request #9887: URL: https://github.com/apache/kafka/pull/9887#issuecomment-760488841 Hey @wcarlson5 can you also take a look at this? This is an automated message from the Apache Git Service. To

[GitHub] [kafka] abbccdda merged pull request #9834: MINOR: fix typo in TimeIndex

2021-01-14 Thread GitBox
abbccdda merged pull request #9834: URL: https://github.com/apache/kafka/pull/9834 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [kafka] cadonna commented on a change in pull request #9888: KAFKA-12194: use stateListener to catch each state change

2021-01-14 Thread GitBox
cadonna commented on a change in pull request #9888: URL: https://github.com/apache/kafka/pull/9888#discussion_r557647216 ## File path: streams/src/test/java/org/apache/kafka/streams/integration/AdjustStreamThreadCountTest.java ## @@ -119,37 +160,47 @@ public void shouldAddStr

[jira] [Updated] (KAFKA-12207) Do not maintain list of latest producer append information

2021-01-14 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-12207: Labels: needs-kip (was: ) > Do not maintain list of latest producer append information >

[jira] [Updated] (KAFKA-12207) Do not maintain list of latest producer append information

2021-01-14 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-12207: Issue Type: Improvement (was: Bug) > Do not maintain list of latest producer append infor

[jira] [Created] (KAFKA-12207) Do not maintain list of latest producer append information

2021-01-14 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-12207: --- Summary: Do not maintain list of latest producer append information Key: KAFKA-12207 URL: https://issues.apache.org/jira/browse/KAFKA-12207 Project: Kafka

[GitHub] [kafka] C0urante commented on pull request #9880: KAFKA-10792 (2.5 backport): Prevent source task shutdown from blocking herder thread (#9669)

2021-01-14 Thread GitBox
C0urante commented on pull request #9880: URL: https://github.com/apache/kafka/pull/9880#issuecomment-760448619 Thanks Randall! This is an automated message from the Apache Git Service. To respond to the message, please log o

[GitHub] [kafka] jsancio commented on a change in pull request #9715: Upstream ApisUtils from kip-500

2021-01-14 Thread GitBox
jsancio commented on a change in pull request #9715: URL: https://github.com/apache/kafka/pull/9715#discussion_r557669397 ## File path: core/src/main/scala/kafka/server/AuthHelper.scala ## @@ -0,0 +1,74 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or m

[GitHub] [kafka] lct45 commented on a change in pull request #9895: KAFKA-9924: Add docs for RocksDB properties-based metrics

2021-01-14 Thread GitBox
lct45 commented on a change in pull request #9895: URL: https://github.com/apache/kafka/pull/9895#discussion_r557642098 ## File path: docs/ops.html ## @@ -2133,6 +2141,137 @@ RocksDB Properties-based Metrics + RocksDB Properties-based Metrics: + All of the following properti

[GitHub] [kafka] mjsax commented on pull request #9733: KAFKA-10017: fix 2 issues in EosBetaUpgradeIntegrationTest

2021-01-14 Thread GitBox
mjsax commented on pull request #9733: URL: https://github.com/apache/kafka/pull/9733#issuecomment-760424092 @showuon Sorry for late response. Pretty busy atm. We found that the fix for the exception handler contained in this PR is also blocking https://github.com/apache/kafka/pull/9

[GitHub] [kafka] jsancio commented on a change in pull request #9816: KAFKA-10761: Kafka Raft update log start offset

2021-01-14 Thread GitBox
jsancio commented on a change in pull request #9816: URL: https://github.com/apache/kafka/pull/9816#discussion_r557643648 ## File path: core/src/main/scala/kafka/raft/KafkaMetadataLog.scala ## @@ -29,15 +32,22 @@ import org.apache.kafka.snapshot.FileRawSnapshotReader import or

[GitHub] [kafka] aloknnikhil commented on a change in pull request #9881: MINOR: Initialize QuorumState lazily in RaftClient.initialize()

2021-01-14 Thread GitBox
aloknnikhil commented on a change in pull request #9881: URL: https://github.com/apache/kafka/pull/9881#discussion_r557624393 ## File path: raft/src/main/java/org/apache/kafka/raft/RaftConfig.java ## @@ -129,16 +130,25 @@ public String toString() { QUORUM_LINGE

[GitHub] [kafka] hachikuji commented on a change in pull request #9883: MINOR: Generalize server startup to make way for KIP-500

2021-01-14 Thread GitBox
hachikuji commented on a change in pull request #9883: URL: https://github.com/apache/kafka/pull/9883#discussion_r557622659 ## File path: core/src/main/scala/kafka/server/KafkaRaftController.scala ## @@ -0,0 +1,23 @@ +/* + * Licensed to the Apache Software Foundation (ASF) unde

[GitHub] [kafka] hachikuji commented on a change in pull request #9881: MINOR: Initialize QuorumState lazily in RaftClient.initialize()

2021-01-14 Thread GitBox
hachikuji commented on a change in pull request #9881: URL: https://github.com/apache/kafka/pull/9881#discussion_r557611820 ## File path: raft/src/main/java/org/apache/kafka/raft/RaftConfig.java ## @@ -129,16 +130,25 @@ public String toString() { QUORUM_LINGER_

[jira] [Commented] (KAFKA-10792) Source tasks can block herder thread by hanging during stop

2021-01-14 Thread Randall Hauch (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17265116#comment-17265116 ] Randall Hauch commented on KAFKA-10792: --- Thanks for the backport PR for the `2.5`

[jira] [Updated] (KAFKA-10792) Source tasks can block herder thread by hanging during stop

2021-01-14 Thread Randall Hauch (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch updated KAFKA-10792: -- Fix Version/s: 2.5.2 > Source tasks can block herder thread by hanging during stop > -

[GitHub] [kafka] rhauch merged pull request #9880: KAFKA-10792 (2.5 backport): Prevent source task shutdown from blocking herder thread (#9669)

2021-01-14 Thread GitBox
rhauch merged pull request #9880: URL: https://github.com/apache/kafka/pull/9880 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] rhauch commented on pull request #9880: KAFKA-10792 (2.5 backport): Prevent source task shutdown from blocking herder thread (#9669)

2021-01-14 Thread GitBox
rhauch commented on pull request #9880: URL: https://github.com/apache/kafka/pull/9880#issuecomment-760387979 There seem to be environmental build issues; the builds are failing with "JDK" unknown and "maven" unknown. I'm going to go ahead and merge this PR to the `2.5` branch. ---

[GitHub] [kafka] g1geordie opened a new pull request #9899: KAFKA-12191 SslTransportTls12Tls13Test can replace 'assumeTrue' by (j…

2021-01-14 Thread GitBox
g1geordie opened a new pull request #9899: URL: https://github.com/apache/kafka/pull/9899 SslTransportTls12Tls13Test can replace 'assumeTrue' by (junit 5) conditional test Test in Java8 ``` testCiphersSuiteForTls12FailsForTls13() Disabled on JRE version: 1.8.0_275 1.27 sp

[GitHub] [kafka] rhauch commented on pull request #9880: KAFKA-10792 (2.5 backport): Prevent source task shutdown from blocking herder thread (#9669)

2021-01-14 Thread GitBox
rhauch commented on pull request #9880: URL: https://github.com/apache/kafka/pull/9880#issuecomment-760385519 I'm trying to get the builds to run properly, but I did pull locally and the build of that local branch does pass.

[GitHub] [kafka] chia7712 commented on pull request #9889: KAFKA-12203 Migrate connect:mirror-client module to JUnit 5

2021-01-14 Thread GitBox
chia7712 commented on pull request #9889: URL: https://github.com/apache/kafka/pull/9889#issuecomment-760384843 > Given the test results for the last build, I think you can merge this, right? It produces some failed tests but they pass on my local. I want to check QA again :)

[GitHub] [kafka] g1geordie opened a new pull request #9898: KAFKA-12189 ShellTest can replace 'assumeTrue' by (junit 5) condition…

2021-01-14 Thread GitBox
g1geordie opened a new pull request #9898: URL: https://github.com/apache/kafka/pull/9898 ShellTest can replace 'assumeTrue' by (junit 5) conditional test I also test in windows . ``` ShellTest > testEchoHello() SKIPPED ShellTest > testRunProgramWithErrorReturn() SKIPPED S

[GitHub] [kafka] ijuma commented on pull request #9889: KAFKA-12203 Migrate connect:mirror-client module to JUnit 5

2021-01-14 Thread GitBox
ijuma commented on pull request #9889: URL: https://github.com/apache/kafka/pull/9889#issuecomment-760378170 @chia7712 Given the test results for the last build, I think you can merge this, right? This is an automated messag

[GitHub] [kafka] ijuma commented on a change in pull request #9876: KAFKA-12183: Add the KIP-631 metadata record definitions

2021-01-14 Thread GitBox
ijuma commented on a change in pull request #9876: URL: https://github.com/apache/kafka/pull/9876#discussion_r557596784 ## File path: build.gradle ## @@ -1010,6 +1015,53 @@ project(':core') { } } +project(':metadata') { + archivesBaseName = "kafka-metadata" + + dependen

[GitHub] [kafka] ijuma opened a new pull request #9897: MINOR: Remove incorrect code in metadata module build

2021-01-14 Thread GitBox
ijuma opened a new pull request #9897: URL: https://github.com/apache/kafka/pull/9897 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including upgrade notes)

[GitHub] [kafka] jolshan commented on pull request #9896: KAFKA-12206: o.a.k.common.Uuid should implement Comparable

2021-01-14 Thread GitBox
jolshan commented on pull request #9896: URL: https://github.com/apache/kafka/pull/9896#issuecomment-760375020 LGTM This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [kafka] wcarlson5 commented on pull request #9888: KAFKA-12194: use stateListener to catch each state change

2021-01-14 Thread GitBox
wcarlson5 commented on pull request #9888: URL: https://github.com/apache/kafka/pull/9888#issuecomment-760368501 @showuon These changes look good. Thanks for shoring up these tests This is an automated message from the Apache

[GitHub] [kafka] cmccabe opened a new pull request #9896: KAFKA-12206: o.a.k.common.Uuid should implement Comparable

2021-01-14 Thread GitBox
cmccabe opened a new pull request #9896: URL: https://github.com/apache/kafka/pull/9896 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Created] (KAFKA-12206) o.a.k.common.Uuid should implement Comparable

2021-01-14 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-12206: Summary: o.a.k.common.Uuid should implement Comparable Key: KAFKA-12206 URL: https://issues.apache.org/jira/browse/KAFKA-12206 Project: Kafka Issue Type: Im

[GitHub] [kafka] jsancio commented on a change in pull request #9816: KAFKA-10761: Kafka Raft update log start offset

2021-01-14 Thread GitBox
jsancio commented on a change in pull request #9816: URL: https://github.com/apache/kafka/pull/9816#discussion_r557586528 ## File path: core/src/main/scala/kafka/raft/KafkaMetadataLog.scala ## @@ -29,15 +32,22 @@ import org.apache.kafka.snapshot.FileRawSnapshotReader import or

[GitHub] [kafka] jsancio commented on a change in pull request #9816: KAFKA-10761: Kafka Raft update log start offset

2021-01-14 Thread GitBox
jsancio commented on a change in pull request #9816: URL: https://github.com/apache/kafka/pull/9816#discussion_r557586344 ## File path: core/src/main/scala/kafka/raft/KafkaMetadataLog.scala ## @@ -113,6 +145,22 @@ class KafkaMetadataLog( log.truncateTo(offset) } + ov

[GitHub] [kafka] cmccabe merged pull request #9876: KAFKA-12183: Add the KIP-631 metadata record definitions

2021-01-14 Thread GitBox
cmccabe merged pull request #9876: URL: https://github.com/apache/kafka/pull/9876 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[GitHub] [kafka] jsancio commented on a change in pull request #9816: KAFKA-10761: Kafka Raft update log start offset

2021-01-14 Thread GitBox
jsancio commented on a change in pull request #9816: URL: https://github.com/apache/kafka/pull/9816#discussion_r557586025 ## File path: core/src/main/scala/kafka/raft/KafkaMetadataLog.scala ## @@ -131,6 +179,10 @@ class KafkaMetadataLog( } } + override def highWaterm

[jira] [Commented] (KAFKA-12190) Failure on Windows due to an UnsupportedOperationException when StateDirectory sets file permissions

2021-01-14 Thread Gary Russell (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17265081#comment-17265081 ] Gary Russell commented on KAFKA-12190: -- Given that this is a critical bug, and a re

[GitHub] [kafka] jsancio commented on a change in pull request #9816: KAFKA-10761: Kafka Raft update log start offset

2021-01-14 Thread GitBox
jsancio commented on a change in pull request #9816: URL: https://github.com/apache/kafka/pull/9816#discussion_r557585643 ## File path: core/src/main/scala/kafka/raft/KafkaMetadataLog.scala ## @@ -79,13 +94,30 @@ class KafkaMetadataLog( throw new IllegalArgumentException

[GitHub] [kafka] jsancio commented on a change in pull request #9816: KAFKA-10761: Kafka Raft update log start offset

2021-01-14 Thread GitBox
jsancio commented on a change in pull request #9816: URL: https://github.com/apache/kafka/pull/9816#discussion_r557585891 ## File path: core/src/main/scala/kafka/raft/KafkaMetadataLog.scala ## @@ -147,18 +199,106 @@ class KafkaMetadataLog( } override def createSnapshot(

[GitHub] [kafka] jsancio commented on a change in pull request #9816: KAFKA-10761: Kafka Raft update log start offset

2021-01-14 Thread GitBox
jsancio commented on a change in pull request #9816: URL: https://github.com/apache/kafka/pull/9816#discussion_r557584847 ## File path: core/src/main/scala/kafka/raft/KafkaMetadataLog.scala ## @@ -29,15 +32,22 @@ import org.apache.kafka.snapshot.FileRawSnapshotReader import or

[GitHub] [kafka] aloknnikhil commented on a change in pull request #9881: MINOR: Initialize QuorumState lazily in RaftClient.initialize()

2021-01-14 Thread GitBox
aloknnikhil commented on a change in pull request #9881: URL: https://github.com/apache/kafka/pull/9881#discussion_r557584646 ## File path: raft/src/main/java/org/apache/kafka/raft/RaftConfig.java ## @@ -129,16 +133,41 @@ public String toString() { QUORUM_LINGE

[GitHub] [kafka] hachikuji commented on a change in pull request #9881: MINOR: Initialize QuorumState lazily in RaftClient.initialize()

2021-01-14 Thread GitBox
hachikuji commented on a change in pull request #9881: URL: https://github.com/apache/kafka/pull/9881#discussion_r557584121 ## File path: raft/src/main/java/org/apache/kafka/raft/RaftConfig.java ## @@ -129,16 +133,41 @@ public String toString() { QUORUM_LINGER_

[GitHub] [kafka] cmccabe commented on a change in pull request #9876: KAFKA-12183: Add the KIP-631 metadata record definitions

2021-01-14 Thread GitBox
cmccabe commented on a change in pull request #9876: URL: https://github.com/apache/kafka/pull/9876#discussion_r557580624 ## File path: build.gradle ## @@ -1010,6 +1015,53 @@ project(':core') { } } +project(':metadata') { + archivesBaseName = "kafka-metadata" + + depend

[GitHub] [kafka] cmccabe commented on a change in pull request #9876: KAFKA-12183: Add the KIP-631 metadata record definitions

2021-01-14 Thread GitBox
cmccabe commented on a change in pull request #9876: URL: https://github.com/apache/kafka/pull/9876#discussion_r557580302 ## File path: build.gradle ## @@ -1010,6 +1015,53 @@ project(':core') { } } +project(':metadata') { + archivesBaseName = "kafka-metadata" + + depend

[GitHub] [kafka] dajac commented on a change in pull request #9832: KAFKA-12152; Idempotent Producer does not reset the sequence number of partitions without in-flight batches

2021-01-14 Thread GitBox
dajac commented on a change in pull request #9832: URL: https://github.com/apache/kafka/pull/9832#discussion_r557576590 ## File path: clients/src/main/java/org/apache/kafka/clients/producer/internals/TransactionManager.java ## @@ -598,6 +618,16 @@ synchronized Integer sequence

[GitHub] [kafka] aloknnikhil commented on a change in pull request #9881: MINOR: Initialize QuorumState lazily in RaftClient.initialize()

2021-01-14 Thread GitBox
aloknnikhil commented on a change in pull request #9881: URL: https://github.com/apache/kafka/pull/9881#discussion_r557575111 ## File path: raft/src/test/java/org/apache/kafka/raft/RaftTestUtil.java ## @@ -0,0 +1,63 @@ +/* + * Licensed to the Apache Software Foundation (ASF) un

[GitHub] [kafka] aloknnikhil commented on a change in pull request #9881: MINOR: Initialize QuorumState lazily in RaftClient.initialize()

2021-01-14 Thread GitBox
aloknnikhil commented on a change in pull request #9881: URL: https://github.com/apache/kafka/pull/9881#discussion_r557574782 ## File path: raft/src/test/java/org/apache/kafka/raft/RaftConfigTest.java ## @@ -24,6 +24,7 @@ import java.util.HashMap; import java.util.Properties;

[GitHub] [kafka] aloknnikhil commented on a change in pull request #9881: MINOR: Initialize QuorumState lazily in RaftClient.initialize()

2021-01-14 Thread GitBox
aloknnikhil commented on a change in pull request #9881: URL: https://github.com/apache/kafka/pull/9881#discussion_r557574380 ## File path: raft/src/main/java/org/apache/kafka/raft/RaftConfig.java ## @@ -129,16 +133,41 @@ public String toString() { QUORUM_LINGE

[GitHub] [kafka] dajac commented on a change in pull request #9832: KAFKA-12152; Idempotent Producer does not reset the sequence number of partitions without in-flight batches

2021-01-14 Thread GitBox
dajac commented on a change in pull request #9832: URL: https://github.com/apache/kafka/pull/9832#discussion_r557574182 ## File path: clients/src/main/java/org/apache/kafka/clients/producer/internals/TransactionManager.java ## @@ -567,8 +571,18 @@ private void bumpIdempotentPr

[GitHub] [kafka] aloknnikhil commented on a change in pull request #9881: MINOR: Initialize QuorumState lazily in RaftClient.initialize()

2021-01-14 Thread GitBox
aloknnikhil commented on a change in pull request #9881: URL: https://github.com/apache/kafka/pull/9881#discussion_r557573785 ## File path: raft/src/main/java/org/apache/kafka/raft/RaftConfig.java ## @@ -129,16 +133,41 @@ public String toString() { QUORUM_LINGE

[GitHub] [kafka] aloknnikhil commented on a change in pull request #9881: MINOR: Initialize QuorumState lazily in RaftClient.initialize()

2021-01-14 Thread GitBox
aloknnikhil commented on a change in pull request #9881: URL: https://github.com/apache/kafka/pull/9881#discussion_r557571170 ## File path: raft/src/main/java/org/apache/kafka/raft/RaftConfig.java ## @@ -129,16 +133,41 @@ public String toString() { QUORUM_LINGE

[GitHub] [kafka] hachikuji commented on a change in pull request #9881: MINOR: Initialize QuorumState lazily in RaftClient.initialize()

2021-01-14 Thread GitBox
hachikuji commented on a change in pull request #9881: URL: https://github.com/apache/kafka/pull/9881#discussion_r557559024 ## File path: raft/src/main/java/org/apache/kafka/raft/RaftConfig.java ## @@ -129,16 +133,41 @@ public String toString() { QUORUM_LINGER_

[GitHub] [kafka] jsancio commented on a change in pull request #9816: KAFKA-10761: Kafka Raft update log start offset

2021-01-14 Thread GitBox
jsancio commented on a change in pull request #9816: URL: https://github.com/apache/kafka/pull/9816#discussion_r557565077 ## File path: core/src/main/scala/kafka/raft/KafkaMetadataLog.scala ## @@ -147,18 +199,106 @@ class KafkaMetadataLog( } override def createSnapshot(

[GitHub] [kafka] jsancio commented on a change in pull request #9816: KAFKA-10761: Kafka Raft update log start offset

2021-01-14 Thread GitBox
jsancio commented on a change in pull request #9816: URL: https://github.com/apache/kafka/pull/9816#discussion_r557563029 ## File path: core/src/main/scala/kafka/raft/KafkaMetadataLog.scala ## @@ -147,18 +199,106 @@ class KafkaMetadataLog( } override def createSnapshot(

[GitHub] [kafka] cadonna commented on pull request #9895: KAFKA-9924: Add docs for RocksDB properties-based metrics

2021-01-14 Thread GitBox
cadonna commented on pull request #9895: URL: https://github.com/apache/kafka/pull/9895#issuecomment-760336972 Call for review: @guozhangwang @ableegoldman @lct45 This is an automated message from the Apache Git Service. To

[GitHub] [kafka] cadonna opened a new pull request #9895: KAFKA-9924: Add docs for RocksDB properties-based metrics

2021-01-14 Thread GitBox
cadonna opened a new pull request #9895: URL: https://github.com/apache/kafka/pull/9895 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including upgrade

[GitHub] [kafka] jsancio commented on a change in pull request #9816: KAFKA-10761: Kafka Raft update log start offset

2021-01-14 Thread GitBox
jsancio commented on a change in pull request #9816: URL: https://github.com/apache/kafka/pull/9816#discussion_r557557769 ## File path: core/src/main/scala/kafka/raft/KafkaMetadataLog.scala ## @@ -147,18 +199,106 @@ class KafkaMetadataLog( } override def createSnapshot(

[GitHub] [kafka] jsancio commented on a change in pull request #9816: KAFKA-10761: Kafka Raft update log start offset

2021-01-14 Thread GitBox
jsancio commented on a change in pull request #9816: URL: https://github.com/apache/kafka/pull/9816#discussion_r557557769 ## File path: core/src/main/scala/kafka/raft/KafkaMetadataLog.scala ## @@ -147,18 +199,106 @@ class KafkaMetadataLog( } override def createSnapshot(

[GitHub] [kafka] jsancio commented on a change in pull request #9816: KAFKA-10761: Kafka Raft update log start offset

2021-01-14 Thread GitBox
jsancio commented on a change in pull request #9816: URL: https://github.com/apache/kafka/pull/9816#discussion_r557556584 ## File path: core/src/main/scala/kafka/raft/KafkaMetadataLog.scala ## @@ -147,18 +199,106 @@ class KafkaMetadataLog( } override def createSnapshot(

[jira] [Commented] (KAFKA-10877) Instantiating loggers for every FetchContext causes low request handler idle pool ratio.

2021-01-14 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17265009#comment-17265009 ] Ismael Juma commented on KAFKA-10877: - Sounds good. > Instantiating loggers for eve

  1   2   >