[GitHub] [kafka] dajac commented on a change in pull request #10141: KAFKA-12329; kafka-reassign-partitions command should give a better error message when a topic does not exist

2021-03-03 Thread GitBox
dajac commented on a change in pull request #10141: URL: https://github.com/apache/kafka/pull/10141#discussion_r586194412 ## File path: core/src/main/scala/kafka/admin/ReassignPartitionsCommand.scala ## @@ -812,6 +812,26 @@ object ReassignPartitionsCommand extends Logging {

[GitHub] [kafka] dajac commented on pull request #10234: MINOR; Clean up LeaderAndIsrResponse construction in `ReplicaManager#becomeLeaderOrFollower`

2021-03-03 Thread GitBox
dajac commented on pull request #10234: URL: https://github.com/apache/kafka/pull/10234#issuecomment-789522482 @chia7712 Thanks for the review. I just pushed a commit to address your comment. Could you take another look? Thi

[GitHub] [kafka] rhauch commented on pull request #10203: MINOR: Prepare for Gradle 7.0

2021-03-03 Thread GitBox
rhauch commented on pull request #10203: URL: https://github.com/apache/kafka/pull/10203#issuecomment-789526689 @ijuma, I ran `./gradlew clean install releaseTarGz -x signArchives` (which is still in the README) and it failed with: ``` * What went wrong: Task 'signArchives' not fou

[GitHub] [kafka] rhauch commented on pull request #10203: MINOR: Prepare for Gradle 7.0

2021-03-03 Thread GitBox
rhauch commented on pull request #10203: URL: https://github.com/apache/kafka/pull/10203#issuecomment-789538085 A few more things regarding `./gradlewAll publish` or `./gradlewAll install`: 1. Using `./gradlewAll publish` or `./gradlewAll install` does not appear to publish source, t

[GitHub] [kafka] rhauch edited a comment on pull request #10203: MINOR: Prepare for Gradle 7.0

2021-03-03 Thread GitBox
rhauch edited a comment on pull request #10203: URL: https://github.com/apache/kafka/pull/10203#issuecomment-789538085 A few more things regarding `./gradlewAll publishToMavenLocal ` or `./gradlewAll install`: 1. Using `./gradlewAll publish` or `./gradlewAll install` does not appear

[GitHub] [kafka] rhauch edited a comment on pull request #10203: MINOR: Prepare for Gradle 7.0

2021-03-03 Thread GitBox
rhauch edited a comment on pull request #10203: URL: https://github.com/apache/kafka/pull/10203#issuecomment-789538085 A few more things regarding `./gradlewAll publishToMavenLocal ` or `./gradlewAll install`: 1. These do not appear to publish source, test or test source JARs to the

[GitHub] [kafka] rhauch edited a comment on pull request #10203: MINOR: Prepare for Gradle 7.0

2021-03-03 Thread GitBox
rhauch edited a comment on pull request #10203: URL: https://github.com/apache/kafka/pull/10203#issuecomment-789538085 A few more things regarding `./gradlewAll publishToMavenLocal ` or `./gradlewAll install`: 1. These do not appear to publish source, test or test source JARs to the

[GitHub] [kafka] rhauch edited a comment on pull request #10203: MINOR: Prepare for Gradle 7.0

2021-03-03 Thread GitBox
rhauch edited a comment on pull request #10203: URL: https://github.com/apache/kafka/pull/10203#issuecomment-789538085 A few more things regarding `./gradlewAll publishToMavenLocal ` or `./gradlewAll install`: 1. These do not appear to publish source, test or test source JARs to the

[GitHub] [kafka] rhauch edited a comment on pull request #10203: MINOR: Prepare for Gradle 7.0

2021-03-03 Thread GitBox
rhauch edited a comment on pull request #10203: URL: https://github.com/apache/kafka/pull/10203#issuecomment-789538085 A few more things regarding `./gradlewAll publishToMavenLocal ` or `./gradlewAll install`: 1. These do not appear to publish source, test or test source JARs to the

[GitHub] [kafka] chia7712 commented on a change in pull request #10252: KAFKA-12403; Ensure local state deleted on `RemoveTopicRecord` received

2021-03-03 Thread GitBox
chia7712 commented on a change in pull request #10252: URL: https://github.com/apache/kafka/pull/10252#discussion_r586208095 ## File path: core/src/main/scala/kafka/server/metadata/MetadataPartitions.scala ## @@ -124,8 +125,30 @@ class MetadataPartitionsBuilder(val brokerId: In

[GitHub] [kafka] chia7712 commented on a change in pull request #10234: MINOR; Clean up LeaderAndIsrResponse construction in `ReplicaManager#becomeLeaderOrFollower`

2021-03-03 Thread GitBox
chia7712 commented on a change in pull request #10234: URL: https://github.com/apache/kafka/pull/10234#discussion_r586270002 ## File path: clients/src/main/java/org/apache/kafka/common/requests/LeaderAndIsrRequest.java ## @@ -145,24 +145,21 @@ public LeaderAndIsrResponse getEr

[GitHub] [kafka] dajac commented on a change in pull request #10234: MINOR; Clean up LeaderAndIsrResponse construction in `ReplicaManager#becomeLeaderOrFollower`

2021-03-03 Thread GitBox
dajac commented on a change in pull request #10234: URL: https://github.com/apache/kafka/pull/10234#discussion_r586285455 ## File path: clients/src/main/java/org/apache/kafka/common/requests/LeaderAndIsrRequest.java ## @@ -145,24 +145,21 @@ public LeaderAndIsrResponse getError

[GitHub] [kafka] chia7712 commented on a change in pull request #10234: MINOR; Clean up LeaderAndIsrResponse construction in `ReplicaManager#becomeLeaderOrFollower`

2021-03-03 Thread GitBox
chia7712 commented on a change in pull request #10234: URL: https://github.com/apache/kafka/pull/10234#discussion_r586289230 ## File path: clients/src/main/java/org/apache/kafka/common/requests/LeaderAndIsrRequest.java ## @@ -145,24 +145,21 @@ public LeaderAndIsrResponse getEr

[GitHub] [kafka] dajac commented on a change in pull request #10234: MINOR; Clean up LeaderAndIsrResponse construction in `ReplicaManager#becomeLeaderOrFollower`

2021-03-03 Thread GitBox
dajac commented on a change in pull request #10234: URL: https://github.com/apache/kafka/pull/10234#discussion_r586310444 ## File path: clients/src/main/java/org/apache/kafka/common/requests/LeaderAndIsrRequest.java ## @@ -145,24 +145,21 @@ public LeaderAndIsrResponse getError

[GitHub] [kafka] dajac commented on pull request #10234: MINOR; Clean up LeaderAndIsrResponse construction in `ReplicaManager#becomeLeaderOrFollower`

2021-03-03 Thread GitBox
dajac commented on pull request #10234: URL: https://github.com/apache/kafka/pull/10234#issuecomment-789621268 @chia7712 I just pushed another small commit to fix/improve `LeaderAndIsrRequestTest#testGetErrorResponse`. It was not testing all the versions as claimed. I have also added asser

[GitHub] [kafka] nicodds commented on pull request #10207: Fixing documentation source for issue KAFKA-12360

2021-03-03 Thread GitBox
nicodds commented on pull request #10207: URL: https://github.com/apache/kafka/pull/10207#issuecomment-789623547 ehy @mjsax, sorry for the delay! I updated the PR This is an automated message from the Apache Git Service. To r

[jira] [Created] (KAFKA-12404) Provision to propagate error message from Authorizer to clients

2021-03-03 Thread Giri (Jira)
Giri created KAFKA-12404: Summary: Provision to propagate error message from Authorizer to clients Key: KAFKA-12404 URL: https://issues.apache.org/jira/browse/KAFKA-12404 Project: Kafka Issue Type:

[GitHub] [kafka] priyavj08 commented on pull request #7898: KAFKA-9366: Change log4j dependency into log4j2

2021-03-03 Thread GitBox
priyavj08 commented on pull request #7898: URL: https://github.com/apache/kafka/pull/7898#issuecomment-789662902 @dongjinleekr really appreciate your guidance here. thanks for the patch. If I chose to not to move to this patch right away, can you please confirm that this vulnerabi

[GitHub] [kafka] chia7712 commented on a change in pull request #10234: MINOR; Clean up LeaderAndIsrResponse construction in `ReplicaManager#becomeLeaderOrFollower`

2021-03-03 Thread GitBox
chia7712 commented on a change in pull request #10234: URL: https://github.com/apache/kafka/pull/10234#discussion_r586390524 ## File path: clients/src/test/java/org/apache/kafka/common/requests/LeaderAndIsrRequestTest.java ## @@ -59,18 +61,41 @@ public void testUnsupportedVers

[GitHub] [kafka] chia7712 commented on a change in pull request #10078: MINOR: Some tests in clients module does not cover all available versions

2021-03-03 Thread GitBox
chia7712 commented on a change in pull request #10078: URL: https://github.com/apache/kafka/pull/10078#discussion_r586408680 ## File path: clients/src/main/java/org/apache/kafka/common/protocol/ApiKeys.java ## @@ -201,7 +201,7 @@ public short oldestVersion() { public Lis

[GitHub] [kafka] dongjinleekr commented on pull request #7898: KAFKA-9366: Change log4j dependency into log4j2

2021-03-03 Thread GitBox
dongjinleekr commented on pull request #7898: URL: https://github.com/apache/kafka/pull/7898#issuecomment-789735966 @priyavj08 I'm sorry that I can't be certain. But as far as I know, any project with log4j 1.2.7 is not safe. (It is why I have been working on this issue.) +1. I also

[GitHub] [kafka] dongjinleekr edited a comment on pull request #7898: KAFKA-9366: Change log4j dependency into log4j2

2021-03-03 Thread GitBox
dongjinleekr edited a comment on pull request #7898: URL: https://github.com/apache/kafka/pull/7898#issuecomment-784202224 Sorry for being late. Finally, here it is! I succeeded to backport this feature to the latest 2.7.0 release. (commit 466b798412) - working branch: [kafka-2.7+lo

[GitHub] [kafka] satishd commented on a change in pull request #10173: KAFKA-9548 Added SPIs and public classes/interfaces introduced in KIP-405 for tiered storage feature in Kafka.

2021-03-03 Thread GitBox
satishd commented on a change in pull request #10173: URL: https://github.com/apache/kafka/pull/10173#discussion_r586499056 ## File path: clients/src/main/java/org/apache/kafka/server/log/remote/storage/RemoteLogMetadataManager.java ## @@ -0,0 +1,200 @@ +/* + * Licensed to the

[jira] [Created] (KAFKA-12405) Broker without active topics still involved in coordinating consumer group

2021-03-03 Thread Alexander (Jira)
Alexander created KAFKA-12405: - Summary: Broker without active topics still involved in coordinating consumer group Key: KAFKA-12405 URL: https://issues.apache.org/jira/browse/KAFKA-12405 Project: Kafka

[jira] [Updated] (KAFKA-12405) Broker without active topics still involved in coordinating consumer group

2021-03-03 Thread Alexander (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander updated KAFKA-12405: -- Description: Short description: Broker without active topics and with inconsistent data still involve

[jira] [Updated] (KAFKA-12405) Inconsistent broker without active topics still involved in coordinating consumer group

2021-03-03 Thread Alexander (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander updated KAFKA-12405: -- Summary: Inconsistent broker without active topics still involved in coordinating consumer group (was

[GitHub] [kafka] ijuma commented on pull request #10203: MINOR: Prepare for Gradle 7.0

2021-03-03 Thread GitBox
ijuma commented on pull request #10203: URL: https://github.com/apache/kafka/pull/10203#issuecomment-789798301 Thanks for testing @rhauch! > @ijuma, I ran `./gradlew clean install releaseTarGz -x signArchives` (which is still in the README) and it failed with: The readme was w

[jira] [Updated] (KAFKA-12405) Inconsistent broker without active topics still involved in coordinating consumer group

2021-03-03 Thread Alexander (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander updated KAFKA-12405: -- Description: Short description: Broker without active topics and with inconsistent data still involve

[jira] [Updated] (KAFKA-12405) Inconsistent broker without active topics still involved in coordinating consumer group

2021-03-03 Thread Alexander (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander updated KAFKA-12405: -- Description: Short description: Broker without active topics and with inconsistent data still involve

[jira] [Updated] (KAFKA-12405) Inconsistent broker without active topics still involved in coordinating consumer group

2021-03-03 Thread Alexander (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander updated KAFKA-12405: -- Description: Short description: Broker without active topics and with inconsistent data still involve

[GitHub] [kafka] chia7712 commented on a change in pull request #10203: MINOR: Prepare for Gradle 7.0

2021-03-03 Thread GitBox
chia7712 commented on a change in pull request #10203: URL: https://github.com/apache/kafka/pull/10203#discussion_r586524651 ## File path: build.gradle ## @@ -933,49 +953,49 @@ project(':core') { ':connect:runtime:genSinkConnectorConfigDocs', ':

[GitHub] [kafka] chia7712 commented on pull request #10203: MINOR: Prepare for Gradle 7.0

2021-03-03 Thread GitBox
chia7712 commented on pull request #10203: URL: https://github.com/apache/kafka/pull/10203#issuecomment-789819700 The libs in distribution get changed. ### before https://user-images.githubusercontent.com/6234750/109832849-ba19b280-7c7b-11eb-8a8a-9190f72a9ef7.png";> ### afte

[GitHub] [kafka] ijuma commented on a change in pull request #10203: MINOR: Prepare for Gradle 7.0

2021-03-03 Thread GitBox
ijuma commented on a change in pull request #10203: URL: https://github.com/apache/kafka/pull/10203#discussion_r586553246 ## File path: build.gradle ## @@ -933,49 +953,49 @@ project(':core') { ':connect:runtime:genSinkConnectorConfigDocs', ':con

[GitHub] [kafka] ijuma commented on a change in pull request #10203: MINOR: Prepare for Gradle 7.0

2021-03-03 Thread GitBox
ijuma commented on a change in pull request #10203: URL: https://github.com/apache/kafka/pull/10203#discussion_r586553980 ## File path: build.gradle ## @@ -933,49 +953,49 @@ project(':core') { ':connect:runtime:genSinkConnectorConfigDocs', ':con

[GitHub] [kafka] chia7712 commented on a change in pull request #10203: MINOR: Prepare for Gradle 7.0

2021-03-03 Thread GitBox
chia7712 commented on a change in pull request #10203: URL: https://github.com/apache/kafka/pull/10203#discussion_r586554506 ## File path: build.gradle ## @@ -933,49 +953,49 @@ project(':core') { ':connect:runtime:genSinkConnectorConfigDocs', ':

[GitHub] [kafka] ijuma commented on a change in pull request #10203: MINOR: Prepare for Gradle 7.0

2021-03-03 Thread GitBox
ijuma commented on a change in pull request #10203: URL: https://github.com/apache/kafka/pull/10203#discussion_r586569305 ## File path: build.gradle ## @@ -933,49 +953,49 @@ project(':core') { ':connect:runtime:genSinkConnectorConfigDocs', ':con

[jira] [Updated] (KAFKA-12405) Inconsistent broker without active topics still involved in coordinating consumer group

2021-03-03 Thread Alexander (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander updated KAFKA-12405: -- Description: Short description: Broker without active topics and with inconsistent data still involve

[GitHub] [kafka] spena commented on a change in pull request #10211: KAFKA-12347: updating TaskMetadata

2021-03-03 Thread GitBox
spena commented on a change in pull request #10211: URL: https://github.com/apache/kafka/pull/10211#discussion_r586578441 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StandbyTask.java ## @@ -282,6 +284,21 @@ public boolean commitNeeded() {

[GitHub] [kafka] junrao merged pull request #10173: KAFKA-9548 Added SPIs and public classes/interfaces introduced in KIP-405 for tiered storage feature in Kafka.

2021-03-03 Thread GitBox
junrao merged pull request #10173: URL: https://github.com/apache/kafka/pull/10173 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [kafka] chia7712 commented on a change in pull request #10203: MINOR: Prepare for Gradle 7.0

2021-03-03 Thread GitBox
chia7712 commented on a change in pull request #10203: URL: https://github.com/apache/kafka/pull/10203#discussion_r586597356 ## File path: build.gradle ## @@ -1833,27 +1848,30 @@ project(':jmh-benchmarks') { apply plugin: 'com.github.johnrengelman.shadow' shadowJar { -

[jira] [Resolved] (KAFKA-9548) SPI - RemoteStorageManager and RemoteLogMetadataManager interfaces and related classes.

2021-03-03 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-9548. Fix Version/s: 3.0.0 Resolution: Fixed merged the PR to trunk > SPI - RemoteStorageManager and Remo

[GitHub] [kafka] spena commented on a change in pull request #10211: KAFKA-12347: updating TaskMetadata

2021-03-03 Thread GitBox
spena commented on a change in pull request #10211: URL: https://github.com/apache/kafka/pull/10211#discussion_r586605597 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamTask.java ## @@ -1136,6 +1144,22 @@ public boolean commitNeeded() {

[GitHub] [kafka] rhauch commented on a change in pull request #10203: MINOR: Prepare for Gradle 7.0

2021-03-03 Thread GitBox
rhauch commented on a change in pull request #10203: URL: https://github.com/apache/kafka/pull/10203#discussion_r586619026 ## File path: build.gradle ## @@ -1987,28 +2005,30 @@ project(':connect:json') { archivesBaseName = "connect-json" dependencies { -compile proj

[GitHub] [kafka] rhauch commented on a change in pull request #10203: MINOR: Prepare for Gradle 7.0

2021-03-03 Thread GitBox
rhauch commented on a change in pull request #10203: URL: https://github.com/apache/kafka/pull/10203#discussion_r586623841 ## File path: build.gradle ## @@ -2026,52 +2043,53 @@ project(':connect:runtime') { archivesBaseName = "connect-runtime" dependencies { - -comp

[GitHub] [kafka] hachikuji commented on a change in pull request #10184: MINOR: enable topic deletion in the KIP-500 controller

2021-03-03 Thread GitBox
hachikuji commented on a change in pull request #10184: URL: https://github.com/apache/kafka/pull/10184#discussion_r586632247 ## File path: metadata/src/main/java/org/apache/kafka/controller/ReplicationControlManager.java ## @@ -541,6 +575,64 @@ static void validateNewTopicNam

[GitHub] [kafka] jsancio opened a new pull request #10253: KAFKA-12376: Apply atomic append to the log

2021-03-03 Thread GitBox
jsancio opened a new pull request #10253: URL: https://github.com/apache/kafka/pull/10253 Append to the log in one batch when handling: 1. Client quota changes 2. Configuration changes 3. Feature changes 4. Topic creation *More detailed description of your change,

[GitHub] [kafka] ijuma commented on a change in pull request #10203: MINOR: Prepare for Gradle 7.0

2021-03-03 Thread GitBox
ijuma commented on a change in pull request #10203: URL: https://github.com/apache/kafka/pull/10203#discussion_r586642475 ## File path: build.gradle ## @@ -1987,28 +2005,30 @@ project(':connect:json') { archivesBaseName = "connect-json" dependencies { -compile proje

[GitHub] [kafka] hachikuji commented on a change in pull request #10252: KAFKA-12403; Ensure local state deleted on `RemoveTopicRecord` received

2021-03-03 Thread GitBox
hachikuji commented on a change in pull request #10252: URL: https://github.com/apache/kafka/pull/10252#discussion_r586643126 ## File path: core/src/main/scala/kafka/server/metadata/MetadataPartitions.scala ## @@ -204,9 +248,10 @@ class MetadataPartitionsBuilder(val brokerId: I

[GitHub] [kafka] wcarlson5 commented on a change in pull request #10211: KAFKA-12347: updating TaskMetadata

2021-03-03 Thread GitBox
wcarlson5 commented on a change in pull request #10211: URL: https://github.com/apache/kafka/pull/10211#discussion_r586622218 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StandbyTask.java ## @@ -282,6 +284,21 @@ public boolean commitNeeded()

[GitHub] [kafka] hachikuji commented on a change in pull request #10252: KAFKA-12403; Ensure local state deleted on `RemoveTopicRecord` received

2021-03-03 Thread GitBox
hachikuji commented on a change in pull request #10252: URL: https://github.com/apache/kafka/pull/10252#discussion_r586646515 ## File path: core/src/main/scala/kafka/server/metadata/MetadataPartitions.scala ## @@ -172,23 +203,36 @@ class MetadataPartitionsBuilder(val brokerId:

[GitHub] [kafka] mjsax commented on pull request #10207: Fixing documentation source for issue KAFKA-12360

2021-03-03 Thread GitBox
mjsax commented on pull request #10207: URL: https://github.com/apache/kafka/pull/10207#issuecomment-789936874 @nicodds -- Thinking about this again, I am actually wondering why the value must be smaller then `max.poll.interval.ms` ? If a tasks idles, we should will call `poll()` frequentl

[GitHub] [kafka] mjsax commented on pull request #10131: KAFKA-5146 / move kafka-streams example to a new module

2021-03-03 Thread GitBox
mjsax commented on pull request #10131: URL: https://github.com/apache/kafka/pull/10131#issuecomment-789939535 We have a larger PR in-progress that changes the gradle file significantly, and I expect conflicts (#10203). Wondering if we can just merge this PR or if it would be better to mer

[GitHub] [kafka] mjsax commented on a change in pull request #10131: KAFKA-5146 / move kafka-streams example to a new module

2021-03-03 Thread GitBox
mjsax commented on a change in pull request #10131: URL: https://github.com/apache/kafka/pull/10131#discussion_r586651685 ## File path: build.gradle ## @@ -1528,8 +1523,7 @@ project(':streams') { ':streams:upgrade-system-tests-24:test', ':streams:upgra

[GitHub] [kafka] mjsax commented on a change in pull request #10131: KAFKA-5146 / move kafka-streams example to a new module

2021-03-03 Thread GitBox
mjsax commented on a change in pull request #10131: URL: https://github.com/apache/kafka/pull/10131#discussion_r586652341 ## File path: streams-examples/.gitignore ## @@ -0,0 +1 @@ +/bin/ Review comment: Just curious. Why do we need this? ---

[GitHub] [kafka] ijuma commented on a change in pull request #10131: KAFKA-5146 / move kafka-streams example to a new module

2021-03-03 Thread GitBox
ijuma commented on a change in pull request #10131: URL: https://github.com/apache/kafka/pull/10131#discussion_r586670861 ## File path: build.gradle ## @@ -1403,12 +1403,7 @@ project(':streams') { dependencies { compile project(':clients') -// this dependency shou

[GitHub] [kafka] ijuma commented on a change in pull request #10131: KAFKA-5146 / move kafka-streams example to a new module

2021-03-03 Thread GitBox
ijuma commented on a change in pull request #10131: URL: https://github.com/apache/kafka/pull/10131#discussion_r586671249 ## File path: build.gradle ## @@ -974,8 +974,8 @@ project(':core') { from(project(':streams:streams-scala').configurations.runtime) { into("libs/") }

[GitHub] [kafka] mjsax commented on a change in pull request #10042: KAFKA-9527: fix NPE when using time-based argument for Stream Resetter

2021-03-03 Thread GitBox
mjsax commented on a change in pull request #10042: URL: https://github.com/apache/kafka/pull/10042#discussion_r586676476 ## File path: streams/src/test/java/org/apache/kafka/streams/tools/StreamsResetterTest.java ## @@ -76,6 +79,30 @@ public void testResetToSpecificOffsetWhe

[GitHub] [kafka] abbccdda commented on pull request #10240: KAFKA-12381: remove live broker checks for forwarding topic creation

2021-03-03 Thread GitBox
abbccdda commented on pull request #10240: URL: https://github.com/apache/kafka/pull/10240#issuecomment-789965233 New system test run: https://jenkins.confluent.io/job/system-test-kafka-branch-builder/4414/ This is an automa

[GitHub] [kafka] hachikuji commented on a change in pull request #10252: KAFKA-12403; Ensure local state deleted on `RemoveTopicRecord` received

2021-03-03 Thread GitBox
hachikuji commented on a change in pull request #10252: URL: https://github.com/apache/kafka/pull/10252#discussion_r586693956 ## File path: core/src/main/scala/kafka/server/metadata/MetadataPartitions.scala ## @@ -124,8 +125,30 @@ class MetadataPartitionsBuilder(val brokerId: I

[GitHub] [kafka] hachikuji commented on a change in pull request #10252: KAFKA-12403; Ensure local state deleted on `RemoveTopicRecord` received

2021-03-03 Thread GitBox
hachikuji commented on a change in pull request #10252: URL: https://github.com/apache/kafka/pull/10252#discussion_r586695760 ## File path: core/src/main/scala/kafka/server/metadata/MetadataPartitions.scala ## @@ -124,8 +125,30 @@ class MetadataPartitionsBuilder(val brokerId: I

[GitHub] [kafka] abbccdda commented on a change in pull request #10211: KAFKA-12347: updating TaskMetadata

2021-03-03 Thread GitBox
abbccdda commented on a change in pull request #10211: URL: https://github.com/apache/kafka/pull/10211#discussion_r586687918 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/TaskMetadata.java ## @@ -32,10 +34,22 @@ private final Set topicPartitions

[GitHub] [kafka] hachikuji commented on a change in pull request #10252: KAFKA-12403; Ensure local state deleted on `RemoveTopicRecord` received

2021-03-03 Thread GitBox
hachikuji commented on a change in pull request #10252: URL: https://github.com/apache/kafka/pull/10252#discussion_r586709124 ## File path: core/src/main/scala/kafka/server/metadata/MetadataPartitions.scala ## @@ -124,8 +125,30 @@ class MetadataPartitionsBuilder(val brokerId: I

[GitHub] [kafka] mjsax commented on a change in pull request #10150: KAFKA-3745: Add access to read-only key in value joiner

2021-03-03 Thread GitBox
mjsax commented on a change in pull request #10150: URL: https://github.com/apache/kafka/pull/10150#discussion_r586703617 ## File path: streams/src/test/java/org/apache/kafka/streams/kstream/internals/KStreamImplTest.java ## @@ -792,12 +802,24 @@ public void shouldNotAllowNul

[GitHub] [kafka] mjsax commented on a change in pull request #10131: KAFKA-5146 / move kafka-streams example to a new module

2021-03-03 Thread GitBox
mjsax commented on a change in pull request #10131: URL: https://github.com/apache/kafka/pull/10131#discussion_r586711923 ## File path: build.gradle ## @@ -974,8 +974,8 @@ project(':core') { from(project(':streams:streams-scala').configurations.runtime) { into("libs/") }

[GitHub] [kafka] mimaison merged pull request #10185: KAFKA-12284: wait for mm2 auto-created the topic

2021-03-03 Thread GitBox
mimaison merged pull request #10185: URL: https://github.com/apache/kafka/pull/10185 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [kafka] ijuma commented on a change in pull request #10203: MINOR: Prepare for Gradle 7.0

2021-03-03 Thread GitBox
ijuma commented on a change in pull request #10203: URL: https://github.com/apache/kafka/pull/10203#discussion_r586713849 ## File path: build.gradle ## @@ -1833,27 +1848,30 @@ project(':jmh-benchmarks') { apply plugin: 'com.github.johnrengelman.shadow' shadowJar { -

[GitHub] [kafka] ijuma commented on a change in pull request #10203: MINOR: Prepare for Gradle 7.0

2021-03-03 Thread GitBox
ijuma commented on a change in pull request #10203: URL: https://github.com/apache/kafka/pull/10203#discussion_r586713849 ## File path: build.gradle ## @@ -1833,27 +1848,30 @@ project(':jmh-benchmarks') { apply plugin: 'com.github.johnrengelman.shadow' shadowJar { -

[GitHub] [kafka] ijuma commented on a change in pull request #10131: KAFKA-5146 / move kafka-streams example to a new module

2021-03-03 Thread GitBox
ijuma commented on a change in pull request #10131: URL: https://github.com/apache/kafka/pull/10131#discussion_r586715706 ## File path: build.gradle ## @@ -974,8 +974,8 @@ project(':core') { from(project(':streams:streams-scala').configurations.runtime) { into("libs/") }

[GitHub] [kafka] hachikuji commented on a change in pull request #10252: KAFKA-12403; Ensure local state deleted on `RemoveTopicRecord` received

2021-03-03 Thread GitBox
hachikuji commented on a change in pull request #10252: URL: https://github.com/apache/kafka/pull/10252#discussion_r586724166 ## File path: core/src/main/scala/kafka/server/metadata/MetadataPartitions.scala ## @@ -172,23 +203,36 @@ class MetadataPartitionsBuilder(val brokerId:

[GitHub] [kafka] hachikuji commented on a change in pull request #10252: KAFKA-12403; Ensure local state deleted on `RemoveTopicRecord` received

2021-03-03 Thread GitBox
hachikuji commented on a change in pull request #10252: URL: https://github.com/apache/kafka/pull/10252#discussion_r586728427 ## File path: core/src/main/scala/kafka/server/metadata/BrokerMetadataListener.scala ## @@ -222,9 +216,16 @@ class BrokerMetadataListener(brokerId: Int

[GitHub] [kafka] hachikuji commented on a change in pull request #10252: KAFKA-12403; Ensure local state deleted on `RemoveTopicRecord` received

2021-03-03 Thread GitBox
hachikuji commented on a change in pull request #10252: URL: https://github.com/apache/kafka/pull/10252#discussion_r586724166 ## File path: core/src/main/scala/kafka/server/metadata/MetadataPartitions.scala ## @@ -172,23 +203,36 @@ class MetadataPartitionsBuilder(val brokerId:

[GitHub] [kafka] cmccabe commented on a change in pull request #10184: MINOR: enable topic deletion in the KIP-500 controller

2021-03-03 Thread GitBox
cmccabe commented on a change in pull request #10184: URL: https://github.com/apache/kafka/pull/10184#discussion_r586739230 ## File path: metadata/src/main/java/org/apache/kafka/controller/ReplicationControlManager.java ## @@ -541,6 +575,64 @@ static void validateNewTopicNames

[GitHub] [kafka] wcarlson5 commented on a change in pull request #10211: KAFKA-12347: updating TaskMetadata

2021-03-03 Thread GitBox
wcarlson5 commented on a change in pull request #10211: URL: https://github.com/apache/kafka/pull/10211#discussion_r586728619 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StandbyTask.java ## @@ -282,6 +284,21 @@ public boolean commitNeeded()

[jira] [Created] (KAFKA-12406) Fix broker-side client quotas in Raft mode

2021-03-03 Thread David Arthur (Jira)
David Arthur created KAFKA-12406: Summary: Fix broker-side client quotas in Raft mode Key: KAFKA-12406 URL: https://issues.apache.org/jira/browse/KAFKA-12406 Project: Kafka Issue Type: Bug

[GitHub] [kafka] mumrah opened a new pull request #10254: KAFKA-12406 Integrate client quotas with raft broker

2021-03-03 Thread GitBox
mumrah opened a new pull request #10254: URL: https://github.com/apache/kafka/pull/10254 This PR adds DescribeClientQuota RPC as a supported RPC of the raft broker. It also fixes the case where an empty set of entity filters in non-strict mode should return _all_ quota entities. Previously

[GitHub] [kafka] mumrah commented on a change in pull request #10253: KAFKA-12376: Apply atomic append to the log

2021-03-03 Thread GitBox
mumrah commented on a change in pull request #10253: URL: https://github.com/apache/kafka/pull/10253#discussion_r586756040 ## File path: metadata/src/main/java/org/apache/kafka/controller/ControllerResult.java ## @@ -28,15 +28,21 @@ class ControllerResult { private final

[GitHub] [kafka] abbccdda edited a comment on pull request #10240: KAFKA-12381: remove live broker checks for forwarding topic creation

2021-03-03 Thread GitBox
abbccdda edited a comment on pull request #10240: URL: https://github.com/apache/kafka/pull/10240#issuecomment-789965233 New system test run: https://jenkins.confluent.io/job/system-test-kafka-branch-builder/4415/ This is an

[GitHub] [kafka] mumrah merged pull request #9992: KAFKA-10759 Add ARM build stage

2021-03-03 Thread GitBox
mumrah merged pull request #9992: URL: https://github.com/apache/kafka/pull/9992 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Commented] (KAFKA-9296) Correlation id for response () does not match request ()

2021-03-03 Thread Cruz Fernandez (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294831#comment-17294831 ] Cruz Fernandez commented on KAFKA-9296: --- I'm seeing a very similar error on my Kafk

[GitHub] [kafka] mumrah commented on pull request #9872: KAFKA-10759: ARM support for Kafka

2021-03-03 Thread GitBox
mumrah commented on pull request #9872: URL: https://github.com/apache/kafka/pull/9872#issuecomment-790050150 This was merged to trunk as https://github.com/apache/kafka/commit/f40a82e05440e579c69363dc62c2dd9c8520eb02 This i

[GitHub] [kafka] mumrah closed pull request #9872: KAFKA-10759: ARM support for Kafka

2021-03-03 Thread GitBox
mumrah closed pull request #9872: URL: https://github.com/apache/kafka/pull/9872 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] jsancio commented on a change in pull request #10253: KAFKA-12376: Apply atomic append to the log

2021-03-03 Thread GitBox
jsancio commented on a change in pull request #10253: URL: https://github.com/apache/kafka/pull/10253#discussion_r586813520 ## File path: metadata/src/test/java/org/apache/kafka/metalog/LocalLogManager.java ## @@ -371,8 +371,21 @@ public void register(MetaLogListener listener)

[GitHub] [kafka] jsancio commented on a change in pull request #10253: KAFKA-12376: Apply atomic append to the log

2021-03-03 Thread GitBox
jsancio commented on a change in pull request #10253: URL: https://github.com/apache/kafka/pull/10253#discussion_r586814226 ## File path: metadata/src/main/java/org/apache/kafka/metalog/LocalLogManager.java ## @@ -328,8 +328,21 @@ public void register(MetaLogListener listener)

[GitHub] [kafka] jsancio commented on a change in pull request #10253: KAFKA-12376: Apply atomic append to the log

2021-03-03 Thread GitBox
jsancio commented on a change in pull request #10253: URL: https://github.com/apache/kafka/pull/10253#discussion_r586814323 ## File path: metadata/src/main/java/org/apache/kafka/metalog/LocalLogManager.java ## @@ -328,8 +328,21 @@ public void register(MetaLogListener listener)

[GitHub] [kafka] mimaison commented on pull request #9950: KAFKA-12170: Fix for Connect Cast SMT to correctly transform a Byte array into a string

2021-03-03 Thread GitBox
mimaison commented on pull request #9950: URL: https://github.com/apache/kafka/pull/9950#issuecomment-790111206 Test failures are not related: ``` JDK 8 / org.apache.kafka.connect.mirror.integration.MirrorConnectorsIntegrationSSLTest.testOneWayReplicationWithAutoOffsetSync() JDK 11

[GitHub] [kafka] mimaison merged pull request #9950: KAFKA-12170: Fix for Connect Cast SMT to correctly transform a Byte array into a string

2021-03-03 Thread GitBox
mimaison merged pull request #9950: URL: https://github.com/apache/kafka/pull/9950 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[jira] [Updated] (KAFKA-12170) Connect Cast cannot deal with fields of type "bytes" correctly

2021-03-03 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison updated KAFKA-12170: --- Fix Version/s: (was: 2.7.1) 3.0.0 > Connect Cast cannot deal with fie

[GitHub] [kafka] rhauch commented on a change in pull request #10203: MINOR: Prepare for Gradle 7.0

2021-03-03 Thread GitBox
rhauch commented on a change in pull request #10203: URL: https://github.com/apache/kafka/pull/10203#discussion_r586853160 ## File path: build.gradle ## @@ -1987,28 +2005,30 @@ project(':connect:json') { archivesBaseName = "connect-json" dependencies { -compile proj

[GitHub] [kafka] jolshan commented on pull request #9944: KAFKA-10580: Add topic ID support to Fetch request

2021-03-03 Thread GitBox
jolshan commented on pull request #9944: URL: https://github.com/apache/kafka/pull/9944#issuecomment-790133100 waiting on https://github.com/apache/kafka/pull/9758 before proceeding since this PR touches a lot of the same files.

[GitHub] [kafka] mjsax commented on a change in pull request #10131: KAFKA-5146 / move kafka-streams example to a new module

2021-03-03 Thread GitBox
mjsax commented on a change in pull request #10131: URL: https://github.com/apache/kafka/pull/10131#discussion_r586863239 ## File path: build.gradle ## @@ -974,8 +974,8 @@ project(':core') { from(project(':streams:streams-scala').configurations.runtime) { into("libs/") }

[GitHub] [kafka] mjsax commented on a change in pull request #10131: KAFKA-5146 / move kafka-streams example to a new module

2021-03-03 Thread GitBox
mjsax commented on a change in pull request #10131: URL: https://github.com/apache/kafka/pull/10131#discussion_r586863239 ## File path: build.gradle ## @@ -974,8 +974,8 @@ project(':core') { from(project(':streams:streams-scala').configurations.runtime) { into("libs/") }

[GitHub] [kafka] ijuma commented on a change in pull request #10131: KAFKA-5146 / move kafka-streams example to a new module

2021-03-03 Thread GitBox
ijuma commented on a change in pull request #10131: URL: https://github.com/apache/kafka/pull/10131#discussion_r586868205 ## File path: build.gradle ## @@ -974,8 +974,8 @@ project(':core') { from(project(':streams:streams-scala').configurations.runtime) { into("libs/") }

[GitHub] [kafka] hachikuji commented on pull request #9590: KAFKA-7556: KafkaConsumer.beginningOffsets does not return actual first offsets

2021-03-03 Thread GitBox
hachikuji commented on pull request #9590: URL: https://github.com/apache/kafka/pull/9590#issuecomment-790152137 @jolshan In `Log.completeSwapOperations`, we have the following comment: ``` // We create swap files for two cases: // (1) Log cleaning where multiple segment

[GitHub] [kafka] mjsax commented on a change in pull request #10131: KAFKA-5146 / move kafka-streams example to a new module

2021-03-03 Thread GitBox
mjsax commented on a change in pull request #10131: URL: https://github.com/apache/kafka/pull/10131#discussion_r586900476 ## File path: build.gradle ## @@ -974,8 +974,8 @@ project(':core') { from(project(':streams:streams-scala').configurations.runtime) { into("libs/") }

[GitHub] [kafka] junrao commented on a change in pull request #10184: MINOR: enable topic deletion in the KIP-500 controller

2021-03-03 Thread GitBox
junrao commented on a change in pull request #10184: URL: https://github.com/apache/kafka/pull/10184#discussion_r586880128 ## File path: core/src/test/scala/unit/kafka/server/ControllerApisTest.scala ## @@ -18,19 +18,26 @@ package unit.kafka.server Review comment: This

[GitHub] [kafka] jolshan commented on pull request #9590: KAFKA-7556: KafkaConsumer.beginningOffsets does not return actual first offsets

2021-03-03 Thread GitBox
jolshan commented on pull request #9590: URL: https://github.com/apache/kafka/pull/9590#issuecomment-790175685 @hachikuji thanks for the review. Just to clarify, you are suggesting updating/changing ``` val oldSegments = logSegments(swapSegment.baseOffset, swapSegment.readNextOffset)

[GitHub] [kafka] ableegoldman commented on a change in pull request #10131: KAFKA-5146 / move kafka-streams example to a new module

2021-03-03 Thread GitBox
ableegoldman commented on a change in pull request #10131: URL: https://github.com/apache/kafka/pull/10131#discussion_r586918859 ## File path: build.gradle ## @@ -974,8 +974,8 @@ project(':core') { from(project(':streams:streams-scala').configurations.runtime) { into("lib

[GitHub] [kafka] mjsax commented on a change in pull request #9744: KAFKA-10062: Add a method to retrieve the current timestamp as known by the Streams app

2021-03-03 Thread GitBox
mjsax commented on a change in pull request #9744: URL: https://github.com/apache/kafka/pull/9744#discussion_r586727033 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/ProcessorContext.java ## @@ -289,4 +291,33 @@ Cancellable schedule(final Duration inte

[GitHub] [kafka] ableegoldman commented on pull request #10251: MINOR: add missing docs for record-e2e-latency metrics

2021-03-03 Thread GitBox
ableegoldman commented on pull request #10251: URL: https://github.com/apache/kafka/pull/10251#issuecomment-790226079 Call for review also any of @lct45 @wcarlson5 @swist @mjsax This is an automated message from the Apache

[GitHub] [kafka] hachikuji commented on a change in pull request #10184: MINOR: enable topic deletion in the KIP-500 controller

2021-03-03 Thread GitBox
hachikuji commented on a change in pull request #10184: URL: https://github.com/apache/kafka/pull/10184#discussion_r586979443 ## File path: metadata/src/main/java/org/apache/kafka/controller/ReplicationControlManager.java ## @@ -349,6 +359,29 @@ public void replay(PartitionCha

  1   2   >