[GitHub] [kafka] satishd commented on pull request #10424: MINOR Replaced File with Path in LogSegmentData.

2021-03-30 Thread GitBox
satishd commented on pull request #10424: URL: https://github.com/apache/kafka/pull/10424#issuecomment-809970485 @kowshik Addressed the comment. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [kafka] satishd commented on a change in pull request #10424: MINOR Replaced File with Path in LogSegmentData.

2021-03-30 Thread GitBox
satishd commented on a change in pull request #10424: URL: https://github.com/apache/kafka/pull/10424#discussion_r603835840 ## File path: clients/src/main/java/org/apache/kafka/server/log/remote/storage/RemoteLogSegmentMetadata.java ## @@ -178,10 +178,10 @@ public long endOffs

[GitHub] [kafka] dajac commented on pull request #10425: KAFKA-12573; Remove deprecated `Metric#value`

2021-03-30 Thread GitBox
dajac commented on pull request #10425: URL: https://github.com/apache/kafka/pull/10425#issuecomment-809983371 One test failed but it is not related to changes in this PR. Merging it to trunk. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [kafka] dajac merged pull request #10425: KAFKA-12573; Remove deprecated `Metric#value`

2021-03-30 Thread GitBox
dajac merged pull request #10425: URL: https://github.com/apache/kafka/pull/10425 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please c

[jira] [Resolved] (KAFKA-12573) Removed deprecated `Metric#value`

2021-03-30 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-12573. - Fix Version/s: 3.0.0 Reviewer: Ismael Juma Resolution: Fixed > Removed deprecate

[jira] [Created] (KAFKA-12577) Remove deprecated `quota.producer.default` and `quota.consumer.default` configurations

2021-03-30 Thread David Jacot (Jira)
David Jacot created KAFKA-12577: --- Summary: Remove deprecated `quota.producer.default` and `quota.consumer.default` configurations Key: KAFKA-12577 URL: https://issues.apache.org/jira/browse/KAFKA-12577

[GitHub] [kafka] satishd commented on pull request #10173: KAFKA-9548 Added SPIs and public classes/interfaces introduced in KIP-405 for tiered storage feature in Kafka.

2021-03-30 Thread GitBox
satishd commented on pull request #10173: URL: https://github.com/apache/kafka/pull/10173#issuecomment-80112 @kowshik @ijuma thanks for your review. Raised https://github.com/apache/kafka/pull/10424 to address your comments. -- This is an automated message from the Apache Git Servic

[jira] [Created] (KAFKA-12578) Remove deprecated PrincipalBuilder

2021-03-30 Thread Ismael Juma (Jira)
Ismael Juma created KAFKA-12578: --- Summary: Remove deprecated PrincipalBuilder Key: KAFKA-12578 URL: https://issues.apache.org/jira/browse/KAFKA-12578 Project: Kafka Issue Type: Task

[jira] [Created] (KAFKA-12579) Remove deprecated ExtendedSerializer/Deserializer

2021-03-30 Thread Ismael Juma (Jira)
Ismael Juma created KAFKA-12579: --- Summary: Remove deprecated ExtendedSerializer/Deserializer Key: KAFKA-12579 URL: https://issues.apache.org/jira/browse/KAFKA-12579 Project: Kafka Issue Type: T

[jira] [Created] (KAFKA-12580) Remove deprecated close(long, TimeUnit)

2021-03-30 Thread Ismael Juma (Jira)
Ismael Juma created KAFKA-12580: --- Summary: Remove deprecated close(long, TimeUnit) Key: KAFKA-12580 URL: https://issues.apache.org/jira/browse/KAFKA-12580 Project: Kafka Issue Type: Task

[jira] [Updated] (KAFKA-12578) Remove deprecated security classes/methods

2021-03-30 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-12578: Summary: Remove deprecated security classes/methods (was: Remove deprecated PrincipalBuilder) >

[GitHub] [kafka] ijuma opened a new pull request #10435: KAFKA-12578: Remove deprecated security classes/methods

2021-03-30 Thread GitBox
ijuma opened a new pull request #10435: URL: https://github.com/apache/kafka/pull/10435 More specifically: - Constants in SslConfigs - Constants in SaslConfigs - AclBinding constructor - AclBindingFilter constructor - PrincipalBuilder and DefaultPrincipalBuilder classes

[GitHub] [kafka] dajac commented on pull request #10427: KAFKA-12577; Remove deprecated `quota.producer.default` and `quota.consumer.default` configurations

2021-03-30 Thread GitBox
dajac commented on pull request #10427: URL: https://github.com/apache/kafka/pull/10427#issuecomment-810020286 @rajinisivaram @ijuma I propose to remove these two configurations that were deprecated in 0.11. There is a clear alternative which consists in using the default dynamic quotas. W

[GitHub] [kafka] ijuma commented on pull request #10435: KAFKA-12578: Remove deprecated security classes/methods

2021-03-30 Thread GitBox
ijuma commented on pull request #10435: URL: https://github.com/apache/kafka/pull/10435#issuecomment-810023871 I still need to update the upgrade notes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [kafka] chia7712 commented on pull request #9851: KAFKA-10769 Remove JoinGroupRequest#containsValidPattern as it is dup…

2021-03-30 Thread GitBox
chia7712 commented on pull request #9851: URL: https://github.com/apache/kafka/pull/9851#issuecomment-810025163 @highluck Could you merge trunk to trigger QA again? It seems our jenkins was on vacation before :) -- This is an automated message from the Apache Git Service. To respond to t

[GitHub] [kafka] kowshik commented on pull request #10401: KAFKA-12552: Introduce LogSegments class abstracting the segments map

2021-03-30 Thread GitBox
kowshik commented on pull request #10401: URL: https://github.com/apache/kafka/pull/10401#issuecomment-810028238 @junrao The jenkins tests have finished. I checked the test failures, they seem to be unrelated to this PR: ``` kafka.server.RaftClusterTest.testCreateClusterAndCreateL

[GitHub] [kafka] dajac opened a new pull request #10436: MINOR: Remove deprecated ConfigEntry constructor

2021-03-30 Thread GitBox
dajac opened a new pull request #10436: URL: https://github.com/apache/kafka/pull/10436 `ConfigEntry`'s constructor was deprecated in 1.1.0. It seems that we can safely remove it now. ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation

[GitHub] [kafka] dajac commented on pull request #10436: MINOR: Remove deprecated ConfigEntry constructor

2021-03-30 Thread GitBox
dajac commented on pull request #10436: URL: https://github.com/apache/kafka/pull/10436#issuecomment-810034992 I need to file a Jira and update the upgrade nodes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [kafka] dajac opened a new pull request #10437: MINOR: Remove deprecated `host.name`, `advertised.host.name`, `port` and `advertised.port` for 3.0

2021-03-30 Thread GitBox
dajac opened a new pull request #10437: URL: https://github.com/apache/kafka/pull/10437 TODO ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including upg

[jira] [Updated] (KAFKA-12579) Remove deprecated methods for consumer, producer and admin client

2021-03-30 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-12579: Summary: Remove deprecated methods for consumer, producer and admin client (was: Remove deprecate

[jira] [Resolved] (KAFKA-12580) Remove deprecated close(long, TimeUnit)

2021-03-30 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-12580. - Fix Version/s: (was: 3.0.0) Resolution: Duplicate Duplicate of KAFKA-12579. > Remove

[GitHub] [kafka] ijuma opened a new pull request #10438: KAFKA-12579: Remove deprecated methods from consumer, producer and admin client for 3.0

2021-03-30 Thread GitBox
ijuma opened a new pull request #10438: URL: https://github.com/apache/kafka/pull/10438 TBD (PR marked as Draft as there are still compiler errors) ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage an

[GitHub] [kafka] wituss opened a new pull request #10439: MINOR: Extend Predicate interface to allow combining and negation

2021-03-30 Thread GitBox
wituss opened a new pull request #10439: URL: https://github.com/apache/kafka/pull/10439 After this commit Predicate interface will be aligned as much as possible with the java.util.function.Predicate API. ### Committer Checklist (excluded from commit message) - [ ] Verify design

[jira] [Updated] (KAFKA-12579) Remove deprecated methods from consumer, producer

2021-03-30 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-12579: Summary: Remove deprecated methods from consumer, producer (was: Remove deprecated methods for co

[jira] [Updated] (KAFKA-12579) Remove deprecated methods for consumer, producer

2021-03-30 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-12579: Summary: Remove deprecated methods for consumer, producer (was: Remove deprecated methods for con

[jira] [Created] (KAFKA-12581) Remove deprecated Admin.electPreferredLeaders

2021-03-30 Thread Ismael Juma (Jira)
Ismael Juma created KAFKA-12581: --- Summary: Remove deprecated Admin.electPreferredLeaders Key: KAFKA-12581 URL: https://issues.apache.org/jira/browse/KAFKA-12581 Project: Kafka Issue Type: Task

[GitHub] [kafka] ijuma opened a new pull request #10440: KAFKA-12581: Remove deprecated `Admin.electPreferredLeaders`

2021-03-30 Thread GitBox
ijuma opened a new pull request #10440: URL: https://github.com/apache/kafka/pull/10440 `Admin.electLeaders` is the replacement. ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ]

[jira] [Commented] (KAFKA-12564) KTable#filter-method called twice after aggregation

2021-03-30 Thread Jessica Johann (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17311325#comment-17311325 ] Jessica Johann commented on KAFKA-12564: [~mjsax] Thanks for your feedback. Woul

[jira] [Created] (KAFKA-12582) Remove deprecated `ConfigEntry` constructor

2021-03-30 Thread David Jacot (Jira)
David Jacot created KAFKA-12582: --- Summary: Remove deprecated `ConfigEntry` constructor Key: KAFKA-12582 URL: https://issues.apache.org/jira/browse/KAFKA-12582 Project: Kafka Issue Type: Improve

[GitHub] [kafka] Iskuskov commented on pull request #9541: KAFKA-10675: Add schema name to ConnectSchema.validateValue() error message

2021-03-30 Thread GitBox
Iskuskov commented on pull request #9541: URL: https://github.com/apache/kafka/pull/9541#issuecomment-810163709 @rhauch, could you take a look at this please? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[jira] [Assigned] (KAFKA-12419) Remove Deprecated APIs of Kafka Streams in 3.0

2021-03-30 Thread Tomasz Nguyen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomasz Nguyen reassigned KAFKA-12419: - Assignee: Tomasz Nguyen > Remove Deprecated APIs of Kafka Streams in 3.0 >

[GitHub] [kafka] swist opened a new pull request #10441: KAFKA-12568, Remove deprecated "KStream#groupBy/join", "Joined#named" overloads

2021-03-30 Thread GitBox
swist opened a new pull request #10441: URL: https://github.com/apache/kafka/pull/10441 This is part of the work tracked in [KAFKA-12419](https://issues.apache.org/jira/browse/KAFKA-12419) as part of pre-3.0 cleanup *More detailed description of your change, if necessary. The

[GitHub] [kafka] chia7712 commented on a change in pull request #10435: KAFKA-12578: Remove deprecated security classes/methods for 3.0

2021-03-30 Thread GitBox
chia7712 commented on a change in pull request #10435: URL: https://github.com/apache/kafka/pull/10435#discussion_r604089974 ## File path: clients/src/main/java/org/apache/kafka/common/security/authenticator/DefaultKafkaPrincipalBuilder.java ## @@ -41,89 +39,39 @@ import java

[GitHub] [kafka] swist commented on pull request #10441: KAFKA-12568, Remove deprecated "KStream#groupBy/join", "Joined#named" overloads

2021-03-30 Thread GitBox
swist commented on pull request #10441: URL: https://github.com/apache/kafka/pull/10441#issuecomment-810262626 Dupe of #10421 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [kafka] swist closed pull request #10441: KAFKA-12568, Remove deprecated "KStream#groupBy/join", "Joined#named" overloads

2021-03-30 Thread GitBox
swist closed pull request #10441: URL: https://github.com/apache/kafka/pull/10441 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please c

[GitHub] [kafka] showuon opened a new pull request #10442: MINOR: update getMagic java doc

2021-03-30 Thread GitBox
showuon opened a new pull request #10442: URL: https://github.com/apache/kafka/pull/10442 Saw this java doc error while tracing codes. We forgot to update it while updating the method before: https://github.com/apache/kafka/pull/2657/files#diff-d3539714f9c04947365bf02a4dac4183aaba88e70d83b

[GitHub] [kafka] showuon commented on pull request #10442: MINOR: update getMagic java doc

2021-03-30 Thread GitBox
showuon commented on pull request #10442: URL: https://github.com/apache/kafka/pull/10442#issuecomment-810274523 @ijuma , could you help review this simple PR? Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[jira] [Commented] (KAFKA-7077) KIP-318: Make Kafka Connect Source idempotent

2021-03-30 Thread Alexandre Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17311554#comment-17311554 ] Alexandre Juma commented on KAFKA-7077: --- Indeed this could greatly benefit Kafka Co

[jira] [Created] (KAFKA-12583) Upgrade of netty-codec due to CVE-2021-21295

2021-03-30 Thread Dominique Mongelli (Jira)
Dominique Mongelli created KAFKA-12583: -- Summary: Upgrade of netty-codec due to CVE-2021-21295 Key: KAFKA-12583 URL: https://issues.apache.org/jira/browse/KAFKA-12583 Project: Kafka Issu

[jira] [Updated] (KAFKA-12583) Upgrade of netty-codec due to CVE-2021-21295

2021-03-30 Thread Dominique Mongelli (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dominique Mongelli updated KAFKA-12583: --- Fix Version/s: (was: 2.6.2) (was: 2.7.1)

[jira] [Updated] (KAFKA-12583) Upgrade of netty-codec due to CVE-2021-21295

2021-03-30 Thread Dominique Mongelli (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dominique Mongelli updated KAFKA-12583: --- Description: Our security tool raised the following security flaw on kafka 2.7: htt

[jira] [Updated] (KAFKA-12583) Upgrade of netty-codec due to CVE-2021-21295

2021-03-30 Thread Dominique Mongelli (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dominique Mongelli updated KAFKA-12583: --- Description: Our security tool raised the following security flaw on kafka 2.7: [ht

[GitHub] [kafka] ijuma commented on a change in pull request #10436: KAFKA-12577; Remove deprecated ConfigEntry constructor

2021-03-30 Thread GitBox
ijuma commented on a change in pull request #10436: URL: https://github.com/apache/kafka/pull/10436#discussion_r604171085 ## File path: docs/upgrade.html ## @@ -28,6 +28,8 @@ Notable changes in 3 The Streams API removed all deprecated APIs that were deprecated in version

[GitHub] [kafka] ijuma commented on pull request #10437: MINOR: Remove deprecated `host.name`, `advertised.host.name`, `port` and `advertised.port` for 3.0

2021-03-30 Thread GitBox
ijuma commented on pull request #10437: URL: https://github.com/apache/kafka/pull/10437#issuecomment-810327340 Makes sense. I assume you're planning to file a JIRA? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [kafka] ijuma edited a comment on pull request #10437: MINOR: Remove deprecated `host.name`, `advertised.host.name`, `port` and `advertised.port` for 3.0

2021-03-30 Thread GitBox
ijuma edited a comment on pull request #10437: URL: https://github.com/apache/kafka/pull/10437#issuecomment-810327340 Makes sense. I assume you're planning to file a JIRA and the upgrade note still? -- This is an automated message from the Apache Git Service. To respond to the message, p

[GitHub] [kafka] dajac commented on a change in pull request #10436: KAFKA-12577; Remove deprecated ConfigEntry constructor

2021-03-30 Thread GitBox
dajac commented on a change in pull request #10436: URL: https://github.com/apache/kafka/pull/10436#discussion_r604176897 ## File path: docs/upgrade.html ## @@ -28,6 +28,8 @@ Notable changes in 3 The Streams API removed all deprecated APIs that were deprecated in version

[GitHub] [kafka] dajac commented on pull request #10437: MINOR: Remove deprecated `host.name`, `advertised.host.name`, `port` and `advertised.port` for 3.0

2021-03-30 Thread GitBox
dajac commented on pull request #10437: URL: https://github.com/apache/kafka/pull/10437#issuecomment-810332800 @ijuma Yes, will do. The PR is not fully completed yet. I'll ping you once it is ready. -- This is an automated message from the Apache Git Service. To respond to the message, p

[GitHub] [kafka] ijuma commented on a change in pull request #10435: KAFKA-12578: Remove deprecated security classes/methods for 3.0

2021-03-30 Thread GitBox
ijuma commented on a change in pull request #10435: URL: https://github.com/apache/kafka/pull/10435#discussion_r604182448 ## File path: clients/src/main/java/org/apache/kafka/common/acl/AclBindingFilter.java ## @@ -50,18 +48,6 @@ public AclBindingFilter(ResourcePatternFilter p

[jira] [Created] (KAFKA-12584) Remove deprecated `Sum` and `Total` classes

2021-03-30 Thread David Jacot (Jira)
David Jacot created KAFKA-12584: --- Summary: Remove deprecated `Sum` and `Total` classes Key: KAFKA-12584 URL: https://issues.apache.org/jira/browse/KAFKA-12584 Project: Kafka Issue Type: Improve

[GitHub] [kafka] ijuma commented on a change in pull request #10436: KAFKA-12577; Remove deprecated ConfigEntry constructor

2021-03-30 Thread GitBox
ijuma commented on a change in pull request #10436: URL: https://github.com/apache/kafka/pull/10436#discussion_r604186633 ## File path: docs/upgrade.html ## @@ -28,6 +28,8 @@ Notable changes in 3 The Streams API removed all deprecated APIs that were deprecated in version

[GitHub] [kafka] chia7712 commented on a change in pull request #10435: KAFKA-12578: Remove deprecated security classes/methods for 3.0

2021-03-30 Thread GitBox
chia7712 commented on a change in pull request #10435: URL: https://github.com/apache/kafka/pull/10435#discussion_r604187554 ## File path: clients/src/main/java/org/apache/kafka/common/acl/AclBindingFilter.java ## @@ -50,18 +48,6 @@ public AclBindingFilter(ResourcePatternFilte

[GitHub] [kafka] ijuma commented on a change in pull request #10436: KAFKA-12577; Remove deprecated ConfigEntry constructor

2021-03-30 Thread GitBox
ijuma commented on a change in pull request #10436: URL: https://github.com/apache/kafka/pull/10436#discussion_r604187955 ## File path: docs/upgrade.html ## @@ -28,6 +28,8 @@ Notable changes in 3 The Streams API removed all deprecated APIs that were deprecated in version

[GitHub] [kafka] ijuma commented on pull request #10435: KAFKA-12578: Remove deprecated security classes/methods for 3.0

2021-03-30 Thread GitBox
ijuma commented on pull request #10435: URL: https://github.com/apache/kafka/pull/10435#issuecomment-810345988 Updated @chia7712 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[GitHub] [kafka] dajac commented on a change in pull request #10436: KAFKA-12577; Remove deprecated ConfigEntry constructor

2021-03-30 Thread GitBox
dajac commented on a change in pull request #10436: URL: https://github.com/apache/kafka/pull/10436#discussion_r604193906 ## File path: docs/upgrade.html ## @@ -28,6 +28,8 @@ Notable changes in 3 The Streams API removed all deprecated APIs that were deprecated in version

[GitHub] [kafka] dajac opened a new pull request #10443: KAFKA-8405; Remove deprecated `kafka-preferred-replica-election` command

2021-03-30 Thread GitBox
dajac opened a new pull request #10443: URL: https://github.com/apache/kafka/pull/10443 The `kafka-preferred-replica-election` command was deprecated in 2.4. As we removed the related APIs in the Admin client (https://github.com/apache/kafka/pull/10440), we can also remove the command lin

[GitHub] [kafka] dajac commented on pull request #10443: KAFKA-8405; Remove deprecated `kafka-preferred-replica-election` command

2021-03-30 Thread GitBox
dajac commented on pull request #10443: URL: https://github.com/apache/kafka/pull/10443#issuecomment-810349142 @ijuma What do you think about this one? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [kafka] dajac commented on pull request #10436: KAFKA-12577; Remove deprecated ConfigEntry constructor

2021-03-30 Thread GitBox
dajac commented on pull request #10436: URL: https://github.com/apache/kafka/pull/10436#issuecomment-810350507 @ijuma Updated the PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [kafka] ijuma commented on pull request #10443: KAFKA-8405; Remove deprecated `kafka-preferred-replica-election` command

2021-03-30 Thread GitBox
ijuma commented on pull request #10443: URL: https://github.com/apache/kafka/pull/10443#issuecomment-810368591 Good question. I think this script is more widely used since it has existed for a lot longer than the admin commands we have removed in #10440. One question: could the script just

[GitHub] [kafka] vvcephei commented on a change in pull request #10404: KAFKA-12557: Fix hanging KafkaAdminClientTest

2021-03-30 Thread GitBox
vvcephei commented on a change in pull request #10404: URL: https://github.com/apache/kafka/pull/10404#discussion_r604216817 ## File path: clients/src/test/java/org/apache/kafka/clients/admin/AdminClientUnitTestEnv.java ## @@ -113,6 +114,9 @@ public MockClient kafkaClient() {

[jira] [Resolved] (KAFKA-12435) Several streams-test-utils classes missing from javadoc

2021-03-30 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-12435. -- Resolution: Fixed > Several streams-test-utils classes missing from javadoc >

[GitHub] [kafka] chia7712 commented on pull request #10435: KAFKA-12578: Remove deprecated security classes/methods for 3.0

2021-03-30 Thread GitBox
chia7712 commented on pull request #10435: URL: https://github.com/apache/kafka/pull/10435#issuecomment-810385150 Is `Resource` exposed to users? It appears that we don't create `Resource` except for `Resource CLUSTER`. If `Resource` is not a kind of public APIs, I feel it can be removed a

[GitHub] [kafka] vvcephei commented on pull request #10404: KAFKA-12557: Fix hanging KafkaAdminClientTest

2021-03-30 Thread GitBox
vvcephei commented on pull request #10404: URL: https://github.com/apache/kafka/pull/10404#issuecomment-810405595 Confirmed that the tests still pass after that last small patch. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [kafka] vvcephei merged pull request #10404: KAFKA-12557: Fix hanging KafkaAdminClientTest

2021-03-30 Thread GitBox
vvcephei merged pull request #10404: URL: https://github.com/apache/kafka/pull/10404 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, pleas

[jira] [Resolved] (KAFKA-12557) org.apache.kafka.clients.admin.KafkaAdminClientTest#testClientSideTimeoutAfterFailureToReceiveResponse intermittently hangs indefinitely

2021-03-30 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-12557. -- Resolution: Fixed > org.apache.kafka.clients.admin.KafkaAdminClientTest#testClientSideTimeoutA

[GitHub] [kafka] hachikuji commented on pull request #10404: KAFKA-12557: Fix hanging KafkaAdminClientTest

2021-03-30 Thread GitBox
hachikuji commented on pull request #10404: URL: https://github.com/apache/kafka/pull/10404#issuecomment-810415561 @vvcephei @guozhangwang @ijuma The new tests still have race conditions which need to be fixed. I have a patch here: https://github.com/apache/kafka/pull/10398. -- This is

[GitHub] [kafka] junrao merged pull request #10401: KAFKA-12552: Introduce LogSegments class abstracting the segments map

2021-03-30 Thread GitBox
junrao merged pull request #10401: URL: https://github.com/apache/kafka/pull/10401 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [kafka] mumrah commented on a change in pull request #10398: MINOR: Fix newly added flaky test `testClientSideTimeoutAfterFailureTest`

2021-03-30 Thread GitBox
mumrah commented on a change in pull request #10398: URL: https://github.com/apache/kafka/pull/10398#discussion_r604267269 ## File path: clients/src/test/java/org/apache/kafka/clients/admin/KafkaAdminClientTest.java ## @@ -5325,12 +5326,23 @@ public void testClientSideTimeoutA

[jira] [Resolved] (KAFKA-12552) Extract segments map out of Log class into separate class

2021-03-30 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-12552. - Fix Version/s: 3.0.0 Resolution: Fixed Merged the PR to trunk. > Extract segments map out of Log

[GitHub] [kafka] junrao commented on pull request #10426: KAFKA-12571: Eliminate LeaderEpochFileCache constructor dependency on logEndOffset

2021-03-30 Thread GitBox
junrao commented on pull request #10426: URL: https://github.com/apache/kafka/pull/10426#issuecomment-810421289 @kowshik : Do you know why the tests timed out? Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[jira] [Commented] (KAFKA-12574) Deprecate eos-alpha

2021-03-30 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17311648#comment-17311648 ] Guozhang Wang commented on KAFKA-12574: --- I agree we should try to encourage users

[GitHub] [kafka] junrao commented on a change in pull request #10424: MINOR Replaced File with Path in LogSegmentData.

2021-03-30 Thread GitBox
junrao commented on a change in pull request #10424: URL: https://github.com/apache/kafka/pull/10424#discussion_r604277850 ## File path: clients/src/main/java/org/apache/kafka/server/log/remote/storage/RemoteLogSegmentMetadata.java ## @@ -82,26 +82,26 @@ /** * Cre

[GitHub] [kafka] guozhangwang commented on pull request #10407: KAFKA-12523: handle TaskCorruption/TimeoutException during handleCorruption and handleRevocation

2021-03-30 Thread GitBox
guozhangwang commented on pull request #10407: URL: https://github.com/apache/kafka/pull/10407#issuecomment-810429831 Thanks @ableegoldman ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

[GitHub] [kafka] guozhangwang commented on pull request #10345: KAFKA-12477: dynamically upgrade rebalancing protocol based on selected assignor

2021-03-30 Thread GitBox
guozhangwang commented on pull request #10345: URL: https://github.com/apache/kafka/pull/10345#issuecomment-810431786 Sounds great, will follow-up on KIP-726. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[jira] [Commented] (KAFKA-12574) Deprecate eos-alpha

2021-03-30 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17311685#comment-17311685 ] A. Sophie Blee-Goldman commented on KAFKA-12574: Yes, something like tha

[jira] [Commented] (KAFKA-12574) Deprecate eos-alpha

2021-03-30 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17311697#comment-17311697 ] Guozhang Wang commented on KAFKA-12574: --- Yeah.. I also felt this procedure require

[GitHub] [kafka] kowshik edited a comment on pull request #10280: KAFKA-12554: Refactor Log layer

2021-03-30 Thread GitBox
kowshik edited a comment on pull request #10280: URL: https://github.com/apache/kafka/pull/10280#issuecomment-808514958 @junrao Just a heads up on the following. I'm working on the changes for the following in separate PRs, these are related with refactoring the recovery logic (KAFKA-12553

[jira] [Updated] (KAFKA-12574) Deprecate eos-alpha

2021-03-30 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman updated KAFKA-12574: --- Labels: needs-kip (was: ) > Deprecate eos-alpha > --- > >

[jira] [Commented] (KAFKA-12574) Deprecate eos-alpha

2021-03-30 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17311717#comment-17311717 ] A. Sophie Blee-Goldman commented on KAFKA-12574: That SGTM -- if users b

[jira] [Updated] (KAFKA-12574) Deprecate eos-alpha

2021-03-30 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman updated KAFKA-12574: --- Priority: Blocker (was: Major) > Deprecate eos-alpha > ---

[GitHub] [kafka] kowshik commented on pull request #10426: KAFKA-12571: Eliminate LeaderEpochFileCache constructor dependency on logEndOffset

2021-03-30 Thread GitBox
kowshik commented on pull request #10426: URL: https://github.com/apache/kafka/pull/10426#issuecomment-810485209 @junrao Jenkins doesn't seem to be starting up tests after I rebased this morning. I'm not sure what's going on. I'll try again today. -- This is an automated message from the

[GitHub] [kafka] ableegoldman commented on pull request #10418: KAFKA-12509 Tighten up StateDirectory thread locking

2021-03-30 Thread GitBox
ableegoldman commented on pull request #10418: URL: https://github.com/apache/kafka/pull/10418#issuecomment-810512151 Just some known flaky test failures: `RaftClusterTest.testCreateClusterAndCreateListDeleteTopic()` and the timeout we've been seeing lately -- This is an automated messa

[GitHub] [kafka] ableegoldman commented on pull request #10418: KAFKA-12509 Tighten up StateDirectory thread locking

2021-03-30 Thread GitBox
ableegoldman commented on pull request #10418: URL: https://github.com/apache/kafka/pull/10418#issuecomment-810512500 Merged to trunk -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [kafka] ableegoldman merged pull request #10418: KAFKA-12509 Tighten up StateDirectory thread locking

2021-03-30 Thread GitBox
ableegoldman merged pull request #10418: URL: https://github.com/apache/kafka/pull/10418 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, p

[GitHub] [kafka] ableegoldman commented on a change in pull request #10342: KAFKA-12288: remove task-level filesystem locks

2021-03-30 Thread GitBox
ableegoldman commented on a change in pull request #10342: URL: https://github.com/apache/kafka/pull/10342#discussion_r604366210 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StateDirectory.java ## @@ -444,22 +408,30 @@ public synchronized vo

[jira] [Resolved] (KAFKA-12509) Tighten up StateDirectory thread locking

2021-03-30 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman resolved KAFKA-12509. Resolution: Fixed > Tighten up StateDirectory thread locking > ---

[jira] [Updated] (KAFKA-12509) Tighten up StateDirectory thread locking

2021-03-30 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman updated KAFKA-12509: --- Fix Version/s: 3.0.0 > Tighten up StateDirectory thread locking > --

[jira] [Commented] (KAFKA-12574) Deprecate eos-alpha

2021-03-30 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17311750#comment-17311750 ] Ismael Juma commented on KAFKA-12574: - A few comments: # I think eos-v2 would be a

[jira] [Commented] (KAFKA-12265) Move the BatchAccumulator in KafkaRaftClient to LeaderState

2021-03-30 Thread Jose Armando Garcia Sancio (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17311777#comment-17311777 ] Jose Armando Garcia Sancio commented on KAFKA-12265: [~rohitdeshaws]

[jira] [Commented] (KAFKA-12574) Deprecate eos-alpha

2021-03-30 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17311787#comment-17311787 ] A. Sophie Blee-Goldman commented on KAFKA-12574: > I think this is sligh

[GitHub] [kafka] hachikuji merged pull request #10398: MINOR: Fix newly added flaky test `testClientSideTimeoutAfterFailureTest`

2021-03-30 Thread GitBox
hachikuji merged pull request #10398: URL: https://github.com/apache/kafka/pull/10398 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, plea

[GitHub] [kafka] ableegoldman opened a new pull request #10444: HOTFIX: move rebalanceInProgress check to skip commit during handleCorrupted

2021-03-30 Thread GitBox
ableegoldman opened a new pull request #10444: URL: https://github.com/apache/kafka/pull/10444 Minor followup to https://github.com/apache/kafka/pull/10407 -- we need to extract the `rebalanceInProgress` check down into the `commitAndFillInConsumedOffsetsAndMetadataPerTaskMap` method which

[GitHub] [kafka] ableegoldman commented on a change in pull request #10444: HOTFIX: move rebalanceInProgress check to skip commit during handleCorrupted

2021-03-30 Thread GitBox
ableegoldman commented on a change in pull request #10444: URL: https://github.com/apache/kafka/pull/10444#discussion_r604505465 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java ## @@ -1013,28 +1016,34 @@ void addRecordsToTasks(

[GitHub] [kafka] ableegoldman commented on pull request #10411: KAFKA-7606: Remove deprecated options from StreamsResetter

2021-03-30 Thread GitBox
ableegoldman commented on pull request #10411: URL: https://github.com/apache/kafka/pull/10411#issuecomment-810653716 Some unrelated failures: `kafka.clients.admin.KafkaAdminClientTest.testClientSideTimeoutAfterFailureToReceiveResponse()` (failed on all three builds) `kafka.server.Ra

[GitHub] [kafka] ableegoldman edited a comment on pull request #10411: KAFKA-7606: Remove deprecated options from StreamsResetter

2021-03-30 Thread GitBox
ableegoldman edited a comment on pull request #10411: URL: https://github.com/apache/kafka/pull/10411#issuecomment-810653716 Some unrelated failures: `kafka.clients.admin.KafkaAdminClientTest.testClientSideTimeoutAfterFailureToReceiveResponse()` (failed on all three builds) `kafka.se

[GitHub] [kafka] ableegoldman commented on pull request #10342: KAFKA-12288: remove task-level filesystem locks

2021-03-30 Thread GitBox
ableegoldman commented on pull request #10342: URL: https://github.com/apache/kafka/pull/10342#issuecomment-810654638 Some unrelated failures: `streams.integration.EosIntegrationTest.shouldNotViolateEosIfOneTaskFailsWithState[exactly_once_beta]` `kafka.clients.admin.KafkaAdminClientT

[GitHub] [kafka] ableegoldman merged pull request #10342: KAFKA-12288: remove task-level filesystem locks

2021-03-30 Thread GitBox
ableegoldman merged pull request #10342: URL: https://github.com/apache/kafka/pull/10342 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, p

[jira] [Updated] (KAFKA-12288) Remove task-level filesystem locks

2021-03-30 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman updated KAFKA-12288: --- Fix Version/s: (was: 2.8.1) (was: 2.7.2)

[GitHub] [kafka] kowshik commented on pull request #10426: KAFKA-12571: Eliminate LeaderEpochFileCache constructor dependency on logEndOffset

2021-03-30 Thread GitBox
kowshik commented on pull request #10426: URL: https://github.com/apache/kafka/pull/10426#issuecomment-810660718 @junrao The jenkins tests have finished. I checked the test failures, they seem to be unrelated to this PR: ``` JDK 11: org.apache.kafka.connect.integration.RebalanceS

[jira] [Created] (KAFKA-12585) FencedInstanceIdException can cause heartbeat thread to never be closed

2021-03-30 Thread Brian Hawkins (Jira)
Brian Hawkins created KAFKA-12585: - Summary: FencedInstanceIdException can cause heartbeat thread to never be closed Key: KAFKA-12585 URL: https://issues.apache.org/jira/browse/KAFKA-12585 Project: Ka

[GitHub] [kafka] mjsax commented on a change in pull request #10411: KAFKA-7606: Remove deprecated options from StreamsResetter

2021-03-30 Thread GitBox
mjsax commented on a change in pull request #10411: URL: https://github.com/apache/kafka/pull/10411#discussion_r604515864 ## File path: core/src/main/scala/kafka/tools/StreamsResetter.java ## @@ -247,14 +246,10 @@ private void parseArguments(final String[] args) {

  1   2   >