[jira] [Assigned] (KAFKA-13287) Upgrade RocksDB to 6.22.1.1

2021-09-09 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman reassigned KAFKA-13287: -- Assignee: Bruno Cadonna > Upgrade RocksDB to 6.22.1.1 >

[jira] [Assigned] (KAFKA-13216) Streams left/outer joins cause new internal changelog topic to grow unbounded

2021-09-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-13216: --- Assignee: Guozhang Wang > Streams left/outer joins cause new internal changelog

[GitHub] [kafka] mjsax closed pull request #11235: KAFKA-13216: write correct tombstones into stream-stream join store changelog

2021-09-09 Thread GitBox
mjsax closed pull request #11235: URL: https://github.com/apache/kafka/pull/11235 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] mjsax commented on pull request #11235: KAFKA-13216: write correct tombstones into stream-stream join store changelog

2021-09-09 Thread GitBox
mjsax commented on pull request #11235: URL: https://github.com/apache/kafka/pull/11235#issuecomment-916630468 Closing the PR in favor of #11252. The performance of this PR is really bad, while #11252 shows stable performance. -- This is an automated message from the Apache Git

[GitHub] [kafka] mjsax commented on a change in pull request #11252: KAFKA-13216: Use a KV with list serde for the shared store

2021-09-09 Thread GitBox
mjsax commented on a change in pull request #11252: URL: https://github.com/apache/kafka/pull/11252#discussion_r705883780 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamImplJoin.java ## @@ -280,85 +279,51 @@ private void

[jira] [Commented] (KAFKA-13256) Possible NPE in ConfigDef when rendering (enriched) RST or HTML when documentation is not set/NULL

2021-09-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412950#comment-17412950 ] Matthias J. Sax commented on KAFKA-13256: - Thanks. Just wondering if this PR fixes a non-problem

[GitHub] [kafka] ijuma commented on pull request #11017: KAFKA-12950 Replace EasyMock and PowerMock with Mockito for KafkaStream

2021-09-09 Thread GitBox
ijuma commented on pull request #11017: URL: https://github.com/apache/kafka/pull/11017#issuecomment-916526936 @chia7712 Conflicts are resolved. :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Created] (KAFKA-13288) Transaction find-hanging command with --broker-id excludes internal topics

2021-09-09 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-13288: --- Summary: Transaction find-hanging command with --broker-id excludes internal topics Key: KAFKA-13288 URL: https://issues.apache.org/jira/browse/KAFKA-13288

[GitHub] [kafka] mattwong949 commented on a change in pull request #10914: [KAFKA-8522] Streamline tombstone and transaction marker removal

2021-09-09 Thread GitBox
mattwong949 commented on a change in pull request #10914: URL: https://github.com/apache/kafka/pull/10914#discussion_r705721987 ## File path: core/src/main/scala/kafka/log/LogCleaner.scala ## @@ -658,23 +676,28 @@ private[log] class Cleaner(val id: Int, } }

[GitHub] [kafka] mattwong949 commented on a change in pull request #10914: [KAFKA-8522] Streamline tombstone and transaction marker removal

2021-09-09 Thread GitBox
mattwong949 commented on a change in pull request #10914: URL: https://github.com/apache/kafka/pull/10914#discussion_r705721022 ## File path: core/src/main/scala/kafka/log/LogCleanerManager.scala ## @@ -163,17 +168,18 @@ private[log] class LogCleanerManager(val logDirs:

[GitHub] [kafka] mattwong949 commented on a change in pull request #10914: [KAFKA-8522] Streamline tombstone and transaction marker removal

2021-09-09 Thread GitBox
mattwong949 commented on a change in pull request #10914: URL: https://github.com/apache/kafka/pull/10914#discussion_r705721022 ## File path: core/src/main/scala/kafka/log/LogCleanerManager.scala ## @@ -163,17 +168,18 @@ private[log] class LogCleanerManager(val logDirs:

[jira] [Assigned] (KAFKA-13164) State store is attached to wrong node in the Kafka Streams topology

2021-09-09 Thread Hao Li (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hao Li reassigned KAFKA-13164: -- Assignee: Hao Li > State store is attached to wrong node in the Kafka Streams topology >

[GitHub] [kafka] cadonna opened a new pull request #11317: KAFKA-13287: Upgrade RocksDB to 6.22.1.1

2021-09-09 Thread GitBox
cadonna opened a new pull request #11317: URL: https://github.com/apache/kafka/pull/11317 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including

[jira] [Updated] (KAFKA-13287) Upgrade RocksDB to 6.22.1.1

2021-09-09 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna updated KAFKA-13287: -- Fix Version/s: 3.1.0 > Upgrade RocksDB to 6.22.1.1 > --- > >

[jira] [Created] (KAFKA-13287) Upgrade RocksDB to 6.22.1.1

2021-09-09 Thread Bruno Cadonna (Jira)
Bruno Cadonna created KAFKA-13287: - Summary: Upgrade RocksDB to 6.22.1.1 Key: KAFKA-13287 URL: https://issues.apache.org/jira/browse/KAFKA-13287 Project: Kafka Issue Type: Task

[jira] [Updated] (KAFKA-13286) Revisit Streams State Store and Serde Implementation

2021-09-09 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-13286: -- Description: Kafka Streams state store is built in hierarchical layers as metered -> cached

[jira] [Created] (KAFKA-13286) Revisit Streams State Store and Serde Implementation

2021-09-09 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-13286: - Summary: Revisit Streams State Store and Serde Implementation Key: KAFKA-13286 URL: https://issues.apache.org/jira/browse/KAFKA-13286 Project: Kafka Issue

[jira] [Updated] (KAFKA-13272) KStream offset stuck after brokers outage

2021-09-09 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-13272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] F Méthot updated KAFKA-13272: - Description: Our KStream app offset stay stuck on 1 partition after outage possibly when exactly_once

[jira] [Updated] (KAFKA-13272) KStream offset stuck after brokers outage

2021-09-09 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-13272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] F Méthot updated KAFKA-13272: - Description: Our KStream app offset stay stuck on 1 partition after outage possibly when exactly_once

[jira] [Updated] (KAFKA-13272) KStream offset stuck after brokers outage

2021-09-09 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-13272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] F Méthot updated KAFKA-13272: - Description: Our KStream app offset stay stuck on 1 partition after outage possibly when exactly_once

[jira] [Updated] (KAFKA-13272) KStream offset stuck after brokers outage

2021-09-09 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-13272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] F Méthot updated KAFKA-13272: - Description: Our KStream app offset stay stuck on 1 partition after outage possibly when exactly_once

[jira] [Updated] (KAFKA-13272) KStream offset stuck after brokers outage

2021-09-09 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-13272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] F Méthot updated KAFKA-13272: - Description: Our KStream app offset stay stuck on 1 partition after outage possibly when exactly_once

[jira] [Updated] (KAFKA-13272) KStream offset stuck after brokers outage

2021-09-09 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-13272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] F Méthot updated KAFKA-13272: - Description: Our KStream app offset stay stuck on 1 partition after outage possibly when exactly_once

[jira] [Commented] (KAFKA-8334) Occasional OffsetCommit Timeout

2021-09-09 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412714#comment-17412714 ] Jun Rao commented on KAFKA-8334: [~geek-chen]: This is a server side issue. So you will need to upgrade

[GitHub] [kafka] junrao commented on pull request #11058: KAFKA-12802 Added a file based cache for consumed remote log metadata for each partition to avoid consuming again incase of broker restarts.

2021-09-09 Thread GitBox
junrao commented on pull request #11058: URL: https://github.com/apache/kafka/pull/11058#issuecomment-916281257 @satishd : Could you rebase this PR? Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Resolved] (KAFKA-12988) Change RLMM add/updateRemoteLogSegmentMetadata and putRemotePartitionDeleteMetadata APIS asynchronous.

2021-09-09 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-12988. - Fix Version/s: 3.1.0 Resolution: Fixed merged the PR to trunk. > Change RLMM

[GitHub] [kafka] junrao merged pull request #11033: KAFKA-12988 Asynchronous API support for RemoteLogMetadataManager add/update methods.

2021-09-09 Thread GitBox
junrao merged pull request #11033: URL: https://github.com/apache/kafka/pull/11033 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] jeqo opened a new pull request #11316: KAFKA-10544: Migrate KTable aggregate and reduce

2021-09-09 Thread GitBox
jeqo opened a new pull request #11316: URL: https://github.com/apache/kafka/pull/11316 As part of the migration of KStream/KTable operations to the new Processor API https://issues.apache.org/jira/browse/KAFKA-8410, this PR includes the migration of KTable aggregate/reduce operations.

[jira] [Resolved] (KAFKA-10542) Convert KTable maps to new PAPI

2021-09-09 Thread Jorge Esteban Quilcate Otoya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Esteban Quilcate Otoya resolved KAFKA-10542. -- Resolution: Fixed https://github.com/apache/kafka/pull/11099

[jira] [Resolved] (KAFKA-13201) Convert KTable suppress to new PAPI

2021-09-09 Thread Jorge Esteban Quilcate Otoya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Esteban Quilcate Otoya resolved KAFKA-13201. -- Resolution: Fixed https://github.com/apache/kafka/pull/11213

[jira] [Assigned] (KAFKA-13201) Convert KTable suppress to new PAPI

2021-09-09 Thread Jorge Esteban Quilcate Otoya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jorge Esteban Quilcate Otoya reassigned KAFKA-13201: Assignee: Jorge Esteban Quilcate Otoya > Convert KTable

[jira] [Assigned] (KAFKA-13256) Possible NPE in ConfigDef when rendering (enriched) RST or HTML when documentation is not set/NULL

2021-09-09 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison reassigned KAFKA-13256: -- Assignee: René Kerner > Possible NPE in ConfigDef when rendering (enriched) RST or

[jira] [Updated] (KAFKA-13256) Possible NPE in ConfigDef when rendering (enriched) RST or HTML when documentation is not set/NULL

2021-09-09 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison updated KAFKA-13256: --- Affects Version/s: 3.0.0 > Possible NPE in ConfigDef when rendering (enriched) RST or HTML

[jira] [Resolved] (KAFKA-13256) Possible NPE in ConfigDef when rendering (enriched) RST or HTML when documentation is not set/NULL

2021-09-09 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-13256. Fix Version/s: 3.1.0 Resolution: Fixed > Possible NPE in ConfigDef when rendering

[GitHub] [kafka] mimaison merged pull request #11287: KAFKA-13256 Fix possible NPE when ConfigDef renders RST or HTML and ConfigKey.documentation is unset/NULL

2021-09-09 Thread GitBox
mimaison merged pull request #11287: URL: https://github.com/apache/kafka/pull/11287 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] jeqo opened a new pull request #11315: KAFKA-10540: Migrate KStream aggregate operations

2021-09-09 Thread GitBox
jeqo opened a new pull request #11315: URL: https://github.com/apache/kafka/pull/11315 As part of the migration of KStream/KTable operations to the new Processor API https://issues.apache.org/jira/browse/KAFKA-8410, this PR includes the migration of KStream aggregate/reduce operations.

[jira] [Comment Edited] (KAFKA-10643) Static membership - repetitive PreparingRebalance with updating metadata for member reason

2021-09-09 Thread Maatari (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412670#comment-17412670 ] Maatari edited comment on KAFKA-10643 at 9/9/21, 4:18 PM: -- So just you know, we 

[jira] [Commented] (KAFKA-10643) Static membership - repetitive PreparingRebalance with updating metadata for member reason

2021-09-09 Thread Maatari (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412670#comment-17412670 ] Maatari commented on KAFKA-10643: - So just you know, we  tried, and it  has an  effect, but only to

[jira] [Comment Edited] (KAFKA-10643) Static membership - repetitive PreparingRebalance with updating metadata for member reason

2021-09-09 Thread Maatari (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412623#comment-17412623 ] Maatari edited comment on KAFKA-10643 at 9/9/21, 2:49 PM: -- [~gray.john] It

[jira] [Comment Edited] (KAFKA-10643) Static membership - repetitive PreparingRebalance with updating metadata for member reason

2021-09-09 Thread Maatari (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412623#comment-17412623 ] Maatari edited comment on KAFKA-10643 at 9/9/21, 2:48 PM: -- [~gray.john] It

[GitHub] [kafka] wcarlson5 commented on pull request #11278: KAFKA-12648: Enforce size limits for each task's cache

2021-09-09 Thread GitBox
wcarlson5 commented on pull request #11278: URL: https://github.com/apache/kafka/pull/11278#issuecomment-916170147 @guozhangwang I think there are defiantly questions to be answered about this and really what we want to the user to achieve. I think the maxbufferedbytes is really being

[jira] [Commented] (KAFKA-10643) Static membership - repetitive PreparingRebalance with updating metadata for member reason

2021-09-09 Thread Maatari (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412623#comment-17412623 ] Maatari commented on KAFKA-10643: - [~gray.john] It feels like disabling it altogether might make sense

[GitHub] [kafka] dajac merged pull request #11314: MINOR: Update LICENSE for 2.8.1

2021-09-09 Thread GitBox
dajac merged pull request #11314: URL: https://github.com/apache/kafka/pull/11314 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Created] (KAFKA-13285) Use consistent access modifier for Admin clients Result classes

2021-09-09 Thread Tom Bentley (Jira)
Tom Bentley created KAFKA-13285: --- Summary: Use consistent access modifier for Admin clients Result classes Key: KAFKA-13285 URL: https://issues.apache.org/jira/browse/KAFKA-13285 Project: Kafka

[jira] [Commented] (KAFKA-10643) Static membership - repetitive PreparingRebalance with updating metadata for member reason

2021-09-09 Thread John Gray (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412602#comment-17412602 ] John Gray commented on KAFKA-10643: --- [~maatdeamon] hey your understanding appears about as good as

[GitHub] [kafka] mimaison commented on a change in pull request #10983: mention IdentityReplicationPolicy in ops docs

2021-09-09 Thread GitBox
mimaison commented on a change in pull request #10983: URL: https://github.com/apache/kafka/pull/10983#discussion_r705288892 ## File path: docs/ops.html ## @@ -845,6 +845,11 @@

[GitHub] [kafka] patrickstuedi commented on a change in pull request #10798: KAFKA-9168: Adding direct byte buffer support to rocksdb state store

2021-09-09 Thread GitBox
patrickstuedi commented on a change in pull request #10798: URL: https://github.com/apache/kafka/pull/10798#discussion_r705268638 ## File path: streams/src/main/java/org/apache/kafka/streams/state/internals/RocksDBRangeIterator.java ## @@ -32,34 +34,49 @@ private final

[GitHub] [kafka] rk3rn3r commented on a change in pull request #11287: KAFKA-13256 Fix possible NPE when ConfigDef renders RST or HTML and ConfigKey.documentation is unset/NULL

2021-09-09 Thread GitBox
rk3rn3r commented on a change in pull request #11287: URL: https://github.com/apache/kafka/pull/11287#discussion_r705252513 ## File path: clients/src/main/java/org/apache/kafka/common/config/ConfigDef.java ## @@ -1372,11 +1372,13 @@ public String toEnrichedRst() { */

[GitHub] [kafka] rk3rn3r commented on a change in pull request #11287: KAFKA-13256 Fix possible NPE when ConfigDef renders RST or HTML and ConfigKey.documentation is unset/NULL

2021-09-09 Thread GitBox
rk3rn3r commented on a change in pull request #11287: URL: https://github.com/apache/kafka/pull/11287#discussion_r705251404 ## File path: clients/src/main/java/org/apache/kafka/common/config/ConfigDef.java ## @@ -1372,11 +1372,13 @@ public String toEnrichedRst() { */

[jira] [Commented] (KAFKA-10643) Static membership - repetitive PreparingRebalance with updating metadata for member reason

2021-09-09 Thread Maatari (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412498#comment-17412498 ] Maatari commented on KAFKA-10643: - [~gray.john] I do have state store to restore, it is happening. We

[GitHub] [kafka] mimaison commented on a change in pull request #11287: KAFKA-13256 Fix possible NPE when ConfigDef renders RST or HTML and ConfigKey.documentation is unset/NULL

2021-09-09 Thread GitBox
mimaison commented on a change in pull request #11287: URL: https://github.com/apache/kafka/pull/11287#discussion_r705140109 ## File path: clients/src/main/java/org/apache/kafka/common/config/ConfigDef.java ## @@ -1372,11 +1372,13 @@ public String toEnrichedRst() { */

[GitHub] [kafka] tombentley commented on a change in pull request #11301: KAFKA-13276: Prefer KafkaFuture in admin Result constructors

2021-09-09 Thread GitBox
tombentley commented on a change in pull request #11301: URL: https://github.com/apache/kafka/pull/11301#discussion_r705112124 ## File path: clients/src/main/java/org/apache/kafka/clients/admin/KafkaAdminClient.java ## @@ -3178,7 +3178,8 @@ public DescribeConsumerGroupsResult

[GitHub] [kafka] mimaison commented on pull request #10649: KAFKA-12762: Use connection timeout when polling the network for new …

2021-09-09 Thread GitBox
mimaison commented on pull request #10649: URL: https://github.com/apache/kafka/pull/10649#issuecomment-915876743 @rajinisivaram Thanks for the reviews. I hope we have answered your comments. Do you have any more questions? -- This is an automated message from the Apache Git Service. To

[GitHub] [kafka] dajac commented on pull request #11314: MINOR: Update LICENSE for 2.8.1

2021-09-09 Thread GitBox
dajac commented on pull request #11314: URL: https://github.com/apache/kafka/pull/11314#issuecomment-915807764 @omkreddy Could you have a quick look at this one please? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [kafka] dajac opened a new pull request #11314: MINOR: Update LICENSE for 2.8.1

2021-09-09 Thread GitBox
dajac opened a new pull request #11314: URL: https://github.com/apache/kafka/pull/11314 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including