[jira] [Commented] (KAFKA-12526) Remove deprecated long ms overloads

2021-03-24 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17308243#comment-17308243 ] Guozhang Wang commented on KAFKA-12526: --- Yes, I think this may be a subset of KAFKA-10434, it only

[jira] [Created] (KAFKA-12549) Allow state stores to opt-in transactional support

2021-03-24 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-12549: - Summary: Allow state stores to opt-in transactional support Key: KAFKA-12549 URL: https://issues.apache.org/jira/browse/KAFKA-12549 Project: Kafka Issue

[jira] [Commented] (KAFKA-12542) Unknown Output topic when Filter Processor is returning false

2021-03-24 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17308053#comment-17308053 ] Guozhang Wang commented on KAFKA-12542: --- Hi [~sinhash] I cannot tell if `dlqTopic:outputTopic` is

[jira] [Updated] (KAFKA-12527) Remove deprecated "PartitionGrouper" interface

2021-03-23 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12527: -- Summary: Remove deprecated "PartitionGrouper" interface (was: Remove deprecated

[jira] [Created] (KAFKA-12527) Remove deprecated "PartitionAssignor" interface

2021-03-23 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-12527: - Summary: Remove deprecated "PartitionAssignor" interface Key: KAFKA-12527 URL: https://issues.apache.org/jira/browse/KAFKA-12527 Project: Kafka Issue

[jira] [Created] (KAFKA-12526) Remove deprecated long ms overloads

2021-03-23 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-12526: - Summary: Remove deprecated long ms overloads Key: KAFKA-12526 URL: https://issues.apache.org/jira/browse/KAFKA-12526 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-12524) Remove deprecated WindowBytesStoreSupplier#segments

2021-03-22 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-12524: - Summary: Remove deprecated WindowBytesStoreSupplier#segments Key: KAFKA-12524 URL: https://issues.apache.org/jira/browse/KAFKA-12524 Project: Kafka Issue

[jira] [Commented] (KAFKA-12472) Add a Consumer / Streams metric to indicate the current rebalance status

2021-03-22 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306618#comment-17306618 ] Guozhang Wang commented on KAFKA-12472: --- I'm now actually thinking, that for transition rules we

[jira] [Commented] (KAFKA-10830) Kafka Producer API should throw unwrapped exceptions

2021-03-22 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306616#comment-17306616 ] Guozhang Wang commented on KAFKA-10830: --- Hi [~dongjin], I think [~bchen225242] is trying to tackle

[jira] [Resolved] (KAFKA-12514) NPE in SubscriptionState

2021-03-22 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-12514. --- Fix Version/s: 3.0.0 Resolution: Fixed > NPE in SubscriptionState >

[jira] [Commented] (KAFKA-12477) Smart rebalancing with dynamic protocol selection

2021-03-22 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306465#comment-17306465 ] Guozhang Wang commented on KAFKA-12477: --- Thanks! After reviewing the PR I think I get it that we

[jira] [Commented] (KAFKA-12519) Consider Removing Streams Old Built-in Metrics Version

2021-03-22 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306460#comment-17306460 ] Guozhang Wang commented on KAFKA-12519: --- Hmm, do you mean that, when user upgrade to 3.0, even

[jira] [Updated] (KAFKA-12506) Expand AdjustStreamThreadCountTest

2021-03-22 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12506: -- Description: Right now the AdjustStreamThreadCountTest runs a minimal topology that just

[jira] [Updated] (KAFKA-12506) Expand AdjustStreamThreadCountTest

2021-03-22 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12506: -- Description: Right now the AdjustStreamThreadCountTest runs a minimal topology that just

[jira] [Commented] (KAFKA-12519) Consider Removing Streams Old Built-in Metrics Version

2021-03-22 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306340#comment-17306340 ] Guozhang Wang commented on KAFKA-12519: --- Hello Bruno, just to clarify: you are suggesting we

[jira] [Commented] (KAFKA-12503) Resizing the thread cache in a non thread safe way can cause records to be redirected throughout the topology

2021-03-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304523#comment-17304523 ] Guozhang Wang commented on KAFKA-12503: --- Thanks for the summary [~wcarlson5] [~ableegoldman]. I'm

[jira] [Updated] (KAFKA-12472) Add a Consumer / Streams metric to indicate the current rebalance status

2021-03-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12472: -- Description: Today to trouble shoot a rebalance issue operators need to do a lot of manual

[jira] [Updated] (KAFKA-12472) Add a Consumer / Streams metric to indicate the current rebalance status

2021-03-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12472: -- Description: Today to trouble shoot a rebalance issue operators need to do a lot of manual

[jira] [Commented] (KAFKA-12472) Add a Consumer / Streams metric to indicate the current rebalance status

2021-03-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304295#comment-17304295 ] Guozhang Wang commented on KAFKA-12472: --- I just added a few more states for Streams, regarding

[jira] [Updated] (KAFKA-12464) Enhance constrained sticky Assign algorithm

2021-03-17 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12464: -- Labels: perfomance (was: ) > Enhance constrained sticky Assign algorithm >

[jira] [Updated] (KAFKA-12464) Enhance constrained sticky Assign algorithm

2021-03-17 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12464: -- Component/s: streams > Enhance constrained sticky Assign algorithm >

[jira] [Commented] (KAFKA-12478) Consumer group may lose data for newly expanded partitions when add partitions for topic if the group is set to consume from the latest

2021-03-17 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303739#comment-17303739 ] Guozhang Wang commented on KAFKA-12478: --- Hello [~hudeqi] this is a valid concern. One workaround

[jira] [Commented] (KAFKA-12475) Kafka Streams breaks EOS with remote state stores

2021-03-17 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303700#comment-17303700 ] Guozhang Wang commented on KAFKA-12475: --- +1 to [~cadonna]. I've seen some people using remote

[jira] [Comment Edited] (KAFKA-12472) Add a Consumer / Streams metric to indicate the current rebalance status

2021-03-17 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303621#comment-17303621 ] Guozhang Wang edited comment on KAFKA-12472 at 3/17/21, 6:31 PM: - Good

[jira] [Comment Edited] (KAFKA-12472) Add a Consumer / Streams metric to indicate the current rebalance status

2021-03-17 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303621#comment-17303621 ] Guozhang Wang edited comment on KAFKA-12472 at 3/17/21, 5:55 PM: - Good

[jira] [Commented] (KAFKA-12472) Add a Consumer / Streams metric to indicate the current rebalance status

2021-03-17 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303621#comment-17303621 ] Guozhang Wang commented on KAFKA-12472: --- Good questions. I'd like to dump some of my rough

[jira] [Comment Edited] (KAFKA-12477) Smart rebalancing with dynamic protocol selection

2021-03-16 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302260#comment-17302260 ] Guozhang Wang edited comment on KAFKA-12477 at 3/16/21, 6:56 AM: - I

[jira] [Comment Edited] (KAFKA-12477) Smart rebalancing with dynamic protocol selection

2021-03-16 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302260#comment-17302260 ] Guozhang Wang edited comment on KAFKA-12477 at 3/16/21, 6:55 AM: - I

[jira] [Commented] (KAFKA-12477) Smart rebalancing with dynamic protocol selection

2021-03-16 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302260#comment-17302260 ] Guozhang Wang commented on KAFKA-12477: --- I think this is a reasonable idea. Just clarifying one

[jira] [Updated] (KAFKA-10518) Consumer fetches could be inefficient when lags are unbalanced

2021-03-16 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-10518: -- Component/s: consumer > Consumer fetches could be inefficient when lags are unbalanced >

[jira] [Commented] (KAFKA-12463) Update default consumer partition assignor for sink tasks

2021-03-15 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302191#comment-17302191 ] Guozhang Wang commented on KAFKA-12463: --- Connect does not use ConsumerCoordinator but implements

[jira] [Commented] (KAFKA-12472) Add a Consumer / Streams metric to indicate the current rebalance status

2021-03-15 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302186#comment-17302186 ] Guozhang Wang commented on KAFKA-12472: --- Re. 1/2: Makes sense. I can distinguish them. Re. 3: My

[jira] [Commented] (KAFKA-12473) Make the CooperativeStickyAssignor the default assignor

2021-03-15 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302178#comment-17302178 ] Guozhang Wang commented on KAFKA-12473: --- Thanks for filing this [~ableegoldman]! The plan SGTM. >

[jira] [Updated] (KAFKA-12472) Add a Consumer / Streams metric to indicate the current rebalance status

2021-03-15 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12472: -- Description: Today to trouble shoot a rebalance issue operators need to do a lot of manual

[jira] [Updated] (KAFKA-12472) Add a Consumer / Streams metric to indicate the current rebalance status

2021-03-15 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12472: -- Description: Today to trouble shoot a rebalance issue operators need to do a lot of manual

[jira] [Updated] (KAFKA-12472) Add a Consumer / Streams metric to indicate the current rebalance status

2021-03-15 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12472: -- Description: Today to trouble shoot a rebalance issue operators need to do a lot of manual

[jira] [Updated] (KAFKA-12472) Add a Consumer / Streams metric to indicate the current rebalance status

2021-03-15 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12472: -- Description: Today to trouble shoot a rebalance issue operators need to do a lot of manual

[jira] [Updated] (KAFKA-12472) Add a Consumer / Streams metric to indicate the current rebalance status

2021-03-15 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12472: -- Description: Today to trouble shoot a rebalance issue operators need to do a lot of manual

[jira] [Updated] (KAFKA-12472) Add a Consumer / Streams metric to indicate the current rebalance status

2021-03-15 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12472: -- Description: Today to trouble shoot a rebalance issue operators need to do a lot of manual

[jira] [Created] (KAFKA-12472) Add a Consumer / Streams metric to indicate the current rebalance status

2021-03-15 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-12472: - Summary: Add a Consumer / Streams metric to indicate the current rebalance status Key: KAFKA-12472 URL: https://issues.apache.org/jira/browse/KAFKA-12472 Project:

[jira] [Updated] (KAFKA-12428) Add a last-heartbeat-seconds-ago metric to Kafka Consumer

2021-03-15 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12428: -- Labels: newbie++ (was: newbie) > Add a last-heartbeat-seconds-ago metric to Kafka Consumer >

[jira] [Updated] (KAFKA-12460) Raft should prevent truncation below high watermark

2021-03-12 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12460: -- Description: Eventually we will have to come up with some approach to recover from committed

[jira] [Commented] (KAFKA-12446) Define KGroupedTable#aggregate subtractor + adder order of execution

2021-03-11 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299967#comment-17299967 ] Guozhang Wang commented on KAFKA-12446: --- +1 as well to make it explicit on public docs! > Define

[jira] [Commented] (KAFKA-12457) Implications of KIP-516 for quorum controller

2021-03-11 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299964#comment-17299964 ] Guozhang Wang commented on KAFKA-12457: --- [~jolshan] [~hachikuji] Just curious, are we going to

[jira] [Commented] (KAFKA-6599) KTable KTable join semantics violated when caching enabled

2021-03-11 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299960#comment-17299960 ] Guozhang Wang commented on KAFKA-6599: -- Thanks [~aosipov] for your analysis! Though decouple caching

[jira] [Commented] (KAFKA-12428) Add a last-heartbeat-seconds-ago metric to Kafka Consumer

2021-03-11 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299798#comment-17299798 ] Guozhang Wang commented on KAFKA-12428: --- Hello [~ketulgupta], thanks for your interests in

[jira] [Commented] (KAFKA-12265) Move the BatchAccumulator in KafkaRaftClient to LeaderState

2021-03-11 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299790#comment-17299790 ] Guozhang Wang commented on KAFKA-12265: --- Thanks [~jagsancio] for the updated description! > Move

[jira] [Commented] (KAFKA-12428) Add a last-heartbeat-seconds-ago metric to Kafka Consumer

2021-03-04 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295791#comment-17295791 ] Guozhang Wang commented on KAFKA-12428: --- Thinking about this a bit, maybe it's better to have two

[jira] [Created] (KAFKA-12428) Add a last-heartbeat-seconds-ago metric to Kafka Consumer

2021-03-04 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-12428: - Summary: Add a last-heartbeat-seconds-ago metric to Kafka Consumer Key: KAFKA-12428 URL: https://issues.apache.org/jira/browse/KAFKA-12428 Project: Kafka

[jira] [Updated] (KAFKA-12428) Add a last-heartbeat-seconds-ago metric to Kafka Consumer

2021-03-04 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12428: -- Component/s: streams > Add a last-heartbeat-seconds-ago metric to Kafka Consumer >

[jira] [Created] (KAFKA-12419) Remove Deprecated APIs of Kafka Streams in 3.0

2021-03-04 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-12419: - Summary: Remove Deprecated APIs of Kafka Streams in 3.0 Key: KAFKA-12419 URL: https://issues.apache.org/jira/browse/KAFKA-12419 Project: Kafka Issue Type:

[jira] [Commented] (KAFKA-10847) Avoid spurious left/outer join results in stream-stream join

2021-02-24 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290685#comment-17290685 ] Guozhang Wang commented on KAFKA-10847: --- I agree that we should delete upon emitting expired

[jira] [Resolved] (KAFKA-12323) Record timestamps not populated in event

2021-02-23 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-12323. --- Resolution: Fixed > Record timestamps not populated in event >

[jira] [Commented] (KAFKA-12370) Refactor KafkaStreams exposed metadata hierarchy

2021-02-23 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289642#comment-17289642 ] Guozhang Wang commented on KAFKA-12370: --- Note this would be related to

[jira] [Created] (KAFKA-12370) Refactor KafkaStreams exposed metadata hierarchy

2021-02-23 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-12370: - Summary: Refactor KafkaStreams exposed metadata hierarchy Key: KAFKA-12370 URL: https://issues.apache.org/jira/browse/KAFKA-12370 Project: Kafka Issue

[jira] [Created] (KAFKA-12352) Improve debuggability with continuous consumer rebalances

2021-02-20 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-12352: - Summary: Improve debuggability with continuous consumer rebalances Key: KAFKA-12352 URL: https://issues.apache.org/jira/browse/KAFKA-12352 Project: Kafka

[jira] [Commented] (KAFKA-12169) Consumer can not know paritions change when client leader restart with static membership protocol

2021-02-19 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17287431#comment-17287431 ] Guozhang Wang commented on KAFKA-12169: --- Inside the AbstractCoordinator: {code} public

[jira] [Updated] (KAFKA-12169) Consumer can not know paritions change when client leader restart with static membership protocol

2021-02-19 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12169: -- Labels: bug (was: ) > Consumer can not know paritions change when client leader restart with

[jira] [Commented] (KAFKA-10847) Avoid spurious left/outer join results in stream-stream join

2021-02-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17286808#comment-17286808 ] Guozhang Wang commented on KAFKA-10847: --- [~spena][~vcrfxia][~mjsax] I'd like to dump some more

[jira] [Commented] (KAFKA-12323) Record timestamps not populated in event

2021-02-17 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17286016#comment-17286016 ] Guozhang Wang commented on KAFKA-12323: --- I checked the source code between 2.6 and trunk, and I

[jira] [Updated] (KAFKA-12313) Consider deprecating the default.windowed.serde.inner.class configs

2021-02-16 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12313: -- Fix Version/s: 3.0.0 > Consider deprecating the default.windowed.serde.inner.class configs >

[jira] [Commented] (KAFKA-12314) Leverage custom comparator for optimized range scans on RocksDB

2021-02-09 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282215#comment-17282215 ] Guozhang Wang commented on KAFKA-12314: --- cc [~vcrfxia] a PR from 3 years ago on using customized

[jira] [Commented] (KAFKA-10648) Add Prefix Scan support to State Stores

2021-02-03 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278283#comment-17278283 ] Guozhang Wang commented on KAFKA-10648: --- [~sagarrao] [~cadonna] Please feel free to resolve the

[jira] [Commented] (KAFKA-12265) Move the BatchAccumulator in KafkaRaftClient to LeaderState

2021-02-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276794#comment-17276794 ] Guozhang Wang commented on KAFKA-12265: --- Just curious why we need this move? Could you elaborate a

[jira] [Commented] (KAFKA-10793) Race condition in FindCoordinatorFuture permanently severs connection to group coordinator

2021-01-28 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17274187#comment-17274187 ] Guozhang Wang commented on KAFKA-10793: --- cc [~hachikuji] [~ijuma] Hopefully we nailed it this

[jira] [Commented] (KAFKA-12169) Consumer can not know paritions change when client leader restart with static membership protocol

2021-01-28 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17274181#comment-17274181 ] Guozhang Wang commented on KAFKA-12169: --- [~zoushengfu] by "restart with unknown member id", do you

[jira] [Updated] (KAFKA-12169) Consumer can not know paritions change when client leader restart with static membership protocol

2021-01-28 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12169: -- Summary: Consumer can not know paritions change when client leader restart with static

[jira] [Commented] (KAFKA-10847) Avoid spurious left/outer join results in stream-stream join

2021-01-28 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273421#comment-17273421 ] Guozhang Wang commented on KAFKA-10847: --- Also, I'm wondering if we have considered if we should

[jira] [Commented] (KAFKA-10847) Avoid spurious left/outer join results in stream-stream join

2021-01-28 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273417#comment-17273417 ] Guozhang Wang commented on KAFKA-10847: --- Hello [~spena], thanks for the detailed implementation

[jira] [Commented] (KAFKA-12242) Decouple state store materialization enforcement from name/serde provider

2021-01-26 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272362#comment-17272362 ] Guozhang Wang commented on KAFKA-12242: --- One idea is adding a flag parameter in Materialized to

[jira] [Created] (KAFKA-12242) Decouple state store materialization enforcement from name/serde provider

2021-01-26 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-12242: - Summary: Decouple state store materialization enforcement from name/serde provider Key: KAFKA-12242 URL: https://issues.apache.org/jira/browse/KAFKA-12242 Project:

[jira] [Commented] (KAFKA-10844) groupBy without shuffling

2021-01-19 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268152#comment-17268152 ] Guozhang Wang commented on KAFKA-10844: --- I agree with [~mjsax] that we can first look into fixing

[jira] [Commented] (KAFKA-10848) Allow fine grained control over cross-partition processing order

2021-01-19 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268141#comment-17268141 ] Guozhang Wang commented on KAFKA-10848: --- I'm thinking about maybe exposing a `RecordChooser`

[jira] [Resolved] (KAFKA-12219) Potential race condition in InMemoryKeyValueStore

2021-01-19 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-12219. --- Fix Version/s: 2.8.0 Resolution: Fixed > Potential race condition in

[jira] [Commented] (KAFKA-12207) Do not maintain list of latest producer append information

2021-01-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267668#comment-17267668 ] Guozhang Wang commented on KAFKA-12207: --- I'm +1 for this. For the magic number 1000 though, I'd

[jira] [Updated] (KAFKA-12207) Do not maintain list of latest producer append information

2021-01-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12207: -- Component/s: core > Do not maintain list of latest producer append information >

[jira] [Updated] (KAFKA-12190) Failure on Windows due to an UnsupportedOperationException when StateDirectory sets file permissions

2021-01-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12190: -- Labels: bug (was: ) > Failure on Windows due to an UnsupportedOperationException when >

[jira] [Commented] (KAFKA-12213) Kafka Streams aggregation Initializer to accept record key

2021-01-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267658#comment-17267658 ] Guozhang Wang commented on KAFKA-12213: --- [~mjsax] Maybe we can break KIP-149/159 into smaller ones

[jira] [Updated] (KAFKA-12223) Consider not to Treat Mixed Usage of Shared and Dedicated Block Caches among RocksDB State Stores as Illegal State

2021-01-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12223: -- Labels: metrics (was: ) > Consider not to Treat Mixed Usage of Shared and Dedicated Block

[jira] [Commented] (KAFKA-10637) KafkaProducer: IllegalMonitorStateException

2021-01-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267500#comment-17267500 ] Guozhang Wang commented on KAFKA-10637: --- Saw similar stack trace from Streams embedded producer as

[jira] [Commented] (KAFKA-10827) Consumer group coordinator node never gets updated for manual partition assignment with infrequent requests

2021-01-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267493#comment-17267493 ] Guozhang Wang commented on KAFKA-10827: --- Hi [~Jack-Lee], could you follow this process to submit a

[jira] [Assigned] (KAFKA-10793) Race condition in FindCoordinatorFuture permanently severs connection to group coordinator

2021-01-15 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reassigned KAFKA-10793: - Assignee: A. Sophie Blee-Goldman > Race condition in FindCoordinatorFuture permanently

[jira] [Updated] (KAFKA-10793) Race condition in FindCoordinatorFuture permanently severs connection to group coordinator

2021-01-15 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-10793: -- Fix Version/s: 2.8.0 > Race condition in FindCoordinatorFuture permanently severs connection

[jira] [Commented] (KAFKA-10827) Consumer group coordinator node never gets updated for manual partition assignment with infrequent requests

2021-01-12 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263670#comment-17263670 ] Guozhang Wang commented on KAFKA-10827: --- [~jaebinyo] That's a fair point, but I think the original

[jira] [Commented] (KAFKA-10853) Replication protocol deficiencies with workloads requiring high durability guarantees

2020-12-14 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249376#comment-17249376 ] Guozhang Wang commented on KAFKA-10853: --- [~ambroff] I'm wondering, in this case where admin

[jira] [Commented] (KAFKA-10788) Streamlining Tests in CachingInMemoryKeyValueStoreTest

2020-12-14 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249371#comment-17249371 ] Guozhang Wang commented on KAFKA-10788: --- [~sagarrao], could you provide some more context, e.g.

[jira] [Commented] (KAFKA-10827) Consumer group coordinator node never gets updated for manual partition assignment with infrequent requests

2020-12-09 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246777#comment-17246777 ] Guozhang Wang commented on KAFKA-10827: --- [~jaebinyo] I think your reasoning is right to the point.

[jira] [Created] (KAFKA-10830) Kafka Producer API should throw unwrapped exceptions

2020-12-08 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-10830: - Summary: Kafka Producer API should throw unwrapped exceptions Key: KAFKA-10830 URL: https://issues.apache.org/jira/browse/KAFKA-10830 Project: Kafka Issue

[jira] [Created] (KAFKA-10829) Kafka Streams handle produce exception improvement

2020-12-08 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-10829: - Summary: Kafka Streams handle produce exception improvement Key: KAFKA-10829 URL: https://issues.apache.org/jira/browse/KAFKA-10829 Project: Kafka Issue

[jira] [Commented] (KAFKA-10802) Spurious log message when starting consumers

2020-12-08 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246222#comment-17246222 ] Guozhang Wang commented on KAFKA-10802: --- I merged a PR in trunk recently for this issue: I think

[jira] [Updated] (KAFKA-10636) Bypass log validation for writes to raft log

2020-12-03 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-10636: -- Labels: raft-log-management (was: ) > Bypass log validation for writes to raft log >

[jira] [Commented] (KAFKA-10688) Handle accidental truncation of repartition topics as exceptional failure

2020-12-02 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17242772#comment-17242772 ] Guozhang Wang commented on KAFKA-10688: --- The main reason I did not go through the consumer route

[jira] [Commented] (KAFKA-10688) Handle accidental truncation of repartition topics as exceptional failure

2020-12-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241992#comment-17241992 ] Guozhang Wang commented on KAFKA-10688: --- Had some more discussions with [~cadonna] about different

[jira] [Updated] (KAFKA-10721) Rewrite topology to allow for overlapping unequal topic subscriptions

2020-11-16 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-10721: -- Labels: newbie++ (was: ) > Rewrite topology to allow for overlapping unequal topic

[jira] [Created] (KAFKA-10725) Merge StoreQueryIntegrationTest and QueryableStateIntegrationTest

2020-11-14 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-10725: - Summary: Merge StoreQueryIntegrationTest and QueryableStateIntegrationTest Key: KAFKA-10725 URL: https://issues.apache.org/jira/browse/KAFKA-10725 Project: Kafka

[jira] [Commented] (KAFKA-10575) StateRestoreListener#onRestoreEnd should always be triggered

2020-11-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229436#comment-17229436 ] Guozhang Wang commented on KAFKA-10575: --- Of course. You can take a look at the

[jira] [Commented] (KAFKA-10688) Handle accidental truncation of repartition topics as exceptional failure

2020-11-09 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17228844#comment-17228844 ] Guozhang Wang commented on KAFKA-10688: --- Normally the repartition topic should never have an

[jira] [Commented] (KAFKA-10688) Handle accidental truncation of repartition topics as exceptional failure

2020-11-06 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227545#comment-17227545 ] Guozhang Wang commented on KAFKA-10688: --- No we don't actually :) In StreamThread we handle

[jira] [Commented] (KAFKA-10604) The StreamsConfig.STATE_DIR_CONFIG's default value does not reflect the JVM parameter or OS-specific settings

2020-11-05 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227084#comment-17227084 ] Guozhang Wang commented on KAFKA-10604: --- I personally would prefer not a KIP for this

[jira] [Comment Edited] (KAFKA-10688) Handle accidental truncation of repartition topics as exceptional failure

2020-11-05 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227080#comment-17227080 ] Guozhang Wang edited comment on KAFKA-10688 at 11/5/20, 11:50 PM: --

<    1   2   3   4   5   6   7   8   9   10   >