[jira] [Commented] (KAFKA-15326) Decouple Processing Thread from Polling Thread

2023-11-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17787544#comment-17787544 ] Guozhang Wang commented on KAFKA-15326: --- My bad not linking the first couple of PRs with this

[jira] [Commented] (KAFKA-15602) Breaking change in 3.4.0 ByteBufferSerializer

2023-10-29 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17780759#comment-17780759 ] Guozhang Wang commented on KAFKA-15602: --- [~luke.kirby] Thanks for reporting the issue, I read

[jira] [Commented] (KAFKA-13152) Replace "buffered.records.per.partition" & "cache.max.bytes.buffering" with "{statestore.cache}/{input.buffer}.max.bytes"

2023-10-15 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17775500#comment-17775500 ] Guozhang Wang commented on KAFKA-13152: --- At the moment I'm afraid I might become the bottleneck if

[jira] [Commented] (KAFKA-15297) Cache flush order might not be topological order

2023-08-08 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17752108#comment-17752108 ] Guozhang Wang commented on KAFKA-15297: --- {{We are not sure if we should not instead decouple

[jira] [Commented] (KAFKA-15259) Kafka Streams does not continue processing due to rollback despite ProductionExceptionHandlerResponse.CONTINUE if using exactly_once

2023-08-07 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751878#comment-17751878 ] Guozhang Wang commented on KAFKA-15259: --- Got it, KAFKA-15309 makes sense. > Kafka Streams does

[jira] [Commented] (KAFKA-15302) Stale value returned when using store.all() in punctuation function.

2023-08-07 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751830#comment-17751830 ] Guozhang Wang commented on KAFKA-15302: --- I think case I'm not sure if this is defined as a bug

[jira] [Commented] (KAFKA-15259) Kafka Streams does not continue processing due to rollback despite ProductionExceptionHandlerResponse.CONTINUE if using execute_once

2023-08-07 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751824#comment-17751824 ] Guozhang Wang commented on KAFKA-15259: --- [~mjsax] Did you mean a different ticket other than

[jira] [Commented] (KAFKA-15297) Cache flush order might not be topological order

2023-08-07 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751821#comment-17751821 ] Guozhang Wang commented on KAFKA-15297: --- I think this is indeed a general issue, that state stores

[jira] [Commented] (KAFKA-15302) Stale value returned when using store.all() in punctuation function.

2023-08-06 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751403#comment-17751403 ] Guozhang Wang commented on KAFKA-15302: --- [~jinyong.choi] to help us better understand your issue,

[jira] [Commented] (KAFKA-12317) Relax non-null key requirement for left/outer KStream joins

2023-08-02 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750491#comment-17750491 ] Guozhang Wang commented on KAFKA-12317: --- Thanks [~aki] ! Will take a look soon. > Relax non-null

[jira] [Commented] (KAFKA-12829) Remove Deprecated methods under Topology

2023-08-02 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750490#comment-17750490 ] Guozhang Wang commented on KAFKA-12829: --- [~pegasas] Your comment seems deleted, are you still

[jira] [Commented] (KAFKA-14748) Relax non-null FK left-join requirement

2023-07-27 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17748285#comment-17748285 ] Guozhang Wang commented on KAFKA-14748: --- [~aki] Thanks for picking this series! I think we can

[jira] [Commented] (KAFKA-12317) Relax non-null key requirement for left/outer KStream joins

2023-07-27 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17748284#comment-17748284 ] Guozhang Wang commented on KAFKA-12317: --- [~mjsax] Though it may not introduce any new configs or

[jira] [Commented] (KAFKA-15240) BrokerToControllerChannelManager cache activeController error cause DefaultAlterPartitionManager send AlterPartition request failed

2023-07-27 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17748281#comment-17748281 ] Guozhang Wang commented on KAFKA-15240: --- [~lushilin] Thanks for reporting this. I think [~cmccabe]

[jira] [Commented] (KAFKA-15215) The default.dsl.store config is not compatible with custom state stores

2023-07-23 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17746106#comment-17746106 ] Guozhang Wang commented on KAFKA-15215: --- Just realized I have not read the KIP! :) At first glance

[jira] [Commented] (KAFKA-15215) The default.dsl.store config is not compatible with custom state stores

2023-07-23 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17746102#comment-17746102 ] Guozhang Wang commented on KAFKA-15215: --- [~ableegoldman] Thanks for bringing this up! I agree that

[jira] [Commented] (KAFKA-14639) Kafka CooperativeStickyAssignor revokes/assigns partition in one rebalance cycle

2023-03-28 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706162#comment-17706162 ] Guozhang Wang commented on KAFKA-14639: --- Had some chat with [~pnee] today regarding the

[jira] [Commented] (KAFKA-14639) Kafka CooperativeStickyAssignor revokes/assigns partition in one rebalance cycle

2023-03-27 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17705734#comment-17705734 ] Guozhang Wang commented on KAFKA-14639: --- As for the fix.. it's quite tough, since the ultimate and

[jira] [Commented] (KAFKA-14639) Kafka CooperativeStickyAssignor revokes/assigns partition in one rebalance cycle

2023-03-27 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17705731#comment-17705731 ] Guozhang Wang commented on KAFKA-14639: --- I looked at both JIRA tickets and I believe the root

[jira] [Created] (KAFKA-14847) Separate the callers of commitAllTasks v.s. commitTasks for EOS(-v2) and ALOS

2023-03-24 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-14847: - Summary: Separate the callers of commitAllTasks v.s. commitTasks for EOS(-v2) and ALOS Key: KAFKA-14847 URL: https://issues.apache.org/jira/browse/KAFKA-14847

[jira] [Commented] (KAFKA-13295) Long restoration times for new tasks can lead to transaction timeouts

2023-03-21 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703404#comment-17703404 ] Guozhang Wang commented on KAFKA-13295: --- [~sagarrao] I had a chat with others driving the 4.0

[jira] [Updated] (KAFKA-13295) Long restoration times for new tasks can lead to transaction timeouts

2023-03-21 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-13295: -- Fix Version/s: (was: 4.0.0) > Long restoration times for new tasks can lead to

[jira] [Commented] (KAFKA-14172) bug: State stores lose state when tasks are reassigned under EOS wit…

2023-03-08 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698180#comment-17698180 ] Guozhang Wang commented on KAFKA-14172: --- [~gray.john][~Horslev] I took a deep look into this issue

[jira] [Commented] (KAFKA-14748) Relax non-null FK left-join requirement

2023-03-06 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697167#comment-17697167 ] Guozhang Wang commented on KAFKA-14748: --- Cool! We are on the same page for the first question

[jira] [Commented] (KAFKA-14748) Relax non-null FK left-join requirement

2023-03-03 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696279#comment-17696279 ] Guozhang Wang commented on KAFKA-14748: --- For table-table FK left-joins, if we have record B whose

[jira] [Commented] (KAFKA-14533) Flaky Test SmokeTestDriverIntegrationTest.shouldWorkWithRebalance

2023-03-02 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695888#comment-17695888 ] Guozhang Wang commented on KAFKA-14533: --- After some investigation I found the following: 1. In

[jira] [Resolved] (KAFKA-12639) AbstractCoordinator ignores backoff timeout when joining the consumer group

2023-02-28 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-12639. --- Fix Version/s: 3.5.0 Resolution: Fixed > AbstractCoordinator ignores backoff timeout

[jira] [Commented] (KAFKA-14533) Flaky Test SmokeTestDriverIntegrationTest.shouldWorkWithRebalance

2023-02-28 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694801#comment-17694801 ] Guozhang Wang commented on KAFKA-14533: --- I took some time into this, also cannot find any clues

[jira] [Commented] (KAFKA-14748) Relax non-null FK left-join requirement

2023-02-28 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694652#comment-17694652 ] Guozhang Wang commented on KAFKA-14748: --- I agree for Stream-Stream joins now, since for the case

[jira] [Commented] (KAFKA-14747) FK join should record discarded subscription responses

2023-02-27 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694213#comment-17694213 ] Guozhang Wang commented on KAFKA-14747: --- Echoing that, I think we can piggy-back on the existing

[jira] [Commented] (KAFKA-14748) Relax non-null FK left-join requirement

2023-02-27 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694147#comment-17694147 ] Guozhang Wang commented on KAFKA-14748: --- Originally I think this can be treated without a KIP,

[jira] [Resolved] (KAFKA-14253) StreamsPartitionAssignor should print the member count in assignment logs

2023-02-16 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-14253. --- Fix Version/s: 3.5.0 Resolution: Fixed > StreamsPartitionAssignor should print the

[jira] [Commented] (KAFKA-13152) Replace "buffered.records.per.partition" & "cache.max.bytes.buffering" with "{statestore.cache}/{input.buffer}.max.bytes"

2023-02-14 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688684#comment-17688684 ] Guozhang Wang commented on KAFKA-13152: --- Thanks [~mimaison], this is still quite relevant and we'd

[jira] [Commented] (KAFKA-12639) AbstractCoordinator ignores backoff timeout when joining the consumer group

2023-02-02 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17683598#comment-17683598 ] Guozhang Wang commented on KAFKA-12639: --- Yeah that would work better I think. >

[jira] [Commented] (KAFKA-14382) StreamThreads can miss rebalance events when processing records during a rebalance

2023-01-20 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679346#comment-17679346 ] Guozhang Wang commented on KAFKA-14382: --- Thanks for catching this bug [~ableegoldman]! I'm late

[jira] [Updated] (KAFKA-14382) StreamThreads can miss rebalance events when processing records during a rebalance

2023-01-20 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-14382: -- Labels: new-consumer-threading-should-fix rebalancing (was: rebalancing) > StreamThreads can

[jira] [Created] (KAFKA-14641) Cleanup CommitNeeded after EOS-V1 is removed

2023-01-19 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-14641: - Summary: Cleanup CommitNeeded after EOS-V1 is removed Key: KAFKA-14641 URL: https://issues.apache.org/jira/browse/KAFKA-14641 Project: Kafka Issue Type:

[jira] [Updated] (KAFKA-14641) Cleanup CommitNeeded after EOS-V1 is removed

2023-01-19 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-14641: -- Component/s: streams > Cleanup CommitNeeded after EOS-V1 is removed >

[jira] [Commented] (KAFKA-14328) KafkaAdminClient should be Changing the exception level When an exception occurs

2022-10-27 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625256#comment-17625256 ] Guozhang Wang commented on KAFKA-14328: --- Hello [~shizhenzhen] sorry for the late reply. I was OOO

[jira] [Commented] (KAFKA-14270) Kafka Streams logs exception on startup

2022-10-02 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17612165#comment-17612165 ] Guozhang Wang commented on KAFKA-14270: --- Thanks for filing the bug [~eikemeier], will take a look.

[jira] [Comment Edited] (KAFKA-14260) InMemoryKeyValueStore iterator still throws ConcurrentModificationException

2022-10-02 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17612164#comment-17612164 ] Guozhang Wang edited comment on KAFKA-14260 at 10/3/22 3:50 AM: Hello

[jira] [Commented] (KAFKA-14260) InMemoryKeyValueStore iterator still throws ConcurrentModificationException

2022-10-02 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17612164#comment-17612164 ] Guozhang Wang commented on KAFKA-14260: --- Hello [~aviperksy] sorry for the late reply! >

[jira] [Commented] (KAFKA-14269) Partition Assignment Strategy - Topic Round Robin Assignor

2022-10-02 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17612163#comment-17612163 ] Guozhang Wang commented on KAFKA-14269: --- Hello [~mathieu.amblard], thanks for reporting this use

[jira] [Updated] (KAFKA-4852) ByteBufferSerializer not compatible with offsets

2022-09-29 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4852: - Fix Version/s: 3.4.0 > ByteBufferSerializer not compatible with offsets >

[jira] [Commented] (KAFKA-10635) Streams application fails with OutOfOrderSequenceException after rolling restarts of brokers

2022-09-26 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609798#comment-17609798 ] Guozhang Wang commented on KAFKA-10635: --- HI [~nicktelford] just making sure you get the latest

[jira] [Commented] (KAFKA-14260) InMemoryKeyValueStore iterator still throws ConcurrentModificationException

2022-09-26 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17609705#comment-17609705 ] Guozhang Wang commented on KAFKA-14260: --- Hello [~aviperksy] just checking is

[jira] [Updated] (KAFKA-12370) Refactor KafkaStreams exposed metadata hierarchy

2022-09-26 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12370: -- Description: Currently in KafkaStreams we have two groups of metadata getter: 1. {code}

[jira] [Comment Edited] (KAFKA-10635) Streams application fails with OutOfOrderSequenceException after rolling restarts of brokers

2022-09-20 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17607329#comment-17607329 ] Guozhang Wang edited comment on KAFKA-10635 at 9/20/22 5:20 PM: Could

[jira] [Commented] (KAFKA-10635) Streams application fails with OutOfOrderSequenceException after rolling restarts of brokers

2022-09-20 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17607329#comment-17607329 ] Guozhang Wang commented on KAFKA-10635: --- Could you try out this patch

[jira] [Commented] (KAFKA-10635) Streams application fails with OutOfOrderSequenceException after rolling restarts of brokers

2022-09-19 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17606711#comment-17606711 ] Guozhang Wang commented on KAFKA-10635: --- >From the logs, I think the OOOSException was thrown

[jira] [Commented] (KAFKA-12634) Should checkpoint after restore finished

2022-09-16 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17606009#comment-17606009 ] Guozhang Wang commented on KAFKA-12634: --- We should be able to close this ticket once KAFKA-10199

[jira] [Commented] (KAFKA-13561) Consider deprecating `StreamsBuilder#build(props)` function

2022-09-16 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17606007#comment-17606007 ] Guozhang Wang commented on KAFKA-13561: --- Hi [~showuon], as we are now working on KIP-862 I think

[jira] [Commented] (KAFKA-10575) StateRestoreListener#onRestoreEnd should always be triggered

2022-09-16 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17605945#comment-17605945 ] Guozhang Wang commented on KAFKA-10575: --- I've just created a new KIP:

[jira] [Commented] (KAFKA-10575) StateRestoreListener#onRestoreEnd should always be triggered

2022-09-16 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17605911#comment-17605911 ] Guozhang Wang commented on KAFKA-10575: --- Hello [~nicktelford] thanks for your inputs! Yes I'm now

[jira] [Created] (KAFKA-14239) Merge StateRestorationIntegrationTest into RestoreIntegrationTest

2022-09-16 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-14239: - Summary: Merge StateRestorationIntegrationTest into RestoreIntegrationTest Key: KAFKA-14239 URL: https://issues.apache.org/jira/browse/KAFKA-14239 Project: Kafka

[jira] [Commented] (KAFKA-10635) Streams application fails with OutOfOrderSequenceException after rolling restarts of brokers

2022-09-14 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17604838#comment-17604838 ] Guozhang Wang commented on KAFKA-10635: --- Hmm okay I think we'd need to reproduce this which can

[jira] [Commented] (KAFKA-10635) Streams application fails with OutOfOrderSequenceException after rolling restarts of brokers

2022-09-13 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17603789#comment-17603789 ] Guozhang Wang commented on KAFKA-10635: --- Hi [~nicktelford], regarding the broker's behavior: >

[jira] [Commented] (KAFKA-14224) Consumer should auto-commit prior to cooperative partition revocation

2022-09-13 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17603743#comment-17603743 ] Guozhang Wang commented on KAFKA-14224: --- cc [~pnee] I think we can address this by always pairing

[jira] [Updated] (KAFKA-14224) Consumer should auto-commit prior to cooperative partition revocation

2022-09-13 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-14224: -- Labels: new-consumer-threading-should-fix (was: ) > Consumer should auto-commit prior to

[jira] [Commented] (KAFKA-14208) KafkaConsumer#commitAsync throws unexpected WakeupException

2022-09-09 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17602574#comment-17602574 ] Guozhang Wang commented on KAFKA-14208: --- I marked it as a blocker for 3.3.0 since it was a newly

[jira] [Updated] (KAFKA-14208) KafkaConsumer#commitAsync throws unexpected WakeupException

2022-09-09 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-14208: -- Priority: Blocker (was: Major) > KafkaConsumer#commitAsync throws unexpected WakeupException

[jira] [Updated] (KAFKA-14208) KafkaConsumer#commitAsync throws unexpected WakeupException

2022-09-09 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-14208: -- Fix Version/s: 3.3.0 > KafkaConsumer#commitAsync throws unexpected WakeupException >

[jira] [Commented] (KAFKA-10635) Streams application fails with OutOfOrderSequenceException after rolling restarts of brokers

2022-09-08 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17602131#comment-17602131 ] Guozhang Wang commented on KAFKA-10635: --- Hello [~nicktelford], thanks for the updates! I've

[jira] [Commented] (KAFKA-6599) KTable KTable join semantics violated when caching enabled

2022-09-08 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17602124#comment-17602124 ] Guozhang Wang commented on KAFKA-6599: -- Hi [~jfilipiak], great to hear back from you. Yeah I think

[jira] [Commented] (KAFKA-14202) IQv2: Expose binary store schema to store implementations

2022-09-08 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17602107#comment-17602107 ] Guozhang Wang commented on KAFKA-14202: --- Hey [~vvcephei] are you considering the scope for store

[jira] [Assigned] (KAFKA-14208) KafkaConsumer#commitAsync throws unexpected WakeupException

2022-09-08 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reassigned KAFKA-14208: - Assignee: Guozhang Wang > KafkaConsumer#commitAsync throws unexpected WakeupException

[jira] [Commented] (KAFKA-14196) Duplicated consumption during rebalance, causing OffsetValidationTest to act flaky

2022-09-08 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17602049#comment-17602049 ] Guozhang Wang commented on KAFKA-14196: --- Thanks Philip, and regarding your two questions above I

[jira] [Commented] (KAFKA-14208) KafkaConsumer#commitAsync throws unexpected WakeupException

2022-09-08 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17602046#comment-17602046 ] Guozhang Wang commented on KAFKA-14208: --- Hello Qingsheng, thanks for reporting this issue, and I

[jira] [Commented] (KAFKA-14189) Improve connection limit and reuse of coordinator and leader in KafkaConsumer

2022-09-08 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17602037#comment-17602037 ] Guozhang Wang commented on KAFKA-14189: --- Hi [~aglicacha] [~vongosling] The main motivation for

[jira] [Commented] (KAFKA-12887) Do not trigger user-customized ExceptionalHandler for RTE

2022-09-08 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17602033#comment-17602033 ] Guozhang Wang commented on KAFKA-12887: --- Hello [~icorne] We have reverted this change due to

[jira] [Commented] (KAFKA-13766) Use `max.poll.interval.ms` as the timeout during complete-rebalance phase

2022-09-08 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601949#comment-17601949 ] Guozhang Wang commented on KAFKA-13766: --- Inside onCompleteJoin, in the block starting with {{//

[jira] [Commented] (KAFKA-14196) Duplicated consumption during rebalance, causing OffsetValidationTest to act flaky

2022-09-06 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600985#comment-17600985 ] Guozhang Wang commented on KAFKA-14196: --- [~pnee] Thanks for reporting this. While reviewing

[jira] [Commented] (KAFKA-14130) Reduce RackAwarenessIntegrationTest to a unit test

2022-09-04 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600190#comment-17600190 ] Guozhang Wang commented on KAFKA-14130: --- Hello [~hoping][~Eslam.hamdy] sorry about the confusion..

[jira] [Resolved] (KAFKA-14130) Reduce RackAwarenessIntegrationTest to a unit test

2022-09-04 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-14130. --- Fix Version/s: 3.4.0 Assignee: Guozhang Wang (was: Eslam) Resolution: Fixed

[jira] [Commented] (KAFKA-10635) Streams application fails with OutOfOrderSequenceException after rolling restarts of brokers

2022-08-19 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17581943#comment-17581943 ] Guozhang Wang commented on KAFKA-10635: --- Thanks [~nicktelford], just to clarify what I asked for

[jira] [Commented] (KAFKA-10635) Streams application fails with OutOfOrderSequenceException after rolling restarts of brokers

2022-08-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17581574#comment-17581574 ] Guozhang Wang commented on KAFKA-10635: --- Hello [~nicktelford] Could you also paste the full stack

[jira] [Commented] (KAFKA-14069) Allow custom configuration of foreign key join internal topics

2022-08-09 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17577634#comment-17577634 ] Guozhang Wang commented on KAFKA-14069: --- That's interesting.. could you check a few things

[jira] [Commented] (KAFKA-14070) Improve documentation for queryMetadataForKey for state stores with Processor API

2022-08-09 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17577633#comment-17577633 ] Guozhang Wang commented on KAFKA-14070: --- Hello [~balajirrao] Thanks for the updated description!

[jira] [Updated] (KAFKA-14138) The Exception Throwing Behavior of Transactional Producer is Inconsistent

2022-08-08 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-14138: -- Description: There's an issue for inconsistent error throwing inside Kafka Producer when

[jira] [Commented] (KAFKA-14138) The Exception Throwing Behavior of Transactional Producer is Inconsistent

2022-08-07 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576529#comment-17576529 ] Guozhang Wang commented on KAFKA-14138: --- [~sagarrao] Yes, I think this is highly related to

[jira] [Created] (KAFKA-14138) The Exception Throwing Behavior of Transactional Producer is Inconsistent

2022-08-03 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-14138: - Summary: The Exception Throwing Behavior of Transactional Producer is Inconsistent Key: KAFKA-14138 URL: https://issues.apache.org/jira/browse/KAFKA-14138 Project:

[jira] [Commented] (KAFKA-13840) KafkaConsumer is unable to recover connection to group coordinator after commitOffsetsAsync exception

2022-08-03 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17574928#comment-17574928 ] Guozhang Wang commented on KAFKA-13840: --- I think this issue is indeed fixed in the latest release

[jira] [Commented] (KAFKA-13840) KafkaConsumer is unable to recover connection to group coordinator after commitOffsetsAsync exception

2022-08-03 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17574893#comment-17574893 ] Guozhang Wang commented on KAFKA-13840: --- [~kyle.stehbens] Just to clarify, when the retriable

[jira] [Resolved] (KAFKA-13877) Flaky RackAwarenessIntegrationTest.shouldDistributeStandbyReplicasOverMultipleClientTags

2022-08-03 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-13877. --- Resolution: Fixed > Flaky >

[jira] [Created] (KAFKA-14130) Reduce RackAwarenessIntegrationTest to a unit test

2022-08-01 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-14130: - Summary: Reduce RackAwarenessIntegrationTest to a unit test Key: KAFKA-14130 URL: https://issues.apache.org/jira/browse/KAFKA-14130 Project: Kafka Issue

[jira] [Commented] (KAFKA-13877) Flaky RackAwarenessIntegrationTest.shouldDistributeStandbyReplicasOverMultipleClientTags

2022-08-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17573993#comment-17573993 ] Guozhang Wang commented on KAFKA-13877: --- I've re-tested this case locally with 5+ times, each with

[jira] [Assigned] (KAFKA-13877) Flaky RackAwarenessIntegrationTest.shouldDistributeStandbyReplicasOverMultipleClientTags

2022-08-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reassigned KAFKA-13877: - Assignee: Guozhang Wang (was: Levani Kokhreidze) > Flaky >

[jira] [Commented] (KAFKA-13877) Flaky RackAwarenessIntegrationTest.shouldDistributeStandbyReplicasOverMultipleClientTags

2022-07-29 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17573180#comment-17573180 ] Guozhang Wang commented on KAFKA-13877: --- [~lkokhreidze] ping again, please let me know if you are

[jira] [Commented] (KAFKA-13877) Flaky RackAwarenessIntegrationTest.shouldDistributeStandbyReplicasOverMultipleClientTags

2022-07-25 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571014#comment-17571014 ] Guozhang Wang commented on KAFKA-13877: --- Hello [~lkokhreidze], are you still actively working on

[jira] [Commented] (KAFKA-14024) Consumer stuck during cooperative rebalance for Commit offset in onJoinPrepare

2022-07-19 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17568732#comment-17568732 ] Guozhang Wang commented on KAFKA-14024: --- Thanks to [~aiquestion] for filing this and also

[jira] [Updated] (KAFKA-14024) Consumer stuck during cooperative rebalance for Commit offset in onJoinPrepare

2022-07-19 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-14024: -- Reviewer: Luke Chen > Consumer stuck during cooperative rebalance for Commit offset in

[jira] [Assigned] (KAFKA-14024) Consumer stuck during cooperative rebalance for Commit offset in onJoinPrepare

2022-07-19 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reassigned KAFKA-14024: - Assignee: Guozhang Wang > Consumer stuck during cooperative rebalance for Commit

[jira] [Assigned] (KAFKA-14024) Consumer stuck during cooperative rebalance for Commit offset in onJoinPrepare

2022-07-19 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reassigned KAFKA-14024: - Assignee: Shawn Wang (was: Guozhang Wang) > Consumer stuck during cooperative

[jira] [Commented] (KAFKA-14024) Consumer stuck during cooperative rebalance for Commit offset in onJoinPrepare

2022-07-19 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17568731#comment-17568731 ] Guozhang Wang commented on KAFKA-14024: --- Hello [~mumrah], I took a look at the ticket and also the

[jira] [Commented] (KAFKA-13846) Add an overloaded metricOrElseCreate function in Metrics

2022-07-14 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566989#comment-17566989 ] Guozhang Wang commented on KAFKA-13846: --- Hi Jose the PR has been merged actually so we should

[jira] [Resolved] (KAFKA-13846) Add an overloaded metricOrElseCreate function in Metrics

2022-07-14 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-13846. --- Fix Version/s: 3.3.0 Resolution: Fixed > Add an overloaded metricOrElseCreate

[jira] [Commented] (KAFKA-14069) Allow custom configuration of foreign key join internal topics

2022-07-13 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566419#comment-17566419 ] Guozhang Wang commented on KAFKA-14069: --- Hello [~ebrard], thanks for bringing this ticket up.

[jira] [Commented] (KAFKA-14070) Improve documentation for queryMetadataForKey

2022-07-13 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566414#comment-17566414 ] Guozhang Wang commented on KAFKA-14070: --- Hello [~balajirrao], thanks for filing this ticket. Could

[jira] [Commented] (KAFKA-13386) Foreign Key Join filtering out valid records after a code change / schema evolved

2022-06-29 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17560812#comment-17560812 ] Guozhang Wang commented on KAFKA-13386: --- Hi [~nikuis], I agree with the same FK1 it will be sent

[jira] [Commented] (KAFKA-12478) Consumer group may lose data for newly expanded partitions when add partitions for topic if the group is set to consume from the latest

2022-06-22 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557576#comment-17557576 ] Guozhang Wang commented on KAFKA-12478: --- Thanks [~hudeqi], I will take a look at the KIP. >

  1   2   3   4   5   6   7   8   9   10   >