[jira] [Commented] (KAFKA-14747) FK join should record discarded subscription responses

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693312#comment-17693312 ] Matthias J. Sax commented on KAFKA-14747: - Talking to [~guozhang] it seem we don't need a KIP

[jira] [Updated] (KAFKA-14747) FK join should record discarded subscription responses

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14747: Labels: beginner newbie (was: beginner needs-kip newbie) > FK join should rec

[jira] [Commented] (KAFKA-14747) FK join should record discarded subscription responses

2023-02-24 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693060#comment-17693060 ] Matthias J. Sax commented on KAFKA-14747: - Sure. Not sure if we need a KIP or not. [~guozhang

[jira] [Assigned] (KAFKA-14747) FK join should record discarded subscription responses

2023-02-23 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-14747: --- Assignee: Koma Zhang > FK join should record discarded subscription respon

[jira] [Created] (KAFKA-14748) Relax non-null FK left-join requirement

2023-02-23 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-14748: --- Summary: Relax non-null FK left-join requirement Key: KAFKA-14748 URL: https://issues.apache.org/jira/browse/KAFKA-14748 Project: Kafka Issue Type

[jira] [Created] (KAFKA-14748) Relax non-null FK left-join requirement

2023-02-23 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-14748: --- Summary: Relax non-null FK left-join requirement Key: KAFKA-14748 URL: https://issues.apache.org/jira/browse/KAFKA-14748 Project: Kafka Issue Type

[jira] [Updated] (KAFKA-14747) FK join should record discarded subscription responses

2023-02-23 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14747: Description: FK-joins are subject to a race condition: If the left-hand side record

[jira] [Created] (KAFKA-14747) FK join should record discarded subscription responses

2023-02-23 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-14747: --- Summary: FK join should record discarded subscription responses Key: KAFKA-14747 URL: https://issues.apache.org/jira/browse/KAFKA-14747 Project: Kafka

[jira] [Created] (KAFKA-14747) FK join should record discarded subscription responses

2023-02-23 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-14747: --- Summary: FK join should record discarded subscription responses Key: KAFKA-14747 URL: https://issues.apache.org/jira/browse/KAFKA-14747 Project: Kafka

[jira] [Resolved] (KAFKA-14128) Kafka Streams terminates on topic check

2023-02-22 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14128. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed > Kafka Stre

[jira] [Resolved] (KAFKA-14128) Kafka Streams terminates on topic check

2023-02-22 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14128. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed > Kafka Stre

Re: [DISCUSS] KIP-904 Kafka Streams - Guarantee subtractor is called before adder if key has not changed

2023-02-22 Thread Matthias J. Sax
Thanks for the KIP. Overall LGTM. I think you can start a VOTE. -Matthias On 2/22/23 5:56 PM, Fq Public wrote: Just wanted to bump this thread for visbility. Thanks to everyone who has participated in the discussion so far. Thanks, Farooq On 2023/02/14 19:32:53 Guozhang Wang wrote: Thanks

Re: [DISCUSS] KIP-907: Add Boolean Serde to public interface

2023-02-22 Thread Matthias J. Sax
Thanks for the KIP. Overall LGMT. One comment: Both `BooleanSerializer` and `BooleanDeserializer` are also new classes that are added and should be listed explicitly similar to `BooleanSerde` in the "Public Interfaces" section of the KIP. -Matthias On 2/21/23 10:52 AM, SpacRocket wrote:

[jira] [Assigned] (KAFKA-12549) Allow state stores to opt-in transactional support

2023-02-21 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-12549: --- Assignee: (was: Alex Sorokoumov) > Allow state stores to opt-in transactio

[jira] [Assigned] (KAFKA-13024) Kafka Streams is dropping messages with null key during repartition

2023-02-21 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-13024: --- Assignee: (was: Alex Sorokoumov) > Kafka Streams is dropping messa

[jira] [Assigned] (KAFKA-9803) Allow producers to recover gracefully from transaction timeouts

2023-02-21 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-9803: -- Assignee: (was: Boyang Chen) > Allow producers to recover gracefully f

[jira] [Resolved] (KAFKA-14530) Check state updater more than once in process loops

2023-02-21 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14530. - Fix Version/s: 3.5.0 Resolution: Fixed > Check state updater more than o

[jira] [Resolved] (KAFKA-14530) Check state updater more than once in process loops

2023-02-21 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14530. - Fix Version/s: 3.5.0 Resolution: Fixed > Check state updater more than o

[jira] [Commented] (KAFKA-14442) GlobalKTable restoration waits requestTimeout during application restart

2023-02-17 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690563#comment-17690563 ] Matthias J. Sax commented on KAFKA-14442: - Just learned about https://issues.apache.org/jira

[jira] [Resolved] (KAFKA-14713) Kafka Streams global table startup takes too long

2023-02-17 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14713. - Resolution: Fixed > Kafka Streams global table startup takes too l

[jira] [Resolved] (KAFKA-14713) Kafka Streams global table startup takes too long

2023-02-17 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14713. - Resolution: Fixed > Kafka Streams global table startup takes too l

[jira] [Commented] (KAFKA-14713) Kafka Streams global table startup takes too long

2023-02-17 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690560#comment-17690560 ] Matthias J. Sax commented on KAFKA-14713: - Ah. Thanks. That makes sense. Did not look

[jira] [Reopened] (KAFKA-14713) Kafka Streams global table startup takes too long

2023-02-17 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-14713: - > Kafka Streams global table startup takes too l

[jira] [Reopened] (KAFKA-14713) Kafka Streams global table startup takes too long

2023-02-17 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-14713: - > Kafka Streams global table startup takes too l

[jira] [Updated] (KAFKA-14713) Kafka Streams global table startup takes too long

2023-02-17 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14713: Fix Version/s: 3.2.0 (was: 3.4.0) > Kafka Streams global ta

[jira] [Comment Edited] (KAFKA-14713) Kafka Streams global table startup takes too long

2023-02-16 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690055#comment-17690055 ] Matthias J. Sax edited comment on KAFKA-14713 at 2/16/23 11:52 PM

[jira] [Commented] (KAFKA-14713) Kafka Streams global table startup takes too long

2023-02-16 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690055#comment-17690055 ] Matthias J. Sax commented on KAFKA-14713: - Thanks for getting back. Glad it's resolved. I am

[jira] [Updated] (KAFKA-14722) Make BooleanSerde public

2023-02-15 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14722: Description: We introduce a "BooleanSerde" via [https://github.com/apache/

[jira] [Commented] (KAFKA-14722) Make BooleanSerde public

2023-02-15 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689401#comment-17689401 ] Matthias J. Sax commented on KAFKA-14722: - Thanks for you interest. We will need a KIP

[jira] [Comment Edited] (KAFKA-14713) Kafka Streams global table startup takes too long

2023-02-15 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689356#comment-17689356 ] Matthias J. Sax edited comment on KAFKA-14713 at 2/15/23 9:44 PM: -- What

[jira] [Commented] (KAFKA-14713) Kafka Streams global table startup takes too long

2023-02-15 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689356#comment-17689356 ] Matthias J. Sax commented on KAFKA-14713: - What version are you using? – Also, can you point me

[jira] [Created] (KAFKA-14722) Make BooleanSerde public

2023-02-15 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-14722: --- Summary: Make BooleanSerde public Key: KAFKA-14722 URL: https://issues.apache.org/jira/browse/KAFKA-14722 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-14722) Make BooleanSerde public

2023-02-15 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-14722: --- Summary: Make BooleanSerde public Key: KAFKA-14722 URL: https://issues.apache.org/jira/browse/KAFKA-14722 Project: Kafka Issue Type: Improvement

[jira] [Updated] (KAFKA-14717) KafkaStreams can' get running if the rebalance happens before StreamThread gets shutdown completely

2023-02-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14717: Component/s: streams > KafkaStreams can' get running if the rebalance happens bef

[jira] [Commented] (KAFKA-14713) Kafka Streams global table startup takes too long

2023-02-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688679#comment-17688679 ] Matthias J. Sax commented on KAFKA-14713: - Sounds like a duplicate to https://issues.apache.org

Re: [VOTE] KIP-889 Versioned State Stores

2023-02-14 Thread Matthias J. Sax
runo On 19.12.22 20:03, Matthias J. Sax wrote: +1 (binding) On 12/15/22 1:27 PM, John Roesler wrote: Thanks for the thorough KIP, Victoria! I'm +1 (binding) -John On 2022/12/15 19:56:21 Victoria Xia wrote: Hi all, I'd like to start a vote on KIP-889 for introducing versioned key-value s

[jira] [Updated] (KAFKA-14660) Divide by zero security vulnerability (sonatype-2019-0422)

2023-02-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14660: Fix Version/s: 3.4.1 > Divide by zero security vulnerability (sonatype-2019-0

[jira] [Commented] (KAFKA-14660) Divide by zero security vulnerability (sonatype-2019-0422)

2023-02-06 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17684958#comment-17684958 ] Matthias J. Sax commented on KAFKA-14660: - Correct. 3.4.0 is already voted and should

[jira] [Comment Edited] (KAFKA-14660) Divide by zero security vulnerability (sonatype-2019-0422)

2023-02-03 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17683951#comment-17683951 ] Matthias J. Sax edited comment on KAFKA-14660 at 2/3/23 4:52 PM

[jira] [Commented] (KAFKA-14660) Divide by zero security vulnerability (sonatype-2019-0422)

2023-02-03 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17683951#comment-17683951 ] Matthias J. Sax commented on KAFKA-14660: - Not sure why the PR was not auto-linked... Fixed

Re: [VOTE] KIP-890: Transactions Server Side Defense

2023-02-02 Thread Matthias J. Sax
Thanks for the KIP! +1 (binding) On 2/2/23 4:18 PM, Artem Livshits wrote: (non-binding) +1. Looking forward to the implementation and fixing the issues that we've got. -Artem On Mon, Jan 23, 2023 at 2:25 PM Guozhang Wang wrote: Thanks Justine, I have no further comments on the KIP. +1.

Re: Coralogix Logo on Powered By Page

2023-02-01 Thread Matthias J. Sax
Thanks for reaching out. Can you open a PR against https://github.com/apache/kafka-site updating `powered-by.html`? -Matthias On 2/1/23 1:13 AM, Tali Soroker wrote: Hi, I am writing on behalf of Coralogix to request adding us to the Powered By page on the Apache Kafka website. I am

[jira] [Commented] (KAFKA-14660) Divide by zero security vulnerability (sonatype-2019-0422)

2023-01-31 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17682648#comment-17682648 ] Matthias J. Sax commented on KAFKA-14660: - The original PR did not make sense

[jira] [Assigned] (KAFKA-14650) IQv2 can throw ConcurrentModificationException when accessing Tasks

2023-01-30 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-14650: --- Assignee: Guozhang Wang > IQv2 can throw ConcurrentModificationException w

[jira] [Commented] (KAFKA-14646) SubscriptionWrapper is of an incompatible version (Kafka Streams 3.2.3 -> 3.3.2)

2023-01-30 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17682401#comment-17682401 ] Matthias J. Sax commented on KAFKA-14646: - I was thinking about this issue, and I think the only

[jira] [Commented] (KAFKA-14660) Divide by zero security vulnerability (sonatype-2019-0422)

2023-01-30 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17682291#comment-17682291 ] Matthias J. Sax commented on KAFKA-14660: - Hey Andy – thanks for the ticket. We would have

[jira] [Assigned] (KAFKA-14660) Divide by zero security vulnerability (sonatype-2019-0422)

2023-01-30 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-14660: --- Assignee: Matthias J. Sax > Divide by zero security vulnerability (sonatype-2

[jira] [Resolved] (KAFKA-14646) SubscriptionWrapper is of an incompatible version (Kafka Streams 3.2.3 -> 3.3.2)

2023-01-25 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14646. - Fix Version/s: 3.4.0 3.3.3 Resolution: Fixed

[jira] [Commented] (KAFKA-13769) KTable FK join can miss records if an upstream non-key-changing operation changes key serializer

2023-01-25 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680858#comment-17680858 ] Matthias J. Sax commented on KAFKA-13769: - I just updated fixed version from 3.0.0 to 3.3.3

[jira] [Updated] (KAFKA-13769) KTable FK join can miss records if an upstream non-key-changing operation changes key serializer

2023-01-25 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-13769: Fix Version/s: 3.4.0 3.3.3 (was: 3.3.0

[jira] [Updated] (KAFKA-14646) SubscriptionWrapper is of an incompatible version (Kafka Streams 3.2.3 -> 3.3.2)

2023-01-25 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14646: Affects Version/s: 3.3.1 3.3.0 > SubscriptionWrap

[jira] [Resolved] (KAFKA-14646) SubscriptionWrapper is of an incompatible version (Kafka Streams 3.2.3 -> 3.3.2)

2023-01-25 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14646. - Fix Version/s: 3.4.0 3.3.3 Resolution: Fixed

[jira] [Commented] (KAFKA-14646) SubscriptionWrapper is of an incompatible version (Kafka Streams 3.2.3 -> 3.3.2)

2023-01-25 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680857#comment-17680857 ] Matthias J. Sax commented on KAFKA-14646: - Ok. Talked to Alex and he quickly figured it out

Re: [VOTE] KIP-869: Improve Streams State Restoration Visibility

2023-01-25 Thread Matthias J. Sax
will also update the metric name a bit to be more specific. On Thu, Jan 19, 2023 at 2:35 PM Guozhang Wang wrote: Hello Matthias, Thanks for the feedback. I was on vacation for a while. Pardon for the late replies. Please see them inline below On Thu, Dec 1, 2022 at 11:23 PM Matthias J. Sax w

Re: [DISCUSS] KIP-890 Server Side Defense

2023-01-25 Thread Matthias J. Sax
ompaction. I was also not aware of this "guarantee" with regards to broker side time. I think that we can do in order handling for a given producer, but not across all producers. However, we can't guarantee that anyway. Let me know if you have any concerns here. Thanks, Justine On

[jira] [Commented] (KAFKA-14646) SubscriptionWrapper is of an incompatible version (Kafka Streams 3.2.3 -> 3.3.2)

2023-01-25 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680840#comment-17680840 ] Matthias J. Sax commented on KAFKA-14646: - Could be – let me sync with Alex who worked

Re: [VOTE] KIP-869: Improve Streams State Restoration Visibility

2023-01-23 Thread Matthias J. Sax
lo Matthias, Thanks for the feedback. I was on vacation for a while. Pardon for the late replies. Please see them inline below On Thu, Dec 1, 2022 at 11:23 PM Matthias J. Sax wrote: Seems I am late to the party... Great KIP. Couple of questions from my side: (1) What is the purpose of `standby-

Re: [DISCUSS] KIP-890 Server Side Defense

2023-01-23 Thread Matthias J. Sax
etime of a producer. Should we change that to a long or add a new long field like txnId? 71. "it will write the prepare commit message with a bumped epoch and send WriteTxnMarkerRequests with the bumped epoch." Hmm, the epoch is associated with the current tx

Re: Custom Kafka Streams State Restore Logic

2023-01-23 Thread Matthias J. Sax
​  | Senior Software Developer  | *ude...@itrsgroup.com* <mailto:ude...@itrsgroup.com> *www.itrsgroup.com* <https://www.itrsgroup.com/> <https://www.itrsgroup.com/> *From: *Matthias J. Sax *Date: *Wednesday, January 18, 2023 at 12:50 AM *To: *users@kafka.ap

[jira] [Commented] (KAFKA-14646) SubscriptionWrapper is of an incompatible version (Kafka Streams 3.2.3 -> 3.3.2)

2023-01-23 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680042#comment-17680042 ] Matthias J. Sax commented on KAFKA-14646: - Thanks for following up – glad to hear that it's

[jira] [Comment Edited] (KAFKA-14646) SubscriptionWrapper is of an incompatible version (Kafka Streams 3.2.3 -> 3.3.2)

2023-01-23 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679991#comment-17679991 ] Matthias J. Sax edited comment on KAFKA-14646 at 1/23/23 7:21 PM: -- Did

[jira] [Commented] (KAFKA-14646) SubscriptionWrapper is of an incompatible version (Kafka Streams 3.2.3 -> 3.3.2)

2023-01-23 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679991#comment-17679991 ] Matthias J. Sax commented on KAFKA-14646: - Did you upgrade with two rolling bounced leveraging

[jira] [Resolved] (KAFKA-14638) Documentation for transaction.timeout.ms should be more precise

2023-01-19 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14638. - Fix Version/s: 3.5.0 Resolution: Fixed > Documentat

[jira] [Resolved] (KAFKA-14638) Documentation for transaction.timeout.ms should be more precise

2023-01-19 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14638. - Fix Version/s: 3.5.0 Resolution: Fixed > Documentat

[jira] [Updated] (KAFKA-14638) Documentation for transaction.timeout.ms should be more precise

2023-01-19 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14638: Issue Type: Improvement (was: Bug) > Documentation for transaction.timeout.ms sho

[jira] [Updated] (KAFKA-14638) Documentation for transaction.timeout.ms should be more precise

2023-01-19 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14638: Component/s: docs > Documentation for transaction.timeout.ms should be more prec

Re: Tumbling windows offset

2023-01-18 Thread Matthias J. Sax
You can use a custom window implementation to do this. Cf https://github.com/confluentinc/kafka-streams-examples/blob/7.1.1-post/src/test/java/io/confluent/examples/streams/window/DailyTimeWindows.java -Matthias On 1/18/23 6:33 AM, Amsterdam Luís de Lima Filho wrote: Hello everyone, I

Re: [VOTE] 3.3.2 RC1

2023-01-18 Thread Matthias J. Sax
Done. On 1/18/23 10:36 AM, Chris Egerton wrote: Thanks Mickael! @John, @Matthias -- would either of you be able to lend a hand with the push to S3? Cheers, Chris On Tue, Jan 17, 2023 at 12:24 PM Mickael Maison mailto:mickael.mai...@gmail.com>> wrote: Hi Chris, I've pushed the

Re: Custom Kafka Streams State Restore Logic

2023-01-17 Thread Matthias J. Sax
Guess it depends what you actually want to achieve? Also note: `InMemoryWindowStore` is an internal class, and thus might change at any point, and it was never designed to be extended... -Matthias On 1/13/23 2:55 PM, Upesh Desai wrote: Hello all, I am currently working on creating a new

Re: [ANNOUNCE] New committer: Stanislav Kozlovski

2023-01-17 Thread Matthias J. Sax
Congrats! On 1/17/23 1:26 PM, Ron Dagostino wrote: Congratulations, Stan! Ron On Jan 17, 2023, at 12:29 PM, Mickael Maison wrote: Congratulations Stanislav! On Tue, Jan 17, 2023 at 6:06 PM Rajini Sivaram wrote: Congratulations, Stan! Regards, Rajini On Tue, Jan 17, 2023 at 5:04 PM

Re: [ANNOUNCE] New committer: Stanislav Kozlovski

2023-01-17 Thread Matthias J. Sax
Congrats! On 1/17/23 1:26 PM, Ron Dagostino wrote: Congratulations, Stan! Ron On Jan 17, 2023, at 12:29 PM, Mickael Maison wrote: Congratulations Stanislav! On Tue, Jan 17, 2023 at 6:06 PM Rajini Sivaram wrote: Congratulations, Stan! Regards, Rajini On Tue, Jan 17, 2023 at 5:04 PM

[jira] [Updated] (KAFKA-14302) Infinite probing rebalance if a changelog topic got emptied

2023-01-17 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14302: Priority: Critical (was: Major) > Infinite probing rebalance if a changelog topic

[ANNOUNCE] New committer: Walker Carlson

2023-01-17 Thread Matthias J. Sax
Dear community, I am pleased to announce Walker Carlson as a new Kafka committer. Walker has been contributing to Apache Kafka since November 2019. He made various contributions including the following KIPs. KIP-671: Introduce Kafka Streams Specific Uncaught Exception Handler KIP-696: Update

[ANNOUNCE] New committer: Walker Carlson

2023-01-17 Thread Matthias J. Sax
Dear community, I am pleased to announce Walker Carlson as a new Kafka committer. Walker has been contributing to Apache Kafka since November 2019. He made various contributions including the following KIPs. KIP-671: Introduce Kafka Streams Specific Uncaught Exception Handler KIP-696: Update

[jira] [Commented] (KAFKA-14624) State restoration is broken with standby tasks and cache-enabled stores in processor API

2023-01-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676934#comment-17676934 ] Matthias J. Sax commented on KAFKA-14624: - Thanks for reporting this issue – will need to think

[jira] [Resolved] (KAFKA-14279) Add 3.3.1 to broker/client and stream upgrade/compatibility tests

2023-01-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14279. - Resolution: Fixed > Add 3.3.1 to broker/client and stream upgrade/compatibility te

[jira] [Resolved] (KAFKA-14279) Add 3.3.1 to broker/client and stream upgrade/compatibility tests

2023-01-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14279. - Resolution: Fixed > Add 3.3.1 to broker/client and stream upgrade/compatibility te

[jira] [Updated] (KAFKA-14279) Add 3.3.1 to broker/client and stream upgrade/compatibility tests

2023-01-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14279: Fix Version/s: 3.4.0 (was: 3.5.0) > Add 3.3.1 to broker/cli

[jira] [Commented] (KAFKA-14126) Convert remaining DynamicBrokerReconfigurationTest tests to KRaft

2023-01-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17656475#comment-17656475 ] Matthias J. Sax commented on KAFKA-14126: - Saw this failing 2x on this PR: https://github.com

Re: [ANNOUNCE] New committer: Edoardo Comar

2023-01-06 Thread Matthias J. Sax
Congrats! On 1/6/23 5:15 PM, Luke Chen wrote: Congratulations, Edoardo! Luke On Sat, Jan 7, 2023 at 7:58 AM Mickael Maison wrote: Congratulations Edo! On Sat, Jan 7, 2023 at 12:05 AM Jun Rao wrote: Hi, Everyone, The PMC of Apache Kafka is pleased to announce a new Kafka committer

Re: [ANNOUNCE] New committer: Edoardo Comar

2023-01-06 Thread Matthias J. Sax
Congrats! On 1/6/23 5:15 PM, Luke Chen wrote: Congratulations, Edoardo! Luke On Sat, Jan 7, 2023 at 7:58 AM Mickael Maison wrote: Congratulations Edo! On Sat, Jan 7, 2023 at 12:05 AM Jun Rao wrote: Hi, Everyone, The PMC of Apache Kafka is pleased to announce a new Kafka committer

[jira] [Updated] (KAFKA-14597) [Streams] record-e2e-latency-max is not reporting correct metrics

2023-01-05 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14597: Component/s: metrics streams > [Streams] record-e2e-latency-

[jira] [Created] (KAFKA-14572) Migrate EmbeddedKafkaCluster used by Streams integration tests from EmbeddedZookeeper to KRaft

2023-01-04 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-14572: --- Summary: Migrate EmbeddedKafkaCluster used by Streams integration tests from EmbeddedZookeeper to KRaft Key: KAFKA-14572 URL: https://issues.apache.org/jira/browse/KAFKA

[jira] [Created] (KAFKA-14572) Migrate EmbeddedKafkaCluster used by Streams integration tests from EmbeddedZookeeper to KRaft

2023-01-04 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-14572: --- Summary: Migrate EmbeddedKafkaCluster used by Streams integration tests from EmbeddedZookeeper to KRaft Key: KAFKA-14572 URL: https://issues.apache.org/jira/browse/KAFKA

[jira] [Created] (KAFKA-14567) Kafka Streams crashes after ProducerFencedException

2023-01-03 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-14567: --- Summary: Kafka Streams crashes after ProducerFencedException Key: KAFKA-14567 URL: https://issues.apache.org/jira/browse/KAFKA-14567 Project: Kafka

[jira] [Created] (KAFKA-14567) Kafka Streams crashes after ProducerFencedException

2023-01-03 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-14567: --- Summary: Kafka Streams crashes after ProducerFencedException Key: KAFKA-14567 URL: https://issues.apache.org/jira/browse/KAFKA-14567 Project: Kafka

[jira] [Commented] (KAFKA-13295) Long restoration times for new tasks can lead to transaction timeouts

2023-01-03 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17654211#comment-17654211 ] Matthias J. Sax commented on KAFKA-13295: - Thanks. SG. > Long restoration times for new ta

Re: [ANNOUNCE] New committer: Justine Olshan

2023-01-03 Thread Matthias J. Sax
Congrats! On 12/29/22 6:47 PM, ziming deng wrote: Congratulations Justine! — Best, Ziming On Dec 30, 2022, at 10:06, Luke Chen wrote: Congratulations, Justine! Well deserved! Luke On Fri, Dec 30, 2022 at 9:15 AM Ron Dagostino wrote: Congratulations, Justine!Well-deserved., and I’m

Re: [ANNOUNCE] New committer: Justine Olshan

2023-01-03 Thread Matthias J. Sax
Congrats! On 12/29/22 6:47 PM, ziming deng wrote: Congratulations Justine! — Best, Ziming On Dec 30, 2022, at 10:06, Luke Chen wrote: Congratulations, Justine! Well deserved! Luke On Fri, Dec 30, 2022 at 9:15 AM Ron Dagostino wrote: Congratulations, Justine!Well-deserved., and I’m

Re: Kafka Stream: The state store, wkstore, may have migrated to another instance

2022-12-29 Thread Matthias J. Sax
Sounds like a SpringBoot issue rather than a KS issues. -Matthias On 12/29/22 2:45 AM, Nawal Sah wrote: Hi, My SpringBoot stream application works fine in a fresh start of the clustered environment. But when I restart one of the pods out of two pods, I start getting the below exception from

[jira] [Assigned] (KAFKA-9224) State store should not see uncommitted transaction result

2022-12-28 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-9224: -- Assignee: (was: Boyang Chen) > State store should not see uncommitted transact

[jira] [Assigned] (KAFKA-8977) Remove MockStreamsMetrics Since it is not a Mock

2022-12-28 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-8977: -- Assignee: (was: bibin sebastian) > Remove MockStreamsMetrics Si

[jira] [Assigned] (KAFKA-6460) Add mocks for state stores used in Streams unit testing

2022-12-28 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-6460: -- Assignee: (was: Yishun Guan) > Add mocks for state stores used in Streams u

[jira] [Assigned] (KAFKA-8272) Changed(De)Serializer does not forward configure() call

2022-12-28 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-8272: -- Assignee: (was: Matthias J. Sax) > Changed(De)Serializer does not forw

[jira] [Assigned] (KAFKA-6786) Remove additional configs in StreamsBrokerDownResilienceTest

2022-12-28 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-6786: -- Assignee: (was: Abhishek Sharma) > Remove additional conf

[jira] [Assigned] (KAFKA-7653) Streams-Scala: Add type level differentiation for Key and Value serdes.

2022-12-28 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-7653: -- Assignee: (was: Mark Tranter) > Streams-Scala: Add type level differentiat

[jira] [Updated] (KAFKA-7653) Streams-Scala: Add type level differentiation for Key and Value serdes.

2022-12-28 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-7653: --- Labels: kip scala (was: scala) > Streams-Scala: Add type level differentiation for

[jira] [Updated] (KAFKA-7653) Streams-Scala: Add type level differentiation for Key and Value serdes.

2022-12-28 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-7653: --- Description: Implicit resolution/conversion of Serdes/Consumed etc is a big improvement

[jira] [Assigned] (KAFKA-7075) Allow Topology#addGlobalStore to add a window store

2022-12-28 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-7075: -- Assignee: (was: Nishanth Pradeep) > Allow Topology#addGlobalStore to add a win

[jira] [Commented] (KAFKA-13295) Long restoration times for new tasks can lead to transaction timeouts

2022-12-28 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17652620#comment-17652620 ] Matthias J. Sax commented on KAFKA-13295: - [~ableegoldman] – I am wondering if this issue

<    5   6   7   8   9   10   11   12   13   14   >