[jira] [Updated] (KAFKA-14638) Documentation for transaction.timeout.ms should be more precise

2023-01-19 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14638: Issue Type: Improvement (was: Bug) > Documentation for transaction.timeout.ms sho

[jira] [Updated] (KAFKA-14638) Documentation for transaction.timeout.ms should be more precise

2023-01-19 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14638: Component/s: docs > Documentation for transaction.timeout.ms should be more prec

Re: Tumbling windows offset

2023-01-18 Thread Matthias J. Sax
You can use a custom window implementation to do this. Cf https://github.com/confluentinc/kafka-streams-examples/blob/7.1.1-post/src/test/java/io/confluent/examples/streams/window/DailyTimeWindows.java -Matthias On 1/18/23 6:33 AM, Amsterdam Luís de Lima Filho wrote: Hello everyone, I

Re: [VOTE] 3.3.2 RC1

2023-01-18 Thread Matthias J. Sax
Done. On 1/18/23 10:36 AM, Chris Egerton wrote: Thanks Mickael! @John, @Matthias -- would either of you be able to lend a hand with the push to S3? Cheers, Chris On Tue, Jan 17, 2023 at 12:24 PM Mickael Maison mailto:mickael.mai...@gmail.com>> wrote: Hi Chris, I've pushed the

Re: Custom Kafka Streams State Restore Logic

2023-01-17 Thread Matthias J. Sax
Guess it depends what you actually want to achieve? Also note: `InMemoryWindowStore` is an internal class, and thus might change at any point, and it was never designed to be extended... -Matthias On 1/13/23 2:55 PM, Upesh Desai wrote: Hello all, I am currently working on creating a new

Re: [ANNOUNCE] New committer: Stanislav Kozlovski

2023-01-17 Thread Matthias J. Sax
Congrats! On 1/17/23 1:26 PM, Ron Dagostino wrote: Congratulations, Stan! Ron On Jan 17, 2023, at 12:29 PM, Mickael Maison wrote: Congratulations Stanislav! On Tue, Jan 17, 2023 at 6:06 PM Rajini Sivaram wrote: Congratulations, Stan! Regards, Rajini On Tue, Jan 17, 2023 at 5:04 PM

Re: [ANNOUNCE] New committer: Stanislav Kozlovski

2023-01-17 Thread Matthias J. Sax
Congrats! On 1/17/23 1:26 PM, Ron Dagostino wrote: Congratulations, Stan! Ron On Jan 17, 2023, at 12:29 PM, Mickael Maison wrote: Congratulations Stanislav! On Tue, Jan 17, 2023 at 6:06 PM Rajini Sivaram wrote: Congratulations, Stan! Regards, Rajini On Tue, Jan 17, 2023 at 5:04 PM

[jira] [Updated] (KAFKA-14302) Infinite probing rebalance if a changelog topic got emptied

2023-01-17 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14302: Priority: Critical (was: Major) > Infinite probing rebalance if a changelog topic

[ANNOUNCE] New committer: Walker Carlson

2023-01-17 Thread Matthias J. Sax
Dear community, I am pleased to announce Walker Carlson as a new Kafka committer. Walker has been contributing to Apache Kafka since November 2019. He made various contributions including the following KIPs. KIP-671: Introduce Kafka Streams Specific Uncaught Exception Handler KIP-696: Update

[ANNOUNCE] New committer: Walker Carlson

2023-01-17 Thread Matthias J. Sax
Dear community, I am pleased to announce Walker Carlson as a new Kafka committer. Walker has been contributing to Apache Kafka since November 2019. He made various contributions including the following KIPs. KIP-671: Introduce Kafka Streams Specific Uncaught Exception Handler KIP-696: Update

[jira] [Commented] (KAFKA-14624) State restoration is broken with standby tasks and cache-enabled stores in processor API

2023-01-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676934#comment-17676934 ] Matthias J. Sax commented on KAFKA-14624: - Thanks for reporting this issue – will need to think

[jira] [Resolved] (KAFKA-14279) Add 3.3.1 to broker/client and stream upgrade/compatibility tests

2023-01-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14279. - Resolution: Fixed > Add 3.3.1 to broker/client and stream upgrade/compatibility te

[jira] [Resolved] (KAFKA-14279) Add 3.3.1 to broker/client and stream upgrade/compatibility tests

2023-01-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14279. - Resolution: Fixed > Add 3.3.1 to broker/client and stream upgrade/compatibility te

[jira] [Updated] (KAFKA-14279) Add 3.3.1 to broker/client and stream upgrade/compatibility tests

2023-01-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14279: Fix Version/s: 3.4.0 (was: 3.5.0) > Add 3.3.1 to broker/cli

[jira] [Commented] (KAFKA-14126) Convert remaining DynamicBrokerReconfigurationTest tests to KRaft

2023-01-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17656475#comment-17656475 ] Matthias J. Sax commented on KAFKA-14126: - Saw this failing 2x on this PR: https://github.com

Re: [ANNOUNCE] New committer: Edoardo Comar

2023-01-06 Thread Matthias J. Sax
Congrats! On 1/6/23 5:15 PM, Luke Chen wrote: Congratulations, Edoardo! Luke On Sat, Jan 7, 2023 at 7:58 AM Mickael Maison wrote: Congratulations Edo! On Sat, Jan 7, 2023 at 12:05 AM Jun Rao wrote: Hi, Everyone, The PMC of Apache Kafka is pleased to announce a new Kafka committer

Re: [ANNOUNCE] New committer: Edoardo Comar

2023-01-06 Thread Matthias J. Sax
Congrats! On 1/6/23 5:15 PM, Luke Chen wrote: Congratulations, Edoardo! Luke On Sat, Jan 7, 2023 at 7:58 AM Mickael Maison wrote: Congratulations Edo! On Sat, Jan 7, 2023 at 12:05 AM Jun Rao wrote: Hi, Everyone, The PMC of Apache Kafka is pleased to announce a new Kafka committer

[jira] [Updated] (KAFKA-14597) [Streams] record-e2e-latency-max is not reporting correct metrics

2023-01-05 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14597: Component/s: metrics streams > [Streams] record-e2e-latency-

[jira] [Created] (KAFKA-14572) Migrate EmbeddedKafkaCluster used by Streams integration tests from EmbeddedZookeeper to KRaft

2023-01-04 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-14572: --- Summary: Migrate EmbeddedKafkaCluster used by Streams integration tests from EmbeddedZookeeper to KRaft Key: KAFKA-14572 URL: https://issues.apache.org/jira/browse/KAFKA

[jira] [Created] (KAFKA-14572) Migrate EmbeddedKafkaCluster used by Streams integration tests from EmbeddedZookeeper to KRaft

2023-01-04 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-14572: --- Summary: Migrate EmbeddedKafkaCluster used by Streams integration tests from EmbeddedZookeeper to KRaft Key: KAFKA-14572 URL: https://issues.apache.org/jira/browse/KAFKA

[jira] [Created] (KAFKA-14567) Kafka Streams crashes after ProducerFencedException

2023-01-03 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-14567: --- Summary: Kafka Streams crashes after ProducerFencedException Key: KAFKA-14567 URL: https://issues.apache.org/jira/browse/KAFKA-14567 Project: Kafka

[jira] [Created] (KAFKA-14567) Kafka Streams crashes after ProducerFencedException

2023-01-03 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-14567: --- Summary: Kafka Streams crashes after ProducerFencedException Key: KAFKA-14567 URL: https://issues.apache.org/jira/browse/KAFKA-14567 Project: Kafka

[jira] [Commented] (KAFKA-13295) Long restoration times for new tasks can lead to transaction timeouts

2023-01-03 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17654211#comment-17654211 ] Matthias J. Sax commented on KAFKA-13295: - Thanks. SG. > Long restoration times for new ta

Re: [ANNOUNCE] New committer: Justine Olshan

2023-01-03 Thread Matthias J. Sax
Congrats! On 12/29/22 6:47 PM, ziming deng wrote: Congratulations Justine! — Best, Ziming On Dec 30, 2022, at 10:06, Luke Chen wrote: Congratulations, Justine! Well deserved! Luke On Fri, Dec 30, 2022 at 9:15 AM Ron Dagostino wrote: Congratulations, Justine!Well-deserved., and I’m

Re: [ANNOUNCE] New committer: Justine Olshan

2023-01-03 Thread Matthias J. Sax
Congrats! On 12/29/22 6:47 PM, ziming deng wrote: Congratulations Justine! — Best, Ziming On Dec 30, 2022, at 10:06, Luke Chen wrote: Congratulations, Justine! Well deserved! Luke On Fri, Dec 30, 2022 at 9:15 AM Ron Dagostino wrote: Congratulations, Justine!Well-deserved., and I’m

Re: Kafka Stream: The state store, wkstore, may have migrated to another instance

2022-12-29 Thread Matthias J. Sax
Sounds like a SpringBoot issue rather than a KS issues. -Matthias On 12/29/22 2:45 AM, Nawal Sah wrote: Hi, My SpringBoot stream application works fine in a fresh start of the clustered environment. But when I restart one of the pods out of two pods, I start getting the below exception from

[jira] [Assigned] (KAFKA-9224) State store should not see uncommitted transaction result

2022-12-28 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-9224: -- Assignee: (was: Boyang Chen) > State store should not see uncommitted transact

[jira] [Assigned] (KAFKA-8977) Remove MockStreamsMetrics Since it is not a Mock

2022-12-28 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-8977: -- Assignee: (was: bibin sebastian) > Remove MockStreamsMetrics Si

[jira] [Assigned] (KAFKA-6460) Add mocks for state stores used in Streams unit testing

2022-12-28 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-6460: -- Assignee: (was: Yishun Guan) > Add mocks for state stores used in Streams u

[jira] [Assigned] (KAFKA-8272) Changed(De)Serializer does not forward configure() call

2022-12-28 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-8272: -- Assignee: (was: Matthias J. Sax) > Changed(De)Serializer does not forw

[jira] [Assigned] (KAFKA-6786) Remove additional configs in StreamsBrokerDownResilienceTest

2022-12-28 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-6786: -- Assignee: (was: Abhishek Sharma) > Remove additional conf

[jira] [Assigned] (KAFKA-7653) Streams-Scala: Add type level differentiation for Key and Value serdes.

2022-12-28 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-7653: -- Assignee: (was: Mark Tranter) > Streams-Scala: Add type level differentiat

[jira] [Updated] (KAFKA-7653) Streams-Scala: Add type level differentiation for Key and Value serdes.

2022-12-28 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-7653: --- Labels: kip scala (was: scala) > Streams-Scala: Add type level differentiation for

[jira] [Updated] (KAFKA-7653) Streams-Scala: Add type level differentiation for Key and Value serdes.

2022-12-28 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-7653: --- Description: Implicit resolution/conversion of Serdes/Consumed etc is a big improvement

[jira] [Assigned] (KAFKA-7075) Allow Topology#addGlobalStore to add a window store

2022-12-28 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-7075: -- Assignee: (was: Nishanth Pradeep) > Allow Topology#addGlobalStore to add a win

[jira] [Commented] (KAFKA-13295) Long restoration times for new tasks can lead to transaction timeouts

2022-12-28 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17652620#comment-17652620 ] Matthias J. Sax commented on KAFKA-13295: - [~ableegoldman] – I am wondering if this issue

[jira] [Resolved] (KAFKA-10493) KTable out-of-order updates are not being ignored

2022-12-28 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-10493. - Fix Version/s: (was: 4.0.0) Assignee: (was: Matthias J. Sax

[jira] [Resolved] (KAFKA-10493) KTable out-of-order updates are not being ignored

2022-12-28 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-10493. - Fix Version/s: (was: 4.0.0) Assignee: (was: Matthias J. Sax

[jira] [Commented] (KAFKA-10493) KTable out-of-order updates are not being ignored

2022-12-28 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17652613#comment-17652613 ] Matthias J. Sax commented on KAFKA-10493: - Given that "version KTable" KIP is appr

[jira] [Commented] (KAFKA-8403) Make suppression results queriable

2022-12-28 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17652611#comment-17652611 ] Matthias J. Sax commented on KAFKA-8403: [~vvcephei] – given https://issues.apache.org/jira

[jira] [Resolved] (KAFKA-13881) Add package.java for public package javadoc

2022-12-28 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-13881. - Fix Version/s: 3.4.0 (was: 3.5.0) Resolution: Fixed >

[jira] [Resolved] (KAFKA-13881) Add package.java for public package javadoc

2022-12-28 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-13881. - Fix Version/s: 3.4.0 (was: 3.5.0) Resolution: Fixed >

[jira] [Commented] (KAFKA-14548) Stable streams applications stall due to infrequent restoreConsumer polls

2022-12-27 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17652327#comment-17652327 ] Matthias J. Sax commented on KAFKA-14548: - Thanks! > Stable streams applications stall

Re: [ANNOUNCE] New committer: Satish Duggana

2022-12-27 Thread Matthias J. Sax
Congrats! On 12/27/22 10:20 AM, Kirk True wrote: Congrats, Satish! On Fri, Dec 23, 2022, at 10:07 AM, Jun Rao wrote: Hi, Everyone, The PMC of Apache Kafka is pleased to announce a new Kafka committer Satish Duggana. Satish has been a long time Kafka contributor since 2017. He is the main

Re: [ANNOUNCE] New committer: Satish Duggana

2022-12-27 Thread Matthias J. Sax
Congrats! On 12/27/22 10:20 AM, Kirk True wrote: Congrats, Satish! On Fri, Dec 23, 2022, at 10:07 AM, Jun Rao wrote: Hi, Everyone, The PMC of Apache Kafka is pleased to announce a new Kafka committer Satish Duggana. Satish has been a long time Kafka contributor since 2017. He is the main

[jira] [Commented] (KAFKA-14548) Stable streams applications stall due to infrequent restoreConsumer polls

2022-12-27 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17652292#comment-17652292 ] Matthias J. Sax commented on KAFKA-14548: - Thanks! – I have of course an interest to get

[jira] [Commented] (KAFKA-14453) Flaky test suite MirrorConnectorsWithCustomForwardingAdminIntegrationTest

2022-12-27 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17652290#comment-17652290 ] Matthias J. Sax commented on KAFKA-14453: - [~ChrisEgerton] – Jenkins seems to be in very bad

[jira] [Commented] (KAFKA-14548) Stable streams applications stall due to infrequent restoreConsumer polls

2022-12-22 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651440#comment-17651440 ] Matthias J. Sax commented on KAFKA-14548: - {quote}This is an anti-pattern, as frequent poll()s

Re: [VOTE] KIP-837 Allow MultiCasting a Result Record.

2022-12-22 Thread Matthias J. Sax
/changes or address any concerns that are still present around this at this point as well. And I would keep in mind the feedback to provide more time in such a scenario. Thanks! Sagar. On Fri, Dec 9, 2022 at 11:41 PM Matthias J. Sax wrote: It is what it is. we did have internal discussions

Re: [ANNOUNCE] New committer: Josep Prat

2022-12-20 Thread Matthias J. Sax
Congrats! On 12/20/22 12:01 PM, Josep Prat wrote: Thank you all! ——— Josep Prat Aiven Deutschland GmbH Immanuelkirchstraße 26, 10405 Berlin Amtsgericht Charlottenburg, HRB 209739 B Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen m: +491715557497 w: aiven.io e: josep.p...@aiven.io On

Re: [ANNOUNCE] New committer: Josep Prat

2022-12-20 Thread Matthias J. Sax
Congrats! On 12/20/22 12:01 PM, Josep Prat wrote: Thank you all! ——— Josep Prat Aiven Deutschland GmbH Immanuelkirchstraße 26, 10405 Berlin Amtsgericht Charlottenburg, HRB 209739 B Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen m: +491715557497 w: aiven.io e: josep.p...@aiven.io On

[jira] [Commented] (KAFKA-14537) Materialized with / as ordering issues

2022-12-20 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17649894#comment-17649894 ] Matthias J. Sax commented on KAFKA-14537: - What you observe is behavior as design. Note

[jira] [Resolved] (KAFKA-14537) Materialized with / as ordering issues

2022-12-20 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14537. - Resolution: Not A Bug > Materialized with / as ordering iss

[jira] [Resolved] (KAFKA-14537) Materialized with / as ordering issues

2022-12-20 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14537. - Resolution: Not A Bug > Materialized with / as ordering iss

Re: [VOTE] KIP-889 Versioned State Stores

2022-12-19 Thread Matthias J. Sax
+1 (binding) On 12/15/22 1:27 PM, John Roesler wrote: Thanks for the thorough KIP, Victoria! I'm +1 (binding) -John On 2022/12/15 19:56:21 Victoria Xia wrote: Hi all, I'd like to start a vote on KIP-889 for introducing versioned key-value state stores to Kafka Streams:

Re: [ANNOUNCE] New committer: Ron Dagostino

2022-12-16 Thread Matthias J. Sax
Congrats! On 12/15/22 7:09 AM, Rajini Sivaram wrote: Congratulations, Ron! Well deserved!! Regards, Rajini On Thu, Dec 15, 2022 at 11:42 AM Ron Dagostino wrote: Thank you, everyone! Ron On Dec 15, 2022, at 5:09 AM, Bruno Cadonna wrote: Congrats Ron! Best, Bruno On 15.12.22 10:23,

Re: [ANNOUNCE] New committer: Ron Dagostino

2022-12-16 Thread Matthias J. Sax
Congrats! On 12/15/22 7:09 AM, Rajini Sivaram wrote: Congratulations, Ron! Well deserved!! Regards, Rajini On Thu, Dec 15, 2022 at 11:42 AM Ron Dagostino wrote: Thank you, everyone! Ron On Dec 15, 2022, at 5:09 AM, Bruno Cadonna wrote: Congrats Ron! Best, Bruno On 15.12.22 10:23,

Re: [ANNOUNCE] New committer: Viktor Somogyi-Vass

2022-12-16 Thread Matthias J. Sax
Congrats! On 12/15/22 7:10 AM, Rajini Sivaram wrote: Congratulations, Viktor! Regards, Rajini On Thu, Dec 15, 2022 at 11:41 AM Ron Dagostino wrote: Congrats to you too, Victor! Ron On Dec 15, 2022, at 4:59 AM, Viktor Somogyi-Vass < viktor.somo...@cloudera.com.invalid> wrote: Thank

Re: [ANNOUNCE] New committer: Viktor Somogyi-Vass

2022-12-16 Thread Matthias J. Sax
Congrats! On 12/15/22 7:10 AM, Rajini Sivaram wrote: Congratulations, Viktor! Regards, Rajini On Thu, Dec 15, 2022 at 11:41 AM Ron Dagostino wrote: Congrats to you too, Victor! Ron On Dec 15, 2022, at 4:59 AM, Viktor Somogyi-Vass < viktor.somo...@cloudera.com.invalid> wrote: Thank

Re: [DISCUSS] KIP-889 Versioned State Stores

2022-12-14 Thread Matthias J. Sax
`put()` method on the TimestampedKeyValueStore representation of versioned key-value stores), so I have left it in as part of the KIP. Best, Victoria On Mon, Dec 12, 2022 at 8:42 PM Matthias J. Sax wrote: Thanks Victoria. I did not re-read the KIP in full on the wiki but only your email. Points

Re: [DISCUSS] KIP-890 Server Side Defense

2022-12-14 Thread Matthias J. Sax
he bumped epoch." Hmm, the epoch is associated with the current txn right? So, it seems weird to write a commit message with a bumped epoch. Should we only bump up the epoch in EndTxnResponse and rename the field to sth like nextProducerEpoch? Thanks, Jun On Mon, Dec 12, 2022 at 8:54 PM Ma

Re: [DISCUSS] KIP-890 Server Side Defense

2022-12-12 Thread Matthias J. Sax
handle the write request before it hears back from the Txn Coordinator. Let me know if I misunderstood something or something was unclear. Justine On Thu, Dec 1, 2022 at 12:15 PM Matthias J. Sax wrote: Thanks for the details Justine! 20) The client side change for 2 is removing

Re: [DISCUSS] KIP-889 Versioned State Stores

2022-12-12 Thread Matthias J. Sax
of this will be deciding on a name for the new class :) Pending objections, I'd like to make a call on item (9) and call a vote on this KIP at the end of this week. Thanks, Victoria On Thu, Dec 1, 2022 at 9:47 PM Matthias J. Sax wrote: Thanks Victoria! (1) About `ReadOnlyVersionedKeyValueStore

Re: [Streams] GlobalStateManagerImpl#restoreState locally restores previously deleted records

2022-12-12 Thread Matthias J. Sax
olff.de<http://www.maibornwolff.de>, Phone +49 89 544 253 000 USt-ID DE 129 299 525, Munich District Court HRB 98058 Managing Directors: Volker Maiborn, Holger Wolff, Alexander Hofmann, Florian Theimer, Marcus Adlwart, Dr. Martina Beck, Christian Loos. __

[jira] [Updated] (KAFKA-14461) StoreQueryIntegrationTest#shouldQuerySpecificActivePartitionStores logic to check for active partitions seems brittle.

2022-12-12 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14461: Component/s: streams unit tests > StoreQueryIntegrationT

Re: [VOTE] KIP-837 Allow MultiCasting a Result Record.

2022-12-09 Thread Matthias J. Sax
opened up for FK-Join. And more importantly, the PR for this is already merged and some of these things came up during that. Here's the PR link: https://github.com/apache/kafka/pull/12803. Thanks! Sagar. On Fri, Dec 9, 2022 at 5:15 AM Matthias J. Sax wrote: Ah. Missed it as it does not have a

Re: [Streams] GlobalStateManagerImpl#restoreState locally restores previously deleted records

2022-12-08 Thread Matthias J. Sax
The way I see it, KAFKA-7663 says, "a global store will be exactly the input topic after restore, regardless of the processor" Not sure what you mean by this? The issue the tickets describe is, that if you don't do a plain `put(key,value)` in your processor, stuff breaks right now. (Note

Re: [VOTE] KIP-837 Allow MultiCasting a Result Record.

2022-12-08 Thread Matthias J. Sax
ture right away so the restriction still exists. Thanks! Sagar. On Wed, Dec 7, 2022 at 9:42 PM Matthias J. Sax wrote: I don't see any update on the wiki about it. Did you forget to hit "save"? Can you also provide some background? I am not sure right now if I understand the proposed

Re: [VOTE] KIP-884: Add config to configure KafkaClientSupplier in Kafka Streams

2022-12-08 Thread Matthias J. Sax
10:08, Sophie Blee-Goldman wrote: Hey Hao, thanks for the KIP -- I'm +1 (binding) On Mon, Nov 21, 2022 at 12:57 PM Matthias J. Sax wrote: +1 (binding) On 11/21/22 7:39 AM, John Roesler wrote: I'm +1 (binding) Thanks for the KIP! -John On 2022/11/17 21:06:29 Hao Li wrote: Hi all, I

Re: [VOTE] KIP-878: Internal Topic Autoscaling for Kafka Streams

2022-12-07 Thread Matthias J. Sax
+1 (binding) On 12/1/22 9:39 PM, Sophie Blee-Goldman wrote: Thanks to all who participated for a great discussion on this KIP. Seems we're ready to kick off the voting on this, but please don't hesitate to call out anything of concern or raise questions over on the voting thread. Otherwise,

Re: [DISCUSS] KIP-878: Autoscaling for Statically Partitioned Streams

2022-12-07 Thread Matthias J. Sax
Matthias J. Sax wrote: Thanks Sophie. Good catch on the default partitioner issue! I missed the default config values as they were put into comments... About the default timeout: what is the follow up rebalance cadence (I though it would be 10 minutes?). For this case, a default timeout of 15

Re: [VOTE] KIP-837 Allow MultiCasting a Result Record.

2022-12-07 Thread Matthias J. Sax
I don't see any update on the wiki about it. Did you forget to hit "save"? Can you also provide some background? I am not sure right now if I understand the proposed changes? -Matthias On 12/6/22 6:36 PM, Sophie Blee-Goldman wrote: Thanks Sagar, this makes sense to me -- we clearly need

Re: BUG: eos KeyValueStore::delete() in Punctuator

2022-12-06 Thread Matthias J. Sax
*Founder, LittleHorse.io* On Mon, Dec 5, 2022 at 7:42 PM Matthias J. Sax wrote: Thanks for reporting this issue. It might have been fixed via https://issues.apache.org/jira/browse/KAFKA-14294 already. -Matthias On 12/3/22 7:05 PM, Colt McNealy wrote: Hi all, I believe I've found a bug

Re: BUG: eos KeyValueStore::delete() in Punctuator

2022-12-05 Thread Matthias J. Sax
Thanks for reporting this issue. It might have been fixed via https://issues.apache.org/jira/browse/KAFKA-14294 already. -Matthias On 12/3/22 7:05 PM, Colt McNealy wrote: Hi all, I believe I've found a bug in Kafka Streams when: - Running an app in EOS - Calling

[jira] [Commented] (KAFKA-14440) Local state wipeout with EOS

2022-12-05 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17643642#comment-17643642 ] Matthias J. Sax commented on KAFKA-14440: - What you observe is behavior by-design (the design

[jira] [Resolved] (KAFKA-14440) Local state wipeout with EOS

2022-12-05 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14440. - Resolution: Duplicate > Local state wipeout with

[jira] [Resolved] (KAFKA-14440) Local state wipeout with EOS

2022-12-05 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14440. - Resolution: Duplicate > Local state wipeout with

[jira] [Resolved] (KAFKA-6643) Warm up new replicas from scratch when changelog topic has LIMITED retention time

2022-12-02 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6643. Resolution: Won't Fix > Warm up new replicas from scratch when changelog topic has LIMI

[jira] [Resolved] (KAFKA-6643) Warm up new replicas from scratch when changelog topic has LIMITED retention time

2022-12-02 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6643. Resolution: Won't Fix > Warm up new replicas from scratch when changelog topic has LIMI

[jira] [Resolved] (KAFKA-6542) Tables should trigger joins too, not just streams

2022-12-02 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6542. Resolution: Invalid This will be fixed via versioned stores and "delayed table lo

[jira] [Resolved] (KAFKA-6542) Tables should trigger joins too, not just streams

2022-12-02 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6542. Resolution: Invalid This will be fixed via versioned stores and "delayed table lo

[jira] [Resolved] (KAFKA-6509) Add additional tests for validating store restoration completes before Topology is intitalized

2022-12-02 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6509. Resolution: Not A Problem > Add additional tests for validating store restorat

[jira] [Resolved] (KAFKA-6509) Add additional tests for validating store restoration completes before Topology is intitalized

2022-12-02 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6509. Resolution: Not A Problem > Add additional tests for validating store restorat

[jira] [Resolved] (KAFKA-5245) KStream builder should capture serdes

2022-12-02 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-5245. Resolution: Fixed > KStream builder should capture ser

[jira] [Resolved] (KAFKA-5245) KStream builder should capture serdes

2022-12-02 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-5245. Resolution: Fixed > KStream builder should capture ser

[jira] [Resolved] (KAFKA-5085) Add test for rebalance exceptions

2022-12-02 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-5085. Resolution: Abandoned Might no be necessary any longer given all the changes we did over

[jira] [Resolved] (KAFKA-5085) Add test for rebalance exceptions

2022-12-02 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-5085. Resolution: Abandoned Might no be necessary any longer given all the changes we did over

[jira] [Updated] (KAFKA-5493) Optimize calls to flush for tasks and standby tasks

2022-12-02 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-5493: --- Labels: eos (was: ) > Optimize calls to flush for tasks and standby ta

Re: [DISCUSS] KIP-878: Autoscaling for Statically Partitioned Streams

2022-12-02 Thread Matthias J. Sax
mpleted" status gauge. At the very least, users will want to know when a failure has occurred, even if it's a single failure, no? Hopefully that makes more sense now, but I suppose I can write something like that in the KIP too Matthias -- answers inline below: On Thu, Dec 1, 2022 at 10:44 PM Matthi

[jira] [Commented] (KAFKA-14400) KStream - KStream - LeftJoin() does not call ValueJoiner with null value

2022-12-02 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642353#comment-17642353 ] Matthias J. Sax commented on KAFKA-14400: - {quote}Am I correct that when one +LAST+ input record

[jira] [Commented] (KAFKA-14184) Kafka streams application crashes due to "UnsupportedOperationException: this should not happen: timestamp() is not supported in standby tasks."

2022-12-02 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642351#comment-17642351 ] Matthias J. Sax commented on KAFKA-14184: - Thanks for the update. – It's hard to say what might

Re: [VOTE] KIP-869: Improve Streams State Restoration Visibility

2022-12-01 Thread Matthias J. Sax
Seems I am late to the party... Great KIP. Couple of questions from my side: (1) What is the purpose of `standby-updating-tasks`? It seems to be the same as the number of assigned standby task? Not sure how useful it would be? (2) `active-paused-tasks` / `standby-paused-tasks` -- what does

Re: [DISCUSS] KIP-878: Autoscaling for Statically Partitioned Streams

2022-12-01 Thread Matthias J. Sax
me. Please call out anything you think I missed addressing either in this email or the updated KIP. Thanks to everyone who helped me refine the design of this feature; it feels much cleaner now. Give it a read and let me know what you think! On Mon, Nov 7, 2022 at 5:45 PM Matthias J. Sax wrote:

Re: [DISCUSS] KIP-889 Versioned State Stores

2022-12-01 Thread Matthias J. Sax
sis. WDYT? 2) I have a similar question as Matthias, about the timestampTo argument when doing a get. Is it inclusive or exclusive? 3) validFrom sounds slightly confusing to me. It is essentially the timestamp at which the record was inserted. validFrom makes it sound like validTo which c

Re: [DISCUSS] KIP-890 Server Side Defense

2022-12-01 Thread Matthias J. Sax
to come back, in theory we could have sent a commit/abort call that would make the original result of the check out of date. That is why we can check the leader state before we write to the log. I'm happy to update the KIP if some of these things were not clear. Thanks, Justine On Mon, N

[jira] [Commented] (KAFKA-14374) Kafka streams losing messages in State Store during first launch of app

2022-12-01 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642135#comment-17642135 ] Matthias J. Sax commented on KAFKA-14374: - Thanks for the details. – It would be very concerning

[jira] [Updated] (KAFKA-14412) Transactional semantics for StateStores

2022-12-01 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14412: Labels: kip (was: ) > Transactional semantics for StateSto

[jira] [Updated] (KAFKA-14299) Benchmark and stabilize state updater

2022-12-01 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14299: Component/s: streams > Benchmark and stabilize state upda

[jira] [Commented] (KAFKA-12679) Rebalancing a restoring or running task may cause directory livelocking with newly created task

2022-12-01 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642054#comment-17642054 ] Matthias J. Sax commented on KAFKA-12679: - [~lbrutschy] Can you link the corresponding ticket

[jira] [Updated] (KAFKA-14432) RocksDBStore relies on finalizers to not leak memory

2022-12-01 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14432: Component/s: streams > RocksDBStore relies on finalizers to not leak mem

<    6   7   8   9   10   11   12   13   14   15   >