Re: [DISCUSSION] KIP-965: Support disaster recovery between clusters by MirrorMaker

2023-08-14 Thread Igor Fomenko
I agree that synchronizing ACL between clusters is a very useful feature for DR scenarios. In fact, I would prefer this to be a default setting since almost every prod implementation requires a DR cluster. There are some scenarios when replication between clusters is done for some other reasons

Re: [DISCUSS] KIP-955: Add stream-table join on foreign key

2023-08-11 Thread Igor Fomenko
apJoin does not work, and we go with aggregationJoin, I would > still argue that it's the same as doing an upstream table aggregation > plus a regular stream-table join, and I don't see a big perf difference > between both operations either. For both cases the table input is > repartit

Re: [DISCUSS] KIP-955: Add stream-table join on foreign key

2023-08-10 Thread Igor Fomenko
rderds.map(/*craft a special "delete order > message"*/).to("orderEventTopic"); > > > The last step is required to have a "cleanup" message to purge state > from the `orderEvents` KTable that was computed via the aggregation. If > such a cleanup message is processe

Re: [DISCUSS] KIP-955: Add stream-table join on foreign key

2023-08-07 Thread Igor Fomenko
mit a > single "enriched" event? > > > Thus, I am actually wondering, if you would not pre-process both > shipment and order-details table, via `groupBy(orderId)` and assemble a > list (or similar) of alls shipments (or order-details) per order? If you > do this pre-

[VOTE] KIP-955: Add stream-table join on foreign key

2023-08-02 Thread Igor Fomenko
Hi All, I would like to call a Vote on KIP-955: Add stream-table join on foreign key. KIP link is here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-955%3A+Add+stream-table+join+on+foreign+key Mostly I would like to get consensus on the need for this new API to Kafka Streams. The actual

[jira] [Created] (KAFKA-15299) Support left stream-table join on foreign key

2023-08-02 Thread Igor Fomenko (Jira)
Igor Fomenko created KAFKA-15299: Summary: Support left stream-table join on foreign key Key: KAFKA-15299 URL: https://issues.apache.org/jira/browse/KAFKA-15299 Project: Kafka Issue Type

Re: [DISCUSS] KIP-955: Add stream-table join on foreign key

2023-07-26 Thread Igor Fomenko
pose to use > the foreignKeyExtractor to be applied to the KTable (which is the right > input, and thus it would be a 1:n join). > > Maybe you can clarify the use case a little bit. For the current KIP > description I only see the 1:1 join case, what would mean we might not > nee

[DISCUSS] KIP-955: Add stream-table join on foreign key

2023-07-24 Thread Igor Fomenko
Hello developers of the Kafka Streams, I would like to start discussion on KIP-955: Add stream-table join on foreign key This KIP proposes the new API to join KStrem with KTable based on foreign

Request permission to contribute

2023-07-18 Thread Igor Fomenko
Hello, I would like to get permission to contribute to the Apache Kafka project. Specifically I would like to create KIP for Kafka Streams and to work on the implementation for that KIP. My JIRA and Confluence ID is the same and it is: igorf211 Regards, Igor Fomenko