Re: [DISCUSS] KIP-718: Make KTable Join on Foreign key unopinionated

2021-04-18 Thread Marco Aurélio Lotz
And thus, it seems to be > error prone: I want to overwrite the stores, but I forget to overwrite > the subscription store. > > And even if one wants to keep RocksDB for the subscription stores only, > they can still pass in both Materialized object using the new methods. >

Re: [DISCUSS] KIP-718: Make KTable Join on Foreign key unopinionated

2021-04-14 Thread Marco Aurélio Lotz
would *only add* new > methods. > > Is it an expected use case to only change the main stores but not the > subscription stores? > > Wondering if we should deprecate the existing methods that only accept a > single `Materialized` parameter? > > > -Matthias > >

[VOTE] KIP-718: Make KTable Join on Foreign key unopinionated

2021-04-14 Thread Marco Aurélio Lotz
Hi all, I would like to start a vote on KIP-718, which proposes to make KTable join on foreign key unopinionated in terms of persistence method (currently it forces RocksDB usage for subscription store and no other option is available). https://cwiki.apache.org/confluence/display/KAFKA/KIP-718%3A

Re: [DISCUSS] KIP-718: Make KTable Join on Foreign key unopinionated

2021-04-09 Thread Marco Aurélio Lotz
a fair amount of complexity, so it might be nice to avoid a new one. > > > > Thanks, > > John > > > > On Tue, Apr 6, 2021, at 10:28, Marco Aurélio Lotz wrote: > >> Hi John / Guozhang, > >> > >> If I correctly understood John's message, he agr

Re: [DISCUSS] KIP-718: Make KTable Join on Foreign key unopinionated

2021-04-06 Thread Marco Aurélio Lotz
ion store. > > > > 3. You might want a different kind (or differently configured) store for > > the subscription store, since it’s access pattern is so different. > > > > If you buy these, it might be good to put the justification into the KIP. > > > > I’m

Re: [DISCUSS] KIP-718: Make KTable Join on Foreign key unopinionated

2021-03-29 Thread Marco Aurélio Lotz
, Mar 4, 2021 at 8:04 PM Guozhang Wang wrote: > Thanks Marco, > > Just a quick thought: what if we reuse the existing Materialized object for > both subscription and join stores, instead of introducing a new param / > class? > > Guozhang > > On Tue, Mar 2, 2021 at 1:07 AM

[DISCUSS] KIP-718: Make KTable Join on Foreign key unopinionated

2021-03-02 Thread Marco Aurélio Lotz
Hi folks, I would like to invite everyone to discuss further KIP-718: https://cwiki.apache.org/confluence/display/KAFKA/KIP-718%3A+Make+KTable+Join+on+Foreign+key+unopinionated I welcome all feedback on it. Kind Regards, Marco Lotz

Re: Create KIP Permission

2021-02-23 Thread Marco Aurélio Lotz
nd a user `marcolotz` -- note, > that the wiki and Jira are two separate accounts. Thus, you need to > create a wiki account in addition to your Jira account. > > -Matthias > > > On 2/11/21 1:31 AM, Marco Aurélio Lotz wrote: > > Dear Kafka Confluence Admin, > >

Create KIP Permission

2021-02-11 Thread Marco Aurélio Lotz
Dear Kafka Confluence Admin, I would like to a KIP for https://issues.apache.org/jira/browse/KAFKA-10383?page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel&focusedCommentId=17282774 . Could you please provide me the access right to do so? my username is marcolotz Kind Regard