I would like to have a KTable, or maybe in Flink term a dynamic Table, that only contains the latest value for each keyed record. This would allow me to perform aggregation and join, based on the latest state of every record, as opposed to every record over time, or a period of time.
On Sun, Jul 21, 2019 at 8:21 AM miki haiat <miko5...@gmail.com> wrote: > Can you elaborate more about your use case . > > > On Sat, Jul 20, 2019 at 1:04 AM Maatary Okouya <maatarioko...@gmail.com> > wrote: > >> Hi, >> >> I am a user of Kafka Stream so far. However, because i have been face >> with several limitation in particular in performing Join on KTable. >> >> I was wondering what is the appraoch in Flink to achieve (1) the concept >> of KTable, i.e. a Table that represent a changeLog, i.e. only the latest >> version of all keyed records, and (2) joining those. >> >> There are currently a lot of limitation around that on Kafka Stream, and >> i need that for performing some ETL process, where i need to mirror entire >> databases in Kafka, and then do some join on the table to emit the logical >> entity in Kafka Topics. I was hoping that somehow i could acheive that by >> using FLink as intermediary. >> >> I can see that you support any kind of join, but i just don't see the >> notion of Ktable. >> >> >>
