Both Presto and Flink make use of a Catalog in order to be able to read/write data from a source/sink. I don't agree about " Flink is about processing data streams" because Flink is competitive also for the batch workloads (and this will be further improved in the next releases). I'd like to register my data sources/sinks in one single catalog (E.g. Presto) and then being able to reuse it also in Flink (with a simple translation). My idea of integration here is thus more at catalog level since I would use Presto for exploring data from UI and Flink to process it because once the configuration part has finished (since I have many Flink jobs that I don't want to throw away or rewrite).
On Mon, Jan 27, 2020 at 2:30 PM Itamar Syn-Hershko < ita...@bigdataboutique.com> wrote: > Hi Flavio, > > Presto contributor and Starburst Partners here. > > Presto and Flink are solving completely different challenges. Flink is > about processing data streams as they come in; Presto is about ad-hoc / > periodic querying of data sources. > > A typical architecture would use Flink to process data streams and write > data and aggregations to some data stores (Redis, MemSQL, SQLs, > Elasticsearch, etc) and then using Presto to query those data stores (and > possible also others using Query Federation). > > What kind of integration will you be looking for? > > On Mon, Jan 27, 2020 at 1:44 PM Flavio Pompermaier <pomperma...@okkam.it> > wrote: > >> Hi all, >> is there any integration between Presto and Flink? I'd like to use Presto >> for the UI part (preview and so on) while using Flink for the batch >> processing. Do you suggest something else otherwise? >> >> Best, >> Flavio >> > > > -- > > [image: logo] <https://bigdataboutique.com/> > Itamar Syn-Hershko > CTO, Founder > +972-54-2467860 > ita...@bigdataboutique.com > https://bigdataboutique.com > <https://www.linkedin.com/in/itamar-syn-hershko-78b25013> > <https://twitter.com/synhershko> > <https://www.youtube.com/channel/UCBHr7lM2u6SCWPJvcKug-Yg> >
