Hi Averell, If the 2a fits in memory, then you can load the data to all TMs in the open() method of any rich function, eg. ProcessFunction [1]. The open() runs before any data is allowed to flow in your pipeline from the sources.
Cheers, Kostas [1] https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/operators/process_function.html <https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/operators/process_function.html> > On Sep 26, 2018, at 2:04 AM, Averell <lvhu...@gmail.com> wrote: > > Thank you Till. > > My use case is like this: I have two streams, one is raw data (1), the > other is enrichment data (2), which in turn consists of two component: > initial enrichment data (2a) which comes from an RDBMS table, and > incremental data (2b) which comes from a Kafka stream. To ensure that (1) > gets enriched properly, I want to have (2a) loaded properly into memory > before starting to process (1). > > Is there any walkaround solution for me in this case? > > Thanks and best regards, > Averell > > > > -- > Sent from: > http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
