Re: Enriching DataStream using static DataSet in Flink streaming

2018-04-04 Thread Fabian Hueske
Hi, This type of applications are not super well supported by Flink, yet. The missing feature is on the roadmap and called Side Inputs [1]. There are (at least) two alternatives but both have some drawbacks: 1) Ingest the static data set as regular DataStream, keyBy the static and the actual stre

Enriching DataStream using static DataSet in Flink streaming

2018-04-04 Thread vijay kansal
Hi All I am writing a Flink streaming program in which I need to enrich a DataStream of user events using some static data set (information base, IB). For E.g. Let's say we have a static data set of buyers and we have an incoming clickstream of events, for each event we want to add a boolean flag