If the dataset is too large for a file, you can put it behind a service and have your stream operators query the service for enrichment. You can even support updates to that dataset in a style very similar to the "lambda architecture" discussed elsewhere.
On Thursday, January 28, 2016, Fabian Hueske <fhue...@gmail.com> wrote: > Hi, > > this is currently not support yet. However, this feature is on our roadmap > and has been requested for a few times. > So I hope somebody will pick it up soon. > > If the static data set is small enough, you can read the full data set > (e.g., as a file) in the open method of FlatMapFunction, build a > hash-table, and do a hash join in the map method. > > Best, Fabian > > 2016-01-28 8:54 GMT+01:00 Don Frascuchon <frascuc...@gmail.com > <javascript:_e(%7B%7D,'cvml','frascuc...@gmail.com');>>: > >> Hi everyone, >> >> There is any way of mixing dataStreams and dataSets ? For example, enrich >> messages from a dataStream with a precalculated info in a dataSet. >> >> Thanks in advance! >> > >
