Re: Apache beam and Flink

Hi, It's currently not possible to mix-and-match and I doubt that this will be possible in the future. Because Beam is a portable API we try and ensure that no API of the underlying Runner can bleed through. Best, Aljoscha > On 13. Aug 2017, at 16:03, Ted Yu wrote: > > I found this: > http://

Re: Apache beam and Flink

I found this: http://search-hadoop.com/m/Beam/gfKHFfzU1k2VKWlv?subj=Re+CEP+Pattern+matching+on+top+of+Beam+pipeline Consider asking on Beam mailing list. On Sun, Aug 13, 2017 at 6:53 AM, Basanth Gowda wrote: > I wasn't able to find much info on Flink and Beam wrt CEP & Graph > functionalities.

Apache beam and Flink

I wasn't able to find much info on Flink and Beam wrt CEP & Graph functionalities. Is it supported with Apache Beam ? Is it possible to mix and match Flink and Beam in a single use case ? thank you, Basanth

Re: Apache Beam and Flink

Small addition: The Flink Runner translates into the DataSet or DataStream API depending on the "streaming" flag of the PipelineOptions. The default mode is batch. Ultimately, this flag we be removed and replaced with an automated decision depending on the sources used. On Thu, May 26, 2016 at 10:

Re: Apache Beam and Flink

Hi Ashutosh There is a related open JIRA: Enable DataSet and DataStream Joins https://issues.apache.org/jira/browse/FLINK-2320 Slim > On May 26, 2016, at 3:05 AM, Fabian Hueske wrote: > > No, that is not supported yet. > Beam provides a co

Re: Apache Beam and Flink

No, that is not supported yet. Beam provides a common API but the Flink runner translates programs against batch sources into the DataSet API programs and Beam programs against streaming source into DataStream programs. It is not possible to mix both. 2016-05-26 10:00 GMT+02:00 Ashutosh Kumar : >

Re: Apache Beam and Flink

Thanks . So if we use Beam API with flink engine then we can get inter action between batch and stream ? As i know currently in flink Dataset and DStream can not talk . Is this correct ? Thanks Ashutosh On Thu, May 26, 2016 at 1:09 PM, Slim Baltagi wrote: > Hi Ashutosh > > Apache Beam provides

Re: Apache Beam and Flink

Hi Ashutosh Apache Beam provides a Unified API for batch and streaming. It also supports multiple ‘runners’: local, Apache Spark, Apache Flink and Google Cloud Data Flow (commercial service). It is not an alternative to Flink because it is an API and you still need an execution engine. It can b

Apache Beam and Flink

How does apache beam fits with flink ? Is it an alternative for flink or complementary to it ? Thanks Ashutosh