Re: Operators resource requirements on K8s Flink session cluster

Hi Yang, Thanks for your quick reply. The Flink K8s documentation distinguishes between standalone and session deployment mode. I think I will use the latter. Since my previous mail, I found FLIP-53

Re: Operators resource requirements on K8s Flink session cluster

Hi Michaël, Glad to hear that you are going to run Flink workload on Kubernetes. AFAIK, we have two deployment ways. 1. Running Flink standalone session/per-job cluster on K8s. You need to calculate how many taskmanagers you need and the per taskmanager. All the taskmanager will be started by a K

Re: Operators in Flink

thanks Robert, I will definitely have a look at it. *--* *-- Felipe Gutierrez* *-- skype: felipe.o.gutierrez* *--* *https://felipeogutierrez.blogspot.com * On Wed, Apr 25, 2018 at 9:45 AM, Robert Metzger wrote: > Hi Felipe, > > Operators are fused by the

Re: Operators in Flink

Hi Felipe, Operators are fused by the system, yes. We call it operator chaining, read more about it here: https://ci.apache.org/projects/flink/flink-docs-master/concepts/runtime.html On Fri, Apr 20, 2018 at 11:58 AM, Felipe Gutierrez < felipe.o.gutier...@gmail.com> wrote: > Hi, > > I have a doub

Re: operators

tion > > > > Thanks for the info. > > > > > > *From:* ewenstep...@gmail.com [mailto:ewenstep...@gmail.com] *On Behalf > Of *Stephan Ewen > *Sent:* Wednesday, March 09, 2016 6:30 PM > *To:* user@flink.apache.org > *Subject:* Re: operators > > > > Hi! >

RE: operators

@flink.apache.org Subject: Re: operators Hi! You cannot specify that on the higher API levels. The lower API levels have something called "CoLocationConstraint". At this point it is not exposed, because we thought that would lead to not very scalable and robust designs in many cases

Re: operators

Hi! You cannot specify that on the higher API levels. The lower API levels have something called "CoLocationConstraint". At this point it is not exposed, because we thought that would lead to not very scalable and robust designs in many cases . The best thing usually is location transparency and l

Re: Operators chaining as custom functions

I don't any reason why the Scala approach should not work in Java. For example, the flink-graph API seems to be built on top of this concept (in Java): https://github.com/project-flink/flink-graph/blob/master/src/main/java/flink/graphs/Graph.java 2015-01-27 23:45 GMT+01:00 Flavio Pompermaier : >

Re: Operators chaining as custom functions

Hi Stephan, thanks for the response! Is that the only possibility?there's no java alternative at the moment? On Jan 27, 2015 10:23 PM, "Stephan Ewen" wrote: > Hi Flavio! > > In Scala: > > You can do that, using the "pimp my library" pattern. Define your own data > set (MyDataSet) that has the met

Re: Operators chaining as custom functions

Hi Flavio! In Scala: You can do that, using the "pimp my library" pattern. Define your own data set (MyDataSet) that has the method "myFunction()" and define an implicit conversion from DataSet to MyData set. See here for more details: http://alvinalexander.com/scala/scala-2.10-implicit-class-exa