Re: Optimal Flink configuration for Standalone cluster.

2020-06-29 Thread Dimitris Vogiatzidakis
ng' on other tasks to be completed. BTW, what kind of workload are you running? Is it streaming or batch? > It is Batch. I have dataset of edges and try to extract features , to later be used for link prediction. Thank you -Dimitris Vogiatzidakis > On Mon, Jun 29, 2020 at 5:07 AM Xintong Song wrot

Re: Optimal Flink configuration for Standalone cluster.

2020-06-28 Thread Dimitris Vogiatzidakis
and worst case scenario 180GB is free to use, should I just say .flink.size: 180g? Thank you very much and sorry if i'm asking silly questions. Dimitris Vogiatzidakis On Sun, Jun 28, 2020 at 5:25 AM Xintong Song wrote: > Hi Dimitris, > > Regarding your questions. > a) For standal

Optimal Flink configuration for Standalone cluster.

2020-06-27 Thread Dimitris Vogiatzidakis
Hello, I'm having a bit of trouble understanding the memory configuration on flink. I'm using flink10.0.0 to read some datasets of edges and extract features. I run this on a cluster consisting of 4 nodes , with 32cores and 252GB Ram each, and hopefully I could expand this as long as I can add

Flink ML

2020-06-16 Thread Dimitris Vogiatzidakis
and it is running in version 1.10.0 that I also currently use, but I'm having trouble implementing it. Are there any java examples currently up and running? Or if you can propose a different way to perform the task? Thank you. -Dimitris Vogiatzidakis