Re: [DISCUSS] Rework History Server into Global Dashboard

2020-05-15 Thread Till Rohrmann
This sounds like a good plan to me Gyula. And there is always the Flink packages option available if we want to make it available earlier. Cheers, Till On Fri, May 15, 2020 at 10:12 AM Gyula Fóra wrote: > Hi Till! > > I agree to some extent that managing multiple clusters is not Flink's >

Re: [DISCUSS] Rework History Server into Global Dashboard

2020-05-15 Thread Gyula Fóra
Hi Till! I agree to some extent that managing multiple clusters is not Flink's primary responsibility. However many (if not most) production users use Flink in per-job-cluster mode which gives superior configurability and resource isolation than standalone/session modes. But still the best job

Re: [DISCUSS] Rework History Server into Global Dashboard

2020-05-14 Thread Till Rohrmann
Hi Gyula, thanks for proposing this extension. I can see that such a feature could be helpful. However, I wouldn't consider the management of multiple clusters core to Flink. Managing a single cluster is already complex enough and given the available community capacity I would rather concentrate

Re: [DISCUSS] Rework History Server into Global Dashboard

2020-05-13 Thread Gyula Fóra
It seems that not everyone can see the screenshot in the email, so here is a link: https://drive.google.com/open?id=1abrlpI976NFqOZSX20k2FoiAfVhBbER9 On Wed, May 13, 2020 at 11:29 AM Gyula Fóra wrote: > Oops I forgot the screenshot, thanks Ufuk :D > > > @Jeff Zhang : Yes we simply call to the

Re: [DISCUSS] Rework History Server into Global Dashboard

2020-05-13 Thread Gyula Fóra
Oops I forgot the screenshot, thanks Ufuk :D @Jeff Zhang : Yes we simply call to the individual cluster's rest endpoints so it would work with multiple flink versions yes. Gyula On Wed, May 13, 2020 at 10:56 AM Jeff Zhang wrote: > Hi Gyula, > > Big +1 for this, it would be very helpful for

Re: [DISCUSS] Rework History Server into Global Dashboard

2020-05-13 Thread Jeff Zhang
Hi Gyula, Big +1 for this, it would be very helpful for flink jobs and cluster operations. Do you call flink rest api to gather the job info ? I hope this history server could work with multiple versions of flink as long as the flink rest api is compatible. Gyula Fóra 于2020年5月13日周三 下午4:13写道: >

[DISCUSS] Rework History Server into Global Dashboard

2020-05-13 Thread Gyula Fóra
Hi All! With the growing number of Flink streaming applications the current HS implementation is starting to lose its value. Users running streaming applications mostly care about what is running right now on the cluster and a centralised view on history is not very useful. We have been