Re: Monitoring and Management Tools for Beam an Friends

Hi Benjamin Please know there is an ongoing PR for a runner agnostic metrics feature https://github.com/apache/beam/pull/4548 Le jeudi 02 mars 2017 à 16:26 +, Stas Levin a écrit : > Hi Benjamin, > > This is somewhat of a hot topic lately, visibility FTW :) > > My experience comes from doing

Re: Monitoring and Management Tools for Beam an Friends

Hi Benjamin, This is somewhat of a hot topic lately, visibility FTW :) My experience comes from doing Beam over Spark over Yarn, where we have been using Graphite + Grafana (4.0+ gives alerting as well). In terms of metrics, the Spark runner supports both Spark native metrics (default + Spark

Re: Monitoring and Management Tools for Beam an Friends

+Stas Levin On Thu, Mar 2, 2017 at 5:30 PM Jean-Baptiste Onofré wrote: Hi Benjamin, It's a bit related to the Metric discussion on the dev@ mailing list. Today, we leverage the monitoring and management provided by the execution engine of the runner.

Re: Monitoring and Management Tools for Beam an Friends

Hi Benjamin, It's a bit related to the Metric discussion on the dev@ mailing list. Today, we leverage the monitoring and management provided by the execution engine of the runner. For instance, with the Spark runner, we can use the "regular" history server, codehale reporter, etc. It's also

Monitoring and Management Tools for Beam an Friends

Hi, I’m trying to collect a list of open source monitoring and management tools for Beam and supported runners. What do you use in your daily routine, and what’s your experience? Regards Ben