Thanks Chesnay. Might I make a tentative case for Yammer? I'm not an expert, but I am currently trying to pull together information on this and was reviewing jmxtrans. This is all tentative, I've just dived in a few days ago. Please find the information below.
Using Yammer it is possible to load an MBean that queries all metrics and exports them en masse to a target destination, statsd or graphite for example, but any destination will to. The gist is that the metrics do not have to be queried one by one, and that the export can be arranged by loading an extra jar. An example of this setup can be seen at: https://github.com/airbnb/kafka-statsd-metrics2 Put the MBean jar in the classpath, add a config file, and presto. This would work for Kafka, and Cassandra, and I would not need a separate JMXtrans server. On Fri, Apr 8, 2016 at 11:01 AM, Chesnay Schepler <ches...@apache.org> wrote: > Flink currently doesn't expose any metrics beyond those shown in the > Dashboard. > > I am currently working on integrating a new metrics system that is partly > *based* on Yammer/Codahale/Dropwizard metrics. > > For a first version it is planned to export metrics only via JMX as this > effectively covers all use-cases with the help of JMXTrans and similar > tools. > > Reporting to specific systems is something we want to add as well though. > > Regards, > Chesnay Schepler > > > On 08.04.2016 09:32, Sanne de Roever wrote: > > Hi, > > I´m looking into setting up monitoring for our (Flink) environment and > realized that both Kafka and Cassandra use the yammer metrics library. This > library enables the direct export of all metrics to Graphite (and possibly > statsd). Does Flink use Yammer metrics? > > Cheers, > > Sanne > > >
