Re: Disactivating Yammer Metrics Monitoring

2014-11-07 Thread François Langelier
Good to know! Thanks Jason, I'll look at it ASAP! :) François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure http://www.etsmtl.ca/ Membre Club Capra http://capra.etsmtl.ca/ VP-Communication - CS Games http://csgames.org 2014 Jeux de Génie http://www.jdgets.com/ 2011 à

Re: Disactivating Yammer Metrics Monitoring

2014-11-06 Thread Jason Rosenberg
Hi Francois, We had the exact same problem. We embed Kafka in our service container, and we use yammer metrics to see data about the whole app (e.g. kafka, the jvm, the service container wrapping it). However, as you observed, by default, kafka produces an insane amount of metrics. So what we

Re: Disactivating Yammer Metrics Monitoring

2014-09-19 Thread François Langelier
Hi Daniel, Thank you for your answer. It's possible that I didn't understood something, if so correct me please. From what I understood, from the kafka doc #monitoring http://kafka.apache.org/documentation.html#monitoring, kafka use Yammer Metrics for monitoring the servers (the brokers) and

Re: Disactivating Yammer Metrics Monitoring

2014-09-19 Thread Otis Gospodnetic
Hi, I don't have any source or configs handy to check things, but you are saying you've configured Kafka to use GraphiteReporter, right? So why not remove that config, so metrics stop being sent to Graphite if your Graphite setup is suffering? If you do that and you still want to see your Kafka

Disactivating Yammer Metrics Monitoring

2014-09-17 Thread François Langelier
Hi all! We are using yammer metrics to monitor some parts of our system. Since we upgrade from kafka 0.7.2 to 0.8.1.1, we saw a lot more data getting in our graphite server and from what I saw, it looks like it all come from our producers. From what i understand, since we already use graphite,

Re: Disactivating Yammer Metrics Monitoring

2014-09-17 Thread Daniel Compton
Hi Francois I didn't quite understand how you've set up your metrics reporting. Are you using the https://github.com/criteo/kafka-ganglia metrics reporter? If so then you should be able to adjust the config to exclude the metrics you don't want, with kafka.ganglia.metrics.exclude.regex. On 18