Re: Kafka Important Metrics

2013-07-03 Thread Cosmin Lehene
I haven't got the chance to try JMXTrans, although I'm planning to (and like to hear feedback if there is any). That being said they seem to focus on performance from their wiki (https://github.com/jmxtrans/jmxtrans/wiki) "The JmxTransformer engine is fully multithreaded. You specify the maximum

Re: Kafka Important Metrics

2013-07-03 Thread Cosmin Lehene
I believe something like https://github.com/jmxtrans/jmxtrans could solve this without the need to implement 3rd party monitoring integrations. On 7/2/13 12:57 AM, "Maxime Brugidou" wrote: >By the way, having an official contrib package with graphite, ganglia and >other well-known reporters woul

Re: Kafka/Hadoop consumers and producers

2013-07-03 Thread Cosmin Lehene
If the Hadoop consumer/producers use-case will remain relevant for Kafka (I assume it will), it would make sense to have the core components (kafka input/output format at least) as part of Kafka so that it could be built, tested and versioned together to maintain compatibility. This would also make