I think keeping haveing the server keep track of more segment sizes (so you don't have to add up all the partitions manually) sounds useful. I've created KAFKA-106 for that.
Network flow is cool, but I'm not sure where among the producers/servers/consumers some of that monitoring fits. On 08/10/2011 03:36 PM, Evan Chan wrote: > For example, the rate at which log files are filling up. I suppose we could > just monitor /tmp/kafka-logs/*. > > It'd be cool to see how many consumers and producers have connected, the > rate of message flow to each consumer, etc. Of course, we could do > monitoring on the producer and consumer sides as well. > > -Evan > > > On Wed, Aug 10, 2011 at 11:05 AM, Chris Burroughs <[email protected] >> wrote: > >> On 08/09/2011 02:10 PM, Evan Chan wrote: >>> 3) Are there ways to otherwise see the health of Kafka? >> >> There are (some) jmx beans. Are there some specific metrics you would >> like to see? >> > > >
