Re: Monitoring compaction
Sure, patching CM stats into nodetool is fine. On Tue, Jun 1, 2010 at 9:50 AM, Ian Soboroff wrote: > Regarding compaction thresholds... the BMT example says to set the threshold > to 0 during an import. Is this advisable during any bulk import (say using > batch mutations or just lots and lots of thrift inserts)? > > Also, when I asked "are folks open to..." I meant that I'm happy to code a > patch if anyone's interested. > Ian > > On Tue, Jun 1, 2010 at 12:41 PM, Ian Soboroff wrote: >> >> Thanks. Are folks open to exposing this via nodetool? I've been trying >> to figure out a decent way to aggregate and expose all this information that >> is easier than nodetool and less noisy than nagios... suggestions >> appreciated. >> >> (My cluster only exposes a master node and everything else is private, so >> running a pile of jconsoles is not even possible...) >> >> Ian >> >> On Tue, Jun 1, 2010 at 12:33 PM, Dylan Egan / WildfireApp.com >> wrote: >>> >>> Hi Ian, >>> >>> On Tue, Jun 1, 2010 at 9:27 AM, Ian Soboroff wrote: >>> > Are stats exposed over JMX for compaction? >>> >>> You can view them via the >>> org.apache.cassandra.db:type=CompactionManager MBean. The PendingTasks >>> attribute might suit you best. >>> >>> Cheers, >>> >>> Dylan. >> > > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of Riptano, the source for professional Cassandra support http://riptano.com
Re: Monitoring compaction
Hi Ian, On Tue, Jun 1, 2010 at 9:41 AM, Ian Soboroff wrote: > Thanks. Are folks open to exposing this via nodetool? I've been trying to > figure out a decent way to aggregate and expose all this information that is > easier than nodetool and less noisy than nagios... suggestions appreciated. You may be interested in the munin plugins written by James Golick and Jonathan Ellis at http://github.com/jamesgolick/cassandra-munin-plugins Cheers, Dylan.
Re: Monitoring compaction
Regarding compaction thresholds... the BMT example says to set the threshold to 0 during an import. Is this advisable during any bulk import (say using batch mutations or just lots and lots of thrift inserts)? Also, when I asked "are folks open to..." I meant that I'm happy to code a patch if anyone's interested. Ian On Tue, Jun 1, 2010 at 12:41 PM, Ian Soboroff wrote: > Thanks. Are folks open to exposing this via nodetool? I've been trying to > figure out a decent way to aggregate and expose all this information that is > easier than nodetool and less noisy than nagios... suggestions appreciated. > > (My cluster only exposes a master node and everything else is private, so > running a pile of jconsoles is not even possible...) > > Ian > > > On Tue, Jun 1, 2010 at 12:33 PM, Dylan Egan / WildfireApp.com < > dylan.e...@wildfireapp.com> wrote: > >> Hi Ian, >> >> On Tue, Jun 1, 2010 at 9:27 AM, Ian Soboroff wrote: >> > Are stats exposed over JMX for compaction? >> >> You can view them via the >> org.apache.cassandra.db:type=CompactionManager MBean. The PendingTasks >> attribute might suit you best. >> >> Cheers, >> >> Dylan. >> > >
Re: Monitoring compaction
Thanks. Are folks open to exposing this via nodetool? I've been trying to figure out a decent way to aggregate and expose all this information that is easier than nodetool and less noisy than nagios... suggestions appreciated. (My cluster only exposes a master node and everything else is private, so running a pile of jconsoles is not even possible...) Ian On Tue, Jun 1, 2010 at 12:33 PM, Dylan Egan / WildfireApp.com < dylan.e...@wildfireapp.com> wrote: > Hi Ian, > > On Tue, Jun 1, 2010 at 9:27 AM, Ian Soboroff wrote: > > Are stats exposed over JMX for compaction? > > You can view them via the > org.apache.cassandra.db:type=CompactionManager MBean. The PendingTasks > attribute might suit you best. > > Cheers, > > Dylan. >
Re: Monitoring compaction
Hi Ian, On Tue, Jun 1, 2010 at 9:27 AM, Ian Soboroff wrote: > Are stats exposed over JMX for compaction? You can view them via the org.apache.cassandra.db:type=CompactionManager MBean. The PendingTasks attribute might suit you best. Cheers, Dylan.
Monitoring compaction
Are stats exposed over JMX for compaction? I'm trying to see when a node is in compaction, and guess when it will complete. tpstats doesn't show anything but the process is using lots of CPU time... I was wondering if there's a better view on compaction besides looking backwards in the system.log for a compaction start message without a corresponding completion message. Ian
