Re: Knowing when there is a *real* need to add nodes

2011-05-19 Thread aaron morton
Considering disk usage is a tricky one. Compacted SSTables files will remain on disk until either there is not enough space, or the JVM GC runs. To measure the live space use the Space used (live) from the CFStats. Space used (total) includes the space which has been compacted and not yet

Re: Knowing when there is a *real* need to add nodes

2011-05-18 Thread Tomer B
As for static disk usage i would add this: test: df -kh description: run test after compaction (check GCGraceSeconds in storage-conf.xml) as only then data is expunged permanently, run on data disk, assuming here commitlog disk is separated from data dir. green gauge: used_space 30% of disk

Knowing when there is a *real* need to add nodes

2011-05-12 Thread Tomer B
Hi I'm trying to predict when my cluster would soon be needing new nodes added, i want a continuous graph telling my of my cluster health so that when i see my cluster becomes more and more busy (I want numbers measurments) i would be able to know i need to start purchasing more machines and get