Re: Index interval tuning

2011-05-11 Thread aaron morton
Thanks A - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 12 May 2011, at 03:44, Jonathan Ellis wrote: > Close: the problem is we don't count *any* true positives *unless* > cache is enabled. > > Fix attached to https://issues.apache.org/

Re: Index interval tuning

2011-05-11 Thread Jonathan Ellis
Close: the problem is we don't count *any* true positives *unless* cache is enabled. Fix attached to https://issues.apache.org/jira/browse/CASSANDRA-2637. On Wed, May 11, 2011 at 7:04 AM, Chris Burroughs wrote: > On 05/10/2011 10:24 PM, aaron morton wrote: >> What version and what were the value

Re: Index interval tuning

2011-05-11 Thread Chris Burroughs
On 05/10/2011 10:24 PM, aaron morton wrote: > What version and what were the values for RecentBloomFilterFalsePositives and > BloomFilterFalsePositives ? > > The bloom filter metrics are updated in SSTableReader.getPosition() the only > slightly odd thing I can see is that we do not count a key

Re: Index interval tuning

2011-05-11 Thread Héctor Izquierdo Seliva
Sorry aaron, here are the values you requested RecentBloomFilterFalsePositives = 5; BloomFilterFalsePositives = 385260; uptime of the node is three days and a half, more or less El mié, 11-05-2011 a las 22:05 +1200, aaron morton escribió: > What are the values for RecentBloomFilterFalsePositiv

Re: Index interval tuning

2011-05-11 Thread aaron morton
What are the values for RecentBloomFilterFalsePositives and BloomFilterFalsePositives the non ratio ones ? - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 11 May 2011, at 19:53, Héctor Izquierdo Seliva wrote: > El mié, 11-05-2011 a las

Re: Index interval tuning

2011-05-11 Thread Héctor Izquierdo Seliva
El mié, 11-05-2011 a las 14:24 +1200, aaron morton escribió: > What version and what were the values for RecentBloomFilterFalsePositives and > BloomFilterFalsePositives ? > > The bloom filter metrics are updated in SSTableReader.getPosition() the only > slightly odd thing I can see is that we do

Re: Index interval tuning

2011-05-10 Thread aaron morton
What version and what were the values for RecentBloomFilterFalsePositives and BloomFilterFalsePositives ? The bloom filter metrics are updated in SSTableReader.getPosition() the only slightly odd thing I can see is that we do not count a key cache hit a a true positive for the bloom filter. If

Re: Index interval tuning

2011-05-10 Thread Chris Burroughs
On 05/10/2011 02:12 PM, Peter Schuller wrote: >> That reminds me, my false positive ration is stuck at 1.0, so I guess >> bloom filters aren't doing a lot for me. > > That sounds unlikely unless you're hitting some edge case like reading > a particular row that happened to be a collision, and only

Re: Index interval tuning

2011-05-10 Thread Peter Schuller
> That reminds me, my false positive ration is stuck at 1.0, so I guess > bloom filters aren't doing a lot for me. That sounds unlikely unless you're hitting some edge case like reading a particular row that happened to be a collision, and only that row. This is from JMX stats on the column family

Re: Index interval tuning

2011-05-09 Thread Héctor Izquierdo Seliva
El lun, 09-05-2011 a las 17:58 +0200, Peter Schuller escribió: > > I have a few sstables with around 500 million keys, and memory usage has > > grown a lot, I suppose because of the indexes. This sstables are > > comprised of skinny rows, but a lot of them. Would tuning index interval > > make the

Re: Index interval tuning

2011-05-09 Thread Peter Schuller
> I have a few sstables with around 500 million keys, and memory usage has > grown a lot, I suppose because of the indexes. This sstables are > comprised of skinny rows, but a lot of them. Would tuning index interval > make the memory usage go down? And what would the performance hit be? Assuming

Index interval tuning

2011-05-09 Thread Héctor Izquierdo Seliva
Hi everyone. I have a few sstables with around 500 million keys, and memory usage has grown a lot, I suppose because of the indexes. This sstables are comprised of skinny rows, but a lot of them. Would tuning index interval make the memory usage go down? And what would the performance hit be? I