RE: compaction throughput rate not even close to 16MB

2013-04-24 Thread Viktor Jevdokimov
; From: Hiller, Dean [mailto:dean.hil...@nrel.gov] > Sent: Wednesday, April 24, 2013 23:38 > To: user@cassandra.apache.org > Subject: Re: compaction throughput rate not even close to 16MB > > Thanks much!!! Better to hear at least one other person sees the same thing > ;). Somet

Re: compaction throughput rate not even close to 16MB

2013-04-24 Thread Wei Zhu
By the way, we are on SSD. -Wei From: "Hiller, Dean" To: "user@cassandra.apache.org" Sent: Wednesday, April 24, 2013 1:37 PM Subject: Re: compaction throughput rate not even close to 16MB Thanks much!!!  Better to hear at least one othe

Re: compaction throughput rate not even close to 16MB

2013-04-24 Thread Hiller, Dean
ndra.apache.org>> Date: Wednesday, April 24, 2013 2:33 PM To: "user@cassandra.apache.org<mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Subject: Re: compaction throughput rate not even close to 16MB I have noticed the same. I think in the "real

Re: compaction throughput rate not even close to 16MB

2013-04-24 Thread Robert Coli
On Wed, Apr 24, 2013 at 1:33 PM, Edward Capriolo wrote: > I think that setting is more important with multi threaded compaction and/or > more compaction slots. In those cases it may actually throttle something. Or if you're simultaneously doing a repair, which does a validation compaction, which

Re: compaction throughput rate not even close to 16MB

2013-04-24 Thread Edward Capriolo
I have noticed the same. I think in the "real" world your compaction throughput is limited by other things. If I had to speculate I would say that compaction can remove expired tombstones, however doing this requires bloom filter checks, etc. I think that setting is more important with multi threa