Re: Problems running Cassandra 0.6.1 on large EC2 instances.

2010-05-21 Thread Curt Bererton
glife http://apps.facebook.com/happyhabitat On Fri, May 21, 2010 at 12:53 PM, S Ahmed wrote: > curious how did things turn out? > > > On Tue, May 18, 2010 at 1:38 PM, Curt Bererton wrote: > >> We only have a few CFs (6 or 7). I've increased the MemtableThroughputInMB >> a

Any kind soul gotten cassandra working with jcollectd?

2010-05-21 Thread Curt Bererton
Hello all, We're running cassandra on EC2 (via Rightscale), and I'm working on connecting up the cassandra JMX monitoring to try to debug why our 0.6.1 Cassandra machine spike to 100% CPU and then choke after about 6 hours worth of production data running through them. We're running on 64 bit EC2

Re: Problems running Cassandra 0.6.1 on large EC2 instances.

2010-05-18 Thread Curt Bererton
We only have a few CFs (6 or 7). I've increased the MemtableThroughputInMB and MemtableOperationsInMillions as per your suggestions. Do we really need a swap file though? I suppose it can't hurt, but with my problem in particular we weren't maxing out main memory. We'll be running another test to

Re: Problems running Cassandra 0.6.1 on large EC2 instances.

2010-05-17 Thread Curt Bererton
h this level, you can > start swapping which is very very bad. As Brandon pointed out, you haven't > exhausted your physically memory yet but you still want to lower Xmx to > something like 5 maybe 6 GB. > > > On Mon, May 17, 2010 at 7:02 PM, Curt Bererton wrote: > >> Here

Re: Problems running Cassandra 0.6.1 on large EC2 instances.

2010-05-17 Thread Curt Bererton
0 PM, Brandon Williams wrote: > On Mon, May 17, 2010 at 6:02 PM, Curt Bererton wrote: > >> So pretty much the defaults aside from the 7Gig max heap. CPU is totally >> hammered right now, and it is receiving 0 ops/sec from me since I >> disconnected it from our application ri

Re: Problems running Cassandra 0.6.1 on large EC2 instances.

2010-05-17 Thread Curt Bererton
yCrafter.com, http://apps.facebook.com/happyhabitat On Mon, May 17, 2010 at 3:51 PM, Mark Greene wrote: > Can you provide us with the current JVM args? Also, what type of work load > you are giving the ring (op/s)? > > > On Mon, May 17, 2010 at 6:39 PM, Curt Bererton wrote: > >

Problems running Cassandra 0.6.1 on large EC2 instances.

2010-05-17 Thread Curt Bererton
Hello Cassandra users+experts, Hopefully someone will be able to point me in the correct direction. We have cassandra 0.6.1 working on our test servers and we *thought* everything was great and ready to move to production. We are currently running a ring of 4 large instance EC2 (http://aws.amazon.