Re: TimeOutExceptions and Cluster Performance

2010-02-13 Thread Stu Hood
you should watch https://issues.apache.org/jira/browse/CASSANDRA-685. Thanks, Stu -Original Message- From: "Jonathan Ellis" Sent: Friday, February 12, 2010 9:43pm To: cassandra-user@incubator.apache.org Subject: Re: TimeOutExceptions and Cluster Performance There's a lot m

Re: TimeOutExceptions and Cluster Performance

2010-02-12 Thread Joel Meyer
It might be an EC2 issue. We've been battling them all day and we noticed Cassandra performance started to tank sometime earlier this week. I'm not convinced the problem is with Cassandra, as we were seeing sub-100ms response times prior to this and we haven't made any changes. We're also running o

Re: TimeOutExceptions and Cluster Performance

2010-02-12 Thread Jonathan Ellis
There's a lot more details that would be useful, but if you are on the verge of OOMing and something actually running out, then that's probably the culprit; when the JVM gets low on ram it will consume all your CPU trying to GC enough to continue. (you mentioned seeing high cpu on one core which t

TimeOutExceptions and Cluster Performance

2010-02-12 Thread Stephen Hamer
Hi, I'm running a 5 node Cassandra cluster and am having a very tough time getting reasonable performance from it. Many of the requests are failing with TimeOutException. This is making it difficult to use Cassandra in a production setting. The cluster was running fine for a week or two (it was cr