Re: Cluster-wide pause

2010-07-01 Thread Oren Benjamin
Thanks Jonathan, It's great that you still manage to help out individual users. I first came across your blog while looking for a good reusable bloom filter implementation a while back. Having surveyed every other Java implementation I could find, I ended up extracting the implementation

Re: Compaction-pool pause -- was: Cluster-wide pause

2010-07-01 Thread Steve Lihn
This problem was solved by forming a 3-node large-instance cluster. The pause went away. I thought I would try a single node configuration to test the intensive inserts, as you would expect to just work (though may not performing well). It turns out somehow Cassandra likes to have a minimum amount

Re: Cluster-wide pause

2010-07-01 Thread Oren Benjamin
From the stress.py code, it looks like the default storage-conf.xml was used (at least schema-wise). I'll give that a go for now. On Jul 1, 2010, at 1:31 PM, Oren Benjamin wrote: As a first step, I'd like to reproduce the test from http://spyced.blogspot.com/2010/01/cassandra-05.html on my

Re: Cluster-wide pause

2010-06-30 Thread Steve Lihn
Jon, I am experimenting writing 8 million rows into Cassandra and also experienced some random timeouts, even with 10-second timeout parameter. How do I avoid such timeout at all cost? (I.e. At this time, my priority is to finish the end-to-end test. Don't want the program to fail at all.) This is

Re: Compaction-pool pause -- was: Cluster-wide pause

2010-06-30 Thread Steve Lihn
Jon, Looks like this compaction process took 360 seconds. What is it and how do I avoid it? INFO [COMPACTION-POOL:1] 2010-06-30 14:56:08,667 CompactionManager.java (line 246) Compacting

Re: Cluster-wide pause

2010-06-30 Thread Jonathan Ellis
use a larger heap or throttle your writes On Wed, Jun 30, 2010 at 12:12 PM, Steve Lihn stevel...@gmail.com wrote: Jon, I am experimenting writing 8 million rows into Cassandra and also experienced some random timeouts, even with 10-second timeout parameter. How do I avoid such timeout at all

Cluster-wide pause

2010-06-29 Thread Oren Benjamin
Hi all - first timer here. I'm experimenting with Cassandra on Rackspace Cloud. Started with 4GB nodes and saw read latency spikes while streaming was taking place, so I increased to 8GB to see if limited memory was the issue. Now I'm seeing very strange behavior during any period that

Re: Cluster-wide pause

2010-06-29 Thread Jonathan Ellis
You could be seeing GC pauses. Did you increase the heap size you gave Cassandra, when you increased your VM size? On Tue, Jun 29, 2010 at 11:57 AM, Oren Benjamin o...@clearspring.com wrote: Hi all - first timer here. I'm experimenting with Cassandra on Rackspace Cloud.  Started with 4GB nodes