exception when cleaning up...

2012-05-20 Thread Boris Yen
Hi, We are currently running 0.8.10 with 4 nodes. We tried to re-balance the range each node owns by using "nodetool move". After moving the node to the assigned token, we run the cleanup command, then we saw the exceptions: Error occured during cleanup java.util.concurrent.ExecutionException:

failed to restore from snapshot

2012-05-20 Thread Tamar Fraenkel
Hi! I wanted to test restoring my Cassandra cluster from a snapshot. I created a new ring (with 3 nodes) same as my environment. I started recovering one node at a time and failed with the first :) I didn't create the schema on the new node, but I did create the cluster. I stopped Cassandra I cop

Re: failed to restore from snapshot

2012-05-20 Thread Tamar Fraenkel
Hi! Sorry, ignore previous mail, my bad. Copied the files to the wrong place. Thanks *Tamar Fraenkel * Senior Software Engineer, TOK Media [image: Inline image 1] ta...@tok-media.com Tel: +972 2 6409736 Mob: +972 54 8356490 Fax: +972 2 5612956 On Sun, May 20, 2012 at 6:19 PM, Tamar Frae

Re: Exception when truncate

2012-05-20 Thread ruslan usifov
I think as you, but this is not true, there are not any permissions issue. And as i said before, cassandra try to create directory for snapshort that already exists 2012/5/19 Jonathan Ellis : > Sounds like you have a permissions problem.  Cassandra creates a > subdirectory for each snapshot. > > O

restoring from snapshot - missing data

2012-05-20 Thread Tamar Fraenkel
Hi! I am testing backup and restore. I created the restore using parallel ssh on all 3 nodes. I created a new 3 ring setup and used the snapshot to test recover. Snapshot from every original node went to one of the new nodes. When I compare the content of the data dir it seems that all files from t

Re: restoring from snapshot - missing data

2012-05-20 Thread Tyler Hobbs
Did you use the same tokens for the nodes in both clusters? On Sun, May 20, 2012 at 1:25 PM, Tamar Fraenkel wrote: > Hi! > I am testing backup and restore. > I created the restore using parallel ssh on all 3 nodes. > I created a new 3 ring setup and used the snapshot to test recover. > Snapshot

Re: Couldn't find cfId

2012-05-20 Thread aaron morton
> Just curious, you said "removing the HintedHandoff files from data/system", > what do the HintedHandoff files look like? The Hinted Handoff CF;s are in the system Keyspace, the files will be in the data/system directory an start with HintedHandoff. Cheers - Aaron Morton Freel

Re: how can we get (a lot) more performance from cassandra

2012-05-20 Thread aaron morton
I would look into the problems you are having with GC... > The server log shows the GC ParNew frequently gets longer than 200ms, often > in the range of 4-5seconds. But nowhere near 15 seconds (which is an > indication that JVM heap is being swapped out). Then check the throughput on the san a

Re: Data modeling for read performance

2012-05-20 Thread aaron morton
I would bucket the time stats as well. If you write all the attributes at the same time, and always want to read them together, storing them in something like a JSON blob is legitimate approach. Other Aaron, can you elaborate on > I'm not using composite row keys (it's just > AsciiType) as th

Re: Connection Reset By Peer (CQL over SSH Tunnel)

2012-05-20 Thread aaron morton
What host:port is the client using ? What is in the client side logs at DEBUG ? Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 18/05/2012, at 5:32 AM, Montgomery Burns wrote: > Hi, > > I am trying to connect to a Cassandra (1.0.8 or 1

Re: Using EC2 ephemeral 4disk raid0 cause high iowait trouble

2012-05-20 Thread aaron morton
Are you using the Ubuntu operating system ? Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 18/05/2012, at 1:59 PM, koji Lin wrote: > Hi > > We use amazon ami 3.2.12-3.2.4.amzn1.x86_64 > > and some of our data file are more than 10G > >

Re: Safely Disabling Compaction

2012-05-20 Thread aaron morton
The docs for the CLI say: - min_compaction_threshold: The minimum number of SSTables needed to start a minor compaction. Default is 4, setting to 0 disables minor compactions. If you are getting an error using 0 can you please raise a ticket on https://issues.apache.org/jira/browse/CASSANDRA (A

Re: restoring from snapshot - missing data

2012-05-20 Thread Tamar Fraenkel
Thanks. Just figured out yesterday that I switched the snapshots mixing the tokens. Will try again today. And another question. If I am putting the snapshots on a clean ring, I need to first create the data model? Thanks *Tamar Fraenkel * Senior Software Engineer, TOK Media [image: Inline image 1]

RE: Safely Disabling Compaction

2012-05-20 Thread Viktor Jevdokimov
To temporarily turn off compactions without schema update, use nodetool –h -p setcompactionthreshold for every node and every column family you need. If nodetool throws same exception, do in 2 steps: 1. nodetool setcompactionthreshold 0 32 (32 – use yours instead) 2. nodeto