exporting data from Cassandra cluster

2011-12-07 Thread Alexandru Dan Sicoe
Hello everyone. 3 node Cassandra 0.8.5 cluster. I've left the system running in production environment for long term testing. I've accumulated about 350GB of data with RF=2. The machines I used for the tests are older and need to be replaced. Because of this I need to export the data to a permanen

RE: exporting data from Cassandra cluster

2011-12-07 Thread Tim Smith
<http://www.webtrends.com/> | 851 SW 6th Ave, Suite 1600, Portland, OR 97204 The Global Leader in Mobile and Social Analytics From: Alexandru Dan Sicoe [mailto:sicoe.alexan...@googlemail.com] Sent: Wednesday, December 07, 2011 8:18 AM To: user@cassandra.apache.org Subject: exporting data fro

Re: exporting data from Cassandra cluster

2011-12-07 Thread Alexandru Dan Sicoe
exandru Dan Sicoe [mailto:sicoe.alexan...@googlemail.com] > *Sent:* Wednesday, December 07, 2011 8:18 AM > *To:* user@cassandra.apache.org > *Subject:* exporting data from Cassandra cluster > > ** ** > > Hello everyone. > 3 node Cassandra 0.8.5 cluster. I've left th

Re: exporting data from Cassandra cluster

2011-12-07 Thread Maxim Potekhin
Hello Alexandru, as you probably know, my group is using Amazon S3 to permanently (or sem-permanently) park the data in CSV format, which makes it portable and we can load it into anything if needed, or analyze on its own. Just my half of a Swiss centime :) And, because the S3 option is not f

Re: exporting data from Cassandra cluster

2011-12-07 Thread Jeremiah Jordan
Stop your current cluster. Start a new cassandra instance on the machine you want to store your data on. Use the sstable loader to load the sstables from all of the current machines into the new machine. Run major compaction a couple times. You will have all of the data on one machine. On

Re: exporting data from Cassandra cluster

2011-12-09 Thread Alexandru Dan Sicoe
Hi Jeremiah, The thing is I will send the data to a massive storage facility (I don't know what's behind the scenes) so I won't be backing up on one machine where I can install Cassandra. Does the sstable loader work just for copying data from a Cassandra cluster to somewhere on a disk where there

Re: exporting data from Cassandra cluster

2011-12-09 Thread Jeremiah Jordan
Once you get all of the data on one machine you can then flush/drain/compact shutdown the single node and then take the data folder off that machine and back it up. Then when you get your new cassandra cluster setup you can use the sstable loader to shoot the data from the backup into the new