Re: how to take consistant snapshot?

2012-12-07 Thread Andrey Ilinykh
Agreed. On Fri, Dec 7, 2012 at 12:38 PM, Tyler Hobbs wrote: > Right. I don't personally think incremental backup is useful beyond > restoring individual nodes unless none of your data happens to reference > any other rows. > > > On Fri, Dec 7, 2012 at 11:37 AM, Andrey Ilinykh wrote: > >> That

Re: how to take consistant snapshot?

2012-12-07 Thread Tyler Hobbs
Right. I don't personally think incremental backup is useful beyond restoring individual nodes unless none of your data happens to reference any other rows. On Fri, Dec 7, 2012 at 11:37 AM, Andrey Ilinykh wrote: > That's right. But when I have incremental backup on each CF gets flushed > indep

Re: how to take consistant snapshot?

2012-12-07 Thread Andrey Ilinykh
That's right. But when I have incremental backup on each CF gets flushed independently. I have "hot" CF which gets flushed every several minutes and regular CF which gets flushed every hour or so. They have references to each other and data in sstables is definitely inconsistent. On Fri, Dec 7,

Re: how to take consistant snapshot?

2012-12-07 Thread Tyler Hobbs
Snapshots trigger a flush first, so data that's currently in the commit log will be covered by the snapshot. On Thu, Dec 6, 2012 at 11:52 PM, Andrey Ilinykh wrote: > > > > On Thu, Dec 6, 2012 at 7:34 PM, aaron morton wrote: > >> For background >> >> >> http://wiki.apache.org/cassandra/Operation

Re: how to take consistant snapshot?

2012-12-06 Thread Andrey Ilinykh
On Thu, Dec 6, 2012 at 7:34 PM, aaron morton wrote: > For background > > > http://wiki.apache.org/cassandra/Operations?highlight=%28snapshot%29#Consistent_backups > > If you it for a single node then yes there is

Re: how to take consistant snapshot?

2012-12-06 Thread aaron morton
For background http://wiki.apache.org/cassandra/Operations?highlight=%28snapshot%29#Consistent_backups If you it for a single node then yes there is a chance of inconsistency across CF's. If you have mulitple nodes the snashots you take on the later nodes will help. If you use CL QUOURM for r

how to take consistant snapshot?

2012-12-05 Thread Andrey Ilinykh
Hello, everybody! I have production cluster with incremental backup on and I want to clone it (create test one). I don't understand one thing- each column family gets flushed (and copied to backup storage) independently. Which means the total snapshot is inconsistent. If I restore from such snapsho