Re: Raid vs rsync -

2015-03-19 Thread Matthew Miller
On Tue, Mar 10, 2015 at 10:27:08AM +0100, Suvayu Ali wrote: > I would recommend rsnapshot. It makes setting up an rsync & cron based > incremental backup system very easy. The only downside is recovery is a > rather manual process. For a more full-blown solution with rsync, > BackupPC might be i

Re: Raid vs rsync -

2015-03-19 Thread Roberto Ragusa
On 03/14/2015 11:02 PM, Martin Cigorraga wrote: > Also if you will be rsyncing from one computer to another (in contrast to an > attached storage) setting up an Rsync daemon on destination will make the > sync to be faster and lighter than syncing over ssh; of course that if you > need an encryp

Re: Raid vs rsync -

2015-03-14 Thread Martin Cigorraga
TL;DR (at least not the entire thread) If you go with Rsync you may find incron an useful add-on as well as with it you can monitor a variety of events on any given file or directory, like OPEN_READ, CREATE, CLOSE, CLOSE_WRITE, etc - and this way backup your data in real time whenever a condition

Re: Raid vs rsync -

2015-03-13 Thread Roberto Ragusa
On 03/10/2015 09:38 PM, Steven Rosenberg wrote: > Ideally the capacity of your rsync server would be many times that of > your main server's data so you could make backups daily, weekly and > monthly and save enough of them for file recovery in the event of > human error. > Actually not. You jus

Re: Raid vs rsync -

2015-03-11 Thread Chris Murphy
On Tue, Mar 10, 2015 at 2:55 PM, Chris Murphy wrote: > Amazon Glacier is fairly inexpensive Google announced Nearline option for Google Cloud Storage, priced similar to Amazon Glacier but with faster retrieval. Storage price is the same, but retrieval is more expensive from the looks of it. Amaz

Re: Raid vs rsync -

2015-03-11 Thread Heinz Diehl
On 10.03.2015, Suvayu Ali wrote: > I would always encourage separate physical disks as backup partitions. > If the OP has flaky power, maybe having them offline when not in use, > would also be a good idea. I second that, this is a very important advice! In addition, use a good lightning protect

Re: Raid vs rsync -

2015-03-10 Thread Chris Murphy
Anyone using RAID of any type: hardware, md, LVM, Btrfs, ZFS, really need to be aware of drive SCT ERC and kernel SCSI command timer mismatches. The mismatch happens by default if you're using consumer hard drives, many of which now either have SCT ERC disabled by default or do not support it. This

Re: Raid vs rsync -

2015-03-10 Thread Chris Murphy
On Tue, Mar 10, 2015 at 2:38 PM, Steven Rosenberg wrote: > What usually happens is that a file is corrupted, by either man or > machine, and then that corrupted data goes to your backup, and you are > screwed. SDC and propagation of corruption is a big problem actually especially rotated media b

Re: Raid vs rsync -

2015-03-10 Thread Rick Stevens
On 03/10/2015 12:24 PM, Bob Goodwin wrote: On 03/10/15 12:29, Gordon Messmer wrote: On 03/09/2015 11:04 AM, Bob Goodwin wrote: However I have been wondering if it wouldn't work just as well to periodically rsync the drive in use with a second drive? I know I'm going to repeat some of what h

Re: Raid vs rsync -

2015-03-10 Thread Chris Murphy
On Tue, Mar 10, 2015 at 1:43 PM, Suvayu Ali wrote: > In my encouter with data corruption in the past, it has usually been > entire drive failures rather than one particular filesystem failing on > me, and the other keeps functioning. > > I would always encourage separate physical disks as backup

Re: Raid vs rsync -

2015-03-10 Thread Chris Murphy
On Tue, Mar 10, 2015 at 1:24 PM, Bob Goodwin wrote: > Well as I said earlier, I mainly want to have files that I consider critical > backed up somewhere. I'd say all data needs at least one backup. Critical stuff should also be off-site in addition to the local backups. If you won't or can't do a

Re: Raid vs rsync -

2015-03-10 Thread Steven Rosenberg
On Mon, Mar 9, 2015 at 11:04 AM, Bob Goodwin wrote: > I had a mainboard fail in a box I use as a server, I moved the hard drive > into old computer and carried on from there. Now I've replaced the board and > intended to set it up using Raid to mirror two drives. However I have been > wondering if

Re: Raid vs rsync -

2015-03-10 Thread Suvayu Ali
On Tue, Mar 10, 2015 at 09:29:50AM -0700, Gordon Messmer wrote: > > Build a system with a RAID1 mirror on the two drives that uses half of the > available space for your system, and half of the space for a separate backup > filesystem. Keeping the backup filesystem separate provides some addition

Re: Raid vs rsync -

2015-03-10 Thread Bob Goodwin
On 03/10/15 12:29, Gordon Messmer wrote: On 03/09/2015 11:04 AM, Bob Goodwin wrote: However I have been wondering if it wouldn't work just as well to periodically rsync the drive in use with a second drive? I know I'm going to repeat some of what has already been said. My 2c anyway: No,

Re: Raid vs rsync -

2015-03-10 Thread Gordon Messmer
On 03/09/2015 11:04 AM, Bob Goodwin wrote: However I have been wondering if it wouldn't work just as well to periodically rsync the drive in use with a second drive? I know I'm going to repeat some of what has already been said. My 2c anyway: No, rsync would not work just as well. Do you w

Re: Raid vs rsync -_-

2015-03-10 Thread poma
On 10.03.2015 01:23, Sam Varshavchik wrote: ... > For starters, in your case taking an existing partition and turning it into > a RAID volume is going to be a big project. You'll have to back up your > existing data somewhere, erase the existing partition, create a raid > partition, then rest

Re: Raid vs rsync -

2015-03-10 Thread Patrick O'Callaghan
On Tue, 2015-03-10 at 10:27 +0100, Suvayu Ali wrote: > On Mon, Mar 09, 2015 at 08:23:23PM -0400, Sam Varshavchik wrote: > > > > rsync is easier to set up when you have existing data, and I do have a few > > laptops where I have a daily job to rsync their data onto a different > > server. > > I wo

Re: Raid vs rsync -

2015-03-10 Thread Andrew R Paterson
One assumes that if you are migrating a filesystem to RAID, you are installing a new disk (for e.g. RAID 1) (you need multiple disks - as in the acoronym RAID). So, if you install your new disk alongside your existing disk, create a RAID mirror with only one partition (from the new disk) create

Re: Raid vs rsync -

2015-03-10 Thread Suvayu Ali
On Mon, Mar 09, 2015 at 08:23:23PM -0400, Sam Varshavchik wrote: > > rsync is easier to set up when you have existing data, and I do have a few > laptops where I have a daily job to rsync their data onto a different > server. I would recommend rsnapshot. It makes setting up an rsync & cron based

Re: Raid vs rsync -

2015-03-09 Thread Bob Goodwin
On 03/09/15 20:23, Sam Varshavchik wrote: Bob Goodwin writes: I had a mainboard fail in a box I use as a server, I moved the hard drive into old computer and carried on from there. Now I've replaced the board and intended to set it up using Raid to mirror two drives. However I have been won

Re: Raid vs rsync -

2015-03-09 Thread Sam Varshavchik
Bob Goodwin writes: I had a mainboard fail in a box I use as a server, I moved the hard drive into old computer and carried on from there. Now I've replaced the board and intended to set it up using Raid to mirror two drives. However I have been wondering if it wouldn't work just as well to

Re: Raid vs rsync -

2015-03-09 Thread Bob Goodwin
On 03/09/15 14:58, Chris Murphy wrote: On Mon, Mar 9, 2015 at 12:04 PM, Bob Goodwin wrote: I had a mainboard fail in a box I use as a server, I moved the hard drive into old computer and carried on from there. Now I've replaced the board and intended to set it up using Raid to mirror two driv

Re: Raid vs rsync -

2015-03-09 Thread Chris Murphy
On Mon, Mar 9, 2015 at 12:04 PM, Bob Goodwin wrote: > > I had a mainboard fail in a box I use as a server, I moved the hard drive > into old computer and carried on from there. Now I've replaced the board and > intended to set it up using Raid to mirror two drives. However I have been > wondering

Raid vs rsync -

2015-03-09 Thread Bob Goodwin
I had a mainboard fail in a box I use as a server, I moved the hard drive into old computer and carried on from there. Now I've replaced the board and intended to set it up using Raid to mirror two drives. However I have been wondering if it wouldn't work just as well to periodically rsync th