Re: [BackupPC-users] cloning the pool
On Thu, Mar 19, 2009 at 08:31:17PM +0100, stoffell wrote: Pool is 235.52GB comprising 718235 files and 4369 directories (as of 19/3 04:12), Well, we just finished rsync'ing (after two days.. ) our complete backuppc disk to new disks (over a dedicated gigabit ethernet link). Currently running on 3x 500 gb raid5, athlon64 3ghz, 3gb ram.. We backup 50 hosts (some small, some big) My pool: Pool is 182.85GB comprising 2356233 files and 4369 directories (as of 2/24 09:31), # time rsync -aAH --inplace --delete /home/BackupPC/ /backup/BackupPC/ real3443m32.269s user25m28.628s sys 51m9.920s /dev/sdc1 917G 195G 676G 23% /backup (on a external usb2 disk attached) Test: Modified the config.pl with the path of the external disk and executed a BackupPC_tarCreate.. it recover correctly from the backups... Seems this method is ok... Thanks Matteo -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] cloning the pool
Koen Linders wrote: If you want an idea what isn't possible; A year ago I tried copying a much pool much smaller too an USB disk than my current (see lower), using a Xeon 2.8 GHz/1 MB with 2 GB DDR and it ran out of memory copying via rsync -H Somewhere in the mailing is other information. Someone said he does an rsync on a 2million file pool worked perfectly for him with 2 GB of memory. Not for me. Rsync 3.x may need less memory - and the requirements may be different when the target is on a remote machine. -- Les Mikesell lesmikes...@gmail.com -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] cloning the pool
If you want an idea what isn't possible; A year ago I tried copying a much pool much smaller too an USB disk than my current (see lower), using a Xeon 2.8 GHz/1 MB with 2 GB DDR and it ran out of memory copying via rsync -H Somewhere in the mailing is other information. Someone said he does an rsync on a 2million file pool worked perfectly for him with 2 GB of memory. Not for me. Now I stop backuppc at night and do: dd if=/dev/sda5 of=/dev/sdb1 bs=4K It works perfectly. I managed to copy this pool back to another server with much bigger raid1 array formatted ext3 with same blocksize. And it works with a problem afterwards afaik. Pool is 235.52GB comprising 718235 files and 4369 directories (as of 19/3 04:12), Pool hashing gives 121 repeated files with longest chain 11, Nightly cleanup removed 6736 files of size 5.27GB (around 19/3 04:12), Pool file system was recently at 61% (19/3 10:02), today's max is 61% (19/3 04:00) and yesterday's max was 61%. Greetings, Koen Linders -Oorspronkelijk bericht- Van: stoffell [mailto:stoff...@gmail.com] Verzonden: woensdag 18 maart 2009 21:57 Aan: General list for user discussion, questions and support Onderwerp: Re: [BackupPC-users] cloning the pool I want to clone the pool to a local disk attached via USB. I can't made it with a dd because the pool is on a raid volume that don't contain the pool only. We're about to do exactly the same thing. This to get ourselves a weekly off-site copy. We will use 500 GB external disks to rsync -aH the complete backuppc directory to this disk. We will use lvm and some encrypted filesystem for enhanced security. We'll have to test it out because the wiki is not very clear about it: rsync has different limitations than cp - don't ask me whether it's better or worse. It's simply something different to try. It might be nice to have some case studies / usage scenarios on the backuppc wiki ? I'll report our experiences after we tested it all out.. cheers stoffell -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] cloning the pool
Hi, I want to clone the pool to a local disk attached via USB. I can't made it with a dd because the pool is on a raid volume that don't contain the pool only. Does it exist best practice to do this? Thanks Matteo -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] cloning the pool
Matteo Sgalaberni wrote: Hi, I want to clone the pool to a local disk attached via USB. I can't made it with a dd because the pool is on a raid volume that don't contain the pool only. Does it exist best practice to do this? If you have a small pool and sufficient RAM, you may be able to copy with a file oriented approach (rsync -H, tar, cp -a, cpio, etc). but you have to take everything under the directory containing the pool and pc subdirectories at once to maintain the hardlinks. However, this is not an efficient process so there are limits to the size you can handle that way. Above that, you would have to partition the raid volume and dd the partition to a equal-sized partition on the external disk. -- Les Mikesell lesmikes...@gmail.com -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] cloning the pool
On Wed, 2009-03-18 at 18:43 +0100, Matteo Sgalaberni wrote: Does it exist best practice to do this? Hi, search for previous posts on the list for using rsync for doing this (or backuppc_tarpccopy maybe?).. stupid solution (depending on the size of your array..): dd and then rm ?? (kiss-logic) -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] cloning the pool
This link: http://backuppc.wiki.sourceforge.net/change+archive+directory has info on how to move the pool, but similar methods can be used to clone it. Dave -Original Message- From: Matteo Sgalaberni [mailto:sg...@sgala.com] Sent: Wednesday, March 18, 2009 10:43 AM To: backuppc-users@lists.sourceforge.net Subject: [BackupPC-users] cloning the pool Hi, I want to clone the pool to a local disk attached via USB. I can't made it with a dd because the pool is on a raid volume that don't contain the pool only. Does it exist best practice to do this? Thanks Matteo -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] cloning the pool
I want to clone the pool to a local disk attached via USB. I can't made it with a dd because the pool is on a raid volume that don't contain the pool only. We're about to do exactly the same thing. This to get ourselves a weekly off-site copy. We will use 500 GB external disks to rsync -aH the complete backuppc directory to this disk. We will use lvm and some encrypted filesystem for enhanced security. We'll have to test it out because the wiki is not very clear about it: rsync has different limitations than cp - don't ask me whether it's better or worse. It's simply something different to try. It might be nice to have some case studies / usage scenarios on the backuppc wiki ? I'll report our experiences after we tested it all out.. cheers stoffell -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
