Re: [BackupPC-users] experiences with very large pools?

2010-02-19 Thread Gerald Brandt
> > I think I've to look for a different solution, I just can't imagine a > pool with > 10 TB. > > > > * I have recently taken my DRBD mirror off-line and copied the BackupPC > > directory structure to both XFS-without-DRBD and an EXT4 file system for > > testing. Performance of the XFS fil

Re: [BackupPC-users] experiences with very large pools?

2010-02-19 Thread Les Mikesell
Ralf Gross wrote: > > I think I've to look for a different solution, I just can't imagine a > pool with > 10 TB. Backuppc's usual scaling issues are with the number of files/links more than total size, so the problems may be different when you work with huge files. I thought someone had posted

[BackupPC-users] BackupPC not cleaning out cpool --- Anyone have anymore ideas?

2010-02-19 Thread joseph . holland
Original Message Subject: Re: [BackupPC-users] BackupPC not cleaning out cpool. From:"Joseph Holland" Date:Tue, February 16, 2010 8:57 am To: "General list for user discussion, questions and support" --

Re: [BackupPC-users] experiences with very large pools?

2010-02-19 Thread Ralf Gross
Gerald Brandt schrieb: > > > > > I think I've to look for a different solution, I just can't imagine a > > pool with > 10 TB. > > > > > > > * I have recently taken my DRBD mirror off-line and copied the BackupPC > > > directory structure to both XFS-without-DRBD and an EXT4 file system for

Re: [BackupPC-users] experiences with very large pools?

2010-02-19 Thread dan
you would need to move up to 15K rpm drives to have a very large array and the cost will grow exponentially trying to get such a large array. as Les said, look at a zfs array with block level dedup. I have a 3TB setup right now and I have some been running a backup against a unix server and 2 lin

Re: [BackupPC-users] experiences with very large pools?

2010-02-19 Thread Ralf Gross
Les Mikesell schrieb: > Ralf Gross wrote: > > > > I think I've to look for a different solution, I just can't imagine a > > pool with > 10 TB. > > Backuppc's usual scaling issues are with the number of files/links more than > total size, so the problems may be different when you work with huge fi

Re: [BackupPC-users] experiences with very large pools?

2010-02-19 Thread Les Mikesell
On 2/19/2010 9:42 AM, Ralf Gross wrote: > Les Mikesell schrieb: >> Ralf Gross wrote: >>> >>> I think I've to look for a different solution, I just can't imagine a >>> pool with> 10 TB. >> >> Backuppc's usual scaling issues are with the number of files/links more than >> total size, so the problems

Re: [BackupPC-users] experiences with very large pools?

2010-02-19 Thread Timothy J Massey
Ralf Gross wrote on 02/19/2010 10:42:35 AM: > bit off topic: > Right now I'm looking for a cheap storage solution that is based > on supermicro chassis with 36 drive bays (server) or 45 drive bays > (expansion unit) in 4 HU. Frightening, that would be 810 TB in one > Rack (36 + 45 HDDs x 5 x 2 TB

Re: [BackupPC-users] experiences with very large pools?

2010-02-19 Thread Ralf Gross
Les Mikesell schrieb: > On 2/19/2010 9:42 AM, Ralf Gross wrote: > > Les Mikesell schrieb: > >> Ralf Gross wrote: > >>> > >>> I think I've to look for a different solution, I just can't imagine a > >>> pool with> 10 TB. > >> > >> Backuppc's usual scaling issues are with the number of files/links mo

Re: [BackupPC-users] experiences with very large pools?

2010-02-19 Thread Ralf Gross
Timothy J Massey schrieb: > Ralf Gross wrote on 02/19/2010 10:42:35 AM: > > > bit off topic: > > Right now I'm looking for a cheap storage solution that is based > > on supermicro chassis with 36 drive bays (server) or 45 drive bays > > (expansion unit) in 4 HU. Frightening, that would be 810 TB

Re: [BackupPC-users] Incremental Seems To Backup Whole System

2010-02-19 Thread Mike Bydalek
All, Thanks for all the input. I'm starting to fully understand how BackupPC scheduling is working now. My apologies for not stating that I was/am using rsync as it is the only choice that makes sense =) On Fri, Feb 19, 2010 at 12:15 AM, Craig Barratt wrote: > Mike, > >> Backup#         Type  

Re: [BackupPC-users] experiences with very large pools?

2010-02-19 Thread Ralf Gross
dan schrieb: > you would need to move up to 15K rpm drives to have a very large array and > the cost will grow exponentially trying to get such a large array. > > as Les said, look at a zfs array with block level dedup. I have a 3TB setup > right now and I have some been running a backup against

Re: [BackupPC-users] experiences with very large pools?

2010-02-19 Thread Les Mikesell
On 2/19/2010 10:28 AM, Ralf Gross wrote: > >> >> if you dont want to go pure opensolaris then look at nexenta. it is a >> functional opensolaris-debian/ubuntu hybrid with ZFS and it has dedup. it >> does not currently share via iscsi so keep that in mind. I believe it also >> uses a full samba p

Re: [BackupPC-users] Incremental Seems To Backup Whole System

2010-02-19 Thread Timothy J Massey
Mike Bydalek wrote on 02/19/2010 11:28:25 AM: > Thanks for all the input. I'm starting to fully understand how > BackupPC scheduling is working now. My apologies for not stating that > I was/am using rsync as it is the only choice that makes sense =) In which case, after your first (potential

Re: [BackupPC-users] Incremental Seems To Backup Whole System

2010-02-19 Thread Mike Bydalek
On Fri, Feb 19, 2010 at 9:53 AM, Timothy J Massey wrote: > Mike Bydalek wrote on 02/19/2010 > 11:28:25 AM: > >> Thanks for all the input.  I'm starting to fully understand how >> BackupPC scheduling is working now.  My apologies for not stating that >> I was/am using rsync as it is the only choic

[BackupPC-users] Using BackupPC to backup virtual hard discs

2010-02-19 Thread John Moorhouse
I'm happily using backupPC to backup a number of machine within our home network, I'm wondering what will happen if I use it to backup the file on the host machine that is the virtual disc for a number of virtual box VM, will it have to backup the whole file each run (they are rather large) or i

Re: [BackupPC-users] Using BackupPC to backup virtual hard discs

2010-02-19 Thread Mike Bydalek
On Fri, Feb 19, 2010 at 10:11 AM, John Moorhouse wrote: > I'm happily using backupPC to backup a number of machine within our home > network, I'm wondering what will happen if I use it to backup the file on the > host machine that is the virtual disc for a number of virtual box VM, will it > ha

Re: [BackupPC-users] Using BackupPC to backup virtual hard discs

2010-02-19 Thread Timothy J Massey
John Moorhouse wrote on 02/19/2010 12:11:45 PM: > I'm happily using backupPC to backup a number of machine within our > home network, I'm wondering what will happen if I use it to backup > the file on the host machine that is the virtual disc for a number > of virtual box VM, will it have to

Re: [BackupPC-users] Using BackupPC to backup virtual hard discs

2010-02-19 Thread Timothy J Massey
Mike Bydalek wrote on 02/19/2010 12:39:29 PM: > On Fri, Feb 19, 2010 at 10:11 AM, John Moorhouse > wrote: > > I'm happily using backupPC to backup a number of machine within > our home network, I'm wondering what will happen if I use it to > backup the file on the host machine that is the vir

Re: [BackupPC-users] Using BackupPC to backup virtual hard discs

2010-02-19 Thread Richard Shaw
On Fri, Feb 19, 2010 at 11:39 AM, Mike Bydalek wrote: > On Fri, Feb 19, 2010 at 10:11 AM, John Moorhouse > wrote: >> I'm happily using backupPC to backup a number of machine within our home >> network, I'm wondering what will happen if I use it to backup the file on >> the host machine that is

Re: [BackupPC-users] experiences with very large pools?

2010-02-19 Thread Chris Robertson
Ralf Gross wrote: > Gerald Brandt schrieb: > >> You may want to look at this thread >> http://www.mail-archive.com/backuppc-users@lists.sourceforge.net/msg17234.html >> >> > > I've seen this thread, but the pool sizes there are max. in the lower > TB region. > > Ralf > Not all of th

Re: [BackupPC-users] experiences with very large pools?

2010-02-19 Thread Chris Robertson
Chris Robertson wrote: > Ralf Gross wrote: > >> Gerald Brandt schrieb: >> >> >>> You may want to look at this thread >>> http://www.mail-archive.com/backuppc-users@lists.sourceforge.net/msg17234.html >>> >>> >>> >> I've seen this thread, but the pool sizes there are max.

Re: [BackupPC-users] Using BackupPC to backup virtual hard discs

2010-02-19 Thread Chris Robertson
Richard Shaw wrote: > On Fri, Feb 19, 2010 at 11:39 AM, Mike Bydalek > wrote: > >> On Fri, Feb 19, 2010 at 10:11 AM, John Moorhouse >> wrote: >> >>> I'm happily using backupPC to backup a number of machine within our home >>> network, I'm wondering what will happen if I use it to backup

Re: [BackupPC-users] Using BackupPC to backup virtual hard discs

2010-02-19 Thread John Rouillard
On Fri, Feb 19, 2010 at 01:44:02PM -0500, Timothy J Massey wrote: > John Moorhouse wrote on 02/19/2010 12:11:45 > PM: > > > I'm happily using backupPC to backup a number of machine within our > > home network, I'm wondering what will happen if I use it to backup > > the file on the host machin

Re: [BackupPC-users] Using BackupPC to backup virtual hard discs

2010-02-19 Thread Timothy J Massey
Richard Shaw wrote on 02/19/2010 02:04:49 PM: > On Fri, Feb 19, 2010 at 11:39 AM, Mike Bydalek > wrote: > > On Fri, Feb 19, 2010 at 10:11 AM, John Moorhouse > > wrote: > >> I'm happily using backupPC to backup a number of machine within > our home network, I'm wondering what will happen if I u

Re: [BackupPC-users] Using BackupPC to backup virtual hard discs

2010-02-19 Thread Timothy J Massey
John Rouillard wrote on 02/19/2010 02:54:28 PM: > On Fri, Feb 19, 2010 at 01:44:02PM -0500, Timothy J Massey wrote: > > John Moorhouse wrote on 02/19/2010 12:11:45 > > PM: > > > > > I'm happily using backupPC to backup a number of machine within our > > > home network, I'm wondering what wi

Re: [BackupPC-users] experiences with very large pools?

2010-02-19 Thread Ralf Gross
Chris Robertson schrieb: > Chris Robertson wrote: > > Ralf Gross wrote: > > > >> Gerald Brandt schrieb: > >> > >> > >>> You may want to look at this thread > >>> http://www.mail-archive.com/backuppc-users@lists.sourceforge.net/msg17234.html > >>> > >>> > >>> > >> I've see