Re: [BackupPC-users] update on ZFS
On 10/25/07, dan <[EMAIL PROTECTED]> wrote: > > just wanted to let anyone interested in opensolaris/ZFS for backuppc my > current status. > > i am running an alpha of nexenta(opensolaris kernel+ubuntu 7.06) > > 1GB RAM > 3 hitachi 250GB SATA drive > > i have the ubuntu backports backuppc3 running on this machine, archiving > on a ZFS volume which is about %90 of each hard disk in a ZRAID config and i > have the ZFS compression module turned on. > > in backuppc I have compression turned OFF as im letting ZFS handle it. > > the good= > ZFS seems to compress the files will less CPU usage that backuppc. > ZFS seems to have *slightly* lower file sizes(that backuppc with > compression on 3) > Backuppc's CGI interface works much faster with a lot of files. im not > sure if this is because compression is off or because ZFS is good. > i can unplug a hard disk and plug it back in and ZFS recovers without > bringing the filesystem down. > i can add another hard disk and add it to the ZFS volume and i will > automatically become a ZRAID member, which = more space and more > performance. > > the bad= > only that nexenta is still pretty much beta and has a few system > glitches. i have had no backup problems but i have some weird little system > issues that are solved with a reboot. > > hope someone finds this interesting and usable. > > I defiantly found this interesting. Thanks for posting Having never touched ZFS or newer versions of solaris, but being a long-term linux admin and fan, the idea of ZFS seems interesting but not really realistic for my projects. Perhaps work like the Indiana project will change my view on this? http://www.opensolaris.org/os/project/indiana/ - This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] archive problem
Check the permissions on /dev/st0 what group owns that device? Add the backuppc user to the tape group (or whoever the owning group of the device is) On 7/31/08, Les Mikesell <[EMAIL PROTECTED]> wrote: > Jeff Rippy wrote: >> Thanks for the quick reply. The backuppc user uses /bin/sh not bash. >> sh is a symbolic link to /bin/dash it looks like. Not sure if this >> helps or not. > > The shell doesn't have much to do with this except possibly giving you > the wrong error message. The real problem is almost certainly that the > backuppc user doesn't have write permission on /dev/st0 (and if you are > ever going to write more than one run to a tape you might want to use > /dev/nst0 instead). > > I'm not sure how Ubuntu handles the setup, but udev-based systems > rebuild the device nodes on the fly so if you just change > owner/group/permissions, you have to do it after every reboot. If it is > group rw you can add the backuppc user to it's group. Otherwise you'll > have to add a udev rule or something to control it. > > -- >Les Mikesell > [EMAIL PROTECTED] > > > - > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great > prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:http://backuppc.wiki.sourceforge.net > Project: http://backuppc.sourceforge.net/ > - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] backup the backuppc pool with bacula
On Tue, May 19, 2009 at 12:27 PM, Carl Wilhelm Soderstrom wrote: > On 05/19 12:04 , Tim Cole wrote: >> How often do you want to backup the server? What about using rsync to >> backup the pool? I want to mirror my primary backup server to another >> system daily so I can switch to my backup server quickly. I was going >> to use rsync for this. > > Rsync memory requirements have historically been too high for this. > I tried rsync'ing 100GB on a machine with 512MB RAM and about the same swap; > and it crushed the box to the point where I had to power-cycle it. > > Best thing to do is set up a duplicate backuppc server that independently > backs up the hosts you want to have a redundant backup for. > Try Rsync v3, it has much lower memory requirements since it builds the file list incrementally. I used it at one company to do nightly syncs of their ~4TB backuppc pool offsite. -- Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT is a gathering of tech-side developers & brand creativity professionals. Meet the minds behind Google Creative Lab, Visual Complexity, Processing, & iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian Group, R/GA, & Big Spaceship. http://www.creativitycat.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] zfs send
On Fri, May 15, 2009 at 10:49 AM, Dan Pritts wrote: > I've seen a couple posts from people who are using > ZFS as the backend for backuppc but no discussion of this, > sorry if my searches missed it. > > Anyone done a "zfs send" and then "zfs receive" to duplicate > the backuppc filesystem? How long did it take? > > danno I tried using zfs sends to replicate the pool off-site, but decided to use zfs snapshots and rsync3 instead. ZFS send/receive was just too slow when I tried it. I read recently that after the recent SNV110 SXCE/Nevada, there's been some great speed improvements made to ZFS send/recv. -- Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT is a gathering of tech-side developers & brand creativity professionals. Meet the minds behind Google Creative Lab, Visual Complexity, Processing, & iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian Group, R/GA, & Big Spaceship. http://www.creativitycat.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] backup the backuppc pool with bacula
Good point Holger- I don't have hardlink counts or stats, but it should only take about 10mns of work to download/compile rsync3, and run a benchmark on your pool ;) On 5/21/09, Holger Parplies wrote: > Hi, > > Rob Terhaar wrote on 2009-05-21 13:01:58 -0400 [Re: [BackupPC-users] backup > the backuppc pool with bacula]: >> [...] >> Try Rsync v3, it has much lower memory requirements since it builds >> the file list incrementally. > > by all means, try it. But it's not the file list that is the specific > problem > of BackupPC. > >> I used it at one company to do nightly >> syncs of their ~4TB backuppc pool offsite. > > It's still a matter of file count (used inodes, to be exact), not pool > storage > size. rsync V3 may perform significantly better if you have many links to > comparatively few inodes, but if you have many inodes (for some unknown > value > of "many"), I am still convinced that you will hit a problem. Feel free to > convince me otherwise, but "works for me" is unlikely to succeed ;-). > > Regards, > Holger > -- Sent from my mobile device -- Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT is a gathering of tech-side developers & brand creativity professionals. Meet the minds behind Google Creative Lab, Visual Complexity, Processing, & iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian Group, R/GA, & Big Spaceship. http://www.creativitycat.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] multiple instances? multiple pools?
Hi all- So my backuppc install is getting fairly big. I'm backing up a total of about 1.2tb, soon to be almost 2tb. About 4gig of that changes every day. Like I said, we're going to be expanding the amount of data that backuppc will be storing- so I've been thinking about ways to optimize storage. One way i've thought up, is to run 2 instances of backuppc on the same machine. One instance will be the high priority backups which will be stored on a raid 5 fast array. The second instance will be stored on a 1tb jbod, since this collection of stuff that is also backed-up to tape on another machine. Is this a good idea? Is it possible to create multiple pools in backuppc? What sorts of other cost-prohibited storage options are people using? - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] multiple instances? multiple pools?
> Rob Terhaar wrote: > > Hi all- > > So my backuppc install is getting fairly big. I'm backing up a total of > > about 1.2tb, soon to be almost 2tb. About 4gig of that changes every > > day. > > > > Like I said, we're going to be expanding the amount of data that > > backuppc will be storing- so I've been thinking about ways to optimize > > storage. > > > > One way i've thought up, is to run 2 instances of backuppc on the same > > machine. One instance will be the high priority backups which will be > > stored on a raid 5 fast array. The second instance will be stored on a > > 1tb jbod, since this collection of stuff that is also backed-up to tape > > on another machine. > > > > Is this a good idea? > > Is it possible to create multiple pools in backuppc? > > > > What sorts of other cost-prohibited storage options are people using? > > On Fri, 2006-08-04 at 09:19 -0700, Ski Kacoroski wrote: > Rob, > > I have created multiple backuppc instances by doing (on Debian): > > 1. Create a second account (e.g. backuppc-HP). Add this user to the > backuppc group. > > 2. Create copy of the /usr/share/backuppc directory (e.g. > /usr/share/backuppc-HP). Modify all references to backuppc to be > backuppc-HP for all files in this directory tree (mostly use lib > statements). I ran rgrep "/etc/backuppc" ., rgrep "/var/lib/backuppc"., > and rgrep "/usr/lib/backuppc" . to find all files that had to be modified. > > 3. Create a copy of the /var/lib/backuppc directory (e.g. > /var/lib/backuppc-HP) > > 4. Create a copy of the /etc/backuppc directory (e.g. /etc/backuppc-HP). > Modify the apache.conf and config.pl files to point to the backuppc-HP > directories. > > 5. Create a copy of the /etc/init.d/backuppc script (e.g. > /etc/init.d/backuppc-HP). > > Then just configure it and run it along side the first one. Works great. > > cheers, > > ski > Thanks for the advice Ski, this helps alot! I'm going to give the 2nd instance a shot with 3.0beta1. Have people been generally happy with the stability of the new 3.0 release? - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] Directory mysteriosly excluded
On Fri, 2006-08-11 at 10:37 -0400, Benjamin Kudria wrote: > I run a server used for hosting many web and mail accounts. I have installed > BackupPC and configured it to backup files using sudo and rsync, as described > in the docs. For some reason, my /usr/local/vpopmail directory is excluded. > My global config, host config, and log file are at: > > http://pastebin.ca/126001 > > Why isn't /usr/local/vpopmail being backed up? where is the exclude > statement > that makes this happen? Help? > > Thanks, > Benjamin Kudria even though you're using sudo... I bet it's a permissions issue what do the xfer logs say? - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] Directory mysteriosly excluded
On Fri, 2006-08-11 at 10:54 -0400, Benjamin Kudria wrote: > On Friday, August 11 2006 10:45, Rob Terhaar wrote: > > even though you're using sudo... I bet it's a permissions issue > > > > what do the xfer logs say? > > I don't see how it would be a permissions issue...or... > Maybe the backuppc user needs to be added to the vpopmail or whatever group? > > The Xfer logs are at the end of the paste. > ok i see now, you're right, the folder is indeed getting added to the excludes somehow... The only thing i could think of is that there must be a pc level config file as well as the global config.pl? Perhaps try to put something into your excludes, like /tmp? - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] Directory mysteriosly excluded
On Fri, 2006-08-11 at 12:55 -0400, Benjamin Kudria wrote: > On Friday, August 11 2006 12:29, Rob Terhaar wrote: > > ok i see now, > > you're right, the folder is indeed getting added to the excludes > > somehow... The only thing i could think of is that there must be a pc > > level config file as well as the global config.pl? Perhaps try to put > > something into your excludes, like /tmp? > > > Err, actually, the pc-level config is at the end of the paste. :) I made > the > excludes variable undef there too, just to make sure. Strange, no? > > -Benjamin Kudria > very weird... All I can suggest is to define _something_ for the excludes, and try to run BackupPC_Dump -f in verbose mode (or even try running it under strace?) to see if you get any more insight. - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
