Re: [BackupPC-users] Backup to USB disk.
Les Stott wrote: >> Just thinking out loud here, but couldn't you achieve the same result >> by using the automounter? The the drive is present, the automounter >> would mount it up and then BackupPC would be happy. If the drive >> isn't present, the mount should fail and BackupPC would error out >> because its directory tree would not be present. >> >> Perhaps it's not as pretty as the scripted solution you're using, but >> I think it should "just work" otherwise. >> > > Never had much luck with the automounter doing things the right way. > It > always wants to auto mount on directories under /media, and the > directory can either be a label or a made up name. > > i prefer mounting and unmounting explicitly and choosing my own > directory mount points. Couldn't you use hotplug to start the BackupPC daemon when the external drive gets plugged in and stop it when it is removed? Nils Breunese. - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] scheduled backups won't start
Carl Wilhelm Soderstrom wrote: > On 04/14 02:26 , Micha Silver wrote: > >> The newer one, configured to backup some workstations, won't start >> scheduled backups. >> > > Are you out of disk space? > > Thanks for the reply, but No, the backup partition is on LVM with 1.5 TB and 14% used. Besides, manual backups run fine. -- Micha Silver Arava Development Co +972-8-6592270 - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] scheduled backups won't start
Micha writes: > I've been scratching my head over this for more than a week. > I have two backup servers running, both on CentOS (64 bit). One has been > humming along nicely for several months now, backing up several servers. > > The newer one, configured to backup some workstations, won't start > scheduled backups. I can manually start backups from the cgi interface, > both full and incr, and they run to completion OK. My wakeup time is > 12:00 noon, and blackout is from 07:00 to 11:30. In the log I see the > cpool cleanup and the BackupPC_link lines. But no backup, and no email > of failure. Is there any chance your blackout is to 11:30pm instead of 11:30am? Look on the host summary to see what it thinks the blackout is. Craig - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Backup to USB disk.
Nils Breunese (Lemonbit) wrote: > > Couldn't you use hotplug to start the BackupPC daemon when the > external drive gets plugged in and stop it when it is removed? > > > Yeah, that worked OK in centos 4 with the hal daemon, but then it all changed in CentOS 5 with the gnome auto mounting. Maybe someone who has done auto mounting in CentOS 5 with removable usb drives can share their experience? Regards, Les - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Backup to USB disk.
Les Stott wrote: > Nils Breunese (Lemonbit) wrote: >> > >> Couldn't you use hotplug to start the BackupPC daemon when the >> external drive gets plugged in and stop it when it is removed? >> > > Yeah, that worked OK in centos 4 with the hal daemon, but then it all > changed in CentOS 5 with the gnome auto mounting. > > Maybe someone who has done auto mounting in CentOS 5 with removable > usb > drives can share their experience? http://wiki.centos.org/TipsAndTricks/HAL seems to have some info. Nils Breunese. - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] scheduled backups won't start
Craig Barratt wrote: > Micha writes: > > >> I've been scratching my head over this for more than a week. >> I have two backup servers running, both on CentOS (64 bit). One has been >> humming along nicely for several months now, backing up several servers. >> >> The newer one, configured to backup some workstations, won't start >> scheduled backups. I can manually start backups from the cgi interface, >> both full and incr, and they run to completion OK. My wakeup time is >> 12:00 noon, and blackout is from 07:00 to 11:30. In the log I see the >> cpool cleanup and the BackupPC_link lines. But no backup, and no email >> of failure. >> > > Is there any chance your blackout is to 11:30pm instead of 11:30am? > Look on the host summary to see what it thinks the blackout is. > > Craig > > > Well in the config.pl file I have: $Conf{BlackoutPeriods} = [ { 'hourEnd' => '11.5', 'weekDays' => [ 0, 1, 2, 3, 4 ], 'hourBegin' => 7 } ]; I don't see any mention on the host summary page of blackout period. Should I try to set BlackoutGoodCnt to -1 to disable that feature? Thanks, Micha > This mail was sent via Kinneret Mail-SeCure System. > > > -- Micha Silver Arava Development Co +972-8-6592270 - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Conserve daily backups for 10 years
On Sun, Apr 13, 2008 at 03:08:12PM +0200, Mario Giammarco wrote: > since backuppc is very handy I would like to use it to keep an accurate > history (like cdp or cvs) of each machine day by day. > So I would like to keep 365 day x 10 years backups. > I do not understand if it is possible, nor how to do it. If it is not > possible > I would like to do the most similar thing. It is possible. You could either instruct BackupPC to do full backups only (set $Conf{FullPeriod} = 0.97 and $Conf{FullKeepCnt} = 3660). Or configure Full and Incr backups accordingly: (10 years, every 7 days) $Conf{FullKeepCnt} = 523; $Conf{IncrKeepCnt} = 3137; How many clients are you talking about and how much data is on them? You're talking about a pretty HUGE amount of data. I'm wondering which machine, disk subsystem and file system will be able to handle that. You might be talking about billions (10^9) of files here. And don't forget a second layer of backup: What if your backup server crashes hardly or burns down? What if some subtle file system bug is triggered and eats all your data? Every file which is stored in only one location has to be considered lost. HTH, Tino. -- „What we resist, persists.” (Zen saying) www.craniosacralzentrum.de www.forteego.de - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] scheduled backups won't start
Micha writes: > $Conf{BlackoutPeriods} = [ > { > 'hourEnd' => '11.5', > 'weekDays' => [ > 0, > 1, > 2, > 3, > 4 > ], > 'hourBegin' => 7 > } > ]; Looks ok. > I don't see any mention on the host summary page of blackout period. I meant the per-host page. No need to change the blackout settings unless the description there looks wrong. I'd recommend running BackupPC_dump manually with the -v option (not the -f option): su backuppc BackupPC_dump -v HOST It should print why it doesn't do a backup. Craig - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Archive encrypted zip
On 04/14 08:22 , Tino Schwarze wrote: > Zip encryption is useless. IIRC it's cracked within seconds. I've actually tried cracking a zipfile; and perhaps it had a strong password, or the software wasn't very good; but I was unable to crack it after a couple of weeks of trying. Can't say I've done extensive tests; this is only one data point, and the plural of anecdote is not data. :) -- Carl Soderstrom Systems Administrator Real-Time Enterprises www.real-time.com - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] do a manual fill of a backup
Does anyone know how to do a manual fill of a backup from the command line? what I am doing is changing incrementals to fulls and fulls to incrementals. when going full->incr there is not problem but when going from incr->full I would like to do the fill process on that backup. I don't know that it really matters that much in the end but I want to know that there is a copy/hard link of every file in this 'full' backup. I am aware of the circumstances that an incr backup wouldn't be complete or wouldn't be as thorough in checking for file changes but in my circumstance my files always have their mtime changed. Any ideas? - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Archive encrypted zip
This is a requirement here at my company to have encrypted archives for off-site backup. Tino Schwarze wrote: > On Tue, Apr 15, 2008 at 10:18:50AM -0400, Alexandre Joly wrote: > >> Well, I can see WinZip 11 has support for 128- and 256-bit AES >> encryption. PKZIP, on the other hand, is weak and can be cracked within >> minutes. >> >> My initial question was, anyone ever modified BackupPC in order to >> archive in ZIP format instead of bz2 or gzip? >> > > Why would you want to do that? You loose lots of meta information by > going to ZIP instead of tar.gz. Compression is inferior and every > decent archive browser tool should support .tar.gz anyway. > > Bye, > > Tino. > > -- Alexandre Joly <[EMAIL PROTECTED]> Network Administrator Infodev Electronic Designers Intl (418) 681-3539 ext. 153 - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] file extraction, windows
I think that this has been hashed over for some time now. It seems that windows will only handle a 2GB zip file via the CGI interface for no apparently good reason. You can either do BackupPC_zipCreate on the backuppc machine and save it to your windows machine via samba or something OR you can just choose tar for your restore and then compresses that if you like. Simone Marzona wrote: > Hi all > > When I extract some data from backuppc on a windows host the extraction > stops at 2 GB. This happens either when I use the archive function > either when I recover with/without compression. > > This happens only if working on Windows even if the FS is ntfs. > > Is there a solution for this problem? > > The size of 2 GB is so suspect... I think that this is a Windows xp > "gift". > > > - > This SF.net email is sponsored by the 2008 JavaOne(SM) Conference > Don't miss this year's exciting event. There's still time to save $100. > Use priority code J8TL2D2. > http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:http://backuppc.wiki.sourceforge.net > Project: http://backuppc.sourceforge.net/ > - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Archive encrypted zip
Well, I can see WinZip 11 has support for 128- and 256-bit AES encryption. PKZIP, on the other hand, is weak and can be cracked within minutes. My initial question was, anyone ever modified BackupPC in order to archive in ZIP format instead of bz2 or gzip? Carl Wilhelm Soderstrom wrote: > On 04/14 08:22 , Tino Schwarze wrote: > >> Zip encryption is useless. IIRC it's cracked within seconds. >> > > I've actually tried cracking a zipfile; and perhaps it had a strong > password, or the software wasn't very good; but I was unable to crack it > after a couple of weeks of trying. > > Can't say I've done extensive tests; this is only one data point, and the > plural of anecdote is not data. :) > > -- Alexandre Joly <[EMAIL PROTECTED]> Network Administrator Infodev Electronic Designers Intl (418) 681-3539 ext. 153 - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Archive encrypted zip
On Tue, Apr 15, 2008 at 10:18:50AM -0400, Alexandre Joly wrote: > Well, I can see WinZip 11 has support for 128- and 256-bit AES > encryption. PKZIP, on the other hand, is weak and can be cracked within > minutes. > > My initial question was, anyone ever modified BackupPC in order to > archive in ZIP format instead of bz2 or gzip? Why would you want to do that? You loose lots of meta information by going to ZIP instead of tar.gz. Compression is inferior and every decent archive browser tool should support .tar.gz anyway. Bye, Tino. -- „What we resist, persists.” (Zen saying) www.craniosacralzentrum.de www.forteego.de - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Wildly different speeds for hosts
yet another situation when IO is the enemy. I know most people are most concerned with IO performance on the server, but the client also must be able to keep up or you get .66MB's or something. Raman Gupta wrote: > Raman Gupta wrote: > >> I have three hosts configured to backup to my PC. Here are the speeds >> from the host summary: >> >> host 1: 24.77 GB, 14,000 files, 18.78 MB/s (slower WAN link) >> host 2: 1.27 GB, 4,000 files, 1.89 MB/s (faster WAN link) >> host 3: 4.82 GB, 190,000 files, 0.66 MB/s (fast LAN link) >> >> They all use rsync with the same setup, other than the exclude list. >> Backups are configured to run one at a time so there is no overlap >> between them. >> >> The speed of host 3 concerns me. Host 3 is by far the beefiest >> machine, and on the fastest network link of all the hosts, but yet >> backs up at only 0.66 MB/s (incrementals are even slower). >> > > Ok, it seems that the number of files has a large non-linear affect on > the performance of BackupPC. I excluded a bunch of stuff from my host > 3 backup, and the new stats are: > > host 3:4.2 GB, 85,000 files, 2.19 MB/s > > For a file count reduction factor of 2.2, there was a speed increase > factor of 3.3. > > Cheers, > Raman > > - > This SF.net email is sponsored by the 2008 JavaOne(SM) Conference > Don't miss this year's exciting event. There's still time to save $100. > Use priority code J8TL2D2. > http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:http://backuppc.wiki.sourceforge.net > Project: http://backuppc.sourceforge.net/ > - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Archive encrypted zip
Alexandre Joly wrote: > This is a requirement here at my company to have encrypted archives > for > off-site backup. Yeah, but Tino's question was why you'd want to use zip instead of a compressed tarball, because metadata like permissions and ownership can't be stored in a zip file (AFAIK). You could also create a tar archive and encrypt that, right? Or store the archive on an encrypted volume. Nils Breunese. > Tino Schwarze wrote: >> On Tue, Apr 15, 2008 at 10:18:50AM -0400, Alexandre Joly wrote: >> >>> Well, I can see WinZip 11 has support for 128- and 256-bit AES >>> encryption. PKZIP, on the other hand, is weak and can be cracked >>> within >>> minutes. >>> >>> My initial question was, anyone ever modified BackupPC in order to >>> archive in ZIP format instead of bz2 or gzip? >>> >> >> Why would you want to do that? You loose lots of meta information by >> going to ZIP instead of tar.gz. Compression is inferior and every >> decent archive browser tool should support .tar.gz anyway. >> >> Bye, >> >> Tino. - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Archive encrypted zip
I thought of zip as a good solution for achieving encrypted backups. But you are right here, it will lose metadata. My only requirements are that archives must be encrypted at the file level (forget encrypted volume) and that I can open those under Windows (using Winzip for example). Nils Breunese (Lemonbit) wrote: > Alexandre Joly wrote: > > >> This is a requirement here at my company to have encrypted archives >> for >> off-site backup. >> > > Yeah, but Tino's question was why you'd want to use zip instead of a > compressed tarball, because metadata like permissions and ownership > can't be stored in a zip file (AFAIK). You could also create a tar > archive and encrypt that, right? Or store the archive on an encrypted > volume. > > Nils Breunese. > > >> Tino Schwarze wrote: >> >>> On Tue, Apr 15, 2008 at 10:18:50AM -0400, Alexandre Joly wrote: >>> >>> Well, I can see WinZip 11 has support for 128- and 256-bit AES encryption. PKZIP, on the other hand, is weak and can be cracked within minutes. My initial question was, anyone ever modified BackupPC in order to archive in ZIP format instead of bz2 or gzip? >>> Why would you want to do that? You loose lots of meta information by >>> going to ZIP instead of tar.gz. Compression is inferior and every >>> decent archive browser tool should support .tar.gz anyway. >>> >>> Bye, >>> >>> Tino. >>> > > - > This SF.net email is sponsored by the 2008 JavaOne(SM) Conference > Don't miss this year's exciting event. There's still time to save $100. > Use priority code J8TL2D2. > http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:http://backuppc.wiki.sourceforge.net > Project: http://backuppc.sourceforge.net/ > -- Alexandre Joly <[EMAIL PROTECTED]> Network Administrator Infodev Electronic Designers Intl (418) 681-3539 ext. 153 - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Backup to USB disk.
I think I understand your want in that you would like to have backuppc check that a drive is hooked up before trying to use it for backups. If I am correct then I would suggest you build a quick daemon script that starts backuppc when the device is hotplugged and stops backuppc when unplugged. I dont know what your linux distro is but hotplug scripts are pretty easy, do some google work to get the file and method for a hotplug script on a specific device. Martin Leben wrote: > Mauro Condarelli wrote: > >> Hi, >> I asked this before, but no one answered, so I will try again :) >> >> I am using a large (500G) external USB disk as backup media. >> It performs reasonably, so no sweat. >> >> Problem is: >> Is there a way to do a pre-check to see if the drive is actually mounted >> and, if not, just skip the scheduled backup? >> It would be easy to put a do_not_backup file in the directory over which >> I mount the remote. >> I could then do a test to see if that file is present (no disk) or if it >> is absent (something was mounted over it. >> Unfortunately I have no idea where to put such a test in BackupPC! >> >> Can someone help me, please? >> >> Related issue: >> I would like to use a small pool of identical external HDs in order to >> increase further security. >> > > > Hi Mauro, > > Considering what it seems like you want to achieve, I would suggest another > approach: Use at least three disks in a rotating scheme and RAID1. > > Say I have three disks labeled 1, 2 and 3. Then I would rotate them according > to > the schedule below, which guarantees that: > - there is always at least one disk in the BackupPC server. > - there is always at least one disk in the off-site storage. > - all disks are never at the same location. > > 1 2 3 (a = attached, o = off-site) > a o o > a a o -> RAID sync > o a o > o a a -> RAID sync > o o a > a o a -> RAID sync > . . . > > An even safer approach would of course be to rotate four disks where at least > two disks are always attached to the BackupPC server. > > Good luck! > /Martin Leben > > > - > This SF.net email is sponsored by the 2008 JavaOne(SM) Conference > Don't miss this year's exciting event. There's still time to save $100. > Use priority code J8TL2D2. > http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:http://backuppc.wiki.sourceforge.net > Project: http://backuppc.sourceforge.net/ > - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Archive encrypted zip
Alexandre Joly wrote: > Well, I can see WinZip 11 has support for 128- and 256-bit AES > encryption. PKZIP, on the other hand, is weak and can be cracked > within > minutes. > > My initial question was, anyone ever modified BackupPC in order to > archive in ZIP format instead of bz2 or gzip? I don't know, but AFAIK Zip files don't store things like permissions and ownership, so I wouldn't use Zip for archiving purposes. Nils Breunese. - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Archive encrypted zip
Alexandre Joly wrote: > I thought of zip as a good solution for achieving encrypted backups. > But you are right here, it will lose metadata. My only requirements > are that archives must be encrypted at the file level (forget > encrypted volume) At the file level of the archive or at the file level of the files *inside* the archive? The first case is easy I guess: you could use an encryption tool like GnuPG [0] to encrypt the archive created by BackupPC. If the files inside the created archive need to be encrypted then you'll have to hack your way into BackupPC I'm afraid... > and that I can open those under Windows (using Winzip for example). GPG is cross-platform. Nils Breunese. [0] http://www.gnupg.org/ - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Backup to USB disk.
Hi Daniel, No, not quite. If you want a clean file system on the drive you are going to remove you must temporary stop BackupPC and unmount the file system first. When the drive is removed you can mount the file system again and start BackupPC. This will cause the RAID to run in degraded mode if you only have one disk left in the RAID, but will otherwise work as usual. (You don't have to run in degraded mode if you are rotating four disks in the scheme I proposed.) Stopping BackupPC and unmounting the file system can't be done by hotplug, because it is already too late. You don't have to stop BackupPC when you attach a drive. Just plug it in and add it to the RAID with "mdadm --add", which you might be able to get hotplug to do for you. Best regards, /Martin Leben Daniel Denson wrote: > I think I understand your want in that you would like to have backuppc > check that a drive is hooked up before trying to use it for backups. If > I am correct then I would suggest you build a quick daemon script that > starts backuppc when the device is hotplugged and stops backuppc when > unplugged. I dont know what your linux distro is but hotplug scripts > are pretty easy, do some google work to get the file and method for a > hotplug script on a specific device. - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] file extraction, windows
On Tue, Apr 15, 2008 at 08:26:42AM -0600, Daniel Denson wrote: > I think that this has been hashed over for some time now. It seems that > windows will only handle a 2GB zip file via the CGI interface for no > apparently good reason. You can either do BackupPC_zipCreate on the > backuppc machine and save it to your windows machine via samba or > something OR you can just choose tar for your restore and then > compresses that if you like. IIRC, ZIP has a 2 GB file size limit - only 32bit integers in there for file size. Tino. -- „What we resist, persists.” (Zen saying) www.craniosacralzentrum.de www.forteego.de - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] thnks n apprecite
Thanks Les n guys i now been able to run BackupPc and the cgi scripts executes fine but i do have a problem the pics on the page not displayed and the apache error logs display [Tue Apr 15 22:51:58 2008] [error] [client xx.xx.xx.xx] (8)Exec format error: exec of '/var/www/cgi-bin/BackupPC/BackupPC_stnd.css' failed, referer: http://xx.xx.xx.xx/BackupPC_Admin [Tue Apr 15 22:51:58 2008] [error] [client xx.xx.xx.xx] (8)Exec format error: exec of '/var/www/cgi-bin/BackupPC/sorttable.js' failed, referer: http://xx.xx.xx.xx/BackupPC_Admin [Tue Apr 15 22:51:58 2008] [error] [client xx.xx.xx.xx] Premature end of script headers: BackupPC_stnd.css, referer: http://xx.xx.xx.xx/BackupPC_Admin [Tue Apr 15 22:51:58 2008] [error] [client xx.xx.xx.xx] Premature end of script headers: sorttable.js, referer: http://xx.xx.xx.xx/BackupPC_Admin [Tue Apr 15 22:51:58 2008] [error] [client xx.xx.xx.xx] (8)Exec format error: exec of '/var/www/cgi-bin/BackupPC/logo.gif' failed, referer: http://xx.xx.xx.xx/BackupPC_Admin also the permission of the above files are -r-xr--r-- 1 backuppc backuppc 4016 Apr 15 11:39 BackupPC_stnd.css -r-xr--r-- 1 backuppc backuppc 6463 Apr 15 11:39 sorttable.js -r-xr--r-- 1 backuppc backuppc 1394 Apr 15 11:39 logo.gif apache is run by user backuppc and gruoup is apache really apprecite your help regards simon -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] # of files per backup job
Hi can anyone comment on back jobs with lots of files effecting transfer time? I have 2 big backup jobs which are taking too long over a WAN link. Would it be advisable to break the jobs up into many smaller jobs with fewer files / job? Would I be gaining anything? would 10 jobs with a 100,000 files each complete faster then 1 job with 1,000,000 files if they were backing up the same information thanks - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] # of files per backup job
On Apr 15, 2008, at 4:54 PM, Tim Hall wrote: > Hi can anyone comment on back jobs with lots > of files effecting transfer time? > > I have 2 big backup jobs which are taking too > long over a WAN link. Would it be advisable to > break the jobs up into many smaller jobs with > fewer files / job? Would I be gaining anything? How fast are the WAN links at both ends? You may also want to look at latency and any packet loss between the two endpoints. If you are backing up GB of data even a T1 is pretty slow, especially if you have other data going across the same link, it could create an inadvertent "DoS" if you peg the whole connection. If you are using rsync, and especially if memory and / or CPU is a bottlneck, breaking it up into smaller jobs could help by reducing the size of the "list" that rsync has to build and transfer. Having a lot of files will increase the size of the list. What I have done in some cases is to just "mirror" what I want to backup across the link to a "separate drive" at the remote end and then use BackupPC at the remote end to make a "backup" of the mirror. The "mirror" is just a copy of whatever is on the original, but BackupPC provides the "history" of changes over time so you have more than just last night's backup. That also helps for initial set up since I can use e.g. an external USB drive at the local site, do the initial mirror via USB rather then over the WAN link, and then physically take the USB drive to the remote (or maybe in your case ship the drive) and plug it into the server there. Optionally, substitute eSATA / SCSI / iSCSI / IEEE 1394 your connection type of choice for USB. Backing up many GB over T1 will take several hours, especially if you limit bandwidth so that it does not just peg your T1 and put everything else out of commission until it finishes. For e.g 20 GiB * 1024 MiB / GiB = 20480 MiB / 1.544 MiB/s = 13264 s / 3600 s/ hour = 3:41 hours That would be for an optimal point-to-point T1 ignoring bandwidth lost to framing bits, in practice will most likely take quite a bit longer than that, especially if it is through VPN across the internet with possible congestion at routers along the way. > > > would 10 jobs with a 100,000 files each complete > faster then 1 job with 1,000,000 files if they > were backing up the same information > > thanks > > > - > This SF.net email is sponsored by the 2008 JavaOne(SM) Conference > Don't miss this year's exciting event. There's still time to save > $100. > Use priority code J8TL2D2. > http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:http://backuppc.wiki.sourceforge.net > Project: http://backuppc.sourceforge.net/ - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Archive encrypted zip
for a high-compression AES 256bit encryption you can use a tar.7z. you need to wrap the files in tar to preserve permissions and meta data and then 7z it with AES. 7z is also a very powerfull compressor, better than zip or gzip and can match bzip2 but be faster. you could technically use 7zip to make AES encrypted regular zip(pkzip style) zip files. Alternatively, you could just use tar.gz and then encrypt that file with another program. On Tue, Apr 15, 2008 at 9:35 AM, Nils Breunese (Lemonbit) <[EMAIL PROTECTED]> wrote: > Alexandre Joly wrote: > > > I thought of zip as a good solution for achieving encrypted backups. > > But you are right here, it will lose metadata. My only requirements > > are that archives must be encrypted at the file level (forget > > encrypted volume) > > At the file level of the archive or at the file level of the files > *inside* the archive? The first case is easy I guess: you could use an > encryption tool like GnuPG [0] to encrypt the archive created by > BackupPC. If the files inside the created archive need to be encrypted > then you'll have to hack your way into BackupPC I'm afraid... > > > and that I can open those under Windows (using Winzip for example). > > GPG is cross-platform. > > Nils Breunese. > > [0] http://www.gnupg.org/ > > - > This SF.net email is sponsored by the 2008 JavaOne(SM) Conference > Don't miss this year's exciting event. There's still time to save $100. > Use priority code J8TL2D2. > > http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:http://backuppc.wiki.sourceforge.net > Project: http://backuppc.sourceforge.net/ > - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] file extraction, windows
zip does not have a 2GB limit. you can use Backuppc_zipCreate to make a very large zip file, well over 2GB, just not through the CGI interface. On Tue, Apr 15, 2008 at 10:18 AM, Tino Schwarze <[EMAIL PROTECTED]> wrote: > On Tue, Apr 15, 2008 at 08:26:42AM -0600, Daniel Denson wrote: > > I think that this has been hashed over for some time now. It seems that > > windows will only handle a 2GB zip file via the CGI interface for no > > apparently good reason. You can either do BackupPC_zipCreate on the > > backuppc machine and save it to your windows machine via samba or > > something OR you can just choose tar for your restore and then > > compresses that if you like. > > IIRC, ZIP has a 2 GB file size limit - only 32bit integers in there for > file size. > > Tino. > > -- > „What we resist, persists." (Zen saying) > > www.craniosacralzentrum.de > www.forteego.de > > - > This SF.net email is sponsored by the 2008 JavaOne(SM) Conference > Don't miss this year's exciting event. There's still time to save $100. > Use priority code J8TL2D2. > > http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:http://backuppc.wiki.sourceforge.net > Project: http://backuppc.sourceforge.net/ > - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] # of files per backup job
technically, you wont have any difference in backup speed by splitting up the job. you might be running into a system resource issue on the server or client because rsync will eat up large chunks of RAM as file count increases(rule of thumb is 100Bytes per file) which may mean your system is pushing everything off to swap, making the server run very very slow. another likely issue is that with many many files, IO on EITHER the server or the client could be a bit bottleneck. I do a large rsync transfer over a T1 line nightly, I mirror my backuppc server remotely each night. this is a pretty long process even though I only have about 1GB of new data each night. The math says that can be transfered in about 1.5 hours but the initial file list takes 10 minutes to compute and IO performance is a bottleneck so the transfer takes about 2.5 hours, more or less depending on the amount of backup data. On Tue, Apr 15, 2008 at 3:23 PM, Jonathan Dill <[EMAIL PROTECTED]> wrote: > On Apr 15, 2008, at 4:54 PM, Tim Hall wrote: > > > Hi can anyone comment on back jobs with lots > > of files effecting transfer time? > > > > I have 2 big backup jobs which are taking too > > long over a WAN link. Would it be advisable to > > break the jobs up into many smaller jobs with > > fewer files / job? Would I be gaining anything? > > How fast are the WAN links at both ends? You may also want to look at > latency and any packet loss between the two endpoints. If you are > backing up GB of data even a T1 is pretty slow, especially if you have > other data going across the same link, it could create an inadvertent > "DoS" if you peg the whole connection. > > If you are using rsync, and especially if memory and / or CPU is a > bottlneck, breaking it up into smaller jobs could help by reducing the > size of the "list" that rsync has to build and transfer. Having a lot > of files will increase the size of the list. > > What I have done in some cases is to just "mirror" what I want to > backup across the link to a "separate drive" at the remote end and > then use BackupPC at the remote end to make a "backup" of the mirror. > The "mirror" is just a copy of whatever is on the original, but > BackupPC provides the "history" of changes over time so you have more > than just last night's backup. > > That also helps for initial set up since I can use e.g. an external > USB drive at the local site, do the initial mirror via USB rather then > over the WAN link, and then physically take the USB drive to the > remote (or maybe in your case ship the drive) and plug it into the > server there. Optionally, substitute eSATA / SCSI / iSCSI / IEEE 1394 > your connection type of choice for USB. Backing up many GB over T1 > will take several hours, especially if you limit bandwidth so that it > does not just peg your T1 and put everything else out of commission > until it finishes. > > For e.g > > 20 GiB * 1024 MiB / GiB = 20480 MiB / 1.544 MiB/s = 13264 s / 3600 s/ > hour = 3:41 hours > > That would be for an optimal point-to-point T1 ignoring bandwidth lost > to framing bits, in practice will most likely take quite a bit longer > than that, especially if it is through VPN across the internet with > possible congestion at routers along the way. > > > > > > > would 10 jobs with a 100,000 files each complete > > faster then 1 job with 1,000,000 files if they > > were backing up the same information > > > > thanks > > > > > > > - > > This SF.net email is sponsored by the 2008 JavaOne(SM) Conference > > Don't miss this year's exciting event. There's still time to save > > $100. > > Use priority code J8TL2D2. > > > http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone > > ___ > > BackupPC-users mailing list > > BackupPC-users@lists.sourceforge.net > > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > > Wiki:http://backuppc.wiki.sourceforge.net > > Project: http://backuppc.sourceforge.net/ > > > - > This SF.net email is sponsored by the 2008 JavaOne(SM) Conference > Don't miss this year's exciting event. There's still time to save $100. > Use priority code J8TL2D2. > > http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:http://backuppc.wiki.sourceforge.net > Project: http://backuppc.sourceforge.net/ > - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p
Re: [BackupPC-users] thnks n apprecite
Benedict simon wrote: > Thanks Les n guys > > i now been able to run BackupPc and the cgi scripts executes fine but i do > have a problem > > the pics on the page not displayed > > and the apache error logs display > > [Tue Apr 15 22:51:58 2008] [error] [client xx.xx.xx.xx] (8)Exec format > error: exec of '/var/www/cgi-bin/BackupPC/BackupPC_stnd.css' failed, > referer: http://xx.xx.xx.xx/BackupPC_Admin > [Tue Apr 15 22:51:58 2008] [error] [client xx.xx.xx.xx] (8)Exec format > error: exec of '/var/www/cgi-bin/BackupPC/sorttable.js' failed, referer: > http://xx.xx.xx.xx/BackupPC_Admin > [Tue Apr 15 22:51:58 2008] [error] [client xx.xx.xx.xx] Premature end of > script headers: BackupPC_stnd.css, referer: > http://xx.xx.xx.xx/BackupPC_Admin > [Tue Apr 15 22:51:58 2008] [error] [client xx.xx.xx.xx] Premature end of > script headers: sorttable.js, referer: http://xx.xx.xx.xx/BackupPC_Admin > [Tue Apr 15 22:51:58 2008] [error] [client xx.xx.xx.xx] (8)Exec format > error: exec of '/var/www/cgi-bin/BackupPC/logo.gif' failed, referer: > http://xx.xx.xx.xx/BackupPC_Admin > > also the permission of the above files are > > > -r-xr--r-- 1 backuppc backuppc 4016 Apr 15 11:39 BackupPC_stnd.css > -r-xr--r-- 1 backuppc backuppc 6463 Apr 15 11:39 sorttable.js > -r-xr--r-- 1 backuppc backuppc 1394 Apr 15 11:39 logo.gif > It has been a while since I did an install, but I thought you were supposed to pick a different directory (usually a subdirectory where apache is already configured to serve non-executable content) for the images and css files. I see the current documentation says this can be a symlink. The problem is that the apache configuration for /var/www/cgi-bin makes it attempt to execute content there, so it needs to be served from some other location. -- Les Mikesell [EMAIL PROTECTED] - This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/