Re: [BackupPC-users] Combine multiple Backuppc servers into one
Les Mikesell wrote at about 15:27:19 -0600 on Friday, December 18, 2009: Kameleon wrote: To simplify what I am trying to accomplish I will explain it this way: We currently have 2 backuppc servers. Both have 2x 1TB drives in a Raid1 array. What I want to do is move all the drives into one machine and set it up as a Raid5. That would give us 3TB usable rather than 2TB usable. Hence why I need to move everything to one setup. Thanks for any guidance. There's no good way to merge existing pooled files if that is what you are asking. Or to convert a Raid1 to a Raid5 without losing the contents. I'd recommend building a new setup the way you want and holding on to the old systems for as long as you might have a need to restore from their older history, or perhaps generating tar images that you can store elsewhere with BackupPC_tarCreate. Once the new system has collected the history you need you can re-use the old drives. Agreed that there is no good way but if you don't mind a little coding, you could do a brute force merge -- it wouldn't be very hard... Conceptually it would be easiest to think of it in 2 steps: 1. First crawl through pool B and for each entry not already in the pool, just add it to the pool (you could adapt existing routines) 2. Then crawl through the pc directory and link each entry to the pool (again adapting existing routines) A faster method would combine step #1 with a list of inodes filenames representing the pc tree so that as you go through the pool inodes you would also link in the pc tree. -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd via ssh-redirected port
Matthias Meyer wrote:
Guido Schmidt wrote:
What works? The opening and closing of the tunnel.
What does not? The connection to it. Nothing in the rsyncd-logs on
host.example.com.
If I leave DumpPostUserCmd empty the tunnel stays open and I can use it
with rsync as user backuppc on a shell providing the password by hand:
rsync -av --list-only --port=32323 backu...@localhost::Alles
/home/backuppc/test/
Do you provide the password during your script?
The ssh-connection works (authenticated via public key). The password I
refered to is for connecting to rsyncd and that is stored in
$Conf{RsyncdPasswd}.
It seems that backuppc does not reach the point where it actually tries
to connect to rsync daemon. There are no entries in the rsyncd-log
(there are when I use the rsync-command above). How can I find out more
what happens and what not?
--
Schalloch Musikhandel GmbH
Percussionsabteilung
Firmensitz: Karolinenstraße 4-5, 20357 Hamburg
Registergericht: Amtsgericht Hamburg, HRB 22770
Geschäftsführer: Christoph Scheffler
Tel 040-43 84 94
Fax 040-430 29 47
Öffnungszeiten:
Mo-Mi 10-19 Uhr
Do+Fr 10-20 Uhr
Sa10-16 Uhr
Sie erreichen mich:
Mo 13-19 Uhr
Di 10-19 Uhr
Do 11-20 Uhr
Jeden 2. Sa 10-16 Uhr
--
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd via ssh-redirected port
Guido Schmidt wrote:
Matthias Meyer wrote:
Guido Schmidt wrote:
What works? The opening and closing of the tunnel.
What does not? The connection to it. Nothing in the rsyncd-logs on
host.example.com.
If I leave DumpPostUserCmd empty the tunnel stays open and I can use it
with rsync as user backuppc on a shell providing the password by hand:
rsync -av --list-only --port=32323 backu...@localhost::Alles
/home/backuppc/test/
Do you provide the password during your script?
The ssh-connection works (authenticated via public key). The password I
refered to is for connecting to rsyncd and that is stored in
$Conf{RsyncdPasswd}.
It seems that backuppc does not reach the point where it actually tries
to connect to rsync daemon. There are no entries in the rsyncd-log
(there are when I use the rsync-command above). How can I find out more
what happens and what not?
I don't really know what the problem :-(
You can increase the loglevel with $Conf{XferLogLevel}.
What happens if you start your tunnel interactive and leave DumpPreUser as well
as CmdDumpPostUserCmd empty.
Try your interactive:
rsync -av --list-only --port=32323 backu...@localhost::Alles
/home/backuppc/test/
If it work, start a backup via BackupPC.
Why do you need the identification by rsync? I would believe you can trust your
ssh-tunnel and dont't need an additional authentication.
br
Matthias
--
Don't Panic
--
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] incremental backup question
My TarClientCmd is: '$sshPath -q -x -l backup -o PreferredAuthentications=publickey $host /usr/bin/env LC_ALL=C LANG=en_EN /usr/bin/sudo $tarPath -c -v -f - -C $shareName+ --totals' Attila Mesterhazy Mester wrote on 2009-12-19 21:49:58 +0100 [[BackupPC-users] incremental backup question]: I use backuppc on a Debian Linux 5.0 server for backing up another Debian Linux 5.0 server over the internet with tar over ssh. The first full backup is created succesfully but the incremental backups alway make full backup. What could be the reason of this? a missing '+', clock skew, or a number of different configuration errors. Regards, Holger -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] incremental backup question
Mester wrote:
My TarClientCmd is:
'$sshPath -q -x -l backup -o PreferredAuthentications=publickey $host
/usr/bin/env LC_ALL=C LANG=en_EN /usr/bin/sudo $tarPath -c -v -f - -C
$shareName+ --totals'
Your extra sudo might make an extra level of shell escaping necessary.
What about $Conf{TarIncrArgs}? Maybe the space in the date string is
getting parsed as a separator by the extra shell layer.
--
Les Mikesell
lesmikes...@gmail.com
--
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] incremental backup question
Hi,
Les Mikesell wrote on 2009-12-21 14:58:03 -0600 [Re: [BackupPC-users]
incremental backup question]:
Mester wrote:
My TarClientCmd is:
'$sshPath -q -x -l backup -o PreferredAuthentications=publickey $host
/usr/bin/env LC_ALL=C LANG=en_EN /usr/bin/sudo $tarPath -c -v -f - -C
$shareName+ --totals'
Your extra sudo might make an extra level of shell escaping necessary.
no, it doesn't.
What about $Conf{TarIncrArgs}?
That is more interesting (because this is where the '+' might be missing). To
put it more general: if you want to avoid this debugging ping-pong, provide
some relevant information (like your configuration settings and log file
extracts, for example). Even if we *can* sometimes give terse answers to
terse questions, you probably wouldn't be asking the questions if this type
of answer were of any help to you (the documentation would explain everything
sufficiently in this case (not meaning to imply that it's terse)).
In particular, describe your problem, not your analysis of it. We want to
concentrate on fixing problems, not analyses.
Maybe the space in the date string is
getting parsed as a separator by the extra shell layer.
That is what I was thinking. It would, however, most probably lead to tar
complaining about a non-existant file and redundant backups of only a small
part of the files. I'm still in favour of clock skew. Or maybe a TarIncrArgs
without a --newer ;-).
Regards,
Holger
--
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
[BackupPC-users] ssh don't work to backup localhost
I'm trying to setup the backup of the localhost with backuppc. I already backup several other linux machine via ssh. I've setuped all them via running the following command as backuppc user: ssh-keygen -t dsa cd .ssh ssh-copy-id -i id_dsa.pub r...@oligoextra.phyto.qc.ca ssh -l root oligoextra oligoextra is the localhost. On all other machine I can then login via ssh without password asked except for the localhost where it keep asking the root password. I've no idea on why and how to get ssh connection without password. all machines are fedora core of various version from 9 to 12. localhost is FC11 What is missing for the local host Thank you -- Claude Gélinas agr. Phyto Ressources inc. -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] ssh don't work to backup localhost
Claude Gélinas wrote: I'm trying to setup the backup of the localhost with backuppc. I already backup several other linux machine via ssh. I've setuped all them via running the following command as backuppc user: ssh-keygen -t dsa cd .ssh ssh-copy-id -i id_dsa.pub r...@oligoextra.phyto.qc.ca ssh -l root oligoextra oligoextra is the localhost. On all other machine I can then login via ssh without password asked except for the localhost where it keep asking the root password. I've no idea on why and how to get ssh connection without password. all machines are fedora core of various version from 9 to 12. localhost is FC11 What is missing for the local host Try adding -v or -vv to your 'ssh -l root oligoextra' test. It may tell you why it isn't accepting the key. -- Les Mikesell lesmikes...@gmail.com -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] zfs dedupe test
an update to my zfs dedupe test. opensolaris-dev build 129 (first build to enable dedupe) I create a zfs volume that I export with iSCSI, then did a gigabit crossover cable to my test backuppc server running ubuntu 9.04. I mount the iscsi volume to /var/lib/backuppc. let just say that this has to be seen to be believed. zfs dedupe totally pegs my cpu and used up the 4GB of ram in my test SAN box BUT it drastically improves write performance for files with the same blocks as other files(which is a lot). The different between a ubuntu 8.04 and 9.04 disk is only about 30MB with block level dedupe. Because the system does this dedupe in-stream, it doesnt have to write the 'extra' data and can complete the process in a hurry. I can copy a disk image of ubuntu 9.04 is litterally 2 seconds because the dedupe is done online so it almost feels like creating a hardlink at the expense of pegging the CPU. I have a dual core 2Ghz opteron and I can see the need for a quad core xeon but the benefits look to be huge. If you have some hardware lying around I encourage you to test out zfs dedupe. nexenta core3 alpha2 and opensolaris b129 both have it and it is very nice. I also tested the opensolaris cifs server joined to AD sharing a deduped disk and that works very well also, your AD users and ACLs are handle well by opensolaris. -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
