Re: [BackupPC-users] Archives Configuration
Yes, I know. I make archive copies to a removable ssd. I need this copy, because we have otherwise no other offline backup. And a offline backup is nowadays a must in our opinion. But the ssd does not have space for more than 3 tar-copies of each host. Thats why it would be nice to have a feature, where the oldest ones would be deleted automatically, before the new one is made. Kind regards Don Am Dienstag, den 29.10.2024 um 15:16 schrieb Les Mikesell: On Tue, Oct 29, 2024 at 4:37 AM Donat Waber, VFMG via BackupPC-users wrote: > > Hi > > I'm struggling with the archives configuration. I have only space for 3 archives on my device. So where can I configure, that older archives must be deleted, before the next archive can be made? I tried a lot, but nothing works till now. My Configuration right now is: "FillCycle = 1", and "FullKeepCnt = 1,1", "FullKeepCntMin =1" and "FullAgeMax=30". > > Any help would be appreciated. 'Archives' are tar-image copies of a host intended to be on removable media if you want offsite copies so they don't share space like normal backups. If you aren't moving copies elsewhere you may not need the archive function at all, and if you do you would probably want one snapshot at a time when you swap media. -- Les Mikesell lesmikes...@gmail.com smime.p7s Description: S/MIME cryptographic signature ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Archives Configuration
Hi,
This is my archive.pl file
$Conf{ArchiveDest} = '/mnt/backup';
$Conf{BackupPCNightlyPeriod} = 1;
$Conf{XferMethod} = 'archive';
$Conf{BackupsDisable} = 1;
$Conf{BlackoutPeriods} = [];
$Conf{FullKeepCntMin} = 1;
$Conf{FullKeepCnt} = [
1,
1
];
$Conf{IncrAgeMax} = 0;
$Conf{IncrKeepCnt} = 0;
$Conf{IncrKeepCntMin} = 0;
$Conf{FullAgeMax} = 30;
$Conf{FillCycle} = 1;
Kind regardsDon
Am Dienstag, den 29.10.2024 um 14:19 schrieb G.W. Haywood:
Hi there,
On Tue, 29 Oct 2024, Donat Waber, VFMG wrote:
> I'm struggling with the archives configuration. I have only space
for
> 3 archives on my device. So where can I configure, that older
archives
> must be deleted, before the next archive can be made? I tried a lot,
> but nothing works till now. My Configuration right now is:
"FillCycle
> = 1", and "FullKeepCnt = 1,1", "FullKeepCntMin =1" and
> "FullAgeMax=30".
>
> Any help would be appreciated.
Something doesn't seem right here.
Can you share more information about your hardware setup?
--
73,
Ged.
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
smime.p7s
Description: S/MIME cryptographic signature
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
[BackupPC-users] Archives Configuration
Hi I'm struggling with the archives configuration. I have only space for 3 archives on my device. So where can I configure, that older archives must be deleted, before the next archive can be made? I tried a lot, but nothing works till now. My Configuration right now is: "FillCycle = 1", and "FullKeepCnt = 1,1", "FullKeepCntMin =1" and "FullAgeMax=30". Any help would be appreciated. Kind regardsDon smime.p7s Description: S/MIME cryptographic signature ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backup corrupted, impossible to corect it
- Le 25 Oct 24, à 6:36, Tim Connors tim.w.conn...@gmail.com a écrit : > Backuppc user of >~ 20 years, moved from ext4 to XFS (lost data) to btrfs > (lost data) to ZFS in ~2010-2012, moved it to a VM inside proxmox talking > to the original raw disks in 2019/20, upgraded to V4 sometime around then. > > Have had the "missing pool file" error mentioned last comment in #494 (not > "can't open pool file") whenever a client crashes halfway through a backup > (like my desktop yesterday). Sometimes I've never found the culprit of > what backup caused these messages, and since they can tally to the > hundreds or thousands and pollute my logfile every day, I then rollback my > backuppc pool a day or a few in ZFS to a point without any of these noisy > backups, and they go away (Although there are 4 residual "missing pool > file" messages in my daily log, where I never identified which backup they > were coming from). > > Never had any other identiable corruption on ZFS though. > > *However*, ZFSonlinux has had *plenty* of sparse file related bugs to > do with snapshots and similar. It was getting so bad at one point, I > nearly stopped trusting the filesystem (my mind has been more at ease > since I stopped having the time to follow mailing list discussions). > I don't think backuppc is creating files with holes in them though. The culprit in my case was not ZFS, but backups of several /etc/pve directories from the same proxmox cluster at the same time. Probably some locking issues, which rsync translates in an error code not correctly handled by rsync_bpc. I've switch to use tar backup method for my proxmox hosts, and have no missing pool file errors since. -- Daniel Berteaud ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Grouping for Hosts?
Several possibilities:
1. Use a link to a single config file in your /etc/backuppc/pc
directory. e.g.,
pc1a.pl --> group1.pl
pc1b.pl --> group1.pl
pc1c.pl --> group1.pl
2. Use Perl code like:
my $hostname = $_[1];
if($hostname =~ /^(pc1a|pc1b|pc1c)$/) { #Group 1 configs
...
}elsif($hostname =~ /^(pc2a|pc2b|pc2c$/) { #Group2 configs
...
}else { #Default
...
}
Christian Völker via BackupPC-users wrote at about 08:14:47 +0200 on Monday,
October 7, 2024:
> Hi all,
>
> using BackupPC since almost a decade now and it is really great!
> One thing I am currently missing is the possibility to group hosts. Why
> am I asking for?
>
> I have some hosts which are all eaqual systems (ie all MacOS) and even
> share a common name (start all with mac*). But these are all hosts which
> are not 24/7 online.
> On the other side I have hosts which are 24/7 online and prefer them to
> be backed up during night time
> My configuration is therefore global:
> $Conf{WakeupSchedule} = [ 5,6,7,8,9,13,14,15,16,17,18,19,20,23,1,2,3,4];
>
> I know I can overwrite the above setting per host. But this means I have
> to do it on all hosts manually.
>
> It would be easier to maintain if I put them all into a group which
> overwrites the global settings. And, of course, the local settings of
> these hosts should overwrite group settings...
>
> I guess it is not possible, but is there some development to get this?
>
> Thank& Greetings
>
> /Christian
>
>
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:https://github.com/backuppc/backuppc/wiki
> Project: https://backuppc.github.io/backuppc/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
[BackupPC-users] Grouping for Hosts?
Hi all,
using BackupPC since almost a decade now and it is really great!
One thing I am currently missing is the possibility to group hosts. Why
am I asking for?
I have some hosts which are all eaqual systems (ie all MacOS) and even
share a common name (start all with mac*). But these are all hosts which
are not 24/7 online.
On the other side I have hosts which are 24/7 online and prefer them to
be backed up during night time
My configuration is therefore global:
$Conf{WakeupSchedule} = [ 5,6,7,8,9,13,14,15,16,17,18,19,20,23,1,2,3,4];
I know I can overwrite the above setting per host. But this means I have
to do it on all hosts manually.
It would be easier to maintain if I put them all into a group which
overwrites the global settings. And, of course, the local settings of
these hosts should overwrite group settings...
I guess it is not possible, but is there some development to get this?
Thank& Greetings
/Christian
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] BackupPC after 3->4 upgrade disk full
Richard Shaw wrote at about 08:37:02 -0500 on Wednesday, September 25, 2024: > On Wed, Sep 25, 2024 at 8:11 AM Adam Pribyl wrote: > > > 2/2024 I did upgrade of debian to 12 with a new backuppc version 4. Now > > after several month of further backups the backuppc reports a full disk. > > > > This is from memory so take it for what it's worth... > > The V3 pools are not converted to V4, over time the V3 backups expire based > on your retention settings, so it looks like in your case having both is > taking up more room than you have. > > As far as what to do about that other than potentially adding more disk > space temporarily I'm not sure there are a lot of good options. > There is a program included with BackupPC that allows for "upgrading" V3 pool and pc-tree to V4 -- BackupPC_migrateV3toV You still may need temporarily extra storage during the transition but after that it shouldn't be necessary and you won't need either the V3 pool or pc-tree. It worked perfectly for me... YMMV ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backup corrupted, impossible to corect it
> - Le 19 Sep 24, à 16:46, Les Mikesell lesmikes...@gmail.com a écrit : >> >> Are the files in question stable? That is fairly normal behavior >> where files are being created and deleted or renamed quickly so rsync >> sees the name in a directory but the file doesn't exist by the time it >> tries to read it. Some things use file creation/linking for atomic >> actions which can cause some visible clutter. > > > Yes, very few changes in this pseudo filesystem. A few transient file patterns > have been excluded already. And especially the files which have been reported > with error have not changed for sure. Anyway, files being created/deleted/renamed during the backup are expected to be reported as xfer error, in this particular backup only. But it should not corrupt the pool, which is happening here (references to files which are not added to the pool, leading to errors like "BackupPC_refCountUpdate: missing pool file 2e7b5147d702a0e7291dab81ec03c9c5 count 2" during the following nightly cleanups, with no way to fix it) -- Daniel Berteaud ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backup corrupted, impossible to corect it
- Le 19 Sep 24, à 16:46, Les Mikesell lesmikes...@gmail.com a écrit : > On Thu, Sep 19, 2024 at 9:27 AM Daniel Berteaud via BackupPC-users > wrote: >> >> There are sensitive info here, so I can't share it (secret keys, x509 cert + >> key, password for storage etc.). But my guess is that the issue is not with >> the >> content, but with the FS. Maybe the client rsync can't open the file (du to a >> bad interaction with pmxcfs, or a lock problem), sending an error code not >> correctly handled by rsync-bpc. The problem might even be related to the fact >> that I backup several PVE hosts in the same cluster (so, same /etc/pve, >> that's >> why I think of a locking issue) at the same time. >> > > Are the files in question stable? That is fairly normal behavior > where files are being created and deleted or renamed quickly so rsync > sees the name in a directory but the file doesn't exist by the time it > tries to read it. Some things use file creation/linking for atomic > actions which can cause some visible clutter. Yes, very few changes in this pseudo filesystem. A few transient file patterns have been excluded already. And especially the files which have been reported with error have not changed for sure. -- Daniel Berteaud ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backup corrupted, impossible to corect it
- Le 19 Sep 24, à 15:56, G.W. Haywood bac...@jubileegroup.co.uk a écrit :
> Hi there,
>
> On Thu, 19 Sep 2024, Daniel Berteaud wrote:
>
>> Not sure yet, but it seems the problem is at least easier to trigger
>> (maybe even only happens in this context) when I backup /etc/pve on
>> some proxmox VE servers, with rsync. In this directory is mounted a
>> fuse based FS (pmxcfs which is a tiny corosync based clustered
>> filesystem, with only a few MB of small text files).
>
> Then maybe there's a chance of reproducing it at will. That would be
> a huge step forward. :) Am I right in thinking that the data in that
> tree would probably not be considered sensitive?
There are sensitive info here, so I can't share it (secret keys, x509 cert +
key, password for storage etc.). But my guess is that the issue is not with the
content, but with the FS. Maybe the client rsync can't open the file (du to a
bad interaction with pmxcfs, or a lock problem), sending an error code not
correctly handled by rsync-bpc. The problem might even be related to the fact
that I backup several PVE hosts in the same cluster (so, same /etc/pve, that's
why I think of a locking issue) at the same time.
>
>> Just got a lot of errors during backup of 2 Proxmox servers this
>> morning :
>>
>> First, 38 errors like this :
>>
>> G bpc_fileOpen: can't open pool file
>> /var/lib/BackupPC//cpool/b6/d8/b6d9603ea...
>
> That doubled forward slash makes me a little uncomfortable.
>
> Do you generally get away with it? Just wondering out loud because I
> wouldn't necessarily bet my life that it would cause no problems with
> the kind of layered architecture which you're using.
That's just a cosmetic issue, du to the fact that I've set $Conf{TopDir} to
'/var/lib/BackupPC/' (with a trailing slash).
--
Daniel Berteaud
_______
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backup corrupted, impossible to corect it
- Le 18 Sep 24, à 18:39, Paul Leyland paul.leyl...@gmail.com a écrit : > My earlier report indicating no known problems was for unencrypted ZFS > on Linux. > > Something over five years ago encrypted ZFS was unavailable. Today my > threat model considers the probability of someone breaking into my house > and stealing the server or disks as acceptably low. I do, of course, > have several layered protective mechanisms between you and me. Not sure yet, but it seems the problem is at least easier to trigger (maybe even only happens in this context) when I backup /etc/pve on some proxmox VE servers, with rsync. In this directory is mounted a fuse based FS (pmxcfs which is a tiny corosync based clustered filesystem, with only a few MB of small text files). Just got a lot of errors during backup of 2 Proxmox servers this morning : First, 38 errors like this : G bpc_fileOpen: can't open pool file /var/lib/BackupPC//cpool/b6/d8/b6d9603ea5001178b6020466b548b412 (from etc/pve/nodes/imm-pve-cour-1/qemu-server/159.conf, 3, 16) rsync_bpc: failed to open "/etc/pve/nodes/imm-pve-cour-1/qemu-server/159.conf", continuing: No such file or directory (2) Followed by 38 errors like this : R bpc_fileOpen: can't open pool file /var/lib/BackupPC//cpool/b6/d8/b6d9603ea5001178b6020466b548b412 (from etc/pve/nodes/imm-pve-cour-1/qemu-server/159.conf, 3, 16) (all of the 38 errors refers to files in /etc/pve) -- Daniel Berteaud ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backup corrupted, impossible to corect it
- Le 19 Sep 24, à 0:29, Paul Leyland paul.leyl...@gmail.com a écrit : > Our data in the security group was encrypted, just not encrypted ZFS > which, as I have stated, was not available at the time. > > We used LUKS, which is filesystem independent. > > Any reason why you can't do the same? I could, but this would imply using a VM, on top of an unencrypted zvol, and using LUKS in the VM. Which means an important performance penalty. Of course, between performance and confidence in my backups, I'd choose confidence, but I'd prefer having both ;-) Regards, Daniel -- Daniel Berteaud ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backup corrupted, impossible to corect it
- Le 18 Sep 24, à 18:39, Paul Leyland paul.leyl...@gmail.com a écrit : > My earlier report indicating no known problems was for unencrypted ZFS > on Linux. > > Something over five years ago encrypted ZFS was unavailable. Today my > threat model considers the probability of someone breaking into my house > and stealing the server or disks as acceptably low. I do, of course, > have several layered protective mechanisms between you and me. Working with medical data, it's mandatory to encrypt our backups (yeah, even if in reality, it doesn't bring a lot of aditional security in this context) -- Daniel Berteaud ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backup corrupted, impossible to corect it
- Le 18 Sep 24, à 18:21, G.W. Haywood bac...@jubileegroup.co.uk a écrit :
> Hi there,
>
> On Wed, 18 Sep 2024, Daniel Berteaud wrote:
>
>> But I also triggered it a few years ago on CentOS 8 (don't have the
>> details as I do not have access to this system anymore)
>
> Was there any correspondence on the mailing list at the time? I see
> nothing from your email address. I wonder if any useful details have
> been recorded somewhere. It would especially be interesting to know
> about the filesystem - and in particular if it was encrypted ZFS which
> so far seems to be a common theme, although obviously not conclusive.
No, I haven't posted anything about this issue here (lack of time). But it was
encrypted ZFS too.
>
> You've seen the problem on two different versions of Perl, so I think
> Perl itself might begin to look a less likely candidate, but in both
> cases your versions of BackupPC, BackupPC::XS and rsync-bpc are very
> similar. Although I'm on ext4, here are the versions I'm using:
>
> Debian 'Bullseye' on arm64.
> Perl 5.32.1 - Debian package
> BackupPC 4.3.1 )
> BackupPC::XS 0.59 ) Installed from Github sources, February 2020)
> rsync-bpc 3.1.2.1 )
>
> In your more recent versions there are several potentially interesting
> changes from my older versions.
>
> Maybe others who are using ZFS can let us know their versions/sources?
>
> It might also be useful to get some statistics on the populations of
> the files being backed up.
>
> Have you tried for example setting $Conf{XferLogLevel} to 4 or greater
> to see if there's anything interesting in the logs? I'm sure there
> are other logging-type things which could help narrow this down.
There's ~100 hosts being backed up, some with several million files.
And I have no clue yet on which hosts trigger the problem (or if it can affect
any file, on any host). Such a loglevel would produce a lot of logs to analyze.
>
> I'd be keen to see the problem reproduced on an unencrypted ZFS. :)
I'm just starting tests on unencrypted ZFS on my problematic server.
--
Daniel Berteaud
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Upgrade Kubuntu22.04 lts to 24.04 lts
Have you seen https://github.com/backuppc/backuppc/issues/466? The related fix should be easy enough to implement manually. But unless your upstream package maintainer cherry-picked it, I suspect the bug still exists in current packages. ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backup corrupted, impossible to corect it
- Le 17 Sep 24, à 20:31, G.W. Haywood bac...@jubileegroup.co.uk a écrit : > Hi there, > > On Mon, 16 Sep 2024, Daniel Berteaud wrote: > >> I tried 3 times to wipe and start from empty pool, but this comes >> back everytime. So there's a bug in BackupPC. > > Even if it isn't in ZFS it still might not be in BackupPC. It might > be in one of the modules used by BackupPC or it might even be in the > Perl interpreter itself. Did you tell us the versions you're using? It could. I triggered the issue on a Debian 12 (well, in fact proxmox 8, which is Debian 12 based), with the standard packages from repo perl 5.36.0-7+deb12u1 backuppc 4.4.0-8 backuppc-rsync 3.1.3.0-3 lib-backuppc-xs-perl 0.62-2+b2 Linux kernel 6.8.12-1-pve ZFS 2.2.4-pve1 But I also triggered it a few years ago on CentOS 8 (don't have the details as I do not have access to this system anymore) > > On Tue, 17 Sep 2024, Daniel Berteaud wrote: >> - Le 16 Sep 24, ? 18:08, G.W. Haywood bac...@jubileegroup.co.uk a ?crit : >> > ... >> > Does ZFS work on Linux now? That's a genuine question, not some way >> > of trying to goad ZFS lovers. >> >> ZFS on Linux is rock solid for several years now. > > Several other posters have now chimed in with their experience of > BackupPC/ZFS/Linux and it seems they're happy enough with it. And I'm also one of those. My own personal backup server is running BackupPC on ZFS with no issue (very similar software version than the one having issue). The main differences, which could point at the culprint : - The working system is running a ZFS mirror on 2 SATA HDD, while the problematic is running on a 4 mirrors NVMe pool (so speed could be related to the issue being triggered) - The working system is not using ZFS encryption, while the problematic one is. This also could be related. But, I'm also using ZFS encryption on other servers, with different workloads, with no issue. So at least, it's not a general problem with it (but it could be a problem triggered by some specific access pattern BackupPC is doing) >> > ...fire up a system using ext4, don't do anything fancy with it, >> > run it in parallel with your ZFS version ... >> >> And that's what I'll be doing, running BackupPC on XFS, ... > > XFS. Hmmm. Well, all right then, if you must. For now. :/ XFS is as stable as ext4 (and is the default FS on RHEL since RHEL7). Never had problems with it. But, I just have some interesting additional data : reinstalled BackupPC in a VM, using XFS (on top of an encrypted zvol). So BackupPC is not interacting directly with ZFS anymore (ZFS becomes an implementation detail). And I still have the issue. After a few backups, which all succeed (no error reported on any of them), my logs during BackupPC_nightly have a lot of errors like previously 2024-09-18 12:00:01 admin1 : BackupPC_refCountUpdate: missing pool file 816bde0c5a408deba27b5e1aec212922 count 2 2024-09-18 12:00:03 admin : BackupPC_refCountUpdate: missing pool file 0513f5328a1ef564e294ce4c13c00489 count 2 2024-09-18 12:00:06 admin1 : BackupPC_refCountUpdate: missing pool file 8df2d40b0408826ddcc5d897a1e18730 count 2 2024-09-18 12:00:06 admin : BackupPC_refCountUpdate: missing pool file 0eb72563928c1a663225b853030f29f9 count 2 2024-09-18 12:00:06 admin1 : BackupPC_refCountUpdate: missing pool file 8ece70725b0339f242c9a486d1c60bb7 count 2 This new setup is running a different OS (AlmaLinux 9), with those components : - BackupPC 4.4.0 (built from sources) - BackupPC-XS 0.62 (built from sources) - rsync-bpc 3.1.3.0 (built from sources) - perl 5.32.1 -- Daniel Berteaud ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backup corrupted, impossible to corect it
G.W. Haywood wrote at about 19:31:34 +0100 on Tuesday, September 17, 2024: > On Mon, 16 Sep 2024, Daniel Berteaud wrote: > > Anyway, BackupPC seems to become abandonware, so I'll probably > > migrate to restic sooner rather than later. > > It's definitely a concern with a lot of Perl projects thesedays, but > if BackupPC looked like being abandoned I'd be happy to take it on as > the maintainer myself because I've used it so extensively for so long. > I'd be surprised if others on this list wouldn't also step up. > I have been using BackupPC for 20 years or so... and I find it *awesome* and incredibly flexible, stable & reliable. So long as I can put ssh & rsyn on a device, I can back it up. This applies to any PC (Linux, Windows, Mac), RPi and other single board computers, Android phones & tablets, etc. *No* custom client required! I'm not sure there is a single program out there that can do all so easily. Plus the de-duplication is awesome. And being written in Perl (including the configs) means that I have been able to do some "funky" stuff in my configurations to allow snapshotting before backup for both BTRFS and Window as well as many other useful tweaks to meet my needs. I find it so stable that one *almost* doesn't need a maintainer... But sadly it seems that programs that are abandoned tend to eventually wilt as things inevitably break with upgrades and as the community dwindles away. Unfortunately, I haven't heard a word from Craig (the creator of BackupPC) in a couple of years so it might make sense to reach out to him to see what his interests and intentions are regarding continuing development or at least maintenance... If not, definitely appreciate your willingness to step up :) ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backup corrupted, impossible to corect it
- Le 16 Sep 24, à 18:08, G.W. Haywood bac...@jubileegroup.co.uk a écrit : > Hi there, > > On Mon, 16 Sep 2024, Daniel Berteaud wrote: >> - Le 21 Ao? 24, ? 2:02, backu...@kosowsky.org a ?crit : >> >>> First of all, the corruption seems almost definitely to be a disk >>> issue and not a backuppc issue. >> >> I'm just configuring a new BackupPC v4.4 (on Debian, using packages >> from the repo), ... > > Does ZFS work on Linux now? That's a genuine question, not some way > of trying to goad ZFS lovers. ZFS on Linux is rock solid for several years now. >> ... encounter this kind of errors systematically. It's not a >> corruption due to some hardware fault, but clearly a bug in >> BackupPC. > > As I've said before, but I'll repeat, I don't have any BackupPC axe to > grind but Mr. Kosowsky and I both think that what you're seeing looks > like filesystem corruption. And I'm 100% sure it's not. Brand new hardware, reproducible on different (but similar) servers. I've been using ZFS for long enough, and with critical enough workloads to be more confident in it than in BackupPC. > You seem to be of the opinion that this > is not the explanation, and you might be right, but to convince me (at > least) unless I've missed something in your posts which makes the case > conclusively and to which you can point, then I think it must be up to > you to produce that evidence. > >> ... This pool is used for other stuff (1 relatively busy mariadb >> server in a VM, one Proxmox Backup Server storage pool), and >> everything is working correctly. Only BackupPC is having issues. > > The "everything is working correctly" part troubles me. I don't see > that you have evidence for that. The way I approach the logic of > troubleshooting, I'd say you haven't had problems with everything else > *yet*. Well, I cannot make you trust me. Bringing proof that this pool is working doesn't make a lot of sense. I have enough experience in Linux/Sysadmin/ZFS to know this pool is working correctly (stress testing it for several weeks with various workloads), and there's no hardware issue. Nor there's a general ZFS issue. There's still a slight chance it could be a bug in ZFS triggered only by a particular access pattern made by BackupPC. But I wouldn't bet on this. ZFS (even if we count Linux users only) is used by hundred times more users than BackupPC, and is very actively developped (unlike BackupPC), so this pattern would've probably been caught and fixed. But it's a possibility. > And you might never have trouble with anything else, but that > is not the presence of evidence. It is the absence of evidence. > >> Looks like I'm not the only one affected, see >> https://github.com/backuppc/backuppc/issues/494 > > Hmmm. That's on Linux as well - or more strictly, it was in April. > >> I tried 3 times to wipe and start from empty pool, but this comes >> back everytime. So there's a bug in BackupPC. It might only be >> triggered on ZFS (or maybe it's related to the speed on the >> underlying storage, as this one is really the fastest I ever >> used). But there's something. For the first time in more than 18 >> years of using BackupPC, > > I've been running BackupPC for nearly as long as you have, and I've > never seen such errors. But I run ext4. I've managed something like 30 or 40 BackupPC installs with various versions (from 2.1.2 to 4.4.0), using ext3, ext4, xfs. Yes, it was solid (especially in the 3.x era). Since v4, I have a bit less trust in it. And not being able to use ZFS to store backups is painly enough for me to reconsider my backup solution of choice. > > AFAICT so far, the best we can say is that the combination of BackuPC > and ZFS on Linux might be problematic. I can't say I'm surprised, but > I can say that we really don't yet know where your problem lies. Well, the issue is either in BackupPC, or in ZFS. And the probability it's in BackupPC is much (really much) higher. But no, I have no evidence. I just have enough confidence in my storage to be sure the issue only appears with BackupPC. > So > far, I only know of two people running BackupPC on ZFS on Linux. [*] > Both have posted to Github issue 494. Unless there's some lurker here > who's keeping very quiet, in my view as I said above only you and that > other person are in a position in which they will be able to collect > evidence to identify BackupPC as the culprit. Evidence, not anecdote. Well, you ask me to prove my storage pool is working correctly. But I could just as
Re: [BackupPC-users] Backup corrupted, impossible to corect it
- Le 21 Aoû 24, à 2:02, backu...@kosowsky.org a écrit : > First of all, the corruption seems almost definitely to be a disk > issue and not a backuppc issue. I'm just configuring a new BackupPC v4.4 (on Debian, using packages from the repo), and encounter this kind of errors systematically. It's not a corruption due to some hardware fault, but clearly a bug in BackupPC. All my backups seem to work fine (no xfer error), but the nightly cleanup show lots of errors like 2024-09-16 12:00:05 admin1 : BackupPC_refCountUpdate: missing pool file 81db068be9b224623dabacf4c68f109d count 2 2024-09-16 12:00:21 admin : BackupPC_refCountUpdate: missing pool file 08c8a1eb695a242d2bd7eaea1f3edab6 count 2 2024-09-16 12:00:32 admin1 : BackupPC_refCountUpdate: missing pool file 9223a6f7e93e469f2ac7545cd2cd6400 count 2 2024-09-16 12:00:40 admin : BackupPC_refCountUpdate: missing pool file 1c9e19403c2e95778baf7b1010c3982b count 2 2024-09-16 12:00:45 admin : BackupPC_refCountUpdate: missing pool file 25f002208fe299e9b0cc92d17c748ca3 count 2 2024-09-16 12:00:47 admin1 : BackupPC_refCountUpdate: missing pool file a92d3b961a8f02c92daae28df16a245f count 2 This is running on a full NVMe ZFS pool (RAID10 like with 4 mirror pairs), I tried with BackupPC's compression off (and using ZFS compresseion), or with BackupPC's compression (disabling ZFS compression) with the same outcome. This pool is used for other stuff (1 relatively busy mariadb server in a VM, one Proxmox Backup Server storage pool), and everything is working correctly. Only BackupPC is having issues. Looks like I'm not the only one affected, see https://github.com/backuppc/backuppc/issues/494 (although in my case, using BackupPC's compression is not fixing the issue). I tried 3 times to wipe and start from empty pool, but this comes back everytime. So there's a bug in BackupPC. It might only be triggered on ZFS (or maybe it's related to the speed on the underlying storage, as this one is really the fastest I ever used). But there's something. For the first time in more than 18 years of using BackupPC, I think I cannot trust my backups anymore. The fact that there's no way to fix these errors is very worrying. -- Daniel Berteaud ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Find pc files from pool file name (checksum)
I think I posted something about 5+ years ago that does this... Kenneth Porter wrote at about 18:28:58 -0700 on Friday, August 23, 2024: > Is there a script that can iterate over all pc files to find the ones > that match a pool file? I've found some corrupt pool files and am trying > to figure out my exposure. What does BPC do when it encounters such a > bad file (when its checksum doesn't match its name) during the nightly scan? > > Also, how does BPC know that a pool file is no longer in use? Is there a > count of how many pc files are using it? > > > > > _______ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:https://github.com/backuppc/backuppc/wiki > Project: https://backuppc.github.io/backuppc/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backup corrupted, impossible to corect it
Alexander Kobel wrote at about 14:38:22 +0200 on Wednesday, August 21, 2024: > On 2024-08-21 12:40, Guillermo Rozas wrote: > > If you change it back to --ignore-times it will re-test the server files > > by comparing block-by-block checksums with the one on the client. If a > > file is corrupted in the server this will detect the difference and update > > it as a "new version" of the file from then on. However, --ignore-times is > > MUCH slower than --checksum, so you may want to run it only in response to > > a corruption suspicion and not regularly. > > > That's a quite reasonable explanation, yes. Nevertheless, I wonder if the > proper reaction for BackupPC_fsck should be to move an obviously invalid > file out of the way (i.e. to a "quarantine" location or so), to enforce that > check - after all, the corruption has already been detected and confirmed. > I don't think moving it to a "quarantine" is a good idea since the corruption could only be minor (even a single character change and the md5sum's won't match). And if moved, then historical backups won't be able to find the file and there is no good (i.e., quick) way to find all the attrib files that point to the damaged file beyond manually opening and searching through potentially hundreds of thousands if not more attrib files in the pc tree. A potentially better solution would be to keep a list of bad files and on subsequent backups create a new file with suffix _1 (or higher as appropriate) leveraging the hash collision mechanism within BackupPC. But that would add overhead to every new file being backed up to check against the list. Even better might be to do the following. Rename corrupted files in place with an additional terminal '_corrupt' suffix. Change the logic in BackupPC as follows: - If fsck finds a file to be corrupt or any pool access to the file fails to complete properly, rename the corresponding pool file in place with a '_corrupt' suffix. Optionally, in addition to logging such corruption, it would be good to maintain a file containing a list of all such corruptions. - If same file needs to be backed up again, treat the '_corrupt' as a hash collision and backup with an incremented '_N' suffix as per any hash collision (this will effectively create a new copy) - If original, corrupt file needs to be read * Change lookup algorithm so that if the file can't be found in the pool at the original attrib lookup location, say '', then look at '_corrupt' instead * Log a warning that a corrupted file has been referenced The above would require only trivial changes to the code and would not impose any performance penalty except when referencing a corrupted file. I also think it would be helpful to show the number of corrupt files in one of the GUI status pages together with a link to a browseable list of the corrupted files to date ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backup corrupted, impossible to corect it
Ghislain Adnet wrote at about 19:41:31 +0200 on Tuesday, August 20, 2024: > so what i get from this is that when there a corruption for a random reason > backuppc will see it but will not do anything to correct it or backup it > ever again even if it exist on the source client. > > This sound really bad to me beceause if this is true then we have no way of > recovering from this it seems. > > So we can all have thousands of files not backuped on our servers without > any way to correct this apart reinstalling a fresh backuppc system and pray > it does not do it again :( First of all, the corruption seems almost definitely to be a disk issue and not a backuppc issue. You should be monitoring for disk corruption using various versions of RAID or advanced file systems independent of backuppc. Not sure why you would be blaming backuppc for that. Second, when files are missing from the pool, typically backuppc does warn in the logs. However, it doesn't necessarily make sense for backuppc to continuously check through an endless number of historical backups to see if there is corruption somewhere. Third, as others have pointed out you should regularly check yourself that your backups are intact. Such checks range from the simple like running Backuppc_fsck regularly or running file system integrity checks to the more comprehensive like writing your own routines to trawl through the pc and pool trees to look for errors (warning: they can take A LOT of time) or simulating a full to the metal restore. Finally, you should backup your backups. I run two independent versions of backuppc in my home situation with one running on a RPi4. ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Same File - Single Storage
Immediately. If a file matches a pre-existing pool file, it is not entered into the pool, so it is not saved. Christian Völker via BackupPC-users wrote at about 22:24:23 +0200 on Wednesday, July 3, 2024: > Hi, > > as far as I remember v4 stores same file from different hosts only once > in /var/lib/backuppc, right? > > My question now is if BackuPPC recons the duplicate file already during > backup or later when some maintenance task is running? > > On my storage I have around 500GB available space but I want to backup a > host with 700G data. But this data is already backed up from another > host. So when backing up, does it immediately save space or later? > > Thanks! > > /KNEBB > > > > _______ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:https://github.com/backuppc/backuppc/wiki > Project: https://backuppc.github.io/backuppc/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
[BackupPC-users] Same File - Single Storage
Hi, as far as I remember v4 stores same file from different hosts only once in /var/lib/backuppc, right? My question now is if BackuPPC recons the duplicate file already during backup or later when some maintenance task is running? On my storage I have around 500GB available space but I want to backup a host with 700G data. But this data is already backed up from another host. So when backing up, does it immediately save space or later? Thanks! /KNEBB ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] rsync via ssh/rrsync
Well, I guess you'll need to make sure ssh works fine. To do so, go to your backuppc server an switch into the user context of backuppc by "su - backuppc". From there issue "ssh user@hostname" and accept the public key of the target client. Once done, it should run without any problems. As long as you have rsync installed on your target and it is configured to be found in the default path. /Christian Am 23.05.24 um 08:23 schrieb Gandalf Corvotempesta: hi guys im using with great success backuppc backing up clients with rsyncd for one host i have to move from rsyncd to rsync through ssh (and rrsync on ssh command) but im hitting tons of different errors can someone stare a working config for rsync? other that changing the share name to the path (ie from "everything" as share name to "/") and changing "rsyncd" to "rsync", everything else is the same? ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] BackupPC remembers _everything_
By default, rsync will only copy new files to the destination and update existing ones, but it does not delete files which are not present in the source unless it receives the --delete parameter. Sounds like you're probably missing that. From: Kirby Sent: Monday, May 6, 2024 17:55 To: backuppc-users@lists.sourceforge.net Subject: [BackupPC-users] BackupPC remembers _everything_ BackupPC has been covering up my stupid mistakes since 2005. Fortunately, I have never done the 'rm -r *' until last week. Good thing was that I was in my home directory so the system itself was untouched and I caught myself before too much could get deleted. 'Not a problem!' I thought. I will just restore from last night's backup and be on my way. I selecting the missing files and directories, started the restore, and went for a walk. When I got back things were in a sorry state. My ~/Downloads directory was has filled up my drive included stuff that had been deleted 5 years ago. Am I misunderstanding how fill works? I though it was filled from the last backup going back to the last non-filled backup. Instead it looks like it is pulling everything it has ever backed up. I am running BackupPC-4.4.0-1.el8.x86_64. Thank you. ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] BackupPC remembers _everything_
That shouldn't of course happen -- though you did violate the first rule of backups which is to *test* them so they are there and working when you need them 😊 You would need to tell us a lot more details if you want help. My guess given the lack of any other diagnostic information is that perhaps you changed the rsync parameters? Kirby wrote at about 11:55:16 -0400 on Monday, May 6, 2024: > BackupPC has been covering up my stupid mistakes since 2005. > Fortunately, I have never done the 'rm -r *' until last week. Good thing > was that I was in my home directory so the system itself was untouched > and I caught myself before too much could get deleted. > > 'Not a problem!' I thought. I will just restore from last night's backup > and be on my way. I selecting the missing files and directories, started > the restore, and went for a walk. When I got back things were in a sorry > state. My ~/Downloads directory was has filled up my drive included > stuff that had been deleted 5 years ago. > > Am I misunderstanding how fill works? I though it was filled from the > last backup going back to the last non-filled backup. Instead it looks > like it is pulling everything it has ever backed up. > > I am running BackupPC-4.4.0-1.el8.x86_64. > > Thank you. > > > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:https://github.com/backuppc/backuppc/wiki > Project: https://backuppc.github.io/backuppc/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] BUG in 'sub new' in Lib.pm
There was a slight bug in the code I offered below.
Here is a fixed and better version:
foreach my $dir ( qw(TopDir ConfDir InstallDir LogDir RunDir) ) {
if ($bpc->{Conf}{$dir} eq "" || defined(lcfirst($dir))) {
$bpc->{Conf}{$dir} = $bpc->{$dir};
} else {
$bpc->{$dir} = $bpc->{Conf}{$dir};
}
$paths->{$dir} = $bpc->{$dir};
backu...@kosowsky.org wrote at about 13:50:11 + on Sunday, May 5, 2024:
> The following code seems to imply that one can (optionally) set
> TopDir, InstallDir, and ConfDir when initializing a new bpc class
> sub new
> {
> my $class = shift;
> my($topDir, $installDir, $confDir, $noUserCheck) = @_;
>
> However, this doesn't really seem to have any effect in practice.
>
> Specifically,
> - If TopDir, InstallDir, or ConfDir *are* set in config.pl, then
> the following code overrides the arguments given to 'sub new',
> making the input arguments irrelevant.
>
> foreach my $dir ( qw(TopDir ConfDir InstallDir LogDir RunDir) ) {
>next if ( $bpc->{Conf}{$dir} eq "" );
>$paths->{$dir} = $bpc->{$dir} = $bpc->{Conf}{$dir};
>
>
> - Conversely, if TopDir, InstallDir, or ConfDir are *not* set in
> config.pl, then $bpc->{Conf}{$dir} is never set causing any
> routine that references $Conf{$dir} to fail
>
> Suggested fix:
> foreach my $dir ( qw(TopDir ConfDir InstallDir LogDir RunDir) ) {
>if (( $bpc->{Conf}{$dir} eq "" ) ||
>(defined($topDir) && $dir eq "TopDir") ||
>(defined($confDir) && $dir eq "ConfDir") ||
>(defined($installDir) && $dir eq "InstallDir"))
>{
>$bpc->{Conf}{$dir} = $bpc->{$dir};
>} else
> $bpc->{$dir} = $bpc->{Conf}{$dir};
>}
> $paths->{$dir} = $bpc->{$dir};
>
>
>
>
>
>
>
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:https://github.com/backuppc/backuppc/wiki
> Project: https://backuppc.github.io/backuppc/
>
>
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki: https://github.com/backuppc/backuppc/wiki
> Project: https://backuppc.github.io/backuppc/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
[BackupPC-users] BUG in 'sub new' in Lib.pm
The following code seems to imply that one can (optionally) set
TopDir, InstallDir, and ConfDir when initializing a new bpc class
sub new
{
my $class = shift;
my($topDir, $installDir, $confDir, $noUserCheck) = @_;
However, this doesn't really seem to have any effect in practice.
Specifically,
- If TopDir, InstallDir, or ConfDir *are* set in config.pl, then
the following code overrides the arguments given to 'sub new',
making the input arguments irrelevant.
foreach my $dir ( qw(TopDir ConfDir InstallDir LogDir RunDir) ) {
next if ( $bpc->{Conf}{$dir} eq "" );
$paths->{$dir} = $bpc->{$dir} = $bpc->{Conf}{$dir};
- Conversely, if TopDir, InstallDir, or ConfDir are *not* set in
config.pl, then $bpc->{Conf}{$dir} is never set causing any
routine that references $Conf{$dir} to fail
Suggested fix:
foreach my $dir ( qw(TopDir ConfDir InstallDir LogDir RunDir) ) {
if (( $bpc->{Conf}{$dir} eq "" ) ||
(defined($topDir) && $dir eq "TopDir") ||
(defined($confDir) && $dir eq "ConfDir") ||
(defined($installDir) && $dir eq "InstallDir"))
{
$bpc->{Conf}{$dir} = $bpc->{$dir};
} else
$bpc->{$dir} = $bpc->{Conf}{$dir};
}
$paths->{$dir} = $bpc->{$dir};
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backup problems with /home directory
In BackupPC > Edit Config > Rsync Paths/Commands/Args do you have “sudo /usr/bin/rsync” for RsyncClientPath? Kind regards, *Jamie* -- *From:* John Cusick *Sent:* Tuesday, April 16, 2024 8:09 AM *To:* General list for user discussion, questions and support < backuppc-users@lists.sourceforge.net> *Subject:* Re: [BackupPC-users] Backup problems with /home directory On Mon, Apr 15, 2024 at 8:44 PM Les Mikesell wrote: On Mon, Apr 15, 2024 at 9:10 PM John Cusick wrote: > > I've searched multiple sites and everything I've tried just isn't working. > > I'm using rsyncd > > The systems I'm testing are both Fedora 39, one server and one laptop. > > I'm using the BackupPC on the server: > BackupPC-XS-0.62-13.fc39.x86_64 > BackupPC-4.4.0-10.fc39.x86_64 > > I named the backup user "backuppc" which has passwordless ssh login on both the server and laptop client. > > the sudoers file has the following entry: ... Are you sure you understand the difference between the rsync and rsyncd methods?Rsyncd expects a standalone rsync daemon listening on the client and backs up 'shares' in the rsyncd.conf setup. The rsync method connects over ssh to the client and either needs to connect as root on the client or have a more convoluted sudo configuration to have permission to read everything. -- Les Mikesell lesmikes...@gmail.com Les, thanks for your reply. I believe I do know the difference. I'm using the rsyncd method although I tried the rsync method which I felt was too convoluted to bother with, and it didn't work either. In a work environment using BackupPC, version 2.x, and 3.x, I had set up a system that successfully backed up terabytes of info for 11 or so clients for years using rsyncd on the clients. The only difference I specifically remember compared to today is that the backuppc user 6+ years ago was set up with a service UID/GID number (<1000 for UID/GID on RedHat/Fedora) I've since retired but have been asked to come back and set up something along the same lines, so I figured I had better "practice" on my home systems first with the newer version of BackupPC. And, as I mentioned, the server is successfully backing up the /etc and /usr/local directories using rsync with the rsyncd daemon on the client but will not back up either of the /home/user directories. The setup for each directory on the client system is identical, for example: - [local] comment = /usr/local directory path = /usr/local auth users = backuppc secrets file = /etc/rsyncd.secrets hosts allow = x.x.x.x [user] comment = home directory path = /home/user auth users = backuppc secrets file = /etc/rsyncd.secrets hosts allow = x.x.x.x - (I've changed the "user name") /usr/local backs up with no unexpected errors. The user directories fail with: "rsync: [sender] change_dir "/" (in backuppc) failed: Permission denied (13)" The permissions of the user directories are identical to those I worked with years ago, i.e., /home/user is drwx-- (This is required in this secured environment) BackupPC version 3 had no problems entering these user directories using rsync/rsyncd but for some reason this version gives the above error. The reason I mention transferring the test file was to show that the "sudo rsync" command for the backuppc user without password is working to copy a file from one home directory to another home directory even with the permissions set as they are. I cannot figure out why this is happening after messing with it for hours yesterday and today. Obviously I'm missing something and I'm assuming it has something to do with the /home/user directory permissions but they must remain as they are due to security issues required at the work site for the last 10 years or so. It worked then but isn't working now and selinux, enforcing, is giving no errors One thing I've noticed is that rsync runs on the client system as user nobody, so I'm assuming it's a permissions error, so I tried setting rsync with the suid bit, but it changed nothing.. I would have thought that the "sudo /usr/bin/rsync" would give the rsync executable root level access but I guess not. Something has appeared to have changed from 6 years ago and I'm not sure what it is. (again, the sudoers file reads: "backuppc ALL= NOPASSWD:/usr/bin/rsync" ) Regards, John C. ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] PingCmd no longer having effect
On 4/5/24 17:40, Les Mikesell wrote:
You can use $Conf{ClientNameAlias} to point multiple hosts to the same
IP (or a resolvable name).
Yes, this works so long as I override the RsyncSshArgs in the host
config to include the correct port.
Thanks___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] PingCmd no longer having effect
Thank you! You're completely right. When it says
2024-04-05 15:28:10 Can't find host myhost.com via NS and netbios
2024-04-05 15:28:10 can't ping (client = myhost.com); exiting
It seems like the first line is the real failure, and the ping is never
attempted.
Apologies for the list to cutting the log entry too short in my original
post.
I guess this is my fault due to my setup. I have several systems at a
single dynamic ip. I have backupPC set up like so:
host1.myhost.com
host2.myhost.com
host3.myhost.com
...
The backuppc user's ssh config file has each of those hosts configured
with different ports:
Host host1.myhost.com
Hostname myhost.com
Port 1
User root
Host host2.myhost.com
Hostname myhost.com
Port 2
User root
Host host3.myhost.com
Hostname myhost.com
Port 3
User root
...
This way the backuppc user can ssh host3.myhost.com and be logged in to
the proper system automatically.
I guess now my goal is to find out how to make backuppc bypass the dns
check, or to check myhost.com instead of hostx.myhost.com.
Though perhaps I'm way off base and there's a better way of configuring
all of this.
Ian
On 4/5/24 16:14, Robert Trevellyan wrote:
Unless I'm missing something, this seems to be important: 2024-04-05
15:28:10 Can't find host myhost.com <http://myhost.com/> via NS and
netbios
Have you tried adding an entry to your hosts file just to get past
this and allow further troubleshooting?
Robert Trevellyan
On Fri, Apr 5, 2024 at 3:45 PM Ian via BackupPC-users
wrote:
On 4/5/24 15:25, to...@tuxteam.de wrote:
> On Fri, Apr 05, 2024 at 02:27:55PM -0400, Ian via BackupPC-users
wrote:
>> Hi,
>>
>> I've been using BackupPC for many years now, and have used
/usr/bin/true as
>> the ping command [...]
> Are you sure it's supposed to be /usr/bin/true and not just
/bin/true?
>
> Cheers
Pretty sure, 'which true' returns '/usr/bin/true'. Though, on my
system
true also exists at /bin/true, so I tried that as well just now.
Same
result.
I've also tried placing scripts in the PingCmd field and they do not
appear to execute.
Thanks,
Ian
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project:https://backuppc.github.io/backuppc/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] PingCmd no longer having effect
Ian via BackupPC-users wrote: > the PingCmd field The documentation suggests to alter PingPath rather than PingCmd: https://backuppc.github.io/backuppc/BackupPC.html#_conf_pingpath_ Fabian ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] PingCmd no longer having effect
On 4/5/24 15:25, to...@tuxteam.de wrote: On Fri, Apr 05, 2024 at 02:27:55PM -0400, Ian via BackupPC-users wrote: Hi, I've been using BackupPC for many years now, and have used /usr/bin/true as the ping command [...] Are you sure it's supposed to be /usr/bin/true and not just /bin/true? Cheers Pretty sure, 'which true' returns '/usr/bin/true'. Though, on my system true also exists at /bin/true, so I tried that as well just now. Same result. I've also tried placing scripts in the PingCmd field and they do not appear to execute. Thanks, Ian ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] PingCmd no longer having effect
On 4/5/24 14:52, Mike Hughes wrote:
$Conf{PingCmd} = '/bin/echo $host';
Thanks for the idea, unfortunately same result.
2024-04-05 15:28:10 Can't find host myhost.com via NS and netbios
2024-04-05 15:28:10 can't ping (client = myhost.com); exiting
I also tried this
$Conf{PingCmd} = '/var/lib/backuppc/test.sh';
Where test.sh is +x and contains
#!/usr/bin/bash
echo `/usr/bin/date` >> /var/lib/backuppc/testlog.txt
After restarting backuppc (and the whole server for good measure, since
this problem is starting to feel weird), I tried backing up that host.
No output in the text file.
However using sudo to execute the file as backuppc user works as expected.
Ian
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
[BackupPC-users] PingCmd no longer having effect
Hi,
I've been using BackupPC for many years now, and have used /usr/bin/true
as the ping command for hosts that can't respond to ping. However after
a reboot on January 31st, my server stopped obeying pingcmd and stopped
backing up those hosts due to lack of ping response. I am using
BackupPC 4.4.0-5ubuntu2 amd64 on Ubuntu 22.04.
So far I have tried:
Overriding $Conf{PingCmd}, $Conf{PingPath}, and $Conf{Ping6Path} in the
global config from webui and config file.
Setting $Conf{PingCmd} in the client config to either /usr/bin/true or
ping -c1 127.0.0.1 using webui and config file.
None of the above seem to make any difference at all anymore. No matter
what I set, I restart the service and get the same error:
2024-04-05 13:58:38 can't ping (client = myclient.com); exiting
However I can confirm other changes to the client config files do have
an effect. For example setting a ClientNameAlias in the client config
works.
I also tried deleting the client config file and allowing the webui to
create it, and doing an apt-get --reinstall install backuppc. Same effect.
I'm wondering if anyone has noticed anything similar, or has advice on
how to debug.
Thanks,
Ian___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backing up Windows 11
Did you try using exclude files patterns?On Mar 11, 2024 22:41, Dave Bachmann wrote: I've recently added a Windows 11 machine to a home network that is otherwise all Linux. The single hard drive has separate CODE and DATA partitions The DATA partition backs up easily, but I have problems with the CODE. I don't want to waste the space required to backup all of the Windows executables, but do want backups of \Users and possibly \ProgramData, \Program Files, and \Program Files (x86) as well as any others that may be recommended. I've tried a number of techniques using BackupFilesOnly that consistently backs up files for C:\ as well as from many, but not all, of the other folders. I know this question must have been asked many times before, but is there a sample configuration that I can use to stop beating my head against a wall? Thanx! ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Progress indicator for longer backups
Thank you for this information. The correct setting needs quotes: --log-format="log: %o %i %B %8U,%8G %9l %f%L" Dave From: Dave Sherohman via BackupPC-users Sent: Thursday, February 22, 2024 3:17 AM To: General list for user discussion, questions and support Cc: Dave Sherohman Subject: [EXTERNAL] Re: [BackupPC-users] Progress indicator for longer backups WARNING: Email originated from an EXTERNAL source. Do NOT click links, open attachments or reply unless you recognize sender and know the content is safe. When I was debugging an issue some time ago, I added a setting to RsyngArgs which caused all files to be listed in the XferLOGs. I believe the relevant setting was: --log-format=log: %o %i %B %8U,%8G %9l %f%L but I can't find documentation to confirm that. In any case, I now get entries in XferLOG while it works, which look like newrecv >f.st.. rw-r- 33, 4157414 var/log/nginx/access.log newrecv >f.st.. rw-r- 33, 4185251 var/log/nginx/access.log.1 pool recv >f.st.. rw-r- 33, 4 4652 var/log/nginx/access.log.10.gz pool recv >f.st.. rw-r- 33, 4 4721 var/log/nginx/access.log.11.gz From: david.pearce--- via BackupPC-users mailto:backuppc-users@lists.sourceforge.net>> Sent: Wednesday, February 21, 2024 18:34 To: backuppc-users@lists.sourceforge.net<mailto:backuppc-users@lists.sourceforge.net> mailto:backuppc-users@lists.sourceforge.net>> Cc: david.pea...@l3harris.com<mailto:david.pea...@l3harris.com> mailto:david.pea...@l3harris.com>> Subject: [BackupPC-users] Progress indicator for longer backups I have one backup host defined that has about 333 GB of data. The "full" job when it competes takes about 9 hours to run. Right now I see no progress indicators. Even if the log file showed a list of files that would be great. The log level is set to five but no files are listed. While a backup job is running, is there a log file being written somewhere? David Pearce Systems Administrator CONFIDENTIALITY NOTICE: This email and any attachments are for the sole use of the intended recipient and may contain material that is proprietary, confidential, privileged or otherwise legally protected or restricted under applicable government laws. Any review, disclosure, distributing or other use without expressed permission of the sender is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies without reading, printing, or saving. ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Progress indicator for longer backups
When I was debugging an issue some time ago, I added a setting to RsyngArgs which caused all files to be listed in the XferLOGs. I believe the relevant setting was: --log-format=log: %o %i %B %8U,%8G %9l %f%L but I can't find documentation to confirm that. In any case, I now get entries in XferLOG while it works, which look like newrecv >f.st.. rw-r- 33, 4157414 var/log/nginx/access.log newrecv >f.st.. rw-r- 33, 4185251 var/log/nginx/access.log.1 pool recv >f.st.. rw-r- 33, 4 4652 var/log/nginx/access.log.10.gz pool recv >f.st.. rw-r- 33, 4 4721 var/log/nginx/access.log.11.gz From: david.pearce--- via BackupPC-users Sent: Wednesday, February 21, 2024 18:34 To: backuppc-users@lists.sourceforge.net Cc: david.pea...@l3harris.com Subject: [BackupPC-users] Progress indicator for longer backups I have one backup host defined that has about 333 GB of data. The “full” job when it competes takes about 9 hours to run. Right now I see no progress indicators. Even if the log file showed a list of files that would be great. The log level is set to five but no files are listed. While a backup job is running, is there a log file being written somewhere? David Pearce Systems Administrator CONFIDENTIALITY NOTICE: This email and any attachments are for the sole use of the intended recipient and may contain material that is proprietary, confidential, privileged or otherwise legally protected or restricted under applicable government laws. Any review, disclosure, distributing or other use without expressed permission of the sender is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies without reading, printing, or saving. ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
[BackupPC-users] Progress indicator for longer backups
I have one backup host defined that has about 333 GB of data. The "full" job when it competes takes about 9 hours to run. Right now I see no progress indicators. Even if the log file showed a list of files that would be great. The log level is set to five but no files are listed. While a backup job is running, is there a log file being written somewhere? David Pearce Systems Administrator CONFIDENTIALITY NOTICE: This email and any attachments are for the sole use of the intended recipient and may contain material that is proprietary, confidential, privileged or otherwise legally protected or restricted under applicable government laws. Any review, disclosure, distributing or other use without expressed permission of the sender is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies without reading, printing, or saving. ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
[BackupPC-users] rsync'ing BackupPC Pool?
Hi, I remember the "good old time" when it was a really bad idea to rsync a BackupPC pool to an off-site location. This was because of the high usage of hardlinks in Pool v3 version. At least a bad idea on the size of my pool (1.5TB) even with mostly static content. How is this with the up-to-date v4 pool? Can I do a simple rsync meanwhile within a reasonable amount of time? Or are there any other ideas of syncing the pool off-site? Thanks a lot! /KNEBB ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
[BackupPC-users] How to check pool?
Hi all, I have a large v4 pool (not cpool) (1.6TB) running on top of btrfs. Is there any chance to perform a pool check from BackupPC to verify all data in the pool is still ok? I am getting some checksum errors from btrfs and I want to know if the backed up data is still fine. Thanks! /KNEBB ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] error restoring backup
> Sent: Friday, February 16, 2024 at 5:02 PM > From: "Les Mikesell" > To: "daggs" > Cc: "General list for user discussion, questions and support" > > Subject: Re: [BackupPC-users] error restoring backup > > On Fri, Feb 16, 2024 at 2:31 AM daggs wrote: > > > > managed to get it to work, the the -s was / and the rest was all the > > folders one after another as * didn't worked > > > > If you aren't familiar with the unix/linux shell, * would have to be > enclosed in single quotes like '*'. Otherwise it expands to the list > of files in your current directory before the command sees it. > I am familiar with the unix/linux shell, '*' didn't worked too ragardless, now I have the backup restored. Thanks. ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] error restoring backup
> Sent: Wednesday, February 14, 2024 at 12:04 AM > From: "Les Mikesell" > To: "daggs" > Cc: "General list for user discussion, questions and support" > > Subject: Re: [BackupPC-users] error restoring backup > > On Tue, Feb 13, 2024 at 1:15 PM daggs wrote: > > > > I want to restore it to a mount I've attached to the backup server > > so Backuppc_tarCreate -h host -n -1 | tar xf -C /mnt > > will do the trick? > > > > Backuppc_tarCreate needs a '-s sharename' option which would be the > share you used for the backup (maybe '/') and you can specify a list > of files or directories to restore. You can also use '-l' to just > list the files. I'd try that first - and maybe restore a small > directory like /etc or a single file first to see if you are on the > right track. I'm retired and a little fuzzy on this myself.Also, > is the drive mounted as /mnt or something under /mnt? I'd cd into > the top of that mount point to run the command instead of using -C. > Also tar needs a '-' after the f option to tell it to read stdin. > managed to get it to work, the the -s was / and the rest was all the folders one after another as * didn't worked thanks for the help ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] error restoring backup
> Sent: Sunday, February 11, 2024 at 8:26 AM > From: "Les Mikesell" > To: "daggs" > Cc: "General list for user discussion, questions and support" > > Subject: Re: [BackupPC-users] error restoring backup > > On Sun, Feb 11, 2024 at 12:08 AM daggs wrote: > > > > > > > > what is the expected behavior if I restore to remote and not localhost? > > > > > > > > > > That's going to depend on ssh being set up correctly on the remote. > > > And it will use the method configured for that host for the restore. > > > If you want the large tar image file instead you could use the web > > > interface to download it on some other computer with space. > > > > > > > both machines are headless... > > also, I'm not sure I can place a >2 TB file anywhere on my systems. > > > > I assume I can use BackupPC_zcat on each file and restore it to the proper > > location, thing is, I have the files which are part of either full backup > > and incremental backup > > and the last save is a incremental one, so is there a way to work with only > > the incremental one and have BackupPC_zcat know when to take it from the > > full backup? > > Did you want to restore to the original remote host or to a mounted > local filesystem? If the latter, and the problem is not having space > for the intermediate tar image file, then pipe the tarCreate command > output to an appropriate tar restore command. Note that the extract > will happen in your current directory unless you include a -C path > option, and ownership is going to be set according to the numeric user > id on the original file which may not match when on a different > machine. I want to restore it to a mount I've attached to the backup server so Backuppc_tarCreate -h host -n -1 | tar xf -C /mnt will do the trick? > > -- > Les Mikesell > lesmikes...@gmail.com > ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] error restoring backup
> Sent: Saturday, February 10, 2024 at 11:14 PM > From: "Les Mikesell" > To: "daggs" > Cc: "General list for user discussion, questions and support" > > Subject: Re: [BackupPC-users] error restoring backup > > On Sat, Feb 10, 2024 at 1:15 PM daggs wrote: > > > > what is the expected behavior if I restore to remote and not localhost? > > > > That's going to depend on ssh being set up correctly on the remote. > And it will use the method configured for that host for the restore. > If you want the large tar image file instead you could use the web > interface to download it on some other computer with space. > both machines are headless... also, I'm not sure I can place a >2 TB file anywhere on my systems. I assume I can use BackupPC_zcat on each file and restore it to the proper location, thing is, I have the files which are part of either full backup and incremental backup and the last save is a incremental one, so is there a way to work with only the incremental one and have BackupPC_zcat know when to take it from the full backup? ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] error restoring backup
what is the expected behavior if I restore to remote and not localhost? > Sent: Saturday, February 10, 2024 at 7:42 PM > From: "Les Mikesell" > To: "General list for user discussion, questions and support" > > Cc: "daggs" > Subject: Re: [BackupPC-users] error restoring backup > > On Sat, Feb 10, 2024 at 10:53 AM daggs via BackupPC-users > wrote: > > > > the log doesn't specify the command but I think I have a clue, I saw that > > the cmd is something in the line of this: > > https://unix.stackexchange.com/questions/291402/backuppc-restore-using-command-line-tools > > > > so it restores it to local path, in my case the tar file should be almost 3 > > TB of size and the local path as at most 16 GB. > > the target path has enough space. > > so I assume the issue is lack of space > > tarCreate writes to stdout, which in that example is redirected to a > local file. Send it where you have space - or test again restoring > only a small directory. > > -- >Les Mikesell > lesmikes...@gmail.com > ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] error restoring backup
the log doesn't specify the command but I think I have a clue, I saw that the cmd is something in the line of this: https://unix.stackexchange.com/questions/291402/backuppc-restore-using-command-line-tools so it restores it to local path, in my case the tar file should be almost 3 TB of size and the local path as at most 16 GB. the target path has enough space. so I assume the issue is lack of space > Sent: Saturday, February 10, 2024 at 3:21 AM > From: "Norman Goldstein" > To: backuppc-users@lists.sourceforge.net > Subject: Re: [BackupPC-users] error restoring backup > > Run tarCreate at the command prompt. The log file may have the tarCreate > command line that was used. > > On 2024-02-09 14:27, daggs via BackupPC-users wrote: > >> Sent: Thursday, February 08, 2024 at 11:40 PM > >> From: "Les Mikesell" > >> To: "General list for user discussion, questions and support" > >> > >> Cc: "daggs" > >> Subject: Re: [BackupPC-users] error restoring backup > >> > >> On Thu, Feb 8, 2024 at 2:46 PM daggs via BackupPC-users > >> wrote: > >>> any ideas? maybe to use the cli interface? > >>> > >> If normal permissions and mount status are OK, the next thing that > >> could be preventing writing is selinux. Is it enabled/enforcing? > >> > > no selinux but I have advanced, I've rebooted the server and tried the same > > flow, this time I don't get the error as before, I get an request sent but > > when I'm looking inside the server status tab, I see this: > > localhost restore backuppc 2024-02-09 22:24 > > 2024-02-09 22:24BackupPC_tarCreate failed > > > > how can I get more info on why it failed? > > > > > > ___ > > BackupPC-users mailing list > > BackupPC-users@lists.sourceforge.net > > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > > Wiki:https://github.com/backuppc/backuppc/wiki > > Project: https://backuppc.github.io/backuppc/ > > > > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:https://github.com/backuppc/backuppc/wiki > Project: https://backuppc.github.io/backuppc/ > ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] error restoring backup
> Sent: Thursday, February 08, 2024 at 11:40 PM > From: "Les Mikesell" > To: "General list for user discussion, questions and support" > > Cc: "daggs" > Subject: Re: [BackupPC-users] error restoring backup > > On Thu, Feb 8, 2024 at 2:46 PM daggs via BackupPC-users > wrote: > > > > > any ideas? maybe to use the cli interface? > > > > If normal permissions and mount status are OK, the next thing that > could be preventing writing is selinux. Is it enabled/enforcing? > no selinux but I have advanced, I've rebooted the server and tried the same flow, this time I don't get the error as before, I get an request sent but when I'm looking inside the server status tab, I see this: localhost restore backuppc2024-02-09 22:24 2024-02-09 22:24BackupPC_tarCreate failed how can I get more info on why it failed? ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] error restoring backup
> Sent: Sunday, February 04, 2024 at 4:11 PM > From: "daggs via BackupPC-users" > To: backuppc-users@lists.sourceforge.net > Cc: "daggs" , backuppc-users@lists.sourceforge.net > Subject: Re: [BackupPC-users] error restoring backup > > > Sent: Sunday, February 04, 2024 at 3:58 PM > > From: "G.W. Haywood" > > To: backuppc-users@lists.sourceforge.net > > Subject: Re: [BackupPC-users] error restoring backup > > > > Hi there, > > > > > On Sun, 4 Feb 2024, Les Mikesell wrote: > > > > On Sun, 4 Feb 2024, daggs wrote: > > > > ... > > > > $ cat /etc/fstab > > > > proc/proc procdefaults 0 0 > > > > PARTUUID=4fe29e33-01 /boot/firmware vfat defaults 0 > > > > 2 > > > > PARTUUID=4fe29e33-02 / ext4defaults,noatime 0 > > > > 1 > > > > LABEL=backup /var/lib/backuppc/ext4defaults,noatime,ro 0 > > > > 1 > > > > # a swapfile is not a swap partition, no line here > > > > # use dphys-swapfile swap[on|off] for that > > > > > > > > is there any other info required? > > > > > > Specifically, you need to know why the backuppc user can't write in > > > that location. > > > > Looks like fstab tells us. It doesn't matter *what* the permissions > > say in the filesystem if you mount it read only... :/ > but if you look at mount output, you'll see it is rw as I've remounted as rw > > Dagg > any ideas? maybe to use the cli interface? ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] error restoring backup
> Sent: Sunday, February 04, 2024 at 3:58 PM > From: "G.W. Haywood" > To: backuppc-users@lists.sourceforge.net > Subject: Re: [BackupPC-users] error restoring backup > > Hi there, > > > On Sun, 4 Feb 2024, Les Mikesell wrote: > > > On Sun, 4 Feb 2024, daggs wrote: > > > ... > > > $ cat /etc/fstab > > > proc/proc procdefaults 0 0 > > > PARTUUID=4fe29e33-01 /boot/firmware vfatdefaults 0 2 > > > PARTUUID=4fe29e33-02 / ext4defaults,noatime 0 1 > > > LABEL=backup /var/lib/backuppc/ext4defaults,noatime,ro 0 1 > > > # a swapfile is not a swap partition, no line here > > > # use dphys-swapfile swap[on|off] for that > > > > > > is there any other info required? > > > > Specifically, you need to know why the backuppc user can't write in > > that location. > > Looks like fstab tells us. It doesn't matter *what* the permissions > say in the filesystem if you mount it read only... :/ but if you look at mount output, you'll see it is rw as I've remounted as rw Dagg _______ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] error restoring backup
> Sent: Sunday, February 04, 2024 at 12:38 AM > From: "Les Mikesell" > To: "General list for user discussion, questions and support" > > Cc: "daggs" > Subject: Re: [BackupPC-users] error restoring backup > > > > > Error: Can't open/create > > > > /var/lib/backuppc/pc/localhost/restoreReq.22495.0 > > > is there any other info required? > > Specifically, you need to know why the backuppc user can't write in > that location. > Maybe 'ls -l /var/lib/backuppc/pc' > or > 'ls -ld /var/lib/backuppc/pc/localhost' > will tell you. $ ls -ld /var/lib/backuppc/pc/localhost drwxr-x--- 4 backuppc backuppc 4096 Feb 1 01:00 /var/lib/backuppc/pc/localhost $ ls -l /var/lib/backuppc/pc total 72 drwxr--r-- 5 backuppc backuppc 4096 Feb 1 01:00 dtv_server drwxr--r-- 11 backuppc backuppc 4096 Feb 1 01:00 idesesm-pc drwxr-x--- 4 backuppc backuppc 4096 Feb 1 01:00 localhost drwxr-x--- 2 backuppc backuppc 4096 Feb 1 01:00 media drwxr-x--- 3 backuppc backuppc 4096 Feb 1 01:00 michal_desktop drwxr--r-- 10 backuppc backuppc 4096 Feb 1 01:00 michalvirtpc drwxr-x--- 7 backuppc backuppc 4096 Feb 3 23:00 nas_server drwxr--r-- 10 backuppc backuppc 4096 Feb 1 01:00 ncc-5001-d_confs_n_scripts drwxr--r-- 7 backuppc backuppc 4096 Feb 1 01:00 ncc-5001-d_home drwxr--r-- 5 backuppc backuppc 4096 Feb 1 01:00 ncc-5001-d_imgs drwxr--r-- 7 backuppc backuppc 4096 Feb 1 01:00 ncc-5001-d_media drwxr-x--- 5 backuppc backuppc 4096 Feb 1 01:00 ncc-5001-d_personal drwxr--r-- 7 backuppc backuppc 4096 Feb 1 01:00 ncc-5001-d_pictures drwxr--r-- 8 backuppc backuppc 4096 Feb 1 01:00 ncc-5001-d_remote_media drwxr-x--- 4 backuppc backuppc 4096 Feb 1 01:00 ncc-5001-d_snapshot drwxr--r-- 15 backuppc backuppc 4096 Feb 3 23:00 streamer drwxr--r-- 4 backuppc backuppc 4096 Feb 1 01:00 tvheadend_server drwxr-x--- 6 backuppc backuppc 4096 Feb 3 23:00 utils_server seems ok to me ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] error restoring backup
Greetings, > Sent: Saturday, February 03, 2024 at 4:24 PM > From: "G.W. Haywood" > To: backuppc-users@lists.sourceforge.net > Subject: Re: [BackupPC-users] error restoring backup > > Hi there, > > On Sat, 3 Feb 2024, daggs wrote: > > > I want to restore a remote backup to a external device which is connected > > to my backup server under mount. > > I've selected the remote host and the backup host (localhost) at path /mnt > > but I get the below error. > > Error: Can't open/create /var/lib/backuppc/pc/localhost/restoreReq.22495.0 > > > > what can be the issue? > > When you do *anything*, for example in this case a restore, there's a > 'user' involved. That user has permissions. The permissions need at > least to grant read access to what needs to be read and write access > to what needs to be written. The 'open/create' in the error message > *seems* to be telling us that the user doesn't have permission, but I > wouldn't rule out the possibility that the path is non-existent from > what I've seen so far. Is there any more to the error message? no, that is the only error I see, what I did was to install backuppc and then copy the data from the old drive to the new one where backuppc runs. > > > It might be as simple as giving write permission on a directory to the > user doing the restore, but you might need to look at > > (a) the user ids >- which user is doing the restore >- where the restored files are expected to be written >- what permissions will the user need to do whatever is required that depends on the ui, I don't know what is the user used by the ui > > (b) those parts of the BackupPC configuration which concern >- the locations of the various bits of the BackupPC system and >- the user(s) which are allowed to run backups and restores > where can I find it? > If you can give more details about how you attempted to perform the > restore (if you used the command line, then let us see the commands), > about your configuration, about all the different bits of equipment, > and how they're supposed to talk to each other, we should be able to > give you better help. If you mounted any of the bits manually, let > us see the mount command(s) (and the content of /etc/fstab if used). as said, I'm using the ui to restore from an old host's data to localhost at /mnt/ $ mount ... /dev/sda1 on /var/lib/backuppc type ext4 (rw,relatime) /dev/sdb1 on /mnt type ext3 (rw,relatime) ... $ ls -l /mnt/ -a /var/lib/backuppc /mnt/: total 24 drwxrwxrwx 3 root root 4096 Feb 2 14:32 . drwxr-xr-x 18 root root 4096 Dec 11 01:24 .. drwx-- 2 root root 16384 Feb 2 14:32 lost+found /var/lib/backuppc: total 48 drwxr-xr-x 9 root root 4096 Jan 27 13:32 . drwxr-xr-x 30 root root 4096 Jan 26 13:41 .. drwxr-xr-x 146 backuppc backuppc 4096 Jan 30 20:11 cpool drwxr-xr-x 2 backuppc www-data 4096 Jan 27 13:31 etc_backuppc drwxr-x--- 2 backuppc backuppc 4096 Feb 3 18:00 log drwx-- 4 126 126 16384 Sep 6 2015 lost+found drwxr-xr-x 20 backuppc backuppc 4096 Aug 19 2020 pc drwxr-xr-x 2 backuppc backuppc 4096 Sep 6 2015 pool drwxr- 2 backuppc backuppc 4096 Jul 31 2020 trash $ cat /etc/fstab proc /proc procdefaults 0 0 PARTUUID=4fe29e33-01 /boot/firmware vfatdefaults 0 2 PARTUUID=4fe29e33-02 / ext4defaults,noatime 0 1 LABEL=backup /var/lib/backuppc/ext4defaults,noatime,ro 0 1 # a swapfile is not a swap partition, no line here # use dphys-swapfile swap[on|off] for that is there any other info required? Thanks, Dagg > > -- > > 73, > Ged. > ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
[BackupPC-users] error restoring backup
Greetings, I want to restore a remote backup to a external device which is connected to my backup server under mount. I've selected the remote host and the backup host (localhost) at path /mnt but I get the below error. Error: Can't open/create /var/lib/backuppc/pc/localhost/restoreReq.22495.0 what can be the issue? Thanks, Dagg ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] restoring pool
Greetings, done all the suggested, now I have access to my backups. the backup is mounted as rw as it is required when the config is on the same drive all the backups are disabled, can I assume they won't be deleted? Dagg > Sent: Friday, January 26, 2024 at 10:59 PM > From: "Christian Völker via BackupPC-users" > > To: "General list for user discussion, questions and support" > > Cc: "Christian Völker" > Subject: Re: [BackupPC-users] restoring pool > > Good point. > I suggest to mount as Read-only. Should work. > Grüsse > Christian Völker > > > Am 26.01.2024 um 21:29 schrieb backu...@kosowsky.org: > > > > I would be careful as running BackupPC could cause certain old backups > > to expire that you may not want to expire. > > Plus, if you don't have all the hosts set properly, it could delete > > pool files that are needed... > > > > I would be VERY careful to: > > 1. Make sure I have my full config restored -- including desired > > expiry times > > 2. That all my desired backup hosts are intact > > 3. That I know what I am doing before starting the daemon and risking > > auto-deletion > > > > Regardless, definitely make a copy/snapshot before proceeding... so > > you can undo... > > > > Jeff > > > > > > Christian Völker via BackupPC-users wrote at about 10:41:33 +0100 on > > Friday, January 26, 2024: > >> Hi, > >> > >> does your HDD contain the full structure of a pool (usually the > >> structure below /var/lib/BackupPC)? If so I'd recommend to add all the > >> hosts which are visible as directory in pc/-folder. Stop BackupPC, mount > >> your hdd to /var/lib/BackupPC and start BackupPC. > >> > >> It should recon the structure and match with the hosts configuration. > >> > >> /CV > >> > >> > >>> Am 26.01.24 um 09:35 schrieb daggs via BackupPC-users: > >>> Greetings. > >>> > >>> I have a pool of backups in a external hdd, I've seems to have misplaced > >>> the config for them, is there a way to reconfigure backuppc so they can > >>> be used again? > >>> > >>> Thanks, > >>> > >>> Dagg > >>> > >>> > >>> ___ > >>> BackupPC-users mailing list > >>> BackupPC-users@lists.sourceforge.net > >>> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > >>> Wiki:https://github.com/backuppc/backuppc/wiki > >>> Project: https://backuppc.github.io/backuppc/ > >> > >> > >> > >> ___ > >> BackupPC-users mailing list > >> BackupPC-users@lists.sourceforge.net > >> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > >> Wiki:https://github.com/backuppc/backuppc/wiki > >> Project: https://backuppc.github.io/backuppc/ > > > > > > ___ > > BackupPC-users mailing list > > BackupPC-users@lists.sourceforge.net > > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > > Wiki: https://github.com/backuppc/backuppc/wiki > > Project: https://backuppc.github.io/backuppc/ > > > > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:https://github.com/backuppc/backuppc/wiki > Project: https://backuppc.github.io/backuppc/ > ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] restoring pool
I can create config folder on the device that holds the backups, put the cfg there and link it to /etc/BackupPC Dagg > Sent: Saturday, January 27, 2024 at 8:04 AM > From: "Christian Völker via BackupPC-users" > > To: backuppc-users@lists.sourceforge.net > Cc: "Christian Völker" > Subject: Re: [BackupPC-users] restoring pool > > I can second dthat. For my routine I have a script which rsyncs my > /etc/backuppc folder (including the apache.conf and the host > configurations) to my /var/lib/backuppc folder (which is on an external > drive). > /CV > > > Am 26.01.24 um 23:31 schrieb Kenneth Porter: > > In the future, I recommend putting the config on the external drive > > and mounting it to /etc/BackupPC. > > > > I'd also recommend copying/tarring /etc/httpd or /etc/nginx (depending > > on which web server you use) to the external drive. That lets you > > bring up BackupPC quickly on a replacement server after a disaster. > > > > > > > > > > ___ > > BackupPC-users mailing list > > BackupPC-users@lists.sourceforge.net > > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users > > Wiki: https://github.com/backuppc/backuppc/wiki > > Project: https://backuppc.github.io/backuppc/ > > > > _______ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:https://github.com/backuppc/backuppc/wiki > Project: https://backuppc.github.io/backuppc/ > ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] restoring pool
I can second dthat. For my routine I have a script which rsyncs my /etc/backuppc folder (including the apache.conf and the host configurations) to my /var/lib/backuppc folder (which is on an external drive). /CV Am 26.01.24 um 23:31 schrieb Kenneth Porter: In the future, I recommend putting the config on the external drive and mounting it to /etc/BackupPC. I'd also recommend copying/tarring /etc/httpd or /etc/nginx (depending on which web server you use) to the external drive. That lets you bring up BackupPC quickly on a replacement server after a disaster. ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] restoring pool
Good point. I suggest to mount as Read-only. Should work. Grüsse Christian Völker > Am 26.01.2024 um 21:29 schrieb backu...@kosowsky.org: > > I would be careful as running BackupPC could cause certain old backups > to expire that you may not want to expire. > Plus, if you don't have all the hosts set properly, it could delete > pool files that are needed... > > I would be VERY careful to: > 1. Make sure I have my full config restored -- including desired > expiry times > 2. That all my desired backup hosts are intact > 3. That I know what I am doing before starting the daemon and risking > auto-deletion > > Regardless, definitely make a copy/snapshot before proceeding... so > you can undo... > > Jeff > > > Christian Völker via BackupPC-users wrote at about 10:41:33 +0100 on Friday, > January 26, 2024: >> Hi, >> >> does your HDD contain the full structure of a pool (usually the >> structure below /var/lib/BackupPC)? If so I'd recommend to add all the >> hosts which are visible as directory in pc/-folder. Stop BackupPC, mount >> your hdd to /var/lib/BackupPC and start BackupPC. >> >> It should recon the structure and match with the hosts configuration. >> >> /CV >> >> >>> Am 26.01.24 um 09:35 schrieb daggs via BackupPC-users: >>> Greetings. >>> >>> I have a pool of backups in a external hdd, I've seems to have misplaced >>> the config for them, is there a way to reconfigure backuppc so they can be >>> used again? >>> >>> Thanks, >>> >>> Dagg >>> >>> >>> ___ >>> BackupPC-users mailing list >>> BackupPC-users@lists.sourceforge.net >>> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users >>> Wiki:https://github.com/backuppc/backuppc/wiki >>> Project: https://backuppc.github.io/backuppc/ >> >> >> >> ___ >> BackupPC-users mailing list >> BackupPC-users@lists.sourceforge.net >> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users >> Wiki:https://github.com/backuppc/backuppc/wiki >> Project: https://backuppc.github.io/backuppc/ > > > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:https://github.com/backuppc/backuppc/wiki > Project: https://backuppc.github.io/backuppc/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] restoring pool
I would be careful as running BackupPC could cause certain old backups to expire that you may not want to expire. Plus, if you don't have all the hosts set properly, it could delete pool files that are needed... I would be VERY careful to: 1. Make sure I have my full config restored -- including desired expiry times 2. That all my desired backup hosts are intact 3. That I know what I am doing before starting the daemon and risking auto-deletion Regardless, definitely make a copy/snapshot before proceeding... so you can undo... Jeff Christian Völker via BackupPC-users wrote at about 10:41:33 +0100 on Friday, January 26, 2024: > Hi, > > does your HDD contain the full structure of a pool (usually the > structure below /var/lib/BackupPC)? If so I'd recommend to add all the > hosts which are visible as directory in pc/-folder. Stop BackupPC, mount > your hdd to /var/lib/BackupPC and start BackupPC. > > It should recon the structure and match with the hosts configuration. > > /CV > > > Am 26.01.24 um 09:35 schrieb daggs via BackupPC-users: > > Greetings. > > > > I have a pool of backups in a external hdd, I've seems to have misplaced > > the config for them, is there a way to reconfigure backuppc so they can be > > used again? > > > > Thanks, > > > > Dagg > > > > > > ___ > > BackupPC-users mailing list > > BackupPC-users@lists.sourceforge.net > > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > > Wiki:https://github.com/backuppc/backuppc/wiki > > Project: https://backuppc.github.io/backuppc/ > > > > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki: https://github.com/backuppc/backuppc/wiki > Project: https://backuppc.github.io/backuppc/ _______ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] restoring pool
Greetings Christian, yes, my hdd was mounted on /var/lib/BackupPC so it retains all the structure. so based on your suggestion, I can restore the hosts but still be missing the actual config? if so, I can live with that. Dagg > Sent: Friday, January 26, 2024 at 11:41 AM > From: "Christian Völker via BackupPC-users" > > To: backuppc-users@lists.sourceforge.net > Cc: "Christian Völker" > Subject: Re: [BackupPC-users] restoring pool > > Hi, > > does your HDD contain the full structure of a pool (usually the > structure below /var/lib/BackupPC)? If so I'd recommend to add all the > hosts which are visible as directory in pc/-folder. Stop BackupPC, mount > your hdd to /var/lib/BackupPC and start BackupPC. > > It should recon the structure and match with the hosts configuration. > > /CV > > > Am 26.01.24 um 09:35 schrieb daggs via BackupPC-users: > > Greetings. > > > > I have a pool of backups in a external hdd, I've seems to have misplaced > > the config for them, is there a way to reconfigure backuppc so they can be > > used again? > > > > Thanks, > > > > Dagg > > > > > > ___ > > BackupPC-users mailing list > > BackupPC-users@lists.sourceforge.net > > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > > Wiki: https://github.com/backuppc/backuppc/wiki > > Project: https://backuppc.github.io/backuppc/ > > > > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:https://github.com/backuppc/backuppc/wiki > Project: https://backuppc.github.io/backuppc/ > ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] restoring pool
Hi, does your HDD contain the full structure of a pool (usually the structure below /var/lib/BackupPC)? If so I'd recommend to add all the hosts which are visible as directory in pc/-folder. Stop BackupPC, mount your hdd to /var/lib/BackupPC and start BackupPC. It should recon the structure and match with the hosts configuration. /CV Am 26.01.24 um 09:35 schrieb daggs via BackupPC-users: Greetings. I have a pool of backups in a external hdd, I've seems to have misplaced the config for them, is there a way to reconfigure backuppc so they can be used again? Thanks, Dagg ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
[BackupPC-users] restoring pool
Greetings. I have a pool of backups in a external hdd, I've seems to have misplaced the config for them, is there a way to reconfigure backuppc so they can be used again? Thanks, Dagg ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
[BackupPC-users] rsync'ing Docker's overlay-fs despite "--one-file-system"?
Hi, I am backing up a Debian 12 client host where I an application uses Docker and its overlay filesystem: root@host:~# df -h Dateisystem Größe Benutzt Verf. Verw% Eingehängt auf udev 1,9G 0 1,9G 0% /dev tmpfs 392M 1,3M 391M 1% /run /dev/mapper/hoas--vg-root 82G 18G 61G 23% / tmpfs 2,0G 0 2,0G 0% /dev/shm tmpfs 5,0M 0 5,0M 0% /run/lock tmpfs 4,0M 0 4,0M 0% /sys/fs/cgroup /dev/vda1 455M 95M 336M 22% /boot overlay 82G 18G 61G 23% /var/lib/docker/overlay2/c0fca4e38563165ce1678e4dff6427d0766a892fe269a655a21a9b08064d9d54/merged overlay 82G 18G 61G 23% /var/lib/docker/overlay2/f132bd655da124f4c9a73d4dbc568ad2c87c8a032a87d1f6664537cd87042639/merged overlay 82G 18G 61G 23% /var/lib/docker/overlay2/cb43fbd29e50cdcc82c831ced5e8b43f6bd624be4507f2db063883a35fbfca5c/merged overlay 82G 18G 61G 23% /var/lib/docker/overlay2/cd9ff8530d44d2e6701f04ee0b5c9ed422182fec66e15cad99c20ea04126466d/merged overlay 82G 18G 61G 23% /var/lib/docker/overlay2/f2f1220522a1aae976b5fead17000947cf3b2318e2eb066493b2d4aeda135b03/merged overlay 82G 18G 61G 23% /var/lib/docker/overlay2/0d996fc93c6890cfae0378516bf931a929c02e93764e1ed7ee585051bcc7e0d0/merged overlay 82G 18G 61G 23% /var/lib/docker/overlay2/26f007e3defc1496d3f28569e0c72dffa060a2c9cd2ca5688c514c3b2714cfac/merged tmpfs 392M 0 392M 0% /run/user/0 overlay 82G 18G 61G 23% /var/lib/docker/overlay2/2225be72fd4f2aa2923f42f6e7f6cd3864b1ca09054118972644d2c0aec06939/merged overlay 82G 18G 61G 23% /var/lib/docker/overlay2/0d640041cecf5194e622cc1327d51371e55d46abd732a3d6978871fd00635d6c/merged Obviously the Docker filesystems are dynamically and I do not want them to be backed up. I expected the "--one-file-system" parameter for rsync will take care of it. But when browsing the backups of this host I see not only the mount directories but as well directories and files below the mount point. So why is rsync backing up those files even though I have the "--one-file-system" parameter set? I am trying now to work with excludes but shouldn't it work anyways? Thanks& Greetings /KNEBB ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Setup for Windows backup with rsync
It is safer and more versatile to setup ssh on your Windows machine and then just use 'rsync' Rsyncd uses minimal security and an incompatible config format from rsync-ssh. Samual Flossie wrote at about 10:15:17 -0500 on Saturday, January 20, 2024: > There are several windows rsyncd install/config tutorials. Recommend > looking at this one: > https://kifarunix.com/backup-windows-system-with-backuppc-using-rsyncd/ > > rsyncd is at cygwin-rsyncd <https://github.com/backuppc/cygwin-rsyncd> and > can download Cygwin-Rsyncd installer from Releases page > <https://github.com/backuppc/cygwin-rsyncd/releases> and and install it on > your windows system > (https://github.com/backuppc/cygwin-rsyncd/releases) > > Sam > > On Sat, Jan 20, 2024 at 12:22 AM Les Mikesell wrote: > > > On Fri, Jan 19, 2024 at 4:06 PM Stephen Blackwell > > wrote: > > > > > > My external backup drive died recently so I bought a NAS and installed a > > docker with Backuppc in it and set it up to backup my Linux box. Works like > > a charm. > > > > > > Now I want to add my Windows laptop to the list of clients. I was > > following this guide but I get this error in the XferLOG.bad.z file: > > > > > > > You are supposed to use the rsyncd backup method in backuppc with that > > setup, not rsync. The difference is that rsyncd expects to connect > > directly with a listening rsync daemon, not start one with ssh. > > > > -- > > Les Mikesell > >lesmikes...@gmail.com > > > > > > ___ > > BackupPC-users mailing list > > BackupPC-users@lists.sourceforge.net > > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > > Wiki:https://github.com/backuppc/backuppc/wiki > > Project: https://backuppc.github.io/backuppc/ > > > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:https://github.com/backuppc/backuppc/wiki > Project: https://backuppc.github.io/backuppc/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backing up the BackupPC server using rsync
Try SSHing to phoenix under the user BackupPC runs at from your BackupPC
instance first, accepting the key fingerprint etc.
*From:* Tom Moore
*Sent:* Thursday, December 21, 2023 4:15 PM
*To:* backuppc-users@lists.sourceforge.net
*Subject:* [BackupPC-users] Backing up the BackupPC server using rsync
I have files on the server that is running BackupPC that I would like to
back up. I see from the sourceforge faq that this is possible, and there
is a good example for using tar:
https://backuppc.sourceforge.net/faq/localhost.html
The files that I want to backup are under the /raid folder, except that I
want to exclude the files in /raid/share/tmp:
$Conf{BackupFilesOnly} = '/raid';
$Conf{BackupFilesExclude} = '/raid/share/tmp';
I was able to get the BackupPC tar transfer method working on the
localhost. So far so good.
I would like to set this up for the rsync transfer method since there are a
lot of files to back up and rsync is supposed to be more efficient in a
number of ways. I made the following changes to the host config file:
$Conf{XferMethod} = "rsync";
$Conf{RsyncClientPath} = "sudo /usr/bin/rsync";
$Conf{RsyncSshArgs} = ['-e', ''];
I have also added a line to the sudoers file
backuppc ALL = NOPASSWD: /usr/bin/rsync
When I try to run a backup it fails and I end up with the following error
message in the log file:
Running: /usr/bin/rsync_bpc --bpc-top-dir /var/lib/BackupPC/
--bpc-host-name phoenix --bpc-share-name /raid --bpc-bkup-num 1
--bpc-bkup-comp 3 --bpc-bkup-prevnum -1 --bpc-bkup-prevcomp -1
--bpc-bkup-inode0 9040190 --bpc-log-level 1 --bpc-attrib-new -e
--rsync-path=sudo\ /usr/bin/rsync --super --recursive --protect-args
--numeric-ids --perms --owner --group -D --times --links --hard-links
--delete --delete-excluded --one-file-system --partial --log-format=log:\
%o\ %i\ %B\ %8U,%8G\ %9l\ %f%L --stats --iconv=utf8,UTF-8 --timeout=72000
--include=/raid --exclude=/\* --exclude=/raid/share/tmp phoenix:/raid/ /
incr backup started for directory /raid
Xfer PIDs are now 24843
This is the rsync child about to exec /usr/bin/rsync_bpc
rsync_bpc: Failed to exec phoenix: No such file or directory (2)
Any ideas about what is going wrong here? The localhost is named phoenix,
and 'ping phoenix' works, as does 'nslookup phoenix'.
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] server log : thousands of BackupPC_refCountUpdate: missing pool file
Hi
We noticed the log message about missing pool files appear in the log
mostly if there was an improper shutdown of the BackupPC Server while a
backup was in progress.
We developed the following script to get the affected host and backup
number for each reported missing pool file. The only remedy we found to
get rid of the error is to delete the affected backups. Please let me
know if you find any other remedy.
The way it works is that it extracts the hash of the missing pool file,
subtracts one from the first two letters of the hex value to find the
correct subfolder in the pool and then correlates that with a backup and
a host.
In the following script I think most paths are the default for a rpm
based BackupPC installation but adapt the paths to the installation on
your system. In particular
- the path to the BackupPC log file
- the path to your pool
#!/bin/bash
#
# Script for investigation of missing pool files
#
LOG_FILE_NAME="/home/backuppc/find_missing_pool_files_$(date
+%Y%m%d-%H:%m).log"
echo Search for missing pool files started. Logs will be written to
"$LOG_FILE_NAME"
MISSING_POOL_FILES_HASHES=$(grep 'missing pool' /var/log/BackupPC/LOG |
cut -d' ' -f10)
for full_hex in $MISSING_POOL_FILES_HASHES; do
hex_val=${full_hex:0:2}
hex_val_decr=$(printf "%X" $((0x$hex_val - 1)) | awk '{print
tolower($0)}')
paths="/srv/backuppc/pc/*/*/refCnt/poolCnt.1.$hex_val_decr"
echo "$hex_val - 1 = $hex_val_decr"
for path in $paths; do
echo "$path"
if test -f "$path"; then
echo one found
pool_cnt_print=$(/usr/share/BackupPC/bin/BackupPC_poolCntPrint "$path")
pool_cnt_match=$(echo "$pool_cnt_print" | grep "$full_hex")
if [ -n "$pool_cnt_match" ]; then
host=$(echo "$path" | cut -d'/' -f5)
backup_number=$(echo "$path" | cut -d'/' -f6)
echo Found "$full_hex" in Backup Nr. "$backup_number"
of host "$host" | tee -a "$LOG_FILE_NAME"
/usr/share/BackupPC/bin/BackupPC_ls -R -h "$host" -n
"$backup_number" -s / / | grep -E "$full_hex"
fi
fi
done
done
--
Tim Herren
System Engineer
On 12/11/23 05:34, Samual Flossie wrote:
Thanks for looking deeper. I agree that these missing pool file
warnings are ominous news for recovery. The link you referenced (
https://www.mail-archive.com/backuppc-users@lists.sourceforge.net/msg33090.html)
indicates to me also that in v4, the missing pool file message is not
benign.
It will take me at least a few days to run a full recovery analysis to
see if there are file recovery issues.
Do you know how to get the file/backup#/host from a pool file
reference that was reported missing in the log? That detail would
certainly help speed up my analysis and potential recovery.
I’ll update once that’s done and have some actionable data.
Sam
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
[BackupPC-users] Progress during a backup
When a backup is in the state "backup in progress", where are I look to see the progress? Is there a file on backup server that I can look at? I have a backup that sometimes is in that state but appears to be hung. The XferLOG and Errors logs through the UI are empty. Thanks. David Pearce CONFIDENTIALITY NOTICE: This email and any attachments are for the sole use of the intended recipient and may contain material that is proprietary, confidential, privileged or otherwise legally protected or restricted under applicable government laws. Any review, disclosure, distributing or other use without expressed permission of the sender is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies without reading, printing, or saving. ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] server log : thousands of BackupPC_refCountUpdate: missing pool file
G.W. Haywood wrote at about 13:32:42 + on Sunday, December 10, 2023: > Hi there, > > On Sun, 10 Dec 2023, Samual Flossie wrote: > > > The server log has a bunch (17k) of "BackupPC_refCountUpdate: missing pool > > file" messages. Reread the v4 docs, github wiki, issues and a bunch of > > messages on this email listserve. > > > > I am correct that these messages are benign and do not indicate that a > > backed up file is missing a pool file? > > I believe you are correct. That is true for v3.x but for v4.x if the pool file is missing it may very well represent the (only) copy of data for the same file that is backed up across multiple machines and backups. > > > My overriding concern is that a file will not be able to recover > > when needed and that issue was signaled by a benign log message. > > I'm sure that you are right to be concerned. I would be. > > > What additional steps should be taken to resolve these > > "BackupPC_refCountUpdate" messages? > > Does this help? It's just one result from a quick search. > > https://www.mail-archive.com/backuppc-users@lists.sourceforge.net/msg33090.html > > It seems that this issue has cropped up before without an obvious > cause, but there was a suggestion that an unclean server shutdown > might have been implicated. I think that's just a guess. That is my sense and was the best explanation for when I had some such errors a few years ago. > > Full marks, incidentally, for looking at your server logs. :) > > -- > > 73, > Ged. > > > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:https://github.com/backuppc/backuppc/wiki > Project: https://backuppc.github.io/backuppc/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Migrating User Data to New PC via BackupPC or Other?
BackupPC of course has no idea what you want to restore... and it really is up to you what you want to restore. Once you know what you want to restore (based on your own knowledge or perhaps Google to find out what directories make sense to restore), then you just select the desired files/directories in the GUI. Unlikely that any one will have done this for you as its very much an individual choice. The best way though is to see if your new PC came with migration software and/or use default Windows migration software to copy over the basics. This will ensure that everything gets put in the right place, that ownership/perms/ACLs are properly updated, and that any changes needed for migration are made. THEN if you find anything missing, you can use BackupPC to migrate the files or just copy them directly from your old PC (which is usually even easier!) Tim Evans wrote at about 15:48:58 -0500 on Sunday, November 26, 2023: > Just ordered a new Windows PC to replace a very old one, which has been > backed up via BackupPC (rsync) to my Linux backup server. (Pretty good > black friday deal from Costco.) > > Anyone have a recipe for restoring user data (docs, e-mail, photos, > browser profiles, etc.) via BackuPC? > > Are there better alternatives? Do new (Dell) PC's come with migration > tools? > > Thanks. > > > > _______ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:https://github.com/backuppc/backuppc/wiki > Project: https://backuppc.github.io/backuppc/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Outdated Files in Backup?
Thanks again!
Again, I do not know why this changed. Removed the entry on the host and
let the default settings settle in.
Thanks!
/KNEBB
Am 26.11.23 um 13:51 schrieb jbk:
On 11/26/23 05:30, Christian Völker wrote:
> Hi, > > thanks for pointins this out. I do not remember having set this >
manually on all hosts. It was set globally anyways so I removed these
> entries from all clients. > > And I have only a username for this
single host (as it is MacOS and > does not know "root" as the others
do). > > Meanwhile I have removed the host an created it from scratch.
Started > a backupc and now everything seems to work fine. I do not
know how > this has happened. > > Thanks! > > /KNEBB > > > Am 24.11.23
um 17:05 schrieb jbk: >> On 11/14/23 14:09, Christian Völker wrote:
>>> Hi, >>> >>> I have BackupPC 4.x running on a Debian system. Works
like a >>> champ since years now. >>> >>> One of my clients is an
Apple Mac with current up-to-date MacOS. >>> rsync is installed: >>>
>>> username@macos Documents % rsync --version rsync version 2.6.9 >>>
protocol version 29 Copyright (C) 1996-2006 by Andrew Tridgell, >>>
Wayne Davison, and others. So far it works fine. It does the >>>
backupsand all is good. I am backing up the Users-Folder as >>>
"$RsyncShareName": "/Users/username" and excluded some unneeded >>>
directories. >>> >>> See macos.pl: $Conf{BackupPCNightlyPeriod} = 1;
>>> $Conf{RsyncShareName} = [ '/Users/username' ]; >>>
$Conf{RsyncSshArgs} = [ '-e', '$sshPath -l username' ]; >>> >> In
reviewing again your settings I see that you have the nightly >>
period configured as a per host value to do a full traverse as I >>
do, but for my system this is configured on the server and not by >>
client. I also see that your: '$sshPath -l username' lists >>
username. For my setup that username is backuppc for all clients. >>
Do you have different usernames configured for each client? >> >> One
thing I've noticed in the nightly process is that even with the >>
setting to traverse the whole pool in one night it seems that I'll >>
get a big prune (4-5) G's late in the weekly cycle. >> >> -- Jim KR >
The other thing that I noticed is that your rsync args is missing the
option:
--protect-args
This may be important to BackupPC's operation. It is recommended that
you not change the rsync arguments from their default in the supplied
config.pl
I was guilty of modifying the defaults and it took me three months to
clear the backups of deleted data across four backup disks.
--
Jim KR
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Outdated Files in Backup?
Hi,
thanks for pointins this out. I do not remember having set this manually
on all hosts. It was set globally anyways so I removed these entries
from all clients.
And I have only a username for this single host (as it is MacOS and does
not know "root" as the others do).
Meanwhile I have removed the host an created it from scratch. Started a
backupc and now everything seems to work fine.
I do not know how this has happened.
Thanks!
/KNEBB
Am 24.11.23 um 17:05 schrieb jbk:
On 11/14/23 14:09, Christian Völker wrote:
Hi,
I have BackupPC 4.x running on a Debian system. Works like a champ
since years now.
One of my clients is an Apple Mac with current up-to-date MacOS.
rsync is installed:
username@macos Documents % rsync --version
rsync version 2.6.9 protocol version 29
Copyright (C) 1996-2006 by Andrew Tridgell, Wayne Davison, and others.
So far it works fine. It does the backupsand all is good. I am
backing up the Users-Folder as "$RsyncShareName": "/Users/username"
and excluded some unneeded directories.
See macos.pl:
$Conf{BackupPCNightlyPeriod} = 1;
$Conf{RsyncShareName} = [
'/Users/username'
];
$Conf{RsyncSshArgs} = [
'-e',
'$sshPath -l username'
];
In reviewing again your settings I see that you have the nightly
period configured as a per host value to do a full traverse as I do,
but for my system this is configured on the server and not by client.
I also see that your:
'$sshPath -l username'
lists username. For my setup that username is backuppc for all
clients. Do you have different usernames configured for each client?
One thing I've noticed in the nightly process is that even with the
setting to traverse the whole pool in one night it seems that I'll get
a big prune (4-5) G's late in the weekly cycle.
--
Jim KR
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Outdated Files in Backup?
Beyond the safety precaution you mentioned, rsync doesn't delete files at all unless your RsyncArgs include "--delete". There have been a few previous people mailing the list who didn't have --delete in there, so I wonder whether that might be the problem here. On 11/15/23 12:42, Guillermo Rozas wrote: For testing I did a new "full" backup. It has the same old files in it :\ If you check the full log of that backup, does it shows any error or anything suspicious? I had that kind of things happen sporadically when there is a reading error on the client side, and rsync disables deletions for safety. "Reading error" in my case was usually just a symlink for which the linked file was missing. Best regards, Guillermo ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project:https://backuppc.github.io/backuppc/___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Outdated Files in Backup?
Hi,
yes, the latest full backup shows files which have been deleted months
ago. At the time of backing up the client they did not exist on the client!
For testing I did a new "full" backup.
It has the same old files in it :\
So I created a new host (by IP instead of name), copied the
"macosclient.pl" to "$IP.pl", reloaded backuppc and staarted a new
backup on the IP-based host. This backup now only has the files which
really do exists on the client.
Looks like there is something broken in the inventory of the backups of
this host.
Any better idea instead of simply removeing all backups from this host
and start a new series?
/KNEBB
Am 14.11.23 um 20:34 schrieb Norman J. Goldstein:
Are you saying that your full backup, 666, contains files that *were*
not in your local directory at the time of the backup?
On 2023-11-14 11:09, Christian Völker via BackupPC-users wrote:
Hi,
I have BackupPC 4.x running on a Debian system. Works like a champ
since years now.
One of my clients is an Apple Mac with current up-to-date MacOS.
rsync is installed:
username@macos Documents % rsync --version
rsync version 2.6.9 protocol version 29
Copyright (C) 1996-2006 by Andrew Tridgell, Wayne Davison, and others.
So far it works fine. It does the backupsand all is good. I am
backing up the Users-Folder as "$RsyncShareName": "/Users/username"
and excluded some unneeded directories.
See macos.pl:
$Conf{BackupPCNightlyPeriod} = 1;
$Conf{RsyncShareName} = [
'/Users/username'
];
$Conf{RsyncSshArgs} = [
'-e',
'$sshPath -l username'
];
$Conf{BackupFilesExclude} = {
'/Users/username/.Trash' => [
''
],
'/Users/username/Library/Accounts' => [
''
],
'/Users/username/Library/Application Support' => [
''
],
'/Users/username/Library/Assistant' => [
''
],
'/Users/username/Library/Autosave Information' => [
''
],
'/Users/username/Library/Biome' => [
''
],
'/Users/username/Library/Caches' => [
''
],
'/Users/username/Library/Containers' => [
''
],
'/Users/username/Library/Cookies' => [
''
],
'/Users/username/Library/CoreFollowUps' => [
''
],
'/Users/username/Library/Group Containers' => [
''
],
'/Users/username/Library/HomeKit' => [
''
]
};
$Conf{RsyncArgs} = [
'--super',
'--recursive',
'--numeric-ids',
'--perms',
'--owner',
'--group',
'-D',
'--times',
'--links',
'--hard-links',
'--delete',
'--delete-excluded',
'--one-file-system',
'--partial',
'--log-format=log: %o %i %B %8U,%8G %9l %f%L',
'--stats',
'-z',
'-v'
];
Now I took a look at BackupPC and was going to the last backup
(through "Browse backups"). I see the last succesful backup from today.
But when I compare the files in the backup with the ones existing on
my MacOS there is a hughe difference!
There are so many additional file in the backup which I already
deleted weeks, if not months ago!
This is the list of the current backups until the last full one:
669
<http://backuppc41.knebb.de/backuppc/index.cgi?action=browse&host=cvoelker&num=669>
incr yes 1 2023-11-13 23:17 72.8 0.9
668
<http://backuppc41.knebb.de/backuppc/index.cgi?action=browse&host=cvoelker&num=668>
incr no 1 2023-11-12 20:06 205.0 2.0
667
<http://backuppc41.knebb.de/backuppc/index.cgi?action=browse&host=cvoelker&num=667>
incr no 1 2023-11-10 23:03 90.0 3.9
666
<http://backuppc41.knebb.de/backuppc/index.cgi?action=browse&host=cvoelker&num=666>
full yes 0 2023-11-08 23:49 710.0 5.8
Checking my local directory I do not see many of the files (As I have
them deleted months ago!).
Why do I have files in my backupc which do not exist on the backed up
client?
Thanks for ideas!
/KNEBB
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project:https://backuppc.github.io/backuppc/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project:https://backuppc.github.io/backuppc/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
[BackupPC-users] Outdated Files in Backup?
Hi,
I have BackupPC 4.x running on a Debian system. Works like a champ since
years now.
One of my clients is an Apple Mac with current up-to-date MacOS. rsync
is installed:
username@macos Documents % rsync --version
rsync version 2.6.9 protocol version 29
Copyright (C) 1996-2006 by Andrew Tridgell, Wayne Davison, and others.
So far it works fine. It does the backupsand all is good. I am backing
up the Users-Folder as "$RsyncShareName": "/Users/username" and excluded
some unneeded directories.
See macos.pl:
$Conf{BackupPCNightlyPeriod} = 1;
$Conf{RsyncShareName} = [
'/Users/username'
];
$Conf{RsyncSshArgs} = [
'-e',
'$sshPath -l username'
];
$Conf{BackupFilesExclude} = {
'/Users/username/.Trash' => [
''
],
'/Users/username/Library/Accounts' => [
''
],
'/Users/username/Library/Application Support' => [
''
],
'/Users/username/Library/Assistant' => [
''
],
'/Users/username/Library/Autosave Information' => [
''
],
'/Users/username/Library/Biome' => [
''
],
'/Users/username/Library/Caches' => [
''
],
'/Users/username/Library/Containers' => [
''
],
'/Users/username/Library/Cookies' => [
''
],
'/Users/username/Library/CoreFollowUps' => [
''
],
'/Users/username/Library/Group Containers' => [
''
],
'/Users/username/Library/HomeKit' => [
''
]
};
$Conf{RsyncArgs} = [
'--super',
'--recursive',
'--numeric-ids',
'--perms',
'--owner',
'--group',
'-D',
'--times',
'--links',
'--hard-links',
'--delete',
'--delete-excluded',
'--one-file-system',
'--partial',
'--log-format=log: %o %i %B %8U,%8G %9l %f%L',
'--stats',
'-z',
'-v'
];
Now I took a look at BackupPC and was going to the last backup (through
"Browse backups"). I see the last succesful backup from today.
But when I compare the files in the backup with the ones existing on my
MacOS there is a hughe difference!
There are so many additional file in the backup which I already deleted
weeks, if not months ago!
This is the list of the current backups until the last full one:
669
<http://backuppc41.knebb.de/backuppc/index.cgi?action=browse&host=cvoelker&num=669>
incr yes 1 2023-11-13 23:17 72.8 0.9
668
<http://backuppc41.knebb.de/backuppc/index.cgi?action=browse&host=cvoelker&num=668>
incr no 1 2023-11-12 20:06 205.0 2.0
667
<http://backuppc41.knebb.de/backuppc/index.cgi?action=browse&host=cvoelker&num=667>
incr no 1 2023-11-10 23:03 90.0 3.9
666
<http://backuppc41.knebb.de/backuppc/index.cgi?action=browse&host=cvoelker&num=666>
full yes 0 2023-11-08 23:49 710.0 5.8
Checking my local directory I do not see many of the files (As I have
them deleted months ago!).
Why do I have files in my backupc which do not exist on the backed up
client?
Thanks for ideas!
/KNEBB
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] restore a backup from command line
Hi there, On Fri, 3 Nov 2023, Ghislain Adnet wrote: ? Well i saw the exemples but they seems to create tar on the backup server then moving the tar then untar it. ? unfortunatly I do not have the disk space for that nor on the backup server nor on the destination server :( ?I would like to do a restore the same way i do it in the web interface to automate this but seems there is not a tool for it. I think what you're looking for is 'BackupPC_tarCreate'. You will find it mentioned in both the BackupPC FAQ and in the list archives (at least eight hundred times by my quick count this evening). -- 73, Ged. ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] restore a backup from command line
On 11/3/2023 6:23 AM, Ghislain Adnet wrote: Evidently "BackupPC_restore" is to be used only through the CGI. Follow the link to documentation from within the CGI and once there look for the title "Command-line restore options" where you will find the recommended commands and a some examples usages. thanks, Well i saw the exemples but they seems to create tar on the backup server then moving the tar then untar it. unfortunatly I do not have the disk space for that nor on the backup server nor on the destination server :( I would like to do a restore the same way i do it in the web interface to automate this but seems there is not a tool for it. It's not the cleanest solution, but since BackupPC_tarCreate writes to stdout, you can stream the tar file over the network via ssh and then extract it on the remote machine without ever saving the tar file on either server. (untested) BackupPC_tarCreate ... | ssh user@destination 'cat | tar -x -C /destinationdir' You can do the same thing with BackupPC_zipCreate and use tar -xz to extract on the other side if you want compression other than what is provided by ssh. You can also pipe the tar/zip data through pv if you want some progress information on the copy. (also untested) BackupPC_zipCreate ... | pv | ssh user@destination 'cat | tar -xz -C /destinationdir' -- Bowie___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] restore a backup from command line
Hi there,
On Tue, 31 Oct 2023, Ghislain Adnet wrote:
?i was wondering if there was any way to restore from the command
line. I need to restore all /home/ daily to another server
?I was trying to use
/usr/share/backuppc/bin/BackupPC_restore
?but there is no docs and it fails for me as i try various things like
[~]: sudo -u backuppc /usr/share/backuppc/bin/BackupPC_restore 127.0.0.1
myclientserver.com? /etc/vim/vimrc
/usr/share/backuppc/bin/BackupPC_restore: bad reqFileName (arg #3):
/etc/vim/vimrc
usage: /usr/share/backuppc/bin/BackupPC_restore [-p] [-v] [-m]
any idea if this is possible ?
I'm sure it's possible, but not like that. :(
If I look at the code in BackupPC_restore (it's at line 72 in my
version but that's from 2020, yours may be different) I see
if ( $ARGV[2] !~ /^([\w.]+)$/ ) {
print("$0: bad reqFileName (arg #3): $ARGV[2]\n");
exit(1);
}
This tells me that you can't have anything other than a "word character"
or a dot in the third argument. The '/' character isn't allowed.
$ perl -e '$word = "hello"; if( $word =~ /^([\w\.]+)$/ ) { print "matches\n"; } else {
print "does not match\n"; }'
matches
$ perl -e '$word = "hello.world"; if( $word =~ /^([\w\.]+)$/ ) { print "matches\n"; }
else { print "does not match\n"; }'
matches
$ perl -e '$word = "hello/world"; if( $word =~ /^([\w\.]+)$/ ) { print "matches\n"; }
else { print "does not match\n"; }'
does not match
$
I suspect you might find an answer more to your liking in the mailing
list archives.
--
73,
Ged.
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Deleting backups does not free up disk space
Hi there, On Thu, 26 Oct 2023, Tobias wrote: ... in another installation, we have backups of no longer existing hosts that cannot be simply deleted. ... If I understand correctly, and you mean that these cannot be deleted because they are your only copies of the data from those hosts, then that means that they are *not* backups. They're at risk of loss if they're the only copies. It sounds to me like you're trying to fit several quarts into a pint pot, and some of them aren't even of the right beverage. BackupPC is a backup system. If you want an archiving system, don't try to force BackupPC to be that system. That's not what it was designed to be. Your immediate problem seems to be that a full backup is copying a lot of files which shouldn't have been in the backups in the first place. To get around that, you could simply call the problem machine(s) by a different name as far as BackupPC is concerned, set up the exclusions, and start those backups from backup number one. Then BPC won't copy the cruft which you don't need from the previous backup (which as has been explained is how BackupPC V4 works and there's not much that you can do about that). Deduplication and compression will still happen, unless you do something wilful to prevent it. You can delete the old backups in their entirety at your leisure when you have the new ones. Obviously the main problem is that you need more backup storage space. -- 73, Ged. ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Best Practice to Speedup RSYNC
No not easily, no. The iSCSI disk is from a NAS with 16TB of storage (as was the NFS share) and BackupPC doesn't currently run on the NAS. On 29/09/2023 16:35, Les Mikesell wrote: On Fri, Sep 29, 2023 at 1:46 AM David While via BackupPC-users wrote: Hi Yes I believe that could be the cause. I did some tests with the storage mounted as NFS and then mounted as an ISCSI disk. The ISCSI disk was considerably faster. Can you run the backup against the host of the NFS drive instead of another host mounting it over the network? The way rsync works is that the host where it runs has to read the whole contents of each file in order to use the block checksum algorithm to decide what differences to send. If the drive is mounted over NFS, that complete read will be over a network before it can decide how to reduce network use sending to the rsync partner. ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Best Practice to Speedup RSYNC
Hi
Yes I believe that could be the cause. I did some tests with the storage
mounted as NFS and then mounted as an ISCSI disk.
The ISCSI disk was considerably faster.
David While
On 29/09/2023 00:05, Robert Trevellyan wrote:
"The storage is connected via NFS."
^^^
I suspect this is the main bottleneck.
Robert Trevellyan
On Thu, Sep 28, 2023 at 5:11 PM wrote:
Hi,
i use BackupPC on Linux with rsync since a while. One Task as a full
backup with 1146496 files and 191547.2MiB of size. This takes
781.5 mins
of time. The CompressLevel is setup to 9. The storage is connected
via
NFS. I use latest BackupPC Version on Debian x64.
I asked myself, if there is some potential to boost it up. Its also
seems that rsync uses single cpu instead of multi-cpu. May its an
option
to split the job in smaller jobs so more rsync processes can pallel.
Perhaps i should lower the compression level. But i got no idea if
that
makes a difference.
What are youre experiences and tipps to maby boost rsyn backups?
Thanks all
Taste
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project:https://backuppc.github.io/backuppc/___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
[BackupPC-users] Is there any way to dequeue (future backups/deletes) without stopping current one?
Sometimes I have several things queued that I realize I need to cancel but I don't want to cancel the current job. Is that possible? ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
[BackupPC-users] BUG: When backups fail, the last successful backup number keeps incrementing
I have been encountering this bug for the longest time and have never been able to fully nail down the circumstances that trigger it. Sometimes when backups fail, the last good (incremental) backup number gets continually incremented, so that after each failed (hourly) backup attempt, this last good (incremental) backup sees its number increased, leaving a growing numerical gap between it and the penultimate (next to last) good backup. For example, suppose you start out with backups: '0, 1, 2, 3', where '0' is filled and '1, 2, 3' are incremental. Then, after the first failed backup, you will have '0, 1, 2, 4', then '0, 1, 2, 5', then '0, 1, 2, 6', etc. The corresponding LOG shows the following: 2023-09-05 17:00:01 Removing empty backup #3 2023-09-05 17:00:01 BackupPC_backupDelete: removing #3 2023-09-05 17:00:01 BackupPC_backupDelete: Merge into backup 2 2023-09-05 17:00:09 BackupPC_refCountUpdate: host host1 got 0 errors (took 8 secs) 2023-09-05 17:00:09 Finished BackupPC_backupDelete, status = 0 (running time: 8 sec) 2023-09-05 18:00:01 DumpPreUserCmd returned error status 65280... exiting 2023-09-05 18:00:01 Removing empty backup #4 2023-09-05 18:00:01 BackupPC_backupDelete: removing #4 2023-09-05 18:00:01 BackupPC_backupDelete: Merge into backup 2 2023-09-05 18:00:01 BackupPC_refCountUpdate: host host1 got 0 errors (took 0 secs) 2023-09-05 18:00:01 Finished BackupPC_backupDelete, status = 0 (running time: 0 sec) 2023-09-05 19:00:00 DumpPreUserCmd returned error status 65280... exiting 2023-09-05 19:00:00 Removing empty backup #5 2023-09-05 19:00:00 BackupPC_backupDelete: removing #5 2023-09-05 19:00:00 BackupPC_backupDelete: Merge into backup 2 2023-09-05 19:00:01 BackupPC_refCountUpdate: host host1 got 0 errors (took 0 secs) 2023-09-05 19:00:01 Finished BackupPC_backupDelete, status = 0 (running time: 1 sec) I think this is due to an error in how 'reverse deltas' are unwound when a failure occurs. Vaguely, I think when a new incremental backup is started (following a previously good incremental backup), the last backup number is initially incremented as that becomes the tentative new "filled" backup. If it is successful, then the last backup with the incremented number remains filled and the previously good incremental backup is created using reverse deltas. If the backup fails, then this should all be unwound. For some reason, with SOME (but *not* ALL) types of backup failures, the tentative initial delta is not properly unwound. You can recreate this problem as follows: 1. Set up ssh keys for 'host1' and make sure that added to /etc/backuppc/.ssh/known_hosts 2. Create full backup sudo -u backuppc /usr/share/backuppc/bin/BackupPC_dump -f host1 3. Create first incremental backup sudo -u backuppc /usr/share/backuppc/bin/BackupPC_dump -i host1 4. Remove key for host1 from /etc/backuppc/.ssh/known_hosts (I think it will also work if known_hosts is not pingable) 5. Create second incremental backup sudo -u backuppc /usr/share/backuppc/bin/BackupPC_dump -i host1 > Are you sure you want to continue connecting (yes/no)? no IMPORTANT TO DECLINE THIS 6. Create third incremental backup sudo -u backuppc /usr/share/backuppc/bin/BackupPC_dump -i host1 > Are you sure you want to continue connecting (yes/no)? no IMPORTANT TO DECLINE THIS etc. You will see that the backup number of the first incremental backup is incremented each time, creating an increasing gap between the base full backup and the first incremental backup. ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Identifying rsync Error
Nevermind.
I figured out I am having a VPn isssue which drops the VPN connection
every now and then. So BackupPC start the backup but in the middle of it
the connection drops which causes the error.
I am going to troubleshoot VPN now.
Sorry for inconvinience!
/KNEBB
Am 04.09.23 um 08:29 schrieb Christian Völker via BackupPC-users:
Hi all,
I use BackupPC since years and it is such a great thing! I am used to
some well known issues but currently I have one where I can not
identify the reason.
I have a couple of remote hosts (VPN'd) which I am backing up. A
couple of days I had some issues with the DNS and there fore the ssh
login complained about the wrong ssh keys. Which is fine because
BackupPC really tried to back up the wrong host. The log file tells me
this:
=
@@@
@WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED! @
@@@
IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY!
Someone could be eavesdropping on you right now (man-in-the-middle attack)!
It is also possible that a host key has just been changed.
The fingerprint for the ECDSA key sent by the remote host is
SHA256:ewAnfnr***sV0Y6c.
Please contact your system administrator.
Add correct host key in /var/lib/backuppc/.ssh/known_hosts to get rid of this
message.
Offending ECDSA key in /var/lib/backuppc/.ssh/known_hosts:3
[ skipped 2 lines ]
Host key for remote1 has changed and you have requested strict checking.
Host key verification failed.
rsync_bpc: connection unexpectedly closed (0 bytes received so far) [Receiver]
Done: 0 errors, 0 filesExist, 0 sizeExist, 0 sizeExistComp, 0 filesTotal, 0
sizeTotal, 0 filesNew, 0 sizeNew, 0 sizeNewComp, 255532 inode
==
DNS issue has been fixed (for sure!) but since then the two remote
hosts refuse to get backed up. I did:
* su - backuppc
* ssh root@remote1 #went fine with no complains about a wrong key
* Removed the key through "ssh-keygen" followed by the above ssh
command. Went fine, save the key again.
However, I am still having issues with this host. This is the last
logfile I am getting:
==
2023-09-04 08:01:32 full backup started for directory /
2023-09-04 08:18:01 Got fatal error during xfer (rsync error: unexplained error
(code 255) at io.c(226) [generator=3.1.3.0])
2023-09-04 08:18:06 Backup aborted (rsync error: unexplained error (code 255)
at io.c(226) [generator=3.1.3.0])
2023-09-04 08:18:06 Removing prior partial backup #643
2023-09-04 08:18:06 BackupPC_backupDelete: removing #643
2023-09-04 08:18:06 BackupPC_backupDelete: Merge into backup 599
2023-09-04 08:18:08 BackupPC_refCountUpdate: hostbackuppc42
<http://backuppc41.knebb.de/backuppc/index.cgi?host=backuppc42> got 0 errors
(took 2 secs)
2023-09-04 08:18:08 Finished BackupPC_backupDelete, status = 0 (running time: 2
sec)
==
My ${RsyncArgs} has added the "-v" parameter for this host. And besides of the
DNS issue I really did not change anything on thei targets.
Anyone having ideas for further troubleshooting?
Thanks!
/KNEBB
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project:https://backuppc.github.io/backuppc/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
[BackupPC-users] Identifying rsync Error
Hi all,
I use BackupPC since years and it is such a great thing! I am used to
some well known issues but currently I have one where I can not identify
the reason.
I have a couple of remote hosts (VPN'd) which I am backing up. A couple
of days I had some issues with the DNS and there fore the ssh login
complained about the wrong ssh keys. Which is fine because BackupPC
really tried to back up the wrong host. The log file tells me this:
=
@@@
@WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED! @
@@@
IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY!
Someone could be eavesdropping on you right now (man-in-the-middle attack)!
It is also possible that a host key has just been changed.
The fingerprint for the ECDSA key sent by the remote host is
SHA256:ewAnfnr***sV0Y6c.
Please contact your system administrator.
Add correct host key in /var/lib/backuppc/.ssh/known_hosts to get rid of this
message.
Offending ECDSA key in /var/lib/backuppc/.ssh/known_hosts:3
[ skipped 2 lines ]
Host key for remote1 has changed and you have requested strict checking.
Host key verification failed.
rsync_bpc: connection unexpectedly closed (0 bytes received so far) [Receiver]
Done: 0 errors, 0 filesExist, 0 sizeExist, 0 sizeExistComp, 0 filesTotal, 0
sizeTotal, 0 filesNew, 0 sizeNew, 0 sizeNewComp, 255532 inode
==
DNS issue has been fixed (for sure!) but since then the two remote hosts
refuse to get backed up. I did:
* su - backuppc
* ssh root@remote1 #went fine with no complains about a wrong key
* Removed the key through "ssh-keygen" followed by the above ssh
command. Went fine, save the key again.
However, I am still having issues with this host. This is the last
logfile I am getting:
==
2023-09-04 08:01:32 full backup started for directory /
2023-09-04 08:18:01 Got fatal error during xfer (rsync error: unexplained error
(code 255) at io.c(226) [generator=3.1.3.0])
2023-09-04 08:18:06 Backup aborted (rsync error: unexplained error (code 255)
at io.c(226) [generator=3.1.3.0])
2023-09-04 08:18:06 Removing prior partial backup #643
2023-09-04 08:18:06 BackupPC_backupDelete: removing #643
2023-09-04 08:18:06 BackupPC_backupDelete: Merge into backup 599
2023-09-04 08:18:08 BackupPC_refCountUpdate: hostbackuppc42
<http://backuppc41.knebb.de/backuppc/index.cgi?host=backuppc42> got 0 errors
(took 2 secs)
2023-09-04 08:18:08 Finished BackupPC_backupDelete, status = 0 (running time: 2
sec)
==
My ${RsyncArgs} has added the "-v" parameter for this host. And besides of the
DNS issue I really did not change anything on thei targets.
Anyone having ideas for further troubleshooting?
Thanks!
/KNEBB
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] ssh+rsync and known_hosts
>On 7/22/23 11:59 AM, Kenneth Porter wrote: >> I'm setting up some Raspberry Pis and I set up BackupPC to back them up >> using ssh+rsync. I installed the key in ~backuppc/.ssh/authorized_keys but >> the initial backup was still failing. So I tried manually ssh'ing into the >> Pi and discovered I was hitting the question to add the Pi to known_hosts. I >> don't see this mentioned in the documentation. I'm not sure where it would >> even go, but I wanted to mention it as I'll likely forget this a year from >> now. > > I have learned from past experience to login to the backuppc user and SSH to the remote client using the client host name from the client configuration file. This ensures I have everything set up properly and also adds the client to known_hosts. ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Ever-growing backups
Hi there,
On Wed, 23 Aug 2023, Kirby wrote:
I am running BackupPC-4.4.0-1.el8.x86_64 on an up-to-date CentOS Stream
release 8 system. This system has been runing since early 2015 with
updates, both hardware and software. Things work wonderfully, one might
say too good. It seems old backups are not going away.
I have the following in my config.pl -
$Conf{FullPeriod} = '6.97';
$Conf{FullKeepCnt} = [
4, 0, 3, 0, 2, 0, 1
];
My understanding is that this should keep at most 10 backups distributed
across the last 64 weeks (448 days). Instead a I have hosts with 60 full
weekly backups going back over 500 days. Am I misunderstanding the
FullKeepCnt option?
I don't know if this is your issue, but in config.pl did you see this?
8<--
# There are two reasons you will want a non-zero $Conf{FillCycle} setting
# when you are only doing incrementals:
#
# - a filled backup is a starting point for merging deltas when you restore
# or view backups. So having periodic filled backups makes it more
# efficient to view or restore older backups.
#
# - more importantly, in V4+, deleting backups is done based on Fill/Unfilled,
# not whether the original backup was full/incremental. If there aren't any
# filled backups (other than the most recent), then the $Conf{FullKeepCnt}
# and related settings won't have any effect.
8<--
--
73,
Ged.
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
[BackupPC-users] File has vanised (weird path)
Folks, I am running BPC 4.4.0 across 57 pretty much identical hosts (all Debian) and it's all working great, except today I noticed that on 4 of those hosts, there are XferErros, and they are all along the following lines: ``` file has vanished: "/var/lib/ntp/f%2f/fvar/flib/fntp/attrib" ``` This is weird. Such a file should not exist either on the client, nor on the server. Hast anyone encountered this, and can offer an explanation of what's going on? Thanks, -- martin krafft | https://matrix.to/#/#madduck:madduck.net i welcome your constructive criticism and corrections. spamtraps: madduck.bo...@madduck.net ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] A Perl error?
Hi there,
On Sun, 13 Aug 2023, Jan Stransky wrote:
On Sun, 23 Jul 2023, G.W. Haywood via BackupPC-users wrote:
On Sun, 23 Jul 2023, Jan Stransky wrote:
I started to notice following error. Does any one have any ideas? It
seems to be more related to configure.pl genrerator, rather than the
actual configuration.
Can't use string ("1") as a HASH ref while "strict refs" in use at
configure.pl line 742.
...
What version of BackupPC are you using, and was it installed from a
package or did you install it manually for example from some tarball?
If the latter, please tell us what it was and where it came from.
I am actually not aware of doing any modifications. I run the BackupPC
in as a docker image, and the only thing I did was rebuild the image so
the underlaying system was updated. The BPC was running just fine by
that point. Of course, I cannot exclude a file corruption.
I am using this, but up-to-date Alpine (3.18):
https://github.com/adferrand/docker-backuppc.git
BackupPC is 4.4.0, BackupPC_XS 0.62 and Rsunc_bpc is 3.1.3.0
First off I've never run BackupPC on anything except bare metal. As
far as I can remember I haven't even tried to run it in a VM let alone
using Docker. You're using somebody else's docker installation and I
can imagine that things could go wrong which have nothing to do with
BackupPC itself. By using this form of installation you might be
making it easy to install BackupPC if it works, but I don't think it's
necessarily going to make it easy to troubleshoot things if it doesn't.
Looking at 'Dockerfile' in .../adferrand/docker-backuppc.git makes me
ask more questions than it answers for me.
You said "I started to notice" which says to me you've been using some
procedure on at least a semi-regular basis which did *not* produce the
error, and then, from some point onward, it did. If that's the case
please can you explain this procedure for us?
The configure.pl script is usually run only to install BackupPC, and I
wouldn't expect that anyone would run it routinely. For example it
doesn't even exist on my BackupPC server, as it's my usual practice to
deleted the source trees after running an installation. The script is
able to recognize some command-line arguments; presumably in your case
the script is being run by something from the github package which you
mentioned. Do you know how and with what arguments configure.pl ran?
Have you read the script's 'man' page and/or tried to run it yourself?
Did the script leave you with a log file? If so, it might help if we
can see it.
Please also show us the few lines around line 742 in your configure.pl
script. I'm not sure we can know what's there without duplicating
your setup, and that would be prohibitively time-consuming - unless
someone on the list happens to be using the same docker image and OS.
Did you check that BackupPC was not running before configure.pl ran?
--
73,
Ged.
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
[BackupPC-users] Off-site mirror
Hi
I used BackupPC since decades for a dozen of PC (Linux and Windows)
using rsync/tar through ssh. Some hosts are connected through ADSL
connection. It works perfectly well and fully fit my needs.
Recently I decided to duplicate backuppc data on a remote mini server
(OrangePi+2E + 1TB HDD). I created a script to rsync the cpool
directory separately (rsync spended too much time to compute diff
because of the low data rate link). It takes 2 months for the initial
replication! Anyway, it's done and incremental synchronization should
be done in less than an hour per day.
Now I want to start the BackupPc daemon on the replicated data to ease
backup access. So I need to avoid any nightly pool cleaning (it will
be done by my rsync script) and disable backup from any hosts. I use
this configuration settings:
$Conf{WakeupSchedule} = [];
$Conf{MaxBackupPCNightlyJobs} = 0;
$Conf{PoolSizeNightlyUpdatePeriod} = 0;
$Conf{PoolNightlyDigestCheckPercent} = 0;
$Conf{RefCntFsck} = 0;
$Conf{FullPeriod} = -1;
$Conf{BackupsDisable} = 2;
$Conf{EMailNotifyMinDays} = 365;
I'm confident with disabling host backup feature but I'm not sure
those settings fully deactivate nightly pool cleaning. Can someone
correct it ? Thanks in advance
I added my synchronization script and the associated crontable. Every
thing is running on same account (backuppc user).
Regards,
Laurent Mazet
Synchronization script:
--8<--
#!/bin/sh
HOST=mainserver.mydomain.org
RUN=$HOME/sync_backuppc.run
LOG=$HOME/sync_backuppc.log
BACKUP=/var/lib/backuppc
# check disk mountage
mount | grep -q 'on /mnt/volume type' || { echo disk not mounted; exit 1; }
# don't kill old binary
[ -f "$RUN" ] && pid=$(cat $RUN)
if [ "$pid" ]; then
pids=$(pstree -a -p $pid | awk '{sub(/,/, " "); printf("%s%s",
sep, $2); sep=" "}')
#[ "$pids" ] && kill -TERM $pids
if [ "$pids" ]; then
echo "process $pids already running at $(date -R)" >> $LOG
exit 0
fi
fi
echo $$ > $RUN
echo "process $$ starts at $(date -R)" >> $LOG
# sync configuration
rsync -qa $HOST:/etc/backuppc4/hosts /etc/backuppc/
rsync -qa $HOST:/etc/backuppc4/htpasswd /etc/backuppc/
rsync -qa --delete $HOST:/etc/backuppc4/pc/\*.pl /etc/backuppc/pc/
# sync cpool
for d in $(ssh $HOST find $BACKUP/cpool/ -mindepth 2 -maxdepth 2 -type d); do
[ -d "$d" ] || mkdir -p $d
rsync -qa --delete $HOST:$d $d && sync
done
# sync files
rsync -qa --delete $HOST:$BACKUP/pc/ $BACKUP/pc/ && sync
rsync -qa --delete $HOST:$BACKUP/pool/ $BACKUP/pool/ && sync
# clean
rm -f $RUN
echo "process $$ ends at $(date -R)" >> $LOG
-->8--
Associated crontable:
--8<--
31 1 * * * /bin/systemctl stop backuppc; $HOME/bin/sync_backuppc;
/bin/systemctl start backuppc
-->8--
--
Dr. Laurent Mazet -=- "Use the source, Luke" -=- ma...@softndesign.org
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Why not use Backuppc to backup server systems?
Hi there, On Thu, 10 Aug 2023, Les Mikesell wrote: On Wed, Aug 9, 2023 at 8:42?AM W?chtler, Jan wrote: ... Is there any reason why this list does not include Server systems? I am using it for years now to backup (web/application/database)-server data and configuration, is there any reason why I should not do so? Databases can be a problem ... Most of our application of BackupPC is for what you could describe as "user data". Mainly things in home directories. But I tend to back up /etc/ on everything with BackupPC, sometimes also /usr/local/etc/ and occasionally the odd subdirectory in /var/. People sometimes do some pretty strange things in /opt/. The historical information for files available from BackupPC can prove useful for almost anything. For database *data* I don't let BackupPC get involved. The snapshot utility for the database creates a file, and that file is transferred by rsync, all from a crontab entry, to remote storage. The file won't benefit from BackupPC's deduplication, and nobody wants an old copy of a busy database so BackupPC's aged versions are no use either. For similar reasons, mail server data likely won't benefit much from the BackupPC approach. Web servers might - much will depend on the design and application. Name servers will range from our tiny setups with just a few domains to ISP setups with many millions, so each is going to need to be studied as a special case, as I guess will most other servers. We have a virus scanning server; we don't back it up, since everything on it is downloaded from somewhere else. Of all our servers it's probably the one most at risk. If it gets compromised (it never has been) it would just be wiped and reinstalled. ... bootable image ... integrate that into backuppc ... My head hurts. :) -- 73, Ged. ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Why not use Backuppc to backup server systems?
Yep and we're even using the archiving feature to put it onto tape 😁 On 8/9/2023 3:48 PM, Niels Kristian Jensen via BackupPC-users wrote: I've been using it for servers as well for many years. rsync via ssh Seems good for the purpose. BR. Niels Kristian On 2023-08-09 15:24, Wächtler wrote: The Overview description of backuppc states that it is a “ .. system for backing up Unix, Linux, WinXX, and MacOSX PCs, desktops and laptops …” Is there any reason why this list does not include Server systems? I am using it for years now to backup (web/application/database)-server data and configuration, is there any reason why I should not do so? ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] [Sender Auth Unverified] Why not use Backuppc to backup server systems?
I'm speaking above my pay grade but, it's probably accurate to say that BackupPC is capable of backing up any device that supports rsync, rsyncd, tar, smb or ftp protocols. The language in the documentation probably doesn't specifically reference servers as that may imply SLAs and uptime guarantees that a volunteer project cannot guarantee. Its shareware software, meaning that you take responsibility for its use in yours or a client's environment. Paul Herron > On Aug 9, 2023, at 9:41 AM, Wächtler, Jan wrote: > > > The Overview description of backuppc states that it is a > “ .. system for backing up Unix, Linux, WinXX, and MacOSX PCs, desktops and > laptops …” > > Is there any reason why this list does not include Server systems? > I am using it for years now to backup (web/application/database)-server data > and configuration, is there any reason why I should not do so? > > > > > > > > > > > > > > Jan Wächtler • Senior Consultant > O +49 (89) 1894743-32 > > amasol GmbH > Claudius-Keller-Straße 3 B • 81669 • München • Deutschland > Geschäftsführung: Stefan Deml, Thomas Dirsch, Frank Jahn > Amtsgericht München HRB 282168, Sitz der Gesellschaft München > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:https://github.com/backuppc/backuppc/wiki > Project: https://backuppc.github.io/backuppc/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Why not use Backuppc to backup server systems?
I've been using it for servers as well for many years. rsync via ssh Seems good for the purpose. BR. Niels Kristian On 2023-08-09 15:24, Wächtler wrote: > The Overview description of backuppc states that it is a > > " .. system for backing up Unix, Linux, WinXX, and MacOSX PCs, desktops and > laptops …" > > Is there any reason why this list does not include Server systems? > > I am using it for years now to backup (web/application/database)-server data > and configuration, is there any reason why I should not do so? > > Jan Wächtler * Senior Consultant > O +49 (89) 1894743-32 > > amasol GmbH > Claudius-Keller-Straße 3 B * 81669 * München * Deutschland > Geschäftsführung: Stefan Deml, Thomas Dirsch, Frank Jahn > Amtsgericht München HRB 282168, Sitz der Gesellschaft München > > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:https://github.com/backuppc/backuppc/wiki > Project: https://backuppc.github.io/backuppc/ -- Spejd er sejt! Det Danske Spejderkorps ------___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backup Share Content
To be clear, you don't really need to add '--delete' as it is one of the *default* parameters and the comments in config.pl even warns you not to do so. Rather, please don't delete parameters that you don't understand or intend :) backuppc--- via BackupPC-users wrote at about 21:00:25 +0300 on Saturday, July 29, 2023: > jbk wrote: > > > I'm wondering if I need to add a "delete" argument to the > > rsync line but am not sure of the consequences. > > Yes, you do need to add --delete. See e.g. here for the default rsync > parameters: > https://github.com/backuppc/backuppc/blob/master/conf/config.pl#L1288 > > BR, > Fabian > > > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:https://github.com/backuppc/backuppc/wiki > Project: https://backuppc.github.io/backuppc/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backup Share Content
You are right, jbk is mistaken. It boggles my mind that often people's first reaction to an error is to assume that a stable and well-tested program is fundamentally broken (e.g., doesn't do actual backups but rather just adds and doesn't delete files). The first, most appropriate, and most humble response should be "what am I doing wrong?" or "why don't I understand how the program works?" I can assure you that in my experience, user error (as is the case here) is the far more likely situation... Paul Fox wrote at about 11:50:17 -0400 on Saturday, July 29, 2023: > jbk wrote: > >BackupPC-4.4.0-9.el9.x86_64 > > > >I see now this is a bigger problem than I thought initially. I thought > >that each backup # was a restore point to the state of the share at the > >time of that backup but instead it is an accumulation of all backups > w/o > >reflecting any of the deletions of files now non existent on the source > > Surely that's not correct. If I do a restore of a specific backup, > I'd expect to get exactly the files that were present when that backup > was run. If I wanted files that had been deleted before that backup > was run, I would understand that I'd need to restore them from a > previous backup. > > If this isn't the case, then I'm... shocked, I guess. > > paul > =-- > paul fox, p...@foxharp.boston.ma.us (arlington, ma, where it's 85.1 degrees) > > > > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki: https://github.com/backuppc/backuppc/wiki > Project: https://backuppc.github.io/backuppc/ _______ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Backup Share Content
Before casting mistaken aspersions about how backuppc works, why did
you delete the '--delete' line in the default rsync args?
>From stock config.pl for backuppc 4.x
NOTE how the comment says "DO NOT EDIT (emphasis added) the first set
unless you have a good understanding of rsync options.
#
# Arguments to rsync for backup. Do not edit the first set unless you
# have a good understanding of rsync options.
#
$Conf{RsyncArgs} = [
'--super',
'--recursive',
'--protect-args',
'--numeric-ids',
'--perms',
'--owner',
'--group',
'-D',
'--times',
'--links',
'--hard-links',
'--delete',
'--delete-excluded',
'--one-file-system',
'--partial',
'--log-format=log: %o %i %B %8U,%8G %9l %f%L',
'--stats',
#
# Add additional arguments here, for example --acls or --xattrs
# if all the clients support them.
#
#'--acls',
#'--xattrs',
];
jbk wrote at about 10:08:30 -0400 on Saturday, July 29, 2023:
> BackupPC-4.4.0-9.el9.x86_64
>
> I see now this is a bigger problem than I thought initially.
> I thought that each backup # was a restore point to the
> state of the share at the time of that backup but instead it
> is an accumulation of all backups w/o reflecting any of the
> deletions of files now non existent on the source machine. I
> had never browsed the backups to see if they were what I
> expected for one to one state of the current source. I've
> always used the default rsync args and now I think I need to
> modify them but I guess I'm really nave as to how backuppc
> is working.
> Some historical background. I've been using BackupPC for at
> least 15 years and migrated my backups from version 3. to
> version 4 a year and a half ago when I installed Rocky8 but
> I'm now running Rocky9 on the server. My logs, error and
> otherwise are not showing any backup issues.
>
> Here are a few lines from a recent backup of one of my
> machines xferlogs to illustrate the current rsync arguments
> in use. The full list of includes/excludes has been
> truncated. Note that the pasted lines don't wrap, at least
> not for me in my email client.
>
> #####
>
> XferLOG file /var/lib/BackupPC//pc/xjbk7/XferLOG.64.z created 2023-07-25
> 15:45:31
> Backup prep: type = full, case = 3, inPlace = 1, doDuplicate = 1, newBkupNum
> = 64, newBkupIdx = 3, lastBkupNum = , lastBkupIdx = (FillCycle = 0,
> noFillCnt = 0)
> Executing /usr/share/BackupPC/bin/BackupPC_backupDuplicate -m -h xjbk7
> Xfer PIDs are now 540945
> Copying backup #63 to #64
> Xfer PIDs are now 540946,540945
> BackupPC_refCountUpdate: host xjbk7 got 0 errors (took 2 secs)
> Xfer PIDs are now 540945
> BackupPC_backupDuplicate: got 0 errors and 0 file open errors
> Finished BackupPC_backupDuplicate (running time: 7 sec)
> Running: /usr/bin/rsync_bpc --bpc-top-dir /var/lib/BackupPC/ --bpc-host-name
> xjbk7 --bpc-share-name / --bpc-bkup-num 64 --bpc-bkup-comp 3
> --bpc-bkup-prevnum -1 --bpc-bkup-prevcomp -1 --bpc-bkup-inode0 121320
> --bpc-log-level 1 --bpc-attrib-new -e /usr/bin/ssh\ -l\ backuppc\ \
> --rsync-path=/usr/bin/sudo\ /usr/bin/rsync --numeric-ids --perms --owner
> --group -D --links --hard-links --times --block-size=2048 --recursive
> --one-file-system --checksum --timeout=72000 --include=/boot
>
> #
>
> I'm wondering if I need to add a "delete" argument to the
> rsync line but am not sure of the consequences.
>
> What I want is that for say backup #32 that a restore of
> that backup would be just the current state of the files on
> that machine at the time of backup and backup #31 would be a
> reflection of the share state at the time of that prior backup.
>
> jbk
>
> On 7/26/23 20:36, jbk wrote:
> > On one of my machine shares I did some file consolidation
> > that involved creating a new top level directory and
> > moving files from adjacent top level directories into sub
> > directories under the newly created directory I then
> > deleted those other empty top level directories.
> > Backuppc ran a couple days later a incremental backup, and
> > in this backup there was the new directory with sub
> > directories and files I had moved as well as the old and
> > no longer existing top level directories and files. I
> > waited till the next nightly ran and then checked again
> > and the deleted directories and files were still present.
&
Re: [BackupPC-users] Backup Share Content
jbk wrote: > I'm wondering if I need to add a "delete" argument to the > rsync line but am not sure of the consequences. Yes, you do need to add --delete. See e.g. here for the default rsync parameters: https://github.com/backuppc/backuppc/blob/master/conf/config.pl#L1288 BR, Fabian ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] Cant Backup Mount Point
By default, the RsyncArgs for BPC4 includes --one-file-system, which tells it not to descend into mounted filesystems. To include other filesystems in your backups, you can either add a second "share" to the machine for /var/files so that it's explicitly backed up, or you can remove --one-file-system from RsyncArgs - but note that, if you remove --one-file-system, then you'll probably need to add exclude rules for whatever virtual filesystems you might have mounted. (e.g., /dev, /run, any nfs or samba mounts...) On 7/23/23 22:06, kont...@taste-of-it.de wrote: Hi, i use BPC 4.4.0 with rsync for a linux machine. I mounted via fstab a second sdc1 drive at /var/files/, but this folder isnt backuped. I see in the backup foldertree /var/files but its empty. I have no exclusion for /var/files, or /var/. I assume there is a build in setting for non root disks, but i cant find a solution. Has anybody an idea? thx Taste ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] ssh+rsync and known_hosts
Paul Fox wrote at about 12:46:18 -0400 on Saturday, July 22, 2023: > Kenneth Porter wrote: > > I'm setting up some Raspberry Pis and I set up BackupPC to back them up > > using ssh+rsync. I installed the key in ~backuppc/.ssh/authorized_keys > but > > the initial backup was still failing. > > Unless things have changed (and they might have, but I still do it > this way), then the public key needs to go into /root/.ssh/authorized_keys. > Backuppc (on your backuppc server) needs root access to the client in > order to be able to read all of the files it needs. (You could use a > different user id on the client if you're sure that user can read all > the files which need to be backed up.) On my Linux machines (including RPis), I prefer to create a seaparate backuppc client account and then give it the necessary restricted privileges using sudo. For example, I add this to my etc/sudoers file on each relevant Linux client: #BackupPC #Don't require tty for user 'backuppcClient' Defaults:backuppcClient !requiretty #Allow user 'backuppcClient' to run sudo rsync to avoid need for ssh root@localhost: #Note for rsync < 3.1.x, string to sender can be either: -slHogDtpAXrcxe.iLsf (full) or -slHogDtpAXrxe.iLsf (incremental) #backuppcClient ALL=NOPASSWD: /usr/bin/rsync --server --sender -slHogDtpAXrxe.iLsf, /usr/bin/rsync --server --sender -slHogDtpAXrcxe.iLsf #Note for rsync >= 4.x, string to sender can be either: -slHogDtpAXrcxe.iLsfxC (full) or -slHogDtpAXrxe.iLsfxC (incremental) backuppcClient ALL=NOPASSWD: /usr/bin/rsync --server --sender -slHogDtpAXrxe.iLsfxC, /usr/bin/rsync --server --sender -slHogDtpAXrcxe.iLsfxC While allowing root permissions to rsync is a pretty big security hole itself, it is a little less drastic than simply logging in as root. > > > So I tried manually ssh'ing into the > > Pi and discovered I was hitting the question to add the Pi to > known_hosts. > > I don't see this mentioned in the documentation. I'm not sure where it > > would even go, but I wanted to mention it as I'll likely forget this a > year > > from now. > > You should be trying to manually ssh from the backuppc account, and > you should be trying to become root on the client. I usually do this: > > sudo su - backuppc # take on the identity of backuppc > ssh root@clientmachine # log in to the client as root > id # verify identity on client > exit# leave the client > exit# resume your normal identity > If you use my approach, then you would: ssh backuppcClient@clientmachine > When you hit that "add to known hosts?" question from ssh, just answer > "yes". ssh will put the key in the right place (which is in > ~backuppc/ssh/known_hosts). Don't forget to exit out of both the ssh > and the "sudo su" after you've tested. > > paul > =-- > paul fox, p...@foxharp.boston.ma.us (arlington, ma, where it's 73.1 degrees) > > > > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:https://github.com/backuppc/backuppc/wiki > Project: https://backuppc.github.io/backuppc/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
Re: [BackupPC-users] A Perl error?
Hi there,
On Sun, 23 Jul 2023, Jan Stransky wrote:
I started to notice following error. Does any one have any ideas? It
seems to be more related to configure.pl genrerator, rather than the
actual configuration.
Cheers,
Jan
Can't use string ("1") as a HASH ref while "strict refs" in use at
configure.pl line 742.
Let's try that again.... :)
What version of BackupPC are you using, and was it installed from a
package or did you install it manually for example from some tarball?
If the latter, please tell us what it was and where it came from.
--
73,
Ged.
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
