[BackupPC-users] server maintenance: reconstruct missing poolCnt; find/delete references to missing pool files

Dear all, I have a rather small, private, non-$$$M-mission-critical instance of a BackupPC server running for years (that went from several 3.something through 4.0.0alpha3 to, recently, 4.0.0). After the 4.0.0 migration, I decided to run again some semi-manual maintenance (read: fsck and refCou

Re: [BackupPC-users] server maintenance: reconstruct missing poolCnt; find/delete references to missing pool files

st a stone... ;-) > Future backups with 4.0.0 (assuming the same file exists on the > client) will be updated with the correct digest, but the old backups > will still have the wrong one. The errors will go away when the > corresponding backups eventually expire. Okay. Just important to k

Re: [BackupPC-users] Backing up Windows 7 Pro, not enough permissions

Hi Michael, On 2017-05-15 06:32 PM, Holger Parplies wrote: > Hi, > > Michael Stowe wrote on 2017-05-15 09:58:08 -0500 [Re: [BackupPC-users] > Backing up Windows 7 Pro, not enough permissions]: >[...] >> At any rate, these reasons are why I personally switched to a >> combination of rsync and vsha

Re: [BackupPC-users] Backing up Windows 7 Pro, not enough permissions

tire blog - > very entertaining. > > Here's his BackupPC stuff: > > http://www.michaelstowe.com/backuppc/ Thanks a lot for the pointer; testing soon! Cheers, Alexander On 2017-05-17 09:07 AM, Alexander Kobel wrote: > Hi Michael, > > On 2017-05-15 06:32 PM, Holger P

Re: [BackupPC-users] Mark backup for premenent retention

On 11/28/2017 05:46 PM, Nick Bright wrote: On 11/28/2017 10:38 AM, Nick Bright wrote: Is there a way to mark a backup point (in this case, it's an incremental) so that the backup (and all backups it depends on) are preeminently retained? e.g. for a server that's failed or been decommissioned?

[BackupPC-users] Share exclude lists among different servers

Dear all, is there a good/clean/recommended way of sharing exclude lists between servers by decoupling them from the main config.pl file? I have a couple of servers whose configs differ just a bit, but enough that synchronizing changes becomes slightly annoying. Also, I'm sure that many peo

Re: [BackupPC-users] Bug in rsync_bpc --sparse?

Hi Craig, thanks for your swift reply. On 2017-12-15 05:17, Craig Barratt via BackupPC-users wrote: Unfortunately sparse files are not supported by rsync_bpc, and there are no plans to do so. Okay. Not a big impact for BackupPC's files, anyway - I just thought it's safe and no harm, but prov

Re: [BackupPC-users] 4.1.5 Error: Wrong user: my userid is 33, instead of 126(backuppc)

On 12/19/2017 05:07 PM, JC Francois wrote: Hi, I have been successfully running backuppc on an archlinux server for a couple of months. Since the last update of the arch package I am no longer able to access the web GUI. [...] Hi, are you sure that the backuppc package is the culprit, rather

Re: [BackupPC-users] ssh from an account without a shell

Hi Phil, are you sure that the correct SSH key is used for the connection? You mentioned that the command works as root, so I assume that the SSH key that you authorized for connecting to the client is root's rather than backuppc's. (Crucial line: "Permission denied (publickey,keyboard-inter

Re: [BackupPC-users] $host nice -n 19 sudo

Hi, On 07/10/2018 01:22 PM, Kbtest Testar wrote: Hi... I have installed latest version of Backuppc  4.2.1. and want to set $host nice -n 19 as i used in version 3 but can't find where to set it in version 4.2.1 any hints that can lead me to where to put this configuration is greatly apprici

Re: [BackupPC-users] BackupPC V4 and --checksum

Hi, On 2018-07-28 20:04, Guillermo Rozas wrote: Agreed, that is my situation. I'm reasonably sure of the system(UPS, Debian stable, ext4), but as my backups are relatively small (1can trade some extra hours of backup once in a while for the extra peace of mind. IIUC, you want a way to check t

Re: [BackupPC-users] Find file given digest (and a decompression error)

Hi, On 27.11.18 13:40, Guillermo Rozas wrote: Pigz doesn't correctly support BackupPC compressed files, although it will in some cases.  The reported error is likely the problem. Please use BackupPC_zcat instead and report back. Of course, you're right :) (although pigz failed on

[BackupPC-users] BackupPC Fuse filesystem [was: Only Getting empty directory structure]

Hi, concerning the Fuse interface: On 11.04.19 01:38, Adam Goryachev wrote: Perhaps someone will update the fuse plugin to work with BPC4, which could make this a lot easier. That someone goes by "Craig": the one we all know and love and without whom this project wouldn't fly. https://sour

Re: [BackupPC-users] Identical files

On 24.07.19 23:07, Ted Toal wrote: > BackupPC documentation says ‘by "identical files" we mean files with > identical contents, not necessary the same permissions, ownership or > modification time.’ What about filename and file directory, do these have to > match for a pair of files to be ident

[BackupPC-users] rsync-bpc claims that "file has vanished", but tries to download it over and over again

Dear all, I just noticed that one of two virtually identical BackupPC instances, both backing up the same host (my email server), reports for a couple weeks that some files vanished - and they are. So why does it insist on trying to download it over and over again? In the error log of server 1 (

Re: [BackupPC-users] rsync-bpc claims that "file has vanished", but tries to download it over and over again

Hi, On 29.07.19 18:30, Pierre-Yves Bonnetain-Nesterenko wrote: > On 29/07/2019 17:49, Alexander Kobel wrote: >> Any ideas about what could be the culprit? > > Looks like the « zombie files » bug which was corrected by last update > of BPC. huh. My google-fu fails me her

Re: [BackupPC-users] rsync-bpc claims that "file has vanished", but tries to download it over and over again

users wrote: > Yes, that bug is fixed in the latest versions of BackupPC (4.3.1) and > rsync_bpc (3.1.2.1).  It sounds like you have the latest BackupPC, but > you will need to upgrade to the latest rsync_bpc. > > Craig > > On Mon, Jul 29, 2019 at 12:29 PM Alexander Kobel

Re: [BackupPC-users] Identical files

Hi, On 01.08.19 18:03, G.W. Haywood via BackupPC-users wrote: > Hi there, > > On Fri, 26 Jul 2019, Ted Toal wrote: > >> Is it easy to make updates to the documentation? > > I haven't seen a reply to this so I'll take a stab at it, although I > don't really know the proper procedure.  Mr. Barrat

Re: [BackupPC-users] RsyncIncrArgsExtra

Hi Ted, On 01.08.19 18:31, Ted Toal wrote: > There is a BackupPC config parameter named RsyncFullArgsExtra, but none named > RsyncIncrArgsExtra (to provide extra rsync args for an incremental backup). > I’d like to see such a parameter. My immediate use is that I’d like to > restrict rsync ba

Re: [BackupPC-users] RsyncIncrArgsExtra

Hi again, On 02.08.19 11:50, Alexander Kobel wrote: > Hi Ted, > > On 01.08.19 18:31, Ted Toal wrote: >> There is a BackupPC config parameter named RsyncFullArgsExtra, but none >> named RsyncIncrArgsExtra (to provide extra rsync args for an incremental >> backu

Re: [BackupPC-users] RsyncIncrArgsExtra

Hi Ted, On 02.08.19 20:09, Ted Toal wrote: > Hi Alex, > > Ok, thanks for that suggestion, I’d thought of it, but wasn’t sure if rsync > would complain if the arg appeared twice, but apparently it doesn’t. > > I am NOT sure whether bandwidth limitation is what I want. I am actually > trying to

Re: [BackupPC-users] RsyncIncrArgsExtra

Hi, On 03.08.19 18:59, Ted Toal wrote: > Ged, > >> BackupPC shines, I think, in less well-constrained situations. >> >> Given the boundaries I wonder if you wouldn't do better with something >> simple like a script which runs 'find' to find the files to be backed >> up, plain vanilla rsync to do

Re: [BackupPC-users] Why ping before backup?

On 09.08.19 07:08, Michael Huntley wrote: > It’s simply to check if the host is answering. Yup. > I use ‘echo’ IIUC, you use a command that always returns true (coincidentally, the canonical choice for that command is `true`... ;-))? This means that (1) blackouts won't work as expected (note th

Re: [BackupPC-users] Large rsyncTmp files

Hi Marcelo, On 5/1/20 4:15 PM, Marcelo Ricardo Leitner wrote: Hi, Is it expected for rsync-bpc to be writting such large temporary files? If and only if there is such a big file to be backed up, AFAIK. It seems they are as big as the full backup itself: # ls -la */*/rsync* -rw--- 1 112

Re: [BackupPC-users] Imnproving backup speed

Hi Sorin, On 1/7/21 9:39 AM, Sorin Srbu wrote: Hello all! Trying to improve the backup speed with BPC and looked into setting noatime in fstab. But this article states some backup programs may bork if noatime is set. https://lonesysadmin.net/2013/12/08/gain-30-linux-disk-performance-noatime-n

Re: [BackupPC-users] Imnproving backup speed

Hi all, On 1/7/21 8:56 PM, Michael Stowe wrote: On 2021-01-07 00:39, Sorin Srbu wrote: Hello all! Trying to improve the backup speed with BPC and looked into setting noatime in fstab. [...] What will BPC in particular do if noatime is set? In short, it depends on your transport methods. 

Re: [BackupPC-users] Cpool vs. filesystem level compression

Hi, On 1/27/21 10:58 PM, backu...@kosowsky.org wrote: I know this question has been asked in the more distant past, but I would like to get the latest views, as relevant to backuppc 4.x I have my TopDir on a btrfs filesystem which has file-level compression capabilities (using the mount option

Re: [BackupPC-users] Cpool vs. filesystem level compression

Hi again. On 1/29/21 2:09 AM, backu...@kosowsky.org wrote: Thanks Alexander -- REALLY helpful, REALLY thoughtful. Comments below Alexander Kobel wrote at about 18:04:54 +0100 on Thursday, January 28, 2021: > For initial backups and changes, it depends on your BackupPC server CPU. &g

Re: [BackupPC-users] Which filesystem for external backup drive?

Hi, On 2/4/21 5:02 AM, Kenneth Porter wrote: On 2/3/2021 6:54 PM, backu...@kosowsky.org wrote: I just built backuppc for my Raspberry PI and ordered an external SSD drive that I plan to format in btrfs. I'm using CentOS, and it looks like Red Hat is dropping btrfs in favor of other filesyste

Re: [BackupPC-users] Full backups taking a very long time

Hi Dave, does each client individually take so long, or is it just one? (Or perhaps one client is taking almost all resources, so the other one is slow.) If both clients suddenly have problems, an issue with the BackupPC server is likely. Otherwise, I've seen similar issues when suddenly some

Re: [BackupPC-users] double hop rsync

Hi Greg, On 3/16/21 4:27 PM, gregrwm wrote: > On Tue, Mar 16, 2021 at 8:45 AM > wrote: > > gregrwm wrote at about 19:59:53 -0500 on Monday, March 15, 2021: >  > i'm trying to use a double hop rsync to backup a server that can only > be >  > reached indi

Re: [BackupPC-users] Conf{PoolNightlyDigestCheckPercent} on btrfs and zfs

Hi Guillermo, I agree. BackupPC's RefCnt/Fsck is a must IMHO. A main difference between PoolNightlyDigestCheck and btrfs' builtin checksumming is that the nightly digest checks proactively scan the data and will tell you about broken files as soon as they break (well, as soon as the next check

[BackupPC-users] Invalid config.pl via configuration web interface

Dear all, I receive validation errors of my config file after changes to the (global) config in the web interface. Consequently, BackupPC terminates. I'm absolutely sure that this worked before; my last (host) config change dates back to Feb 2022, the last global config change happened mid 2020

Re: [BackupPC-users] Invalid config.pl via configuration web interface

do (besides restoring the settings that > you had in use) > > Best regards, > > Iosif Fettich > > > > > > > On Wed, 9 Nov 2022, Alexander Kobel wrote: > >> Dear all, >> >> I receive validation errors of my config file after chang

Re: [BackupPC-users] How to check pool?

Hi Christian, `dmesg` will show you where the checksum errors occur. Can be combined with a `btrfs scrub` to get a full report over your entire volume. If you see entries in the BackupPC pool or pc directories, that'll generally mean that the affected file(s) are broken and can't be repaired fro

Re: [BackupPC-users] Backup corrupted, impossible to corect it

Hi, well, your message means that some attrib files are unaccessible. Likely destroyed, but you should confirm that e.g. with checking the access rights of those mentioned files in /var/lib/backuppc/cpool/??/??/ BackupPC_zcat /var/lib/backuppc/cpool/18/04/18049d6c5bf4339c16a4850421ebf02

Re: [BackupPC-users] Backup corrupted, impossible to corect it

hes of the system. I recommend to check the kernel logs for suspicious entries and error messages and to have a look at the drive status (e.g., via SMART readings). Cheers, Alex On 2024-08-13 09:01, Ghislain Adnet wrote: > Le 13/08/2024 à 00:09, Alexander Kobel a écrit : >> Hi, >> &g

Re: [BackupPC-users] Backup corrupted, impossible to corect it

Hi, On 2024-08-20 20:30, to...@tuxteam.de wrote: > On Tue, Aug 20, 2024 at 07:41:31PM +0200, Ghislain Adnet wrote: >> so what i get from this is that when there a corruption for a random reason >> backuppc will see it but will not do anything to correct it or backup it >> ever again even if it e

Re: [BackupPC-users] Backup corrupted, impossible to corect it

s the server to send block checksums to the client." > <\quote> > > By default V4 uses --checksum for full backups, but that has the (slight) > risk of missing file corruption on the server because it trusts the hash > calculated the first time it got the file (that&#x

Re: [BackupPC-users] Backup corrupted, impossible to corect it

Hi, On 2024-08-21 15:31, backu...@kosowsky.org wrote: > Alexander Kobel wrote at about 14:38:22 +0200 on Wednesday, August 21, 2024: > > On 2024-08-21 12:40, Guillermo Rozas wrote: > > > If you change it back to --ignore-times it will re-test the server files > by com