This warning could be significant: R setVarInt botch: got negative argument -1; setting to 0
Could you try rsync 3.1.2.2 <https://github.com/backuppc/rsync-bpc/releases/tag/3.1.2.2>? If you can't find a package for it you can build it from the source tarball. There's no need to install it after you run "make"; you could instead just point $Conf{RsyncBackupPCPath} to the rsync_bpc in the build directory. (BTW, other than gcc and make, you will need to install libacl1-dev to build successfully.) If it still fails, the next step is to turn on more logging. A starting point would be to add "-vvv" to $Conf{RsyncArgsExtra}. Craig On Tue, Oct 20, 2020 at 10:41 AM David Hoskinson < david.hoskin...@astroshapes.com> wrote: > BackupPC-XS-0.62-1.el8.x86_64 > BackupPC-4.4.0-1.el8.x86_64 > rsync-bpc-3.1.2.0-3.el8.x86_64 > > > ------------------------------ > *From: *"backuppc-users" <backuppc-users@lists.sourceforge.net> > *To: *"backuppc-users" <backuppc-users@lists.sourceforge.net> > *Cc: *"Craig Barratt" <cbarr...@users.sourceforge.net> > *Sent: *Tuesday, October 20, 2020 1:17:58 PM > *Subject: *Re: [BackupPC-users] Problems doing full backup resulting in > out of memory errors > > CAUTION: This email originated from outside your organization. Exercise > caution when opening attachments or clicking links, especially from unknown > senders. > What versions are you running? Specifically, BackupPC, rsync-bpc and > BackupPC::XS. > Craig > > On Tue, Oct 20, 2020 at 10:16 AM David Hoskinson < > david.hoskin...@astroshapes.com> wrote: > >> I am having issues with a backup of a nethserver with a 2 TB directory >> being backed up. The system being backed up is Centos 7.8 and my backuppc >> server is at the latest version. I have backed this up over the last month >> with no problems, but had to delete them as selinux was turned on and was >> causing issues syncing through nfs to our offsite box. I deleted all the >> backups for this server and am starting fresh. Config file for this backup >> has not changed. The backuppc box has 64 GB of memory and 96 TB of space >> and nethserver has plenty of memory and space as well so i am not sure whay >> it is now saying out of memory. I keep restarting job about every hour and >> it seems to pick up where it left off as rsync will do but can't always do >> that >> >> Other large backups of comparable sizes are working fine >> >> following is snippets from xfer log >> >> Running BackupPC_refCountUpdate -h ad1 -f on ad1 >> Xfer PIDs are now 2819737 >> BackupPC_refCountUpdate: host ad1 got 0 errors (took 132 secs) >> Xfer PIDs are now >> Finished BackupPC_refCountUpdate (running time: 132 sec) >> Xfer PIDs are now >> XferLOG file /backup/astrobackup//pc/ad1/XferLOG.0.z created 2020-10-20 >> 04:46:13 >> Backup prep: type = full, case = 6, inPlace = 1, doDuplicate = 0, >> newBkupNum = 0, newBkupIdx = 0, lastBkupNum = , lastBkupIdx = (FillCycle = >> 0, noFillCnt = ) >> Running: /usr/bin/rsync_bpc --bpc-top-dir /backup/astrobackup/ >> --bpc-host-name ad1 --bpc-share-name /var/lib/nethserver/ --bpc-bkup-num 0 >> --bpc-bkup-comp 3 --bpc-bkup-prevnum -1 --bpc-bkup-prevcomp -1 >> --bpc-bkup-inode0 8416746 --bpc-log-level 1 --bpc-attrib-new -e >> /usr/bin/ssh\ -l\ root --rsync-path=/usr/bin/rsync --numeric-ids --perms >> --owner --group -D --links --hard-links --times --block-size=2048 >> --recursive --checksum --timeout=72000 ad1:/var/lib/nethserver/ / >> full backup started for directory /var/lib/nethserver/ >> Xfer PIDs are now 2819741 >> This is the rsync child about to exec /usr/bin/rsync_bpc >> Xfer PIDs are now 2819741,2819743 >> xferPids 2819741,2819743 >> R setVarInt botch: got negative argument -1; setting to 0 >> ERROR: out of memory in receive_sums [sender] >> rsync error: error allocating core memory buffers (code 22) at >> util2.c(106) [sender=3.1.2] >> Done: 0 errors, 0 filesExist, 0 sizeExist, 0 sizeExistComp, 0 filesTotal, >> 0 sizeTotal, 6 filesNew, 728183826 sizeNew, 44711371 sizeNewComp, 8416749 >> inode >> rsync_bpc: [generator] write error: Broken pipe (32) >> DoneGen: 0 errors, 0 filesExist, 0 sizeExist, 0 sizeExistComp, 4006236 >> filesTotal, 945858113364 sizeTotal, 0 filesNew, 0 sizeNew, 0 sizeNewComp, >> 8416750 inode >> rsync_bpc exited with fatal status 22 (5632) (rsync_bpc: [generator] >> write error: Broken pipe (32)) >> Removing rsync temporary file >> /backup/astrobackup//pc/ad1/0/rsyncTmp.2819741.1.2 >> Xfer PIDs are now >> Got fatal error during xfer (rsync_bpc: [generator] write error: Broken >> pipe (32)) >> Backup aborted (rsync_bpc: [generator] write error: Broken pipe (32)) >> BackupFailCleanup: nFilesTotal = 4006236, type = full, BackupCase = 6, >> inPlace = 1, lastBkupNum = >> BackupFailCleanup: inPlace with some new files... no cleanup and marking >> partial >> Running BackupPC_refCountUpdate -h ad1 -f on ad1 >> Xfer PIDs are now 2819865 >> BackupPC_refCountUpdate: host ad1 got 0 errors (took 239 secs) >> Xfer PIDs are now >> >> David Hoskinson >> Systems Administrator >> Ext 226 >> >> >> _______________________________________________ >> BackupPC-users mailing list >> BackupPC-users@lists.sourceforge.net >> List: https://lists.sourceforge.net/lists/listinfo/backuppc-users >> Wiki: https://github.com/backuppc/backuppc/wiki >> Project: https://backuppc.github.io/backuppc/ >> <https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fbackuppc.github.io%2fbackuppc%2f&c=E,1,DH4p6aLX80kv807I-rwKqfGwhooDM-PH3l3QZ3J3-snGtk5fC3mqpAVzWbcB930v8YzFdq8KkD-ogifrZjfC4T0JTlMmad7Ocks8U5E1eAjPW__Cqg,,&typo=1> >> > > > _______________________________________________ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki: https://github.com/backuppc/backuppc/wiki > Project: > https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fbackuppc.github.io%2fbackuppc%2f&c=E,1,6mQEW2WiU1g3fuYOJYN84au5Z0-Xt1KQcIil1KT3a59-ukqQEiydSNo68LL3otQsTaowu1zpyzPc5MBDNOVP5DJecaw2zbV8grHMJHEX4bdPbTSYa9VmbPup7A,,&typo=1 > _______________________________________________ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki: https://github.com/backuppc/backuppc/wiki > Project: https://backuppc.github.io/backuppc/ >
_______________________________________________ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/