Please email me the XferLOG file. Feel free to redact lines you consider confidential. Don't send it to the list.
Craig On Wed, Oct 21, 2020 at 9:29 AM David Hoskinson < david.hoskin...@astroshapes.com> wrote: > 2020-10-21 08:57:03 full backup started for directory /var/lib/nethserver/ > 2020-10-21 11:46:42 Got fatal error during xfer (rsync_bpc: [generator] write > error: Broken pipe (32)) > 2020-10-21 11:46:48 Backup aborted (rsync_bpc: [generator] write error: > Broken pipe (32)) > > Seems that updating rsync_bpc 3.1.2.2 didn't help > > What else can i provide?? > > ------------------------------ > *From: *"backuppc-users" <backuppc-users@lists.sourceforge.net> > *To: *"backuppc-users" <backuppc-users@lists.sourceforge.net> > *Cc: *"Craig Barratt" <cbarr...@users.sourceforge.net> > *Sent: *Tuesday, October 20, 2020 1:51:23 PM > *Subject: *Re: [BackupPC-users] Problems doing full backup resulting in > out of memory errors > > CAUTION: This email originated from outside your organization. Exercise > caution when opening attachments or clicking links, especially from unknown > senders. > This warning could be significant: > > R setVarInt botch: got negative argument -1; setting to 0 > > > Could you try rsync 3.1.2.2 > <https://github.com/backuppc/rsync-bpc/releases/tag/3.1.2.2>? If you > can't find a package for it you can build it from the source tarball. > There's no need to install it after you run "make"; you could instead just > point $Conf{RsyncBackupPCPath} to the rsync_bpc in the build directory. > (BTW, other than gcc and make, you will need to install libacl1-dev to > build successfully.) > > If it still fails, the next step is to turn on more logging. A starting > point would be to add "-vvv" to $Conf{RsyncArgsExtra}. > > Craig > > On Tue, Oct 20, 2020 at 10:41 AM David Hoskinson < > david.hoskin...@astroshapes.com> wrote: > >> BackupPC-XS-0.62-1.el8.x86_64 >> BackupPC-4.4.0-1.el8.x86_64 >> rsync-bpc-3.1.2.0-3.el8.x86_64 >> >> >> ------------------------------ >> *From: *"backuppc-users" <backuppc-users@lists.sourceforge.net> >> *To: *"backuppc-users" <backuppc-users@lists.sourceforge.net> >> *Cc: *"Craig Barratt" <cbarr...@users.sourceforge.net> >> *Sent: *Tuesday, October 20, 2020 1:17:58 PM >> *Subject: *Re: [BackupPC-users] Problems doing full backup resulting in >> out of memory errors >> >> CAUTION: This email originated from outside your organization. Exercise >> caution when opening attachments or clicking links, especially from unknown >> senders. >> What versions are you running? Specifically, BackupPC, rsync-bpc and >> BackupPC::XS. >> Craig >> >> On Tue, Oct 20, 2020 at 10:16 AM David Hoskinson < >> david.hoskin...@astroshapes.com> wrote: >> >>> I am having issues with a backup of a nethserver with a 2 TB directory >>> being backed up. The system being backed up is Centos 7.8 and my backuppc >>> server is at the latest version. I have backed this up over the last month >>> with no problems, but had to delete them as selinux was turned on and was >>> causing issues syncing through nfs to our offsite box. I deleted all the >>> backups for this server and am starting fresh. Config file for this backup >>> has not changed. The backuppc box has 64 GB of memory and 96 TB of space >>> and nethserver has plenty of memory and space as well so i am not sure whay >>> it is now saying out of memory. I keep restarting job about every hour and >>> it seems to pick up where it left off as rsync will do but can't always do >>> that >>> >>> Other large backups of comparable sizes are working fine >>> >>> following is snippets from xfer log >>> >>> Running BackupPC_refCountUpdate -h ad1 -f on ad1 >>> Xfer PIDs are now 2819737 >>> BackupPC_refCountUpdate: host ad1 got 0 errors (took 132 secs) >>> Xfer PIDs are now >>> Finished BackupPC_refCountUpdate (running time: 132 sec) >>> Xfer PIDs are now >>> XferLOG file /backup/astrobackup//pc/ad1/XferLOG.0.z created 2020-10-20 >>> 04:46:13 >>> Backup prep: type = full, case = 6, inPlace = 1, doDuplicate = 0, >>> newBkupNum = 0, newBkupIdx = 0, lastBkupNum = , lastBkupIdx = (FillCycle = >>> 0, noFillCnt = ) >>> Running: /usr/bin/rsync_bpc --bpc-top-dir /backup/astrobackup/ >>> --bpc-host-name ad1 --bpc-share-name /var/lib/nethserver/ --bpc-bkup-num 0 >>> --bpc-bkup-comp 3 --bpc-bkup-prevnum -1 --bpc-bkup-prevcomp -1 >>> --bpc-bkup-inode0 8416746 --bpc-log-level 1 --bpc-attrib-new -e >>> /usr/bin/ssh\ -l\ root --rsync-path=/usr/bin/rsync --numeric-ids --perms >>> --owner --group -D --links --hard-links --times --block-size=2048 >>> --recursive --checksum --timeout=72000 ad1:/var/lib/nethserver/ / >>> full backup started for directory /var/lib/nethserver/ >>> Xfer PIDs are now 2819741 >>> This is the rsync child about to exec /usr/bin/rsync_bpc >>> Xfer PIDs are now 2819741,2819743 >>> xferPids 2819741,2819743 >>> R setVarInt botch: got negative argument -1; setting to 0 >>> ERROR: out of memory in receive_sums [sender] >>> rsync error: error allocating core memory buffers (code 22) at >>> util2.c(106) [sender=3.1.2] >>> Done: 0 errors, 0 filesExist, 0 sizeExist, 0 sizeExistComp, 0 >>> filesTotal, 0 sizeTotal, 6 filesNew, 728183826 sizeNew, 44711371 >>> sizeNewComp, 8416749 inode >>> rsync_bpc: [generator] write error: Broken pipe (32) >>> DoneGen: 0 errors, 0 filesExist, 0 sizeExist, 0 sizeExistComp, 4006236 >>> filesTotal, 945858113364 sizeTotal, 0 filesNew, 0 sizeNew, 0 sizeNewComp, >>> 8416750 inode >>> rsync_bpc exited with fatal status 22 (5632) (rsync_bpc: [generator] >>> write error: Broken pipe (32)) >>> Removing rsync temporary file >>> /backup/astrobackup//pc/ad1/0/rsyncTmp.2819741.1.2 >>> Xfer PIDs are now >>> Got fatal error during xfer (rsync_bpc: [generator] write error: Broken >>> pipe (32)) >>> Backup aborted (rsync_bpc: [generator] write error: Broken pipe (32)) >>> BackupFailCleanup: nFilesTotal = 4006236, type = full, BackupCase = 6, >>> inPlace = 1, lastBkupNum = >>> BackupFailCleanup: inPlace with some new files... no cleanup and marking >>> partial >>> Running BackupPC_refCountUpdate -h ad1 -f on ad1 >>> Xfer PIDs are now 2819865 >>> BackupPC_refCountUpdate: host ad1 got 0 errors (took 239 secs) >>> Xfer PIDs are now >>> >>> David Hoskinson >>> Systems Administrator >>> Ext 226 >>> >>> >>> _______________________________________________ >>> BackupPC-users mailing list >>> BackupPC-users@lists.sourceforge.net >>> List: https://lists.sourceforge.net/lists/listinfo/backuppc-users >>> Wiki: https://github.com/backuppc/backuppc/wiki >>> Project: https://backuppc.github.io/backuppc/ >>> <https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fbackuppc.github.io%2fbackuppc%2f&c=E,1,DH4p6aLX80kv807I-rwKqfGwhooDM-PH3l3QZ3J3-snGtk5fC3mqpAVzWbcB930v8YzFdq8KkD-ogifrZjfC4T0JTlMmad7Ocks8U5E1eAjPW__Cqg,,&typo=1> >>> >> >> >> _______________________________________________ >> BackupPC-users mailing list >> BackupPC-users@lists.sourceforge.net >> List: https://lists.sourceforge.net/lists/listinfo/backuppc-users >> Wiki: https://github.com/backuppc/backuppc/wiki >> Project: >> https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fbackuppc.github.io%2fbackuppc%2f&c=E,1,6mQEW2WiU1g3fuYOJYN84au5Z0-Xt1KQcIil1KT3a59-ukqQEiydSNo68LL3otQsTaowu1zpyzPc5MBDNOVP5DJecaw2zbV8grHMJHEX4bdPbTSYa9VmbPup7A,,&typo=1 >> _______________________________________________ >> BackupPC-users mailing list >> BackupPC-users@lists.sourceforge.net >> List: https://lists.sourceforge.net/lists/listinfo/backuppc-users >> Wiki: https://github.com/backuppc/backuppc/wiki >> Project: https://backuppc.github.io/backuppc/ >> <https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fbackuppc.github.io%2fbackuppc%2f&c=E,1,WB9nLeWR2Dg-ssb09n19G-GFHQ43sc2zHJ2Q6Ha7Ty7KA9zRQd5ASCXAdHBtkdJpyeUSaR0DcAo8g8jcPr8vPQ8VOL5jsc9p2EdBgupAAgYvSRtEdIYQjA,,&typo=1> >> > > > _______________________________________________ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki: https://github.com/backuppc/backuppc/wiki > Project: > https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fbackuppc.github.io%2fbackuppc%2f&c=E,1,HlIGfcaJfsocGUo0v0FEf-0yyXh9mbZ-131Tt12QdmWhGvgwuR2pxJbspC1eUM0H5WqB0schD1qOBCiBOYsdl2Uhd5lvOyDsvgkUox2AXJ1_Cjnp-10oX1EwXMfj&typo=1 > _______________________________________________ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki: https://github.com/backuppc/backuppc/wiki > Project: https://backuppc.github.io/backuppc/ >
_______________________________________________ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
