Craig-
(just returning from vacation, so pardon the late response)
The issue seems to have been caused by an odd 'out of inodes' issue caused
by the NFS storage appliance we use for our storage. After rebooting the
storage appliance, the inode issue went away, and we've had no further
instances of this issue.
However, in the meantime, a number of 'orphaned' backup directories were
left behind. They exist, but are not referenced by the
.../BackupPC/pc/[system]/backups file.
For example:
[backuppc@isift090 isemt101]$ pwd
/mnt/backups/BackupPC/pc/isemt101
[backuppc@isift090 isemt101]$ ls -ld 10
drwxr-x---. 5 backuppc backuppc 4096 May 31 23:05 10
[backuppc@isift090 isemt101]$ ls 10
attrib_cf06051de16efa13986a642e2dff5f6c backupInfo f%2f inode refCnt
File/directory ownership is correct, and it looks like an orphaned backup.
So far, I've found that just deleting the orphaned directories seems like
the best course of action, but I had to write a small script to help find
them.
cd /mnt/backups/BackupPC/pc
for dir in $(for i in $(ls); do ls -d $i/[0-9]*| sort -n ; done) ; do
echo -n "$dir:"
host=$(echo $dir |cut -f 1 -d '/')
backup=$(echo $dir |cut -f 2 -d '/')
#echo $host $backup
if grep -q ^$backup $host/backups; then
echo FOUND
else
echo -n "MISSING "
ls -l $host/XferLOG.$backup.z
rm -rf $host/$backup
rm $host/XferLOG.$backup.z
fi
done
On Sat, Jun 10, 2017 at 10:42 PM, Craig Barratt via BackupPC-users <
backuppc-users@lists.sourceforge.net> wrote:
> Ray,
>
> Sorry about the delay in replying. I'm not sure why those two directories
> are still around; BackupPC_backupDelete didn't report any errors. It also
> didn't delete the XferLOG.[56].z files.
>
> It looks like #3 was correctly deleted, and XferLOG.3.z too.
>
> What's in those directories? Are they owned by the backuppc user?
>
> Craig
>
> On Wed, May 24, 2017 at 4:03 PM, Ray Frush <fr...@rams.colostate.edu>
> wrote:
>
>> I've encountered an interesting issue:
>>
>> In $TopDir/pc/host, I have some orphaned directories that don't appear
>> in $TopDir/pc/host/backups.
>>
>> For example: this host shows two extra directories, and XferLOGs for
>> backup #5 and #6 that does not appear in the 'backups' file:
>>
>> $ ls isxxt004
>> 0 17 19 21 23 6 backups LOCK LOG.052017
>> RestoreInfo.0 restores XferLOG.15.z XferLOG.18.z XferLOG.20.z
>> XferLOG.22.z XferLOG.5.z XferLOG.8.z
>> 15 18 20 22 5 8 backups.old LOG.042017.z refCnt
>> RestoreLOG.0.z XferLOG.0.z XferLOG.17.z XferLOG.19.z XferLOG.21.z
>> XferLOG.23.z XferLOG.6.z XferLOG.bad.z.old
>>
>> $ cat isxxt004/backups | cut -f 1,2 -d ' '
>> 0 full
>> 8 incr
>> 15 incr
>> 17 incr
>> 18 incr
>> 19 full
>> 20 incr
>> 21 incr
>> 22 incr
>> 23 incr
>>
>> The odd thing is that the LOG suggests that Backups #5 and #6 should have
>> been deleted:
>>
>> ...
>> 2017-05-11 20:04:32 incr backup started for directory /
>> 2017-05-11 20:08:38 incr backup 12 complete, 182376 files, 182376 bytes,
>> 0 xferErrs (0 bad files, 0 bad shares, 0 other)
>> 2017-05-11 20:08:38 Removing unfilled backup 3
>> 2017-05-11 20:08:38 BackupPC_backupDelete: removing #3
>> 2017-05-11 20:08:38 BackupPC_backupDelete: No prior backup for merge
>> 2017-05-11 20:08:46 BackupPC_refCountUpdate: host isxxt004 got 0 errors
>> (took 7 secs)
>> 2017-05-11 20:08:46 Finished BackupPC_backupDelete, status = 0 (running
>> time: 8 sec)
>> 2017-05-12 20:03:29 incr backup started for directory /
>> 2017-05-12 20:05:03 incr backup 13 complete, 182381 files, 182381 bytes,
>> 0 xferErrs (0 bad files, 0 bad shares, 0 other)
>> 2017-05-12 20:05:04 Removing unfilled backup 5
>> 2017-05-12 20:05:04 BackupPC_backupDelete: removing #5
>> 2017-05-12 20:05:04 BackupPC_backupDelete: No prior backup for merge
>> 2017-05-12 20:05:08 BackupPC_refCountUpdate: host isxxt004 got 0 errors
>> (took 4 secs)
>> 2017-05-12 20:05:08 Finished BackupPC_backupDelete, status = 0 (running
>> time: 4 sec)
>> 2017-05-13 20:03:17 incr backup started for directory /
>> 2017-05-13 20:05:20 incr backup 14 complete, 182388 files, 182388 bytes,
>> 0 xferErrs (0 bad files, 0 bad shares, 0 other)
>> 2017-05-13 20:05:20 Removing unfilled backup 6
>> 2017-05-13 20:05:21 BackupPC_backupDelete: removing #6
>> 2017-05-13 20:05:21 BackupPC_backupDelete: No prior backup for merge
>> 2017-05-13 20:05:25 BackupPC_refCountUpdate: host isxxt004 got 0 errors
>> (took 4 secs)
>> 2017-05-13 20:05:25 Finished BackupPC_backupDelete, status = 0 (running
>> time: 5 sec)
>> ...
>>
>> I'm looking for some advice on the best or safest way to clean up, or
>> re-link in the extra directories.
>> At this point, I'm not concerned about losing the incremental backup
>> history, and just want to get the '$TopDir/pc' tree into a consistent state.
>>
>> Thanks!
>>
>> --
>> Time flies like an arrow, but fruit flies like a banana.
>>
>> ------------------------------------------------------------
>> ------------------
>> Check out the vibrant tech community on one of the world's most
>> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>> _______________________________________________
>> BackupPC-users mailing list
>> BackupPC-users@lists.sourceforge.net
>> List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
>> Wiki: http://backuppc.wiki.sourceforge.net
>> Project: http://backuppc.sourceforge.net/
>>
>>
>
> ------------------------------------------------------------
> ------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki: http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>
>
--
Time flies like an arrow, but fruit flies like a banana.
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
