Sorry about the delay in replying. It appears you have two pairs of identical pool files. In particular, these two pool files appear to be the same:
/var/lib/backuppc/cpool/fc/86/fd871fd27933f41039f22c4201419c29 /var/lib/backuppc/cpool/fc/86/fd871fd27933f41039f22c4201419c2901 and these two as well: /var/lib/backuppc/cpool/d0/6c/d06dc5183aa3095ce36e1334235bd76d /var/lib/backuppc/cpool/d0/6c/d06dc5183aa3095ce36e1334235bd76d01 Can you confirm with cmp that those two pairs are identical (if they are still around)? Obviously this shouldn't happen. For some reason the first file wasn't matched when a backup of the same file was being done, so a new pool file was written. The only time this normally could happen is if you really have different files with the same md5 digest, which is extraordinarily unlikely, unless you construct known examples (which I did to test that part of BackupPC). That's what the "01" extension is for - you can have an arbitrary number of different md5 collisions and that's how they are named in the pool. But they should all be unique files. That said, the backup should work fine - yes, you will see ominous "Botch - got multiple pool file matches" warning messages that multiple pool files match, which sounds concerning, but the first matching file is used and all that will happen is the error count for the transfer is incremented. Craig On Fri, Sep 7, 2018 at 10:46 AM Patel, Tarak (SSC/SPC) < [email protected]> wrote: > Hi all, > > I configured a backup via ssh on my remote host which requires a hop. The > config is as follows: > > $Conf{TarClientCmd} = '$sshPath -q -x -n -l root oem1 env LC_ALL=C ssh -q > -x -n -l root $host "env LC_ALL=C $tarPath --exclude=\'*lost+found*\' > --exclude=\'*ASM1_ora_548653_20180820220003763166143795*\' > --exclude=\'*ora_468842_201808201844508*\' -c -v -f - -C $shareName+ > --totals"'; > $Conf{XferMethod} = 'tar'; > $Conf{TarShareName} = [ > '/etc', > '/home', > '/usr/local/bin', > '/opt/oracle' > ]; > $Conf{ClientNameAlias} = [ > 'repo1' > ]; > $Conf{PingCmd} = '/usr/bin/ssh -q -x -n -l root oem1 $pingPath -c 1 $host'; > $Conf{XferLogLevel} = 9; > $Conf{TarIncrArgs} = '--newer=\'$incrDate+ $fileList+\''; > $Conf{ClientCharset} = 'UTF-8'; > $Conf{ClientCharsetLegacy} = 'UTF-8'; > > After debugging backup failure issue I was able to narrow down two files > which seems to have caused the problem and ended up excluding them. With > XferLogLevel set to 9 and some additional print statements in > BackupPC_tarExtract I was able to capture output below (please ignore line > with TKP entry since those are my print statements): > > tarExtract: splitPath: returning dir = > 'f%2fopt%2foracle%2fgrid12%2frdbms/faudit', fileName = > '+ASM1_ora_548653_20180820220003763166143795.aud', attrib = > 'f%2fopt%2foracle%2fgrid12%2frdbms/faudit/attrib' from path = > '/audit/+ASM1_ora_548653_20180820220003763166143795.aud' > tarExtract: bpc_attribCache_loadPath: path = > /audit/+ASM1_ora_548653_20180820220003763166143795.aud -> dir = > f%2fopt%2foracle%2fgrid12%2frdbms/faudit, fileName = > +ASM1_ora_548653_20180820220003763166143795.aud, attribPath = > f%2fopt%2foracle%2fgrid12%2frdbms/faudit/attrib > > tarExtract: dirCacheNewDir: populating dir = /audit with > +ASM1_ora_548653_20180820220003763166143795.aud > > > tarExtract: Got file > './audit/+ASM1_ora_548653_20180820220003763166143795.aud', mode 0640, size > 1960, type 0 > tarExtract: dirCacheNewFile: path = > audit/+ASM1_ora_548653_20180820220003763166143795.aud: dir = /audit, file = > +ASM1_ora_548653_20180820220003763166143795.aud > tarExtract: tarRead 1960 > tarExtract: TKP processClose BPC_FTYPE_FILE... > tarExtract: TKP Errors: 1 --> poolWite errs 1 --> 1, 745, 1splitPath: > returning dir = 'f%2fopt%2foracle%2fgrid12%2frdbms/faudit', fileName = > '+ASM1_ora_548653_20180820220003763166143795.aud', attrib = > 'f%2fopt%2foracle%2fgrid12%2frdbms/faudit/attrib' from path = > 'audit/+ASM1_ora_548653_20180820220003763166143795.aud' > tarExtract: bpc_attribCache_loadPath: path = > audit/+ASM1_ora_548653_20180820220003763166143795.aud -> dir = > f%2fopt%2foracle%2fgrid12%2frdbms/faudit, fileName = > +ASM1_ora_548653_20180820220003763166143795.aud, attribPath = > f%2fopt%2foracle%2fgrid12%2frdbms/faudit/attrib > tarExtract: bpc_poolWrite_write: digest is fd871fd27933f41039f22c4201419c29 > tarExtract: Candidate matching file > /var/lib/backuppc/cpool/fc/86/fd871fd27933f41039f22c4201419c29 > tarExtract: Candidate matching file > /var/lib/backuppc/cpool/fc/86/fd871fd27933f41039f22c4201419c2901 > tarExtract: > bpc_fileZIO_open(/var/lib/backuppc/cpool/fc/86/fd871fd27933f41039f22c4201419c2901, > 0, 3) -> 3 > tarExtract: match[0] now set to > /var/lib/backuppc/cpool/fc/86/fd871fd27933f41039f22c4201419c2901 > tarExtract: > bpc_fileZIO_open(/var/lib/backuppc/cpool/fc/86/fd871fd27933f41039f22c4201419c29, > 0, 3) -> 5 > tarExtract: match[1] now set to > /var/lib/backuppc/cpool/fc/86/fd871fd27933f41039f22c4201419c29 > tarExtract: Read 1960 bytes of 1960 from match[0] > (/var/lib/backuppc/cpool/fc/86/fd871fd27933f41039f22c4201419c2901) > tarExtract: Read 1960 bytes of 1960 from match[1] > (/var/lib/backuppc/cpool/fc/86/fd871fd27933f41039f22c4201419c29) > tarExtract: Read 0 bytes of 0 from match[0] > (/var/lib/backuppc/cpool/fc/86/fd871fd27933f41039f22c4201419c2901) > tarExtract: Read 0 bytes of 0 from match[1] > (/var/lib/backuppc/cpool/fc/86/fd871fd27933f41039f22c4201419c29) > tarExtract: Botch - got multiple pool file matches > tarExtract: bpc_poolWrite_write: got 2 matching files for digest > fd871fd27933f41039f22c4201419c29 > tarExtract: Found match with match[0] > (/var/lib/backuppc/cpool/fc/86/fd871fd27933f41039f22c4201419c2901) > tarExtract: bpc_fileZIO_close(3) > tarExtract: bpc_fileZIO_close(5) > same 640 500/500 1960 > audit/+ASM1_ora_548653_20180820220003763166143795.aud > tarExtract: tarRead 88 > tarExtract: File audit/+ASM1_ora_548653_20180820220003763166143795.aud: > old digest fd871fd27933f41039f22c4201419c2901, new digest > fd871fd27933f41039f22c4201419c2901 > > > tarExtract: Wrote file +ASM1_ora_548653_20180820220003763166143795.aud: > type = 0, mode = 0640, uid/gid = 500/500, size = 1960, inode = 37027, > nlinks = 0, digest = 0xfd871f..., bufUsed = 80832 > > > ====================== > > tarExtract: > bpc_attrib_dirRead(/var/lib/backuppc/cpool/90/60/9161f01e8845a7b1882da117b6a6f1fc): > Got file +ASM1_ora_468842_20180820184450859252143795.aud: type = 0, mode = > 0640, uid/gid = 500/500, size = 788 > > tarExtract: splitPath: returning dir = > 'f%2fopt%2foracle%2fgrid12%2frdbms/faudit', fileName = > '+ASM1_ora_468842_20180820184450859252143795.aud', attrib = > 'f%2fopt%2foracle%2fgrid12%2frdbms/faudit/attrib' from path = > '/audit/+ASM1_ora_468842_20180820184450859252143795.aud' > tarExtract: bpc_attribCache_loadPath: path = > /audit/+ASM1_ora_468842_20180820184450859252143795.aud -> dir = > f%2fopt%2foracle%2fgrid12%2frdbms/faudit, fileName = > +ASM1_ora_468842_20180820184450859252143795.aud, attribPath = > f%2fopt%2foracle%2fgrid12%2frdbms/faudit/attrib > > tarExtract: dirCacheNewDir: populating dir = /audit with > +ASM1_ora_468842_20180820184450859252143795.aud > > tarExtract: Got file > './audit/+ASM1_ora_468842_20180820184450859252143795.aud', mode 0640, size > 788, type 0 > tarExtract: dirCacheNewFile: path = > audit/+ASM1_ora_468842_20180820184450859252143795.aud: dir = /audit, file = > +ASM1_ora_468842_20180820184450859252143795.aud > tarExtract: tarRead 788 > tarExtract: TKP processClose BPC_FTYPE_FILE... > tarExtract: TKP Errors: 2 --> poolWite errs 1 --> 1, 542, 1splitPath: > returning dir = 'f%2fopt%2foracle%2fgrid12%2frdbms/faudit', fileName = > '+ASM1_ora_468842_20180820184450859252143795.aud', attrib = > 'f%2fopt%2foracle%2fgrid12%2frdbms/faudit/attrib' from path = > 'audit/+ASM1_ora_468842_20180820184450859252143795.aud' > tarExtract: bpc_attribCache_loadPath: path = > audit/+ASM1_ora_468842_20180820184450859252143795.aud -> dir = > f%2fopt%2foracle%2fgrid12%2frdbms/faudit, fileName = > +ASM1_ora_468842_20180820184450859252143795.aud, attribPath = > f%2fopt%2foracle%2fgrid12%2frdbms/faudit/attrib > tarExtract: bpc_poolWrite_write: digest is d06dc5183aa3095ce36e1334235bd76d > tarExtract: Candidate matching file > /var/lib/backuppc/cpool/d0/6c/d06dc5183aa3095ce36e1334235bd76d > tarExtract: Candidate matching file > /var/lib/backuppc/cpool/d0/6c/d06dc5183aa3095ce36e1334235bd76d01 > tarExtract: > bpc_fileZIO_open(/var/lib/backuppc/cpool/d0/6c/d06dc5183aa3095ce36e1334235bd76d01, > 0, 3) -> 3 > tarExtract: match[0] now set to > /var/lib/backuppc/cpool/d0/6c/d06dc5183aa3095ce36e1334235bd76d01 > tarExtract: > bpc_fileZIO_open(/var/lib/backuppc/cpool/d0/6c/d06dc5183aa3095ce36e1334235bd76d, > 0, 3) -> 5 > tarExtract: match[1] now set to > /var/lib/backuppc/cpool/d0/6c/d06dc5183aa3095ce36e1334235bd76d > tarExtract: Read 788 bytes of 788 from match[0] > (/var/lib/backuppc/cpool/d0/6c/d06dc5183aa3095ce36e1334235bd76d01) > tarExtract: Read 788 bytes of 788 from match[1] > (/var/lib/backuppc/cpool/d0/6c/d06dc5183aa3095ce36e1334235bd76d) > tarExtract: Read 0 bytes of 0 from match[0] > (/var/lib/backuppc/cpool/d0/6c/d06dc5183aa3095ce36e1334235bd76d01) > tarExtract: Read 0 bytes of 0 from match[1] > (/var/lib/backuppc/cpool/d0/6c/d06dc5183aa3095ce36e1334235bd76d) > tarExtract: Botch - got multiple pool file matches > tarExtract: bpc_poolWrite_write: got 2 matching files for digest > d06dc5183aa3095ce36e1334235bd76d > tarExtract: Found match with match[0] > (/var/lib/backuppc/cpool/d0/6c/d06dc5183aa3095ce36e1334235bd76d01) > tarExtract: bpc_fileZIO_close(3) > tarExtract: bpc_fileZIO_close(5) > same 640 500/500 788 > audit/+ASM1_ora_468842_20180820184450859252143795.aud > tarExtract: tarRead 236 > tarExtract: File audit/+ASM1_ora_468842_20180820184450859252143795.aud: > old digest d06dc5183aa3095ce36e1334235bd76d01, new digest > d06dc5183aa3095ce36e1334235bd76d01 > > > Besides ‘Botch - got multiple pool file matches’ I don’t see anything > worrisome which would cause the backup to fail. Hope the output provides > some information on possible solution. > > Thanks, > > Tarak > > > -- > > Tarak Patel > > Chef d’équipe, Integration HPC, Solution de calcul E-Science > Service partagé Canada / Gouvernment du Canada > *[email protected]* <[email protected]> > 1-514-421-7299 > > Team Lead, HPC Integration, E-Science Computing Solution > Shared Services Canada, Government of Canada > *[email protected]* <[email protected]> > 1-514-421-7299 > > > > > _______________________________________________ > BackupPC-users mailing list > [email protected] > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki: http://backuppc.wiki.sourceforge.net > Project: http://backuppc.sourceforge.net/ >
_______________________________________________ BackupPC-users mailing list [email protected] List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
