[BackupPC-users] 100,000+ errors in last nights backup
Backuppc has been behaving strangely lately. This is another instance. This is part of the log file for host steve: 2009-08-12 01:00:06 full backup started for directory / 2009-08-12 01:00:06 full backup started for directory / 2009-08-12 05:00:06 Rename /media/disk/pc/steve/new -> /media/disk/pc/steve/151 failed 2009-08-12 05:00:06 full backup complete, 388335 files, 0 bytes, 2 xferErrs (0 bad files, 0 bad shares, 2 other) 2009-08-12 05:00:06 full backup 151 complete, 388335 files, 0 bytes, 2 xferErrs (0 bad files, 0 bad shares, 2 other) Apart from the fact that the backup seems to have started twice (Maybe just logged twice?) everything looks OK but then In the server log file I get this: 2009-08-12 01:00:06 Started full backup on steve (pid=2644, share=/) 2009-08-12 01:06:15 BackupPC_nightly now running BackupPC_sendEmail 2009-08-12 01:06:16 Finished admin1 (BackupPC_nightly 128 255) 2009-08-12 01:06:36 Finished admin (BackupPC_nightly -m 0 127) 2009-08-12 01:06:36 Pool nightly clean removed 0 files of size 0.00GB 2009-08-12 01:06:36 Pool is 0.00GB, 0 files (0 repeated, 0 max chain, 0 max links), 1 directories 2009-08-12 01:06:36 Cpool nightly clean removed 0 files of size 0.00GB 2009-08-12 01:06:36 Cpool is 111.15GB, 364467 files (21648 repeated, 10 max chain, 793 max links), 4369 directories 2009-08-12 02:00:00 Next wakeup is 2009-08-12 03:00:00 2009-08-12 03:00:01 Next wakeup is 2009-08-12 04:00:00 2009-08-12 04:00:00 Next wakeup is 2009-08-12 05:00:00 2009-08-12 05:00:01 Next wakeup is 2009-08-12 06:00:00 2009-08-12 05:00:06 Finished full backup on steve 2009-08-12 05:00:06 Running BackupPC_link steve (pid=8901) 2009-08-12 05:00:08 BackupPC_link got error -3 when calling MakeFileLink(/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml, b32585c3cc30b7ebb556d335a08554e3, 1) followed by 100,000+ of the same error on different files What is going on here? Thanks, Steve -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] 100,000+ errors in last nights backup
Steve Blackwell wrote at about 08:49:23 -0400 on Wednesday, August 12, 2009: > Backuppc has been behaving strangely lately. This is another instance. > > This is part of the log file for host steve: > > 2009-08-12 01:00:06 full backup started for directory / > 2009-08-12 01:00:06 full backup started for directory / > 2009-08-12 05:00:06 Rename /media/disk/pc/steve/new > -> /media/disk/pc/steve/151 failed > 2009-08-12 05:00:06 full backup complete, 388335 files, 0 bytes, 2 > xferErrs (0 bad files, 0 bad shares, 2 other) > 2009-08-12 05:00:06 full backup 151 complete, 388335 files, 0 bytes, 2 > xferErrs (0 bad files, 0 bad shares, 2 other) > > Apart from the fact that the backup seems to have started twice (Maybe > just logged twice?) everything looks OK but then > > In the server log file I get this: > > 2009-08-12 01:00:06 Started full backup on steve (pid=2644, share=/) > 2009-08-12 01:06:15 BackupPC_nightly now running BackupPC_sendEmail > 2009-08-12 01:06:16 Finished admin1 (BackupPC_nightly 128 255) > 2009-08-12 01:06:36 Finished admin (BackupPC_nightly -m 0 127) > 2009-08-12 01:06:36 Pool nightly clean removed 0 files of size 0.00GB > 2009-08-12 01:06:36 Pool is 0.00GB, 0 files (0 repeated, 0 max chain, 0 > max links), 1 directories > 2009-08-12 01:06:36 Cpool nightly clean removed 0 files of size 0.00GB > 2009-08-12 01:06:36 Cpool is 111.15GB, 364467 files (21648 repeated, 10 > max chain, 793 max links), 4369 directories > 2009-08-12 02:00:00 Next wakeup is 2009-08-12 03:00:00 > 2009-08-12 03:00:01 Next wakeup is 2009-08-12 04:00:00 > 2009-08-12 04:00:00 Next wakeup is 2009-08-12 05:00:00 > 2009-08-12 05:00:01 Next wakeup is 2009-08-12 06:00:00 > 2009-08-12 05:00:06 Finished full backup on steve 2009-08-12 05:00:06 > Running BackupPC_link steve (pid=8901) > 2009-08-12 05:00:08 BackupPC_link got error -3 when calling > MakeFileLink(/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml, > b32585c3cc30b7ebb556d335a08554e3, 1) > > followed by 100,000+ of the same error on different files > > What is going on here? > Error -3 means that calling the perl function link (between a file in the pool and a name in the pc tree) failed. Try manually doing something like the following from the command line: link b32585c3cc30b7ebb556d335a08554e3 /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml Potential reasons: - Files are on different filesystems - File system you are using doesn't allow hard links (what filesystem are you using) - Pool file somehow got erased before MakeFileLink was called or pc tree got erased - File system full (?) I guess I would ask what have you changed lately either for BackupPC specifically or on your setup in general? > Thanks, > Steve > > -- > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus > on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:http://backuppc.wiki.sourceforge.net > Project: http://backuppc.sourceforge.net/ > -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] 100,000+ errors in last nights backup
On Wed, 12 Aug 2009 10:06:37 -0400 "Jeffrey J. Kosowsky" wrote: > Steve Blackwell wrote at about 08:49:23 -0400 on Wednesday, August > 12, 2009: > > Backuppc has been behaving strangely lately. This is another > > instance. ... > > 05:00:06 Running BackupPC_link steve (pid=8901) > > 2009-08-12 05:00:08 BackupPC_link got error -3 when calling > > > MakeFileLink(/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml, > > b32585c3cc30b7ebb556d335a08554e3, 1) > > > > followed by 100,000+ of the same error on different files > > > > What is going on here? > > > > Error -3 means that calling the perl function link (between a file in > the pool and a name in the pc tree) failed. > > Try manually doing something like the following from the command line: > link > b32585c3cc30b7ebb556d335a08554e3 > /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml Where do I need to be to run this? > > Potential reasons: > - Files are on different filesystems > - File system you are using doesn't allow hard links (what filesystem > are you using) # mount ... /dev/sdd2 on /media/disk type ext3 (rw,nosuid,nodev,uhelper=hal) ... > - Pool file somehow got erased before MakeFileLink was called or pc > tree got erased > - File system full (?) >From logwatch: - Disk Space Begin FilesystemSize Used Avail Use% Mounted on /dev/mapper/VolGroup00-LogVol00 143G 57G 78G 43% / /dev/sdb1 190M 21M 160M 12% /boot /dev/sda1 112G 69G 44G 61% /mnt/c_drive /dev/sdc1 7.6G 783M 6.9G 11% /media/UDISK /dev/sdd1 466G 80M 466G 1% /media/WINDOWS_BACUP /dev/sdd2 459G 30G 406G 7% /media/disk -- Disk Space End - so plenty of space! > I guess I would ask what have you changed lately either for BackupPC > specifically or on your setup in general? The backup drive is a 1TB external USB and my computer is getting a little long in the tooth and the BIOS won't boot if I power on with it connected. So I get lazy and don't always plug it in and restart the backuppc service. What has changed is that I'm being more diligent in making my backups and perhaps more significantly, I have recently upgraded from F9 to F10. Thanks, Steve -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] 100,000+ errors in last nights backup
Steve Blackwell wrote: > Backuppc has been behaving strangely lately. This is another instance. > > This is part of the log file for host steve: > > 2009-08-12 01:00:06 full backup started for directory / > 2009-08-12 01:00:06 full backup started for directory / > 2009-08-12 05:00:06 Rename /media/disk/pc/steve/new > -> /media/disk/pc/steve/151 failed Out of inodes? Check with 'df -i'. -- Les Mikesell lesmikes...@gmail.com -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] 100,000+ errors in last nights backup
On Wed, 12 Aug 2009 10:19:47 -0500 Les Mikesell wrote: > Steve Blackwell wrote: > > Backuppc has been behaving strangely lately. This is another > > instance. > > > > This is part of the log file for host steve: > > > > 2009-08-12 01:00:06 full backup started for directory / > > 2009-08-12 01:00:06 full backup started for directory / > > 2009-08-12 05:00:06 Rename /media/disk/pc/steve/new > > -> /media/disk/pc/steve/151 failed > > Out of inodes? Check with 'df -i'. # df -i FilesystemInodes IUsed IFree IUse% Mounted on /dev/mapper/VolGroup00-LogVol00 38502400 300300 382021001% / /dev/sdb150200 40 501601% /boot tmpfs 129178 2 1291761% /dev/shm /dev/sda1 45944516 79740 458647761% /mnt/c_drive /dev/sdc10 0 0- /media/UDISK /dev/sdd1 488231440 23 488231417 1% /media/WINDOWS_BACUP /dev/sdd2 61063168 790151 602730172% /media/disk No problems there but thanks for the suggestion. Steve. -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] 100,000+ errors in last nights backup
Steve Blackwell wrote: > On Wed, 12 Aug 2009 10:19:47 -0500 > Les Mikesell wrote: > >> Steve Blackwell wrote: >>> Backuppc has been behaving strangely lately. This is another >>> instance. >>> >>> This is part of the log file for host steve: >>> >>> 2009-08-12 01:00:06 full backup started for directory / >>> 2009-08-12 01:00:06 full backup started for directory / >>> 2009-08-12 05:00:06 Rename /media/disk/pc/steve/new >>> -> /media/disk/pc/steve/151 failed >> Out of inodes? Check with 'df -i'. > > # df -i > FilesystemInodes IUsed IFree IUse% Mounted on > /dev/mapper/VolGroup00-LogVol00 >38502400 300300 382021001% / > /dev/sdb150200 40 501601% /boot > tmpfs 129178 2 1291761% /dev/shm > /dev/sda1 45944516 79740 458647761% /mnt/c_drive > /dev/sdc10 0 0- /media/UDISK > /dev/sdd1 488231440 23 488231417 1% /media/WINDOWS_BACUP > /dev/sdd2 61063168 790151 602730172% /media/disk > > No problems there but thanks for the suggestion. Can you 'mv /media/disk/pc/steve/new /media/disk/pc/steve/151' as the backuppc user? Also, look at the output of 'dmesg' - you might have physical disk errors. If this is a packaged (rpm) install, did you follow the wiki instructions for moving the storage location? -- Les Mikesell lesmikes...@gmail.com -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] 100,000+ errors in last nights backup
Les Mikesell wrote at about 10:19:47 -0500 on Wednesday, August 12, 2009: > Steve Blackwell wrote: > > Backuppc has been behaving strangely lately. This is another instance. > > > > This is part of the log file for host steve: > > > > 2009-08-12 01:00:06 full backup started for directory / > > 2009-08-12 01:00:06 full backup started for directory / > > 2009-08-12 05:00:06 Rename /media/disk/pc/steve/new > > -> /media/disk/pc/steve/151 failed > > Out of inodes? Check with 'df -i'. Don't hard links re-use the same inode? (remember it fails on the 'link' command) > -- >Les Mikesell > lesmikes...@gmail.com > > > > > > -- > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus > on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:http://backuppc.wiki.sourceforge.net > Project: http://backuppc.sourceforge.net/ > -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] 100,000+ errors in last nights backup
Steve Blackwell wrote at about 11:18:36 -0400 on Wednesday, August 12, 2009: > On Wed, 12 Aug 2009 10:06:37 -0400 > "Jeffrey J. Kosowsky" wrote: > > > Steve Blackwell wrote at about 08:49:23 -0400 on Wednesday, August > > 12, 2009: > > > Backuppc has been behaving strangely lately. This is another > > > instance. > > ... > > > 05:00:06 Running BackupPC_link steve (pid=8901) > > > 2009-08-12 05:00:08 BackupPC_link got error -3 when calling > > > > > MakeFileLink(/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml, > > > b32585c3cc30b7ebb556d335a08554e3, 1) > > > > > > followed by 100,000+ of the same error on different files > > > > > > What is going on here? > > > > > > > Error -3 means that calling the perl function link (between a file in > > the pool and a name in the pc tree) failed. > > > > Try manually doing something like the following from the command line: > > link > > b32585c3cc30b7ebb556d335a08554e3 > > /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml > > Where do I need to be to run this? >From the command line anywhere. Just type the command as-is. Actually type it as: su -u backuppc link ... so that it runs as user 'backuppc' If it works, you can undo it by typing: rm /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml (assuming the file didn't exist previously) > > > > > Potential reasons: > > - Files are on different filesystems > > - File system you are using doesn't allow hard links (what filesystem > > are you using) > > # mount > ... > /dev/sdd2 on /media/disk type ext3 (rw,nosuid,nodev,uhelper=hal) > ... > > > - Pool file somehow got erased before MakeFileLink was called or pc > > tree got erased > > - File system full (?) > > >From logwatch: > - Disk Space Begin > > FilesystemSize Used Avail Use% Mounted on > /dev/mapper/VolGroup00-LogVol00 >143G 57G 78G 43% / > /dev/sdb1 190M 21M 160M 12% /boot > /dev/sda1 112G 69G 44G 61% /mnt/c_drive > /dev/sdc1 7.6G 783M 6.9G 11% /media/UDISK > /dev/sdd1 466G 80M 466G 1% /media/WINDOWS_BACUP > /dev/sdd2 459G 30G 406G 7% /media/disk > > > -- Disk Space End - > so plenty of space! > > > I guess I would ask what have you changed lately either for BackupPC > > specifically or on your setup in general? > > The backup drive is a 1TB external USB and my computer is getting a > little long in the tooth and the BIOS won't boot if I power on with it > connected. So I get lazy and don't always plug it in and restart the > backuppc service. What has changed is that I'm being more diligent in > making my backups and perhaps more significantly, I have recently > upgraded from F9 to F10. > > Thanks, > Steve > > -- > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus > on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:http://backuppc.wiki.sourceforge.net > Project: http://backuppc.sourceforge.net/ > -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] 100,000+ errors in last nights backup
On Wed, 12 Aug 2009 12:24:04 -0400 "Jeffrey J. Kosowsky" wrote: > Steve Blackwell wrote at about 11:18:36 -0400 on Wednesday, August > 12, 2009: > > On Wed, 12 Aug 2009 10:06:37 -0400 > > "Jeffrey J. Kosowsky" wrote: > > > > > Steve Blackwell wrote at about 08:49:23 -0400 on Wednesday, > > > August 12, 2009: > > > > Backuppc has been behaving strangely lately. This is another > > > > instance. > > > > ... > > > > 05:00:06 Running BackupPC_link steve (pid=8901) > > > > 2009-08-12 05:00:08 BackupPC_link got error -3 when calling > > > > > MakeFileLink(/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml, > > > > b32585c3cc30b7ebb556d335a08554e3, 1) > > > > > > > > followed by 100,000+ of the same error on different files > > > > > > > > What is going on here? > > > > > > > > > > Error -3 means that calling the perl function link (between a > > > file in the pool and a name in the pc tree) failed. > > > > > > Try manually doing something like the following from the command > > > line: link > > > b32585c3cc30b7ebb556d335a08554e3 > /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml > > > > Where do I need to be to run this? > > >From the command line anywhere. Just type the command as-is. > Actually type it as: > su -u backuppc link ... > > so that it runs as user 'backuppc' > If it works, you can undo it by typing: > rm > /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml > (assuming the file didn't exist previously) su doesn't have a -u option. # su --help Usage: su [OPTION]... [-] [USER [ARG]...] Change the effective user id and group id to that of USER. -, -l, --login make the shell a login shell -c, --command=COMMANDpass a single COMMAND to the shell with -c --session-command=COMMANDpass a single COMMAND to the shell with -c and do not create a new session -f, --fast pass -f to the shell (for csh or tcsh) -m, --preserve-environment do not reset environment variables -p same as -m -s, --shell=SHELLrun SHELL if /etc/shells allows it --help display this help and exit --version output version information and exit A mere - implies -l. If USER not given, assume root. Report bugs to . # su backuppc link b32585c3cc30b7ebb556d335a08554e3 /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml This account is currently not available. # link b32585c3cc30b7ebb556d335a08554e3 /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml link: cannot create link `/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml' to `b32585c3cc30b7ebb556d335a08554e3': No such file or directory Steve -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] 100,000+ errors in last nights backup
On Wed, 12 Aug 2009 11:00:19 -0500 Les Mikesell wrote: > Steve Blackwell wrote: > > On Wed, 12 Aug 2009 10:19:47 -0500 > > Les Mikesell wrote: > > > >> Steve Blackwell wrote: > >>> Backuppc has been behaving strangely lately. This is another > >>> instance. > >>> > >>> This is part of the log file for host steve: > >>> > >>> 2009-08-12 01:00:06 full backup started for directory / > >>> 2009-08-12 01:00:06 full backup started for directory / > >>> 2009-08-12 05:00:06 Rename /media/disk/pc/steve/new > >>> -> /media/disk/pc/steve/151 failed > >> Out of inodes? Check with 'df -i'. > > > > # df -i > > FilesystemInodes IUsed IFree IUse% Mounted on > > /dev/mapper/VolGroup00-LogVol00 > >38502400 300300 382021001% / > > /dev/sdb150200 40 501601% /boot > > tmpfs 129178 2 1291761% /dev/shm > > /dev/sda1 45944516 79740 458647761% /mnt/c_drive > > /dev/sdc10 0 0- /media/UDISK > > /dev/sdd1 488231440 23 488231417 > > 1% /media/WINDOWS_BACUP /dev/sdd2 61063168 790151 > > 602730172% /media/disk > > > > No problems there but thanks for the suggestion. > > Can you 'mv /media/disk/pc/steve/151' as > the backuppc user? Also, look at the output of 'dmesg' - you might > have physical disk errors. If this is a packaged (rpm) install, did > you follow the wiki instructions for moving the storage location? > There is no file /media/disk/pc/steve/new. # ls -l /media/disk/pc/steve total 15388 drwxr-x--- 3 backuppc backuppc4096 2009-08-04 17:03 146 drwxr-x--- 3 backuppc backuppc4096 2009-08-05 20:18 147 drwxr-x--- 3 backuppc backuppc4096 2009-08-08 18:31 148 drwxr-x--- 3 backuppc backuppc4096 2009-08-11 02:10 150 drwxr-x--- 3 backuppc backuppc4096 2009-08-12 05:13 151 -rw-r- 1 backuppc backuppc 802 2009-08-12 05:21 backups -rw-r- 1 backuppc backuppc 799 2009-08-12 05:21 backups.old -rw-r- 1 backuppc backuppc 0 2008-07-26 19:00 LOCK -rw-r- 1 backuppc backuppc 585 2009-01-31 20:09 LOG.012009.z -rw-r- 1 backuppc backuppc 963 2009-02-28 20:40 LOG.022009.z -rw-r- 1 backuppc backuppc 412 2009-03-23 20:14 LOG.032009.z -rw-r- 1 backuppc backuppc 797 2009-04-26 20:09 LOG.042009.z -rw-r- 1 backuppc backuppc 172 2009-06-28 15:30 LOG.062009.z -rw-r- 1 backuppc backuppc 959 2008-08-31 20:05 LOG.082008.z -rw-r- 1 backuppc backuppc2308 2009-08-12 05:00 LOG.082009 -rw-r- 1 backuppc backuppc 748 2008-09-22 20:07 LOG.092008.z -rw-r- 1 backuppc backuppc 662 2008-10-31 20:11 LOG.102008.z -rw-r- 1 backuppc backuppc 625 2008-11-30 05:27 LOG.112008.z -rw-r- 1 backuppc backuppc 143 2008-12-09 05:05 LOG.122008.z -rw-r- 1 backuppc apache 290 2008-07-30 20:48 RestoreInfo.0 -rw-r- 1 backuppc backuppc 200 2008-07-30 20:48 RestoreLOG.0.z -rw-r- 1 backuppc backuppc 36 2008-07-30 20:48 restores -rw-r- 1 backuppc backuppc 4373346 2009-08-04 17:03 XferLOG.146.z -rw-r- 1 backuppc backuppc 439712 2009-08-05 20:18 XferLOG.147.z -rw-r- 1 backuppc backuppc 619036 2009-08-08 18:31 XferLOG.148.z -rw-r- 1 backuppc backuppc 1064831 2009-08-10 02:31 XferLOG.149.z -rw-r- 1 backuppc backuppc 848135 2009-08-11 02:10 XferLOG.150.z -rw-r- 1 backuppc backuppc 8149788 2009-08-12 05:00 XferLOG.151.z -rw-r- 1 backuppc backuppc 264 2008-07-29 12:25 XferLOG.bad.z.old Steve -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] 100,000+ errors in last nights backup
Steve Blackwell wrote: > On Wed, 12 Aug 2009 11:00:19 -0500 > Les Mikesell wrote: > >> Steve Blackwell wrote: >>> On Wed, 12 Aug 2009 10:19:47 -0500 >>> Les Mikesell wrote: >>> Steve Blackwell wrote: > Backuppc has been behaving strangely lately. This is another > instance. > > This is part of the log file for host steve: > > 2009-08-12 01:00:06 full backup started for directory / > 2009-08-12 01:00:06 full backup started for directory / > 2009-08-12 05:00:06 Rename /media/disk/pc/steve/new > -> /media/disk/pc/steve/151 failed Out of inodes? Check with 'df -i'. >>> # df -i >>> FilesystemInodes IUsed IFree IUse% Mounted on >>> /dev/mapper/VolGroup00-LogVol00 >>>38502400 300300 382021001% / >>> /dev/sdb150200 40 501601% /boot >>> tmpfs 129178 2 1291761% /dev/shm >>> /dev/sda1 45944516 79740 458647761% /mnt/c_drive >>> /dev/sdc10 0 0- /media/UDISK >>> /dev/sdd1 488231440 23 488231417 >>> 1% /media/WINDOWS_BACUP /dev/sdd2 61063168 790151 >>> 602730172% /media/disk >>> >>> No problems there but thanks for the suggestion. >> Can you 'mv /media//disk/pc/steve/new /media/disk/pc/steve/151' as >> the backuppc user? Also, look at the output of 'dmesg' - you might >> have physical disk errors. If this is a packaged (rpm) install, did >> you follow the wiki instructions for moving the storage location? >> > > There is no file /media/disk/pc/steve/new. > > # ls -l /media/disk/pc/steve > total 15388 > drwxr-x--- 3 backuppc backuppc4096 2009-08-04 17:03 146 > drwxr-x--- 3 backuppc backuppc4096 2009-08-05 20:18 147 > drwxr-x--- 3 backuppc backuppc4096 2009-08-08 18:31 148 > drwxr-x--- 3 backuppc backuppc4096 2009-08-11 02:10 150 > drwxr-x--- 3 backuppc backuppc4096 2009-08-12 05:13 151 > -rw-r- 1 backuppc backuppc 802 2009-08-12 05:21 backups > -rw-r- 1 backuppc backuppc 799 2009-08-12 05:21 backups.old > -rw-r- 1 backuppc backuppc 0 2008-07-26 19:00 LOCK > -rw-r- 1 backuppc backuppc 585 2009-01-31 20:09 LOG.012009.z > -rw-r- 1 backuppc backuppc 963 2009-02-28 20:40 LOG.022009.z > -rw-r- 1 backuppc backuppc 412 2009-03-23 20:14 LOG.032009.z > -rw-r- 1 backuppc backuppc 797 2009-04-26 20:09 LOG.042009.z > -rw-r- 1 backuppc backuppc 172 2009-06-28 15:30 LOG.062009.z > -rw-r- 1 backuppc backuppc 959 2008-08-31 20:05 LOG.082008.z > -rw-r- 1 backuppc backuppc2308 2009-08-12 05:00 LOG.082009 > -rw-r- 1 backuppc backuppc 748 2008-09-22 20:07 LOG.092008.z > -rw-r- 1 backuppc backuppc 662 2008-10-31 20:11 LOG.102008.z > -rw-r- 1 backuppc backuppc 625 2008-11-30 05:27 LOG.112008.z > -rw-r- 1 backuppc backuppc 143 2008-12-09 05:05 LOG.122008.z > -rw-r- 1 backuppc apache 290 2008-07-30 20:48 RestoreInfo.0 > -rw-r- 1 backuppc backuppc 200 2008-07-30 20:48 RestoreLOG.0.z > -rw-r- 1 backuppc backuppc 36 2008-07-30 20:48 restores > -rw-r- 1 backuppc backuppc 4373346 2009-08-04 17:03 XferLOG.146.z > -rw-r- 1 backuppc backuppc 439712 2009-08-05 20:18 XferLOG.147.z > -rw-r- 1 backuppc backuppc 619036 2009-08-08 18:31 XferLOG.148.z > -rw-r- 1 backuppc backuppc 1064831 2009-08-10 02:31 XferLOG.149.z > -rw-r- 1 backuppc backuppc 848135 2009-08-11 02:10 XferLOG.150.z > -rw-r- 1 backuppc backuppc 8149788 2009-08-12 05:00 XferLOG.151.z > -rw-r- 1 backuppc backuppc 264 2008-07-29 12:25 > XferLOG.bad.z.old > So a subsequent backup has completed? Or was the 151 directory there before? If it wasn't there and that rename failed, there would be an obvious reason for the subsequent link failures involving things under the 151 directory. -- Les Mikesell -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] 100,000+ errors in last nights backup
Steve Blackwell wrote at about 13:27:17 -0400 on Wednesday, August 12, 2009: > On Wed, 12 Aug 2009 12:24:04 -0400 > "Jeffrey J. Kosowsky" wrote: > > > Steve Blackwell wrote at about 11:18:36 -0400 on Wednesday, August > > 12, 2009: > > > On Wed, 12 Aug 2009 10:06:37 -0400 > > > "Jeffrey J. Kosowsky" wrote: > > > > > > > Steve Blackwell wrote at about 08:49:23 -0400 on Wednesday, > > > > August 12, 2009: > > > > > Backuppc has been behaving strangely lately. This is another > > > > > instance. > > > > > > ... > > > > > 05:00:06 Running BackupPC_link steve (pid=8901) > > > > > 2009-08-12 05:00:08 BackupPC_link got error -3 when calling > > > > > > > MakeFileLink(/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml, > > > > > b32585c3cc30b7ebb556d335a08554e3, 1) > > > > > > > > > > followed by 100,000+ of the same error on different files > > > > > > > > > > What is going on here? > > > > > > > > > > > > > Error -3 means that calling the perl function link (between a > > > > file in the pool and a name in the pc tree) failed. > > > > > > > > Try manually doing something like the following from the command > > > > line: link > > > > b32585c3cc30b7ebb556d335a08554e3 > > /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml > > > > > > Where do I need to be to run this? > > > > >From the command line anywhere. Just type the command as-is. > > Actually type it as: > > su -u backuppc link ... > > > > so that it runs as user 'backuppc' > > If it works, you can undo it by typing: > > rm > > /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml > > (assuming the file didn't exist previously) > > su doesn't have a -u option. > run: sudo -u backuppc or su backuppc -c "link..." -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] 100,000+ errors in last nights backup
On Wed, 12 Aug 2009 12:54:05 -0500 Les Mikesell wrote: > Steve Blackwell wrote: > > On Wed, 12 Aug 2009 11:00:19 -0500 > > Les Mikesell wrote: > > > >> Steve Blackwell wrote: > >>> On Wed, 12 Aug 2009 10:19:47 -0500 > >>> Les Mikesell wrote: > >>> > Steve Blackwell wrote: > > Backuppc has been behaving strangely lately. This is another > > instance. > > > > This is part of the log file for host steve: > > > > 2009-08-12 01:00:06 full backup started for directory / > > 2009-08-12 01:00:06 full backup started for directory / > > 2009-08-12 05:00:06 Rename /media/disk/pc/steve/new > > -> /media/disk/pc/steve/151 failed > > > Out of inodes? Check with 'df -i'. > >>> # df -i > >>> FilesystemInodes IUsed IFree IUse% Mounted on > >>> /dev/mapper/VolGroup00-LogVol00 > >>>38502400 300300 382021001% / > >>> /dev/sdb150200 40 501601% /boot > >>> tmpfs 129178 2 1291761% /dev/shm > >>> /dev/sda1 45944516 79740 458647761% /mnt/c_drive > >>> /dev/sdc10 0 0- /media/UDISK > >>> /dev/sdd1 488231440 23 488231417 > >>> 1% /media/WINDOWS_BACUP /dev/sdd2 61063168 790151 > >>> 602730172% /media/disk > >>> > >>> No problems there but thanks for the suggestion. > >> Can you 'mv /media//disk/pc/steve/new /media/disk/pc/steve/151' as > >> the backuppc user? Also, look at the output of 'dmesg' - you might > >> have physical disk errors. If this is a packaged (rpm) install, > >> did you follow the wiki instructions for moving the storage > >> location? > >> > > > > There is no file /media/disk/pc/steve/new. > > > > # ls -l /media/disk/pc/steve > > total 15388 > > drwxr-x--- 3 backuppc backuppc4096 2009-08-04 17:03 146 > > drwxr-x--- 3 backuppc backuppc4096 2009-08-05 20:18 147 > > drwxr-x--- 3 backuppc backuppc4096 2009-08-08 18:31 148 > > drwxr-x--- 3 backuppc backuppc4096 2009-08-11 02:10 150 > > drwxr-x--- 3 backuppc backuppc4096 2009-08-12 05:13 151 > > -rw-r- 1 backuppc backuppc 802 2009-08-12 05:21 backups > > -rw-r- 1 backuppc backuppc 799 2009-08-12 05:21 backups.old > > -rw-r- 1 backuppc backuppc 0 2008-07-26 19:00 LOCK > > -rw-r- 1 backuppc backuppc 585 2009-01-31 20:09 LOG.012009.z > > -rw-r- 1 backuppc backuppc 963 2009-02-28 20:40 LOG.022009.z > > -rw-r- 1 backuppc backuppc 412 2009-03-23 20:14 LOG.032009.z > > -rw-r- 1 backuppc backuppc 797 2009-04-26 20:09 LOG.042009.z > > -rw-r- 1 backuppc backuppc 172 2009-06-28 15:30 LOG.062009.z > > -rw-r- 1 backuppc backuppc 959 2008-08-31 20:05 LOG.082008.z > > -rw-r- 1 backuppc backuppc2308 2009-08-12 05:00 LOG.082009 > > -rw-r- 1 backuppc backuppc 748 2008-09-22 20:07 LOG.092008.z > > -rw-r- 1 backuppc backuppc 662 2008-10-31 20:11 LOG.102008.z > > -rw-r- 1 backuppc backuppc 625 2008-11-30 05:27 LOG.112008.z > > -rw-r- 1 backuppc backuppc 143 2008-12-09 05:05 LOG.122008.z > > -rw-r- 1 backuppc apache 290 2008-07-30 20:48 > > Restoreinfo.0 -rw-r- 1 backuppc backuppc 200 2008-07-30 > > 20:48 RestoreLOG.0.z -rw-r- 1 backuppc backuppc 36 > > 2008-07-30 20:48 restores -rw-r- 1 backuppc backuppc 4373346 > > 2009-08-04 17:03 XferLOG.146.z -rw-r- 1 backuppc backuppc > > 439712 2009-08-05 20:18 XferLOG.147.z -rw-r- 1 backuppc > > backuppc 619036 2009-08-08 18:31 XferLOG.148.z -rw-r- 1 > > backuppc backuppc 1064831 2009-08-10 02:31 XferLOG.149.z -rw-r- > > 1 backuppc backuppc 848135 2009-08-11 02:10 XferLOG.150.z > > -rw-r- 1 backuppc backuppc 8149788 2009-08-12 05:00 > > XferLOG.151.z -rw-r- 1 backuppc backuppc 264 2008-07-29 > > 12:25 XferLOG.bad.z.old > > > > So a subsequent backup has completed? Or was the 151 directory there > before? If it wasn't there and that rename failed, there would be an > obvious reason for the subsequent link failures involving things > under the 151 directory. As I said in my original e-mail: > 2009-08-12 01:00:06 full backup started for directory / > 2009-08-12 01:00:06 full backup started for directory / > 2009-08-12 05:00:06 Rename /media/disk/pc/steve/new -> /media/disk/pc/steve/151 failed > 2009-08-12 05:00:06 full backup complete, 388335 files, 0 bytes, 2 xferErrs (0 bad files, 0 bad shares, 2 other) > 2009-08-12 05:00:06 full backup 151 complete, 388335 files, 0 bytes, 2 xferErrs (0 bad files, 0 bad shares, 2 other) > > Apart from the fact that the backup seems to have started twice (Maybe > just logged twice?)..." So perhaps backuppc is somehow scheduling the backup to run twice at the same time but then if the rename of 'new' to '151' is failing, what is creating '151'? Does the first backup do the rename so that 'new' does not exist for the 2nd backup? That might explain things but then how is the backup scheduled twice?
Re: [BackupPC-users] 100,000+ errors in last nights backup
On Wed, 12 Aug 2009 14:18:04 -0400 "Jeffrey J. Kosowsky" wrote: > Steve Blackwell wrote at about 13:27:17 -0400 on Wednesday, August > 12, 2009: > > On Wed, 12 Aug 2009 12:24:04 -0400 > > "Jeffrey J. Kosowsky" wrote: > > > > > Steve Blackwell wrote at about 11:18:36 -0400 on Wednesday, > > > August 12, 2009: > > > > On Wed, 12 Aug 2009 10:06:37 -0400 > > > > "Jeffrey J. Kosowsky" wrote: > > > > > > > > > Steve Blackwell wrote at about 08:49:23 -0400 on Wednesday, > > > > > August 12, 2009: > > > > > > Backuppc has been behaving strangely lately. This is > > > > > > another instance. > > > > > > > > ... > > > > > > 05:00:06 Running BackupPC_link steve (pid=8901) > > > > > > 2009-08-12 05:00:08 BackupPC_link got error -3 when > > > > > > calling > > > > > > > MakeFileLink(/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml, > > > > > > b32585c3cc30b7ebb556d335a08554e3, 1) > > > > > > > > > > > > followed by 100,000+ of the same error on different files > > > > > > > > > > > > What is going on here? > > > > > > > > > > > > > > > > Error -3 means that calling the perl function link (between > > > > > a file in the pool and a name in the pc tree) failed. > > > > > > > > > > Try manually doing something like the following from the > > > > > command line: link > > > > > b32585c3cc30b7ebb556d335a08554e3 > /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml > > > > > > > > Where do I need to be to run this? > > > > > > >From the command line anywhere. Just type the command as-is. > > > Actually type it as: > > > su -u backuppc link ... > > > > > > so that it runs as user 'backuppc' > > > If it works, you can undo it by typing: > > > rm > /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml > > > (assuming the file didn't exist previously) > > > > su doesn't have a -u option. > > > > run: sudo -u backuppc > or su backuppc -c "link..." # sudo -u backuppc link b32585c3cc30b7ebb556d335a08554e3 /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml link: cannot create link `/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml' to `b32585c3cc30b7ebb556d335a08554e3': No such file or directory Jeffrey, I'm now thinking that two backups have somehow been scheduled at the same. See the Les Miskell thread. Steve -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] 100,000+ errors in last nights backup
Hi, On Wed, Aug 12, 2009 at 08:49, Steve Blackwell wrote: > 2009-08-12 05:00:08 BackupPC_link got error -3 when calling > MakeFileLink(/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml, > b32585c3cc30b7ebb556d335a08554e3, 1) > > followed by 100,000+ of the same error on different files > > What is going on here? I used to have exactly this problem. I guess you changed TopDir in your config.pl file, right? Well, BackupPC 3.1.0 has a bug in that TopDir change will not affect the "pool" and "cpool" directories, so it will try to create a hardlink in /var/lib/BackupPC for a file in /media/disk, which are in different filesystems, so it fails. See this post for a patch that can be used to fix this issue: http://sourceforge.net/mailarchive/message.php?msg_name=20080808032558.GG13869%40gratch.parplies.de Alternatively, you may remove the /var/lib/BackupPC directory and create a symbolic link to /media/disk in its place. You can also upgrade your setup to 3.2.0 beta, which has this bug already fixed. HTH, Filipe -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] 100,000+ errors in last nights backup
Steve Blackwell wrote at about 14:33:54 -0400 on Wednesday, August 12, 2009: > On Wed, 12 Aug 2009 14:18:04 -0400 > "Jeffrey J. Kosowsky" wrote: > > > Steve Blackwell wrote at about 13:27:17 -0400 on Wednesday, August > > 12, 2009: > > > On Wed, 12 Aug 2009 12:24:04 -0400 > > > "Jeffrey J. Kosowsky" wrote: > > > > > > > Steve Blackwell wrote at about 11:18:36 -0400 on Wednesday, > > > > August 12, 2009: > > > > > On Wed, 12 Aug 2009 10:06:37 -0400 > > > > > "Jeffrey J. Kosowsky" wrote: > > > > > > > > > > > Steve Blackwell wrote at about 08:49:23 -0400 on Wednesday, > > > > > > August 12, 2009: > > > > > > > Backuppc has been behaving strangely lately. This is > > > > > > > another instance. > > > > > > > > > > ... > > > > > > > 05:00:06 Running BackupPC_link steve (pid=8901) > > > > > > > 2009-08-12 05:00:08 BackupPC_link got error -3 when > > > > > > > calling > > > > > > > > > MakeFileLink(/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml, > > > > > > > b32585c3cc30b7ebb556d335a08554e3, 1) > > > > > > > > > > > > > > followed by 100,000+ of the same error on different files > > > > > > > > > > > > > > What is going on here? > > > > > > > > > > > > > > > > > > > Error -3 means that calling the perl function link (between > > > > > > a file in the pool and a name in the pc tree) failed. > > > > > > > > > > > > Try manually doing something like the following from the > > > > > > command line: link > > > > > > b32585c3cc30b7ebb556d335a08554e3 > > /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml > > > > > > > > > > Where do I need to be to run this? > > > > > > > > >From the command line anywhere. Just type the command as-is. > > > > Actually type it as: > > > > su -u backuppc link ... > > > > > > > > so that it runs as user 'backuppc' > > > > If it works, you can undo it by typing: > > > > rm > > /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml > > > > (assuming the file didn't exist previously) > > > > > > su doesn't have a -u option. > > > > > > > run: sudo -u backuppc > > or su backuppc -c "link..." > > # sudo -u backuppc link > b32585c3cc30b7ebb556d335a08554e3 > /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml > link: cannot create link > `/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml' > to `b32585c3cc30b7ebb556d335a08554e3': No such file or directory > > > Jeffrey, I'm now thinking that two backups have somehow been scheduled > at the same. See the Les Miskell thread. > > Steve > I don't know. I am perplexed since the code that is creating the error code '3' is as follows (from MakeFileLink in Lib.pm): return -1 if ( !-f $name ); for ( $i = -1 ; ; $i++ ) { return -2 if ( !defined($rawFile = $bpc->MD52Path($d, $compress)) ); $rawFile .= "_$i" if ( $i >= 0 ); if ( -f $rawFile ) { if ( (stat(_))[3] < $bpc->{Conf}{HardLinkMax} && !compare($name, $rawFile) ) { unlink($name); return -3 if ( !link($rawFile, $name) ); Now: $name exists (per the test in the first line) $rawFile exists (per the test in line 6) yet the link fails a couple of lines later. So unless there is an incredibly precise race condition and assuming links work on your machine, the 'link' in the final line should succeed. It is hard to believe that there could be a repeatable race condition with another backup that is so precise that a file exists in one line and then no longer exists just a couple of simple lines of perl code later. I'm still wondering whether there is some problem with linking/unlinking on your computer. So the problem is either that the unlink (i.e., delete) fails in the next to last line or the link fails in the last line. You may also want to look at ownership/permissions in your pc tree to make sure that the relevant files and directories are writable by user backuppc. Also, why don't you try re-running the manual link line that I gave you but this time link against a known *existing* (random) pool file. Also try something like: su backuppc -c "touch /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/tempfile" su backuppc -c "rm /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/tempfile" This will test user backuppc's ability to create and delete files in the pc tree where it failed before. -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and depl
Re: [BackupPC-users] 100,000+ errors in last nights backup
Filipe Brandenburger wrote at about 14:40:34 -0400 on Wednesday, August 12, 2009: > Hi, > > On Wed, Aug 12, 2009 at 08:49, Steve Blackwell wrote: > > 2009-08-12 05:00:08 BackupPC_link got error -3 when calling > > MakeFileLink(/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml, > > b32585c3cc30b7ebb556d335a08554e3, 1) > > > > followed by 100,000+ of the same error on different files > > > > What is going on here? > > I used to have exactly this problem. > > I guess you changed TopDir in your config.pl file, right? > > Well, BackupPC 3.1.0 has a bug in that TopDir change will not affect > the "pool" and "cpool" directories, so it will try to create a > hardlink in /var/lib/BackupPC for a file in /media/disk, which are in > different filesystems, so it fails. > Yes - I had suggested that the problem might be that the pool and pc trees are not on the same filesystem. -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] 100,000+ errors in last nights backup
Hi, Jeffrey J. Kosowsky wrote on 2009-08-12 18:12:09 -0400 [Re: [BackupPC-users] 100,000+ errors in last nights backup]: > Steve Blackwell wrote at about 14:33:54 -0400 on Wednesday, August 12, 2009: > > > > > Steve Blackwell wrote at about 11:18:36 -0400 on Wednesday, August > 12, 2009: > > > > > > On Wed, 12 Aug 2009 10:06:37 -0400 "Jeffrey J. Kosowsky" > wrote: > > > > > > > Try manually doing something like the following from the > > > > > > > command line: link > > > > > > > b32585c3cc30b7ebb556d335a08554e3 > /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml > > > > > > > > > > > > Where do I need to be to run this? you need to be in $TopDir/cpool/b/3/2 ... or rather, it should be sudo -u backuppc ln $TopDir/cpool/b/3/2/b32585c3cc30b7ebb556d335a08554e3 /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml (or use 'link' if you prefer). You need to get $TopDir right though. See below. > > # sudo -u backuppc link > > b32585c3cc30b7ebb556d335a08554e3 > /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml > > link: cannot create link > > > `/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml' > > to `b32585c3cc30b7ebb556d335a08554e3': No such file or directory Yes, most directories won't contain a file with that name ;-). > > Jeffrey, I'm now thinking that two backups have somehow been scheduled > > at the same. See the Les Miskell thread. I agree with that except for the name. But I don't think it's the problem, at least not the one you're looking for. I can't imagine why two backups of the same host would be scheduled simultaneously, and I don't think it's a good idea to do so :-). BackupPC doesn't usually do this. Have you changed the code in any way? Have you seen such a thing happen before? > I don't know. I am perplexed since the code that is creating the error > code '3' is as follows (from MakeFileLink in Lib.pm): > > return -1 if ( !-f $name ); > for ( $i = -1 ; ; $i++ ) { > return -2 if ( !defined($rawFile = $bpc->MD52Path($d, > $compress)) ); > $rawFile .= "_$i" if ( $i >= 0 ); > if ( -f $rawFile ) { > if ( (stat(_))[3] < $bpc->{Conf}{HardLinkMax} > && !compare($name, $rawFile) ) { > unlink($name); > return -3 if ( !link($rawFile, $name) ); > > > Now: > $name exists (per the test in the first line) > $rawFile exists (per the test in line 6) > yet the link fails a couple of lines later. > > So unless there is an incredibly precise race condition Is there such a thing as a "precise race condition"? If it always happened in the same order, would it even be a race condition? > and assuming links work on your machine, the 'link' in the final line should > succeed. It is hard to believe that there could be a repeatable race > condition with another backup that is so precise that a file exists in > one line and then no longer exists just a couple of simple lines of > perl code later. Ah, but it's not just a couple of simple lines of Perl code. Note the 'compare' call in line 8 (File::Compare::compare, if you were wondering), which will take an arbitrary amount of time (and lead to an arbitrary number of page faults/task switches, depending only on the size of the files). But the point really is that between lines *9 and 10* (unlink/link) nothing significant happens (unless unlink() always leads to a task switch, which I doubt). Even then, $rawFile continues to -f, and deleting a link and replacing it with a new link to the same file should succeed any number of times. Only if interrupted *between unlink and link*, the process *might* find upon being rescheduled that the link() fails because another process has already created the file again. But all of that is really beside the point. Let's take a step back. Where are we? We're in BackupPC_link, not in BackupPC_dump. As the log file shows (XferLOG for host steve), the backup is apparently run twice in parallel, leading to the failed rename (only one backup can succeed to rename 'new' to '151', though I'm not sure what will happen to the 'backups' file). The main log file only indicates one instance of BackupPC_link being run though (and one instance of BackupPC will never run more than one BackupPC_link command at the same time in a
Re: [BackupPC-users] 100,000+ errors in last nights backup
On Wed, 12 Aug 2009 18:12:09 -0400 "Jeffrey J. Kosowsky" wrote: > Steve Blackwell wrote at about 14:33:54 -0400 on Wednesday, August > 12, 2009: > > On Wed, 12 Aug 2009 14:18:04 -0400 > > "Jeffrey J. Kosowsky" wrote: > > > > > Steve Blackwell wrote at about 13:27:17 -0400 on Wednesday, > > > August 12, 2009: > > > > On Wed, 12 Aug 2009 12:24:04 -0400 > > > > "Jeffrey J. Kosowsky" wrote: > > > > > > > > > Steve Blackwell wrote at about 11:18:36 -0400 on Wednesday, > > > > > August 12, 2009: > > > > > > On Wed, 12 Aug 2009 10:06:37 -0400 > > > > > > "Jeffrey J. Kosowsky" wrote: > > > > > > > > > > > > > Steve Blackwell wrote at about 08:49:23 -0400 on > > > > > > > Wednesday, August 12, 2009: > > > > > > > > Backuppc has been behaving strangely lately. This is > > > > > > > > another instance. > > > > > > > > > > > > ... > > > > > > > > 05:00:06 Running BackupPC_link steve (pid=8901) > > > > > > > > 2009-08-12 05:00:08 BackupPC_link got error -3 when > > > > > > > > calling > > > > > > > > > MakeFileLink(/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml, > > > > > > > > b32585c3cc30b7ebb556d335a08554e3, 1) > > > > > > > > > > > > > > > > followed by 100,000+ of the same error on different > > > > > > > > files > > > > > > > > > > > > > > > > What is going on here? > > > > > > > > > > > > > > > > > > > > > > Error -3 means that calling the perl function link > > > > > > > (between a file in the pool and a name in the pc tree) > > > > > > > failed. > > > > > > > > > > > > > > Try manually doing something like the following from > > > > > > > the command line: link > > > > > > > b32585c3cc30b7ebb556d335a08554e3 > /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml > > > > > > > > > > > > Where do I need to be to run this? > > > > > > > > > > >From the command line anywhere. Just type the command > > > > > >as-is. > > > > > Actually type it as: > > > > > su -u backuppc link ... > > > > > > > > > > so that it runs as user 'backuppc' > > > > > If it works, you can undo it by typing: > > > > > rm > /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml > > > > > (assuming the file didn't exist previously) > > > > > > > > su doesn't have a -u option. > > > > > > > > > > run: sudo -u backuppc > > > or su backuppc -c "link..." > > > > # sudo -u backuppc link > > b32585c3cc30b7ebb556d335a08554e3 > /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml > > link: cannot create link > > > `/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml' > > to `b32585c3cc30b7ebb556d335a08554e3': No such file or directory > > > > > > Jeffrey, I'm now thinking that two backups have somehow been > > scheduled at the same. See the Les Miskell thread. > > > > Steve > > > > I don't know. I am perplexed since the code that is creating the error > code '3' is as follows (from MakeFileLink in Lib.pm): > > return -1 if ( !-f $name ); > for ( $i = -1 ; ; $i++ ) { > return -2 if ( !defined($rawFile = $bpc->MD52Path($d, > $compress)) ); > $rawFile .= "_$i" if ( $i >= 0 ); > if ( -f $rawFile ) { > if ( (stat(_))[3] < $bpc->{Conf}{HardLinkMax} > && !compare($name, $rawFile) ) { > unlink($name); > return -3 if ( !link($rawFile, $name) ); > > > Now: > $name exists (per the test in the first line) > $rawFile exists (per the test in line 6) > yet the link fails a couple of lines later. > > So unless there is an incredibly precise race condition and assuming > links work on your machine, the 'link' in the final line should > succeed. It is hard to believe that there could be a repeatable race > condition with another backup that is so precise that a file exists in > one line and then no longer exists just a couple of simple lines of > perl code later. > > I'm still wondering whether there is some problem with > linking/unlinking on your computer. So the problem is either that the > unlink (i.e., delete) fails in the next to last line or the link fails > in the last line. You may also want to look at ownership/permissions > in your pc tree to make sure that the relevant files and directories > are writable by user backuppc. > > Also, why don't you try re-running the manual link line that I gave > you but this time link against a known *existing* (random) pool file. > Also try something like: > > su backuppc -c > "touch > /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/tempfile" > su backuppc -c > "rm > /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboa
Re: [BackupPC-users] 100,000+ errors in last nights backup
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Holger Parplies wrote: > We're in BackupPC_link, not in BackupPC_dump. As the log file shows (XferLOG > for host steve), the backup is apparently run twice in parallel, leading to > the failed rename (only one backup can succeed to rename 'new' to '151', > though I'm not sure what will happen to the 'backups' file). The main log file > only indicates one instance of BackupPC_link being run though (and one > instance of BackupPC will never run more than one BackupPC_link command at the > same time in any case). I've frequently managed to cause two backuppc_dump's to run in parallel where one was scheduled by backuppc and one was run manually by me from the command line. It would be nice if backuppc_dump could do a simple check to see if the new directory already exists, and if so, simple exit (or error and exit). Mainly I run backups manually so I can see exactly what is happening during the backup and where/why it is failing or taking so long. Sometimes I remember to use the gui to stop backups for that host for a period of time, and again, sometimes that isn't long enough... Regards, Adam -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.9 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkqDp74ACgkQGyoxogrTyiXEQwCgusv36QQNe2aDmeRhQSix7k9T t8AAnjL/XfeZCeRruovoLvaISc2cLKpE =zeTZ -END PGP SIGNATURE- -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] 100,000+ errors in last nights backup
Holger, I started to reply to your e-mail but my system crashed. The messages log suggests that backuppc may have been the culprit. See below. On Thu, 13 Aug 2009 02:19:25 +0200 Holger Parplies wrote: > Hi, > > Jeffrey J. Kosowsky wrote on 2009-08-12 18:12:09 -0400 [Re: > [BackupPC-users] 100,000+ errors in last nights backup]: > > Steve Blackwell wrote at about 14:33:54 -0400 on Wednesday, August > > 12, 2009: > > > > > > Steve Blackwell wrote at about 11:18:36 -0400 on > > > > > > Wednesday, August 12, 2009: > > > > > > > On Wed, 12 Aug 2009 10:06:37 -0400 "Jeffrey J. > > > > > > > Kosowsky" wrote: > > > > > > > > Try manually doing something like the following from > > > > > > > > the command line: link > > > > > > > > b32585c3cc30b7ebb556d335a08554e3 > > /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml > > > > > > > > > > > > > > Where do I need to be to run this? > > you need to be in $TopDir/cpool/b/3/2 ... or rather, it should be > > sudo -u backuppc ln > $TopDir/cpool/b/3/2/b32585c3cc30b7ebb556d335a08554e3 > /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml my $TopDir is /media/disk. I ran the command above and it appeared to work OK. I don't have the exact result anymore because of the crash. > (or use 'link' if you prefer). You need to get $TopDir right though. > See below. > > > > # sudo -u backuppc link > > > b32585c3cc30b7ebb556d335a08554e3 > > /media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml > > > link: cannot create link > > > > > `/media/disk/pc/steve/151/f%2f/froot/f.gconf/fdesktop/fgnome/faccessibility/fkeyboard/f%25gconf.xml' > > > to `b32585c3cc30b7ebb556d335a08554e3': No such file or directory > > Yes, most directories won't contain a file with that name ;-). > > > > Jeffrey, I'm now thinking that two backups have somehow been > > > scheduled at the same. See the Les Miskell thread. > > I agree with that except for the name. But I don't think it's the > problem, at least not the one you're looking for. I can't imagine why > two backups of the same host would be scheduled simultaneously, and I > don't think it's a good idea to do so :-). BackupPC doesn't usually > do this. Have you changed the code in any way? Have you seen such a > thing happen before? Could I have started the backuppc service twice somehow? I certainly haven't changed any of the code. I haven't written any perl since perl 4 circa 1995. 8>< [snip] > So, I believe we're back to the issue of what you did wrong when > moving $TopDir. I don't remember reading which version of BackupPC When moving $TopDir? I haven't moved it. It's always been /media/disk ever since I installed backuppc. > you are using. What did you do to move $TopDir? Have a look at the > old location, wherever that was. Are there files with recent > modification times below the cpool/ directory? > Below /media/disk/cpool? BackupPC_nightly reports files there, but # ls -l /media/disk total 48 drwxr-x--- 18 backuppc root 4096 2009-08-12 20:00 cpool drwx-- 2 root root 16384 2008-07-16 23:54 lost+found drwxr-x--- 4 backuppc root 4096 2009-08-09 23:06 pc drwxr-x--- 2 backuppc root 4096 2008-07-26 18:53 pool drwxr-x--- 2 backuppc root 4096 2009-08-11 01:25 trash So cpool has today's date ]# ls -l /media/disk/cpool total 128 drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 0 drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 1 drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 2 drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 3 drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 4 drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 5 drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 6 drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 7 drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 8 drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 9 drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 a drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 b drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 c drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 d drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 e drwxr-x--- 18 backuppc backuppc 4096 2009-06-28 15:30 f Nothing since 6/28. This is where I got to when the machine crashed. Looking at /var/log/messages I see this: Aug 12 20:00:12 steve kernel
Re: [BackupPC-users] 100,000+ errors in last nights backup
Steve Blackwell wrote: > >> So, I believe we're back to the issue of what you did wrong when >> moving $TopDir. I don't remember reading which version of BackupPC > > When moving $TopDir? I haven't moved it. It's always been /media/disk > ever since I installed backuppc. If you installed from the sourceforge tarball you can set the location anywhere you want. However it is a very common problem with packaged (rpm/deb) installations that people try to move the storage location after installation and it doesn't work to simply change $TopDir once it is set. But, I didn't think that was your problem since you were at backup 150 before seeing a problem. There is still the possibility of a physical disk error. External drives aren't all that reliable - but that should be reported in 'dmesg'. -- Les Mikesell lesmikes...@gmail.com -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] 100,000+ errors in last nights backup
Last night's backup, after the restart due to the crash appears to have worked OK. Here is the server log file: 2009-08-13 01:00:00 Running 2 BackupPC_nightly jobs from 0..15 (out of 0..15) 2009-08-13 01:00:00 Running BackupPC_nightly -m 0 127 (pid=5801) 2009-08-13 01:00:00 Running BackupPC_nightly 128 255 (pid=5802) 2009-08-13 01:00:00 Next wakeup is 2009-08-13 02:00:00 2009-08-13 01:00:02 Started incr backup on steve (pid=5803, share=/) 2009-08-13 01:06:37 Finished admin1 (BackupPC_nightly 128 255) 2009-08-13 01:06:37 BackupPC_nightly now running BackupPC_sendEmail 2009-08-13 01:06:47 Finished admin (BackupPC_nightly -m 0 127) 2009-08-13 01:06:47 Pool nightly clean removed 0 files of size 0.00GB 2009-08-13 01:06:47 Pool is 0.00GB, 0 files (0 repeated, 0 max chain, 0 max links), 1 directories 2009-08-13 01:06:47 Cpool nightly clean removed 1 files of size 0.00GB 2009-08-13 01:06:47 Cpool is 15.90GB, 397513 files (48553 repeated, 11 max chain, 794 max links), 4369 directories 2009-08-13 01:29:59 Finished incr backup on steve 2009-08-13 01:29:59 Running BackupPC_link steve (pid=5977) 2009-08-13 01:30:21 Finished steve (BackupPC_link steve) and the corresponding log file from steve: 2009-08-13 01:00:02 incr backup started back to 2009-08-12 00:00:06 (backup #151) for directory / 2009-08-13 01:29:59 incr backup 152 complete, 41555 files, 0 bytes, 0 xferErrs (0 bad files, 0 bad shares, 0 other) I didn't change any settings. I think it's worse when things magically start to work than when they continue to fail. [:-P Steve -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] 100,000+ errors in last nights backup
Steve Blackwell wrote: > > I didn't change any settings. I think it's worse when things magically > start to work than when they continue to fail. [:-P Running Fedora or some other close-to-beta OS? -- Les Mikesell lesmikes...@gmail.com -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] 100,000+ errors in last nights backup
On Thu, 13 Aug 2009 10:18:20 -0500 Les Mikesell wrote: > Steve Blackwell wrote: > > > > I didn't change any settings. I think it's worse when things > > magically start to work than when they continue to fail. [:-P > > Running Fedora or some other close-to-beta OS? > F10. I use the oldest supported version in an attempt to step away from the bleeding edge. That strategy has worked up until this version. Steve. -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] 100,000+ errors in last nights backup
Hi, Adam Goryachev wrote on 2009-08-13 15:42:26 +1000 [Re: [BackupPC-users] 100,000+ errors in last nights backup]: > [...] > I've frequently managed to cause two backuppc_dump's to run in parallel > where one was scheduled by backuppc and one was run manually by me from > the command line. It would be nice if backuppc_dump could do a simple > check to see if the new directory already exists, and if so, simple exit > (or error and exit). while a check would be possible, it's not quite as simple as that. What happens when the machine crashes during running backups? The new/ directory won't disappear by itself (well, BackupPC could move all new/ directories to trash on startup, but, according to your logic, you might just be running BackupPC_dump manually ...). File locking? Put up a big sign "don't run BackupPC_dump manually unless you know what you are doing"? ;-) > Mainly I run backups manually so I can see exactly what is happening > during the backup and where/why it is failing or taking so long. Maybe there should/could be a way to serverMesg BackupPC to do a backup for a specific host with a -v switch and verbose logging directed to a specific file (i.e. make BackupPC_dump -v take a file name argument and pass that over via the BackupPC daemon). Please remind me in about two weeks ;-). Regards, Holger -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] 100,000+ errors in last nights backup
Hi, Steve Blackwell wrote on 2009-08-13 00:26:20 -0400 [Re: [BackupPC-users] 100,000+ errors in last nights backup]: > I started to reply to your e-mail but my system crashed. The messages > log suggests that backuppc may have been the culprit. See below. hmm. See below. > On Thu, 13 Aug 2009 02:19:25 +0200 Holger Parplies > wrote: > > > [...] I can't imagine why > > two backups of the same host would be scheduled simultaneously, and I > > don't think it's a good idea to do so :-). BackupPC doesn't usually > > do this. Have you changed the code in any way? Have you seen such a > > thing happen before? > > Could I have started the backuppc service twice somehow? I don't think so. BackupPC opens a UNIX domain socket on startup (and failing to do that is a fatal error). This should make a second instance fail to start up. > > So, I believe we're back to the issue of what you did wrong when > > moving $TopDir. I don't remember reading which version of BackupPC > > When moving $TopDir? I haven't moved it. It's always been /media/disk > ever since I installed backuppc. Meaning you installed from the SF tarball and set TopDir to /media/disk when running the configure script? > > Below /media/disk/cpool? BackupPC_nightly reports files there, but > > # ls -l /media/disk > total 48 > drwxr-x--- 18 backuppc root 4096 2009-08-12 20:00 cpool > drwx-- 2 root root 16384 2008-07-16 23:54 lost+found > drwxr-x--- 4 backuppc root 4096 2009-08-09 23:06 pc > drwxr-x--- 2 backuppc root 4096 2008-07-26 18:53 pool > drwxr-x--- 2 backuppc root 4096 2009-08-11 01:25 trash Shouldn't there be a "log" directory there? Hmm. You might simply have put it elsewhere (probably under /var/log). But I find it confusing that ... > So cpool has today's date ... but ... > ]# ls -l /media/disk/cpool > [...] > Nothing since 6/28. Why is ctime on cpool/ updated when all subdirectories already exist? Hmm, probably the hardlink test (which does *not* necessarily mean this is the cpool BackupPC uses - again: which version are you running?). In any case, pool files would be created three directory levels below. > This is where I got to when the machine crashed. Looking > at /var/log/messages I see this: > > [...] > Aug 12 20:00:12 steve kernel: Pid: 17353, comm: BackupPC_tarExt Yes, BackupPC_tarExtract was running ... not unusual during a backup. But user space processes can't cause kernel panics (they can maybe trigger them, but never *cause* them). I'm no expert on kernel stack traces, so I won't guess about the cause. If I were you, I'd check the BackupPC pool file system (and maybe system memory). > This is repeated for the 2nd CPU. Does this have anything to do with > that link we created? No. > As I said in an earlier e-mail, the disk I backup to is an external 1TB > USB drive. My computer is old enough that the BIOS locks up when > booting with this disk connected so I have to unplug it to boot. "Old enough" as in USB1? What kernel version are you running? Ah, yes. 2.6.27. I've had more problems with older kernels and USB2 than I could have wished for, but newer kernels seem to behave much better. Still, I'd try to avoid USB for such heavy use as a BackupPC pool tends to be. Is that at all possible? eSATA? Does it *need* to be an external disk? > Backuppc fails during the boot process because it can't make the > required links. Ok. That's good. > After the machine has booted, I plug in the USB drive and it gets > automatically mounted as disk on the mount point /media. I take it you mean it is mounted on /media/disk ... > Then I have to restart the backuppc service. Can you umount it manually and run an fsck? Regards, Holger -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] 100,000+ errors in last nights backup
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Holger Parplies wrote: > Hi, > > Adam Goryachev wrote on 2009-08-13 15:42:26 +1000 [Re: [BackupPC-users] > 100,000+ errors in last nights backup]: >> [...] >> I've frequently managed to cause two backuppc_dump's to run in parallel >> where one was scheduled by backuppc and one was run manually by me from >> the command line. It would be nice if backuppc_dump could do a simple >> check to see if the new directory already exists, and if so, simple exit >> (or error and exit). > > while a check would be possible, it's not quite as simple as that. What > happens when the machine crashes during running backups? The new/ directory > won't disappear by itself (well, BackupPC could move all new/ directories to > trash on startup, but, according to your logic, you might just be running > BackupPC_dump manually ...). File locking? Put up a big sign "don't run > BackupPC_dump manually unless you know what you are doing"? ;-) Of course, but programs shouldn't really be designed around what happens when a system crashes (though they should try and handle it well). A simple failure message if the new directory exists telling the admin to rm -rf backuppc/pc/host/new or something to that effect would be sufficient >> Mainly I run backups manually so I can see exactly what is happening >> during the backup and where/why it is failing or taking so long. > > Maybe there should/could be a way to serverMesg BackupPC to do a backup for a > specific host with a -v switch and verbose logging directed to a specific file > (i.e. make BackupPC_dump -v take a file name argument and pass that over via > the BackupPC daemon). Please remind me in about two weeks ;-). Well, I think there is already the ability to increase the log level, and hence see more information in the log, but this has two issues: 1) I don't really want to modify the config to increase the log level, I only want it to apply for the current run. 2) The existing logs are not flushed per line, they are only flushed after a certain amount of bytes (probably per buffsize or whatever it is). So, perhaps this could be achieved by fiddling the loglevel value with a parameter, which could also force the log files to flush after each line. I am pretty sure perl has a method to set this (per line flush or buffer size flush) which can be set after the file open() and applies until the file close() PS, I know it hasn't been two weeks, but thought the above would be easier to implement... Regards, Adam - -- Adam Goryachev Website Managers www.websitemanagers.com.au -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.9 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkqLeWAACgkQGyoxogrTyiVJHwCdEOgs6aT/Wopku3NLN+ErFsNa 6EIAn2qoMeEzF6BwrNLuhkaZ7OZN8ByD =k+qX -END PGP SIGNATURE- -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/