Re: DLE RESULTS MISSING after failed backup due to drive not being turned on
I have frequently done an "ls" on my holding disk, and manually deleted files and directories older than 7 days ago, which clearly amanda is not planning to flush to tape. 7 days because I ran amanda nightly. Your time window is up to you. I'm not sure 'amcleanup -rv backup' gets everything. I had an "onboot" job to send me email and remind me of that command, but perhaps I didn't reboot often, or perhaps amanda didn't register those files any more. If amanda hasn't flushed them during normal backups (assuming autoflush = ALL, i think it is), then it isn't planning to. Manual deletions never hurt my setup. If your holding disk isn't empty, but amanda sees nothing she wants to backup, then I suggest a manual cleanup. Deb Baddorf retired from Fermilab On Saturday, April 16, 2022, 01:27:15 PM EDT, Exuvo wrote: My backup failed tonight as i forgot to turn on my tape drive before i went to bed. Nothing was written to my dump drive as it was too full from a previous aborted backup i had done. When i woke up i turned on the tape drive and ran the backup again as i have done before when this has happend, most DLEs ran fine but the one DLE i have with 'holdingdisk required' failed as there was too little space left on the holding disk. I cleared out the holding disk and ran just that one failed DLE but it fails instantly and i get: FAILURE DUMP SUMMARY: planner: FATAL find_est_for_dp return NULL localhost storage RESULTS MISSING I tried running 'amcleanup -rv backup' but it did not do anything: # sudo -u amanda amcleanup -rv backup amcleanup: pid 2972312 is done amcleanup: pid 2972313 is done amcleanup: pid 2972311 is done amcleanup: pid 2972309 is done amcleanup: pid 2972305 is done amcleanup: no unprocessed logfile to clean up I also tested removing 'holdingdisk required' from the affected DLE but same result. Any ideas about what i should try? The logs don't seem to hold any more information (partial log from a RESULTS MISSING run): SENDING FLUSHES... Cleaning up holding disk '/dumps/' driver: adding holding disk 0 dir /dumps/ size 1949288448 chunksize 9007199254740896 ENDFLUSH SETTING UP FOR ESTIMATES... reserving 1949288448 out of 1949288448 for degraded-mode dumps driver: taper taper0 storage backup-storage tape_size 1499463680 driver: started dumper0 pid 2972312 driver: send-cmd time 0.001 to dumper0: START 20220416185052 planner: time 0.000: setting up estimates for localhost:storage driver: started dumper1 pid 2972313 driver: send-cmd time 0.001 to dumper1: START 20220416185052 setup_estimate: localhost:storage: command 0, options: none last_level 3 next_level0 14 level_days 1 getting estimates 0 (-3) 3 (-3) -1 (-3) planner: time 0.001: setting up estimates took 0.000 secs GETTING ESTIMATES... planner: find_est_for_dp return NULL driver: send-cmd time 0.001 to taper0: START-TAPER taper0 worker0-0 backup-storage 20220416185052 more about starting dumpers which never get used here until quitting. -Mail report 03:14 with drive off- Hostname: minerva Org : exuvo Config : backup Date : april 16, 2022 *** A TAPE ERROR OCCURRED: ['/dev/tape/by-id/scsi-DEC8320699' not found]. Some dumps may have been left in the holding disk. The next 2 tapes Amanda expects to use are: ROT09, ROT07. FAILURE DUMP SUMMARY: localhost efi lev 0 FAILED [can't dump 'holdingdisk never' dle in degraded mode] localhost boot lev 0 FAILED [can't dump 'holdingdisk never' dle in degraded mode] localhost root lev 1 FAILED [can't dump 'holdingdisk never' dle in degraded mode] localhost storage lev 3 FAILED [can't dump required holdingdisk when no holdingdisk space available ] localhost backup-minerva lev 0 FAILED [can't dump 'holdingdisk never' dle in degraded mode] localhost exuvo-desktop-root lev 1 FAILED [can't dump 'holdingdisk never' dle in degraded mode] localhost backup lev 0 FAILED [can't dump 'holdingdisk never' dle in degraded mode] STATISTICS: Total Full Incr. Level:# Estimate Time (hrs:min) 0:15 Run Time (hrs:min) 0:15 Dump Time (hrs:min) 0:00 0:00 0:00 Output Size (meg) 0.0 0.0 0.0 Original Size (meg) 0.0 0.0 0.0 Avg Compressed Size (%) -- -- -- DLEs Dumped 0 0 0 Avg Dump Rate (k/s) -- -- -- Tape Time (hrs:min) 0:00 0:00 0:00 Tape Size (meg) 0.0 0.0 0.0 Tape Used (%) 0.0 0.0 0.0 DLEs Taped 0 0 0 Parts Taped 0 0 0 Avg Tp Write Rate (k/s) -- -- -- NOTES: planner: Last full dump of localhost:efi on tape ROT05 overwritten in 4 runs. planner: Last full dump of localhost:boot on tape ROT05
DLE RESULTS MISSING after failed backup due to drive not being turned on
My backup failed tonight as i forgot to turn on my tape drive before i went to bed. Nothing was written to my dump drive as it was too full from a previous aborted backup i had done. When i woke up i turned on the tape drive and ran the backup again as i have done before when this has happend, most DLEs ran fine but the one DLE i have with 'holdingdisk required' failed as there was too little space left on the holding disk. I cleared out the holding disk and ran just that one failed DLE but it fails instantly and i get: FAILURE DUMP SUMMARY: planner: FATAL find_est_for_dp return NULL localhost storage RESULTS MISSING I tried running 'amcleanup -rv backup' but it did not do anything: # sudo -u amanda amcleanup -rv backup amcleanup: pid 2972312 is done amcleanup: pid 2972313 is done amcleanup: pid 2972311 is done amcleanup: pid 2972309 is done amcleanup: pid 2972305 is done amcleanup: no unprocessed logfile to clean up I also tested removing 'holdingdisk required' from the affected DLE but same result. Any ideas about what i should try? The logs don't seem to hold any more information (partial log from a RESULTS MISSING run): SENDING FLUSHES... Cleaning up holding disk '/dumps/' driver: adding holding disk 0 dir /dumps/ size 1949288448 chunksize 9007199254740896 ENDFLUSH SETTING UP FOR ESTIMATES... reserving 1949288448 out of 1949288448 for degraded-mode dumps driver: taper taper0 storage backup-storage tape_size 1499463680 driver: started dumper0 pid 2972312 driver: send-cmd time 0.001 to dumper0: START 20220416185052 planner: time 0.000: setting up estimates for localhost:storage driver: started dumper1 pid 2972313 driver: send-cmd time 0.001 to dumper1: START 20220416185052 setup_estimate: localhost:storage: command 0, options: none last_level 3 next_level0 14 level_days 1 getting estimates 0 (-3) 3 (-3) -1 (-3) planner: time 0.001: setting up estimates took 0.000 secs GETTING ESTIMATES... planner: find_est_for_dp return NULL driver: send-cmd time 0.001 to taper0: START-TAPER taper0 worker0-0 backup-storage 20220416185052 more about starting dumpers which never get used here until quitting. -Mail report 03:14 with drive off- Hostname: minerva Org : exuvo Config : backup Date : april 16, 2022 *** A TAPE ERROR OCCURRED: ['/dev/tape/by-id/scsi-DEC8320699' not found]. Some dumps may have been left in the holding disk. The next 2 tapes Amanda expects to use are: ROT09, ROT07. FAILURE DUMP SUMMARY: localhost efi lev 0 FAILED [can't dump 'holdingdisk never' dle in degraded mode] localhost boot lev 0 FAILED [can't dump 'holdingdisk never' dle in degraded mode] localhost root lev 1 FAILED [can't dump 'holdingdisk never' dle in degraded mode] localhost storage lev 3 FAILED [can't dump required holdingdisk when no holdingdisk space available ] localhost backup-minerva lev 0 FAILED [can't dump 'holdingdisk never' dle in degraded mode] localhost exuvo-desktop-root lev 1 FAILED [can't dump 'holdingdisk never' dle in degraded mode] localhost backup lev 0 FAILED [can't dump 'holdingdisk never' dle in degraded mode] STATISTICS: Total Full Incr. Level:# Estimate Time (hrs:min) 0:15 Run Time (hrs:min) 0:15 Dump Time (hrs:min) 0:00 0:00 0:00 Output Size (meg) 0.0 0.0 0.0 Original Size (meg) 0.0 0.0 0.0 Avg Compressed Size (%) -- -- -- DLEs Dumped 0 0 0 Avg Dump Rate (k/s) -- -- -- Tape Time (hrs:min) 0:00 0:00 0:00 Tape Size (meg) 0.0 0.0 0.0 Tape Used (%) 0.0 0.0 0.0 DLEs Taped 0 0 0 Parts Taped 0 0 0 Avg Tp Write Rate (k/s) -- -- -- NOTES: planner: Last full dump of localhost:efi on tape ROT05 overwritten in 4 runs. planner: Last full dump of localhost:boot on tape ROT05 overwritten in 4 runs. planner: Last full dump of localhost:root on tape ROT05 overwritten in 4 runs. planner: Last full dump of localhost:storage on tape ROT04 overwritten in 3 runs. planner: Last full dump of localhost:backup-minerva on tape ROT03 overwritten in 3 runs. planner: Last full dump of localhost:exuvo-desktop-root on tape ROT08 overwritten in 2 runs. planner: Last full dump of localhost:backup on tape ROT03 overwritten in 3 runs. planner: Full dump of localhost:backup-minerva promoted from 14 days ahead. planner: Full dump of localhost:boot promoted from 22 days ahead. planner: Full dump of localhost:efi promoted from 22 days ahead. planner: Full dump of localhost:backup promoted from 56 days ahead. DUMP SUMMARY: DUMPER STATS TAPER STATS HOSTNAME
