[Veritas-bu] script to show usage of tape drives on a media s erver
my email is ifanar...@gmail.com can you please share the script? Thanks in advance +-- |This was sent by ifanar...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] script to show usage of tape drives on a media s erver
Hi my email is ifanar...@gmail.com Can you please share the script? Thanks in advance +-- |This was sent by ifanar...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to Monitor SLP Status? (Bahadir Kiziltan)
Be aware - the hoursago default is 24 hours - If you do not have it you get 24, you may need to extend that to 48 or 72 depending on your longest running backup. The date is based on backup START time, so if your backup started more than 24 hours ago you MUST put extended time. I set up aliases on my unix master for last 72 hours incomplete and a separate one that I run on Monday that goes back a week just to check. There is a nbstlutil command option that will list incomplete jobs (nbstlutil stlilist -image_incomplete), but the bpimagelist -stl_incomplete has better information and depending on your NB version can be much faster. nbstlutil stlilist -image_incomplete V6.5 I inorap04-backup_1320951118 LTO5-NORA4-8wk-Vault03 2 V6.5 C med03np-LTO5 2 V6.5 I inorap02-backup_1320971367 LTO5-NORA2-8wk-Vault04 1 V6.5 C med04np-LTO5 1 V6.5 I cbcseagull01wd.cbc.local_1320975294 LTO5-VM-8wk-Vault03 2 Vs bpimagelist -L -idonly -hoursago 72 -stl_incomplete | sort +3r +4r +5rn Time: Thu Nov 10 20:39:58 2011 ID: cbcweb01wd.cbc.local_1320975598 FULL (0) Time: Thu Nov 10 20:34:54 2011 ID: cbcseagull01wd.cbc.local_1320975294 FULL (0) Time: Thu Nov 10 19:29:27 2011 ID: inorap02-backup_1320971367 UBAK (2) Time: Thu Nov 10 13:51:58 2011 ID: inorap04-backup_1320951118 UBAK (2) Be careful around month end, since the sorting can put last month at the top. -- Message: 1 Date: Tue, 8 Nov 2011 18:15:59 +0200 From: Bahadir Kiziltan bahadir.kizil...@gmail.com Subject: Re: [Veritas-bu] Script to Monitor SLP Status? To: Rusty Major rusty.ma...@sungard.com Cc: VERITAS-BU@mailman.eng.auburn.edu Message-ID: CAH843aKH9Gf-EA7nzHbA_G=awe9ypmybfmv4v2dehbjavhu...@mail.gmail.com Content-Type: text/plain; charset=utf-8 bpimagelist -L -idonly -hoursago 24 -stl_incomplete | sort +3r +4r +5rn On Tue, Nov 8, 2011 at 5:59 PM, Rusty Major rusty.ma...@sungard.com wrote: Does anyone have a script to monitor the status of SLP backlog? I need to implement this but thought I?d check here first instead of reinventing the wheel. Thanks! *Rusty Major, MCSE, BCFP, VCS* ? Sr. Storage Engineer ? SunGard Availability Services ? 757 N. Eldridge Suite 200, Houston TX 77079 ? 281-584-4693 Keeping People and Information Connected? ? http://availability.sungard.com/ P *Think before you print* CONFIDENTIALITY: This e-mail (including any attachments) may contain confidential, proprietary and privileged information, and unauthorized disclosure or use is prohibited. If you received this e-mail in error, please notify the sender and delete this e-mail from your system. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Script to Monitor SLP Status?
Does anyone have a script to monitor the status of SLP backlog? I need to implement this but thought I’d check here first instead of reinventing the wheel. Thanks! *Rusty Major, MCSE, BCFP, VCS* ▪ Sr. Storage Engineer ▪ SunGard Availability Services ▪ 757 N. Eldridge Suite 200, Houston TX 77079 ▪ 281-584-4693 Keeping People and Information Connected® ▪ http://availability.sungard.com/ P *Think before you print* CONFIDENTIALITY: This e-mail (including any attachments) may contain confidential, proprietary and privileged information, and unauthorized disclosure or use is prohibited. If you received this e-mail in error, please notify the sender and delete this e-mail from your system. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script
On Windows u would use perfmon and then NetBackup counts for the tape drives. On Sat, Sep 18, 2010 at 8:22 PM, rusty.ma...@sungard.com wrote: I don't have a script, but for those that might, it would be helpful to know what platform you're on. Unix can use iostat -xzn # (where # is the interval). *Rusty Major, MCSE, BCFP, VCS* ▪ Sr. Storage Engineer ▪ SunGard Availability Services ▪ 757 N. Eldridge Suite 200, Houston TX 77079 ▪ 281-584-4693 Keeping People and Information Connected® ▪ * http://availability.sungard.com/* http://availability.sungard.com/ P *Think before you print* CONFIDENTIALITY: This e-mail (including any attachments) may contain confidential, proprietary and privileged information, and unauthorized disclosure or use is prohibited. If you received this e-mail in error, please notify the sender and delete this e-mail from your system. *ccosta@gmail.com* Sent by: veritas-bu-boun...@mailman.eng.auburn.edu 09/18/2010 09:45 AM Please respond to ccosta@gmail.com To VERITAS-BU@mailman.eng.auburn.edu cc Subject [Veritas-bu] Script Does anyone have a good script to measure tape drive performance? Thank you in advance Sent via BlackBerry from T-Mobile ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Script
Does anyone have a good script to measure tape drive performance? Thank you in advance Sent via BlackBerry from T-Mobile ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script
I don't have a script, but for those that might, it would be helpful to know what platform you're on. Unix can use iostat -xzn # (where # is the interval). Rusty Major, MCSE, BCFP, VCS ▪ Sr. Storage Engineer ▪ SunGard Availability Services ▪ 757 N. Eldridge Suite 200, Houston TX 77079 ▪ 281-584-4693 Keeping People and Information Connected® ▪ http://availability.sungard.com/ P Think before you print CONFIDENTIALITY: This e-mail (including any attachments) may contain confidential, proprietary and privileged information, and unauthorized disclosure or use is prohibited. If you received this e-mail in error, please notify the sender and delete this e-mail from your system. ccosta@gmail.com Sent by: veritas-bu-boun...@mailman.eng.auburn.edu 09/18/2010 09:45 AM Please respond to ccosta@gmail.com To VERITAS-BU@mailman.eng.auburn.edu cc Subject [Veritas-bu] Script Does anyone have a good script to measure tape drive performance? Thank you in advance Sent via BlackBerry from T-Mobile ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Script to view the modified time stamp of some files...
Hi, do you know a method to view the timestamp of files in a client backup? Each morning, I need to login the NB console and check a couple of DB servers to be sure that DBs were closed at the time of backup and that the backup I have is good. Is there a script I can run to parse the index files and check for the time stamps on the backup? Thanks. +-- |This was sent by [EMAIL PROTECTED] via Backup Central. |Forward SPAM to [EMAIL PROTECTED] +-- ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to view the modified time stamp of some files...
Modified time: bplist -c Backup time: bplist -b You need to be very careful with the modified times on files in databases. Different databases do different things with updating modified dates - some do and some don't. .../Ed On Wed, Jun 25, 2008 at 8:18 AM, tfc_labellm [EMAIL PROTECTED] wrote: do you know a method to view the timestamp of files in a client backup? Each morning, I need to login the NB console and check a couple of DB servers to be sure that DBs were closed at the time of backup and that the backup I have is good. Is there a script I can run to parse the index files and check for the time stamps on the backup? -- Ed Wilts, Mounds View, MN, USA RHCE, BCFP, BCSD, SCSP, SCSE mailto:[EMAIL PROTECTED] If I've helped you, please make a donation to my favorite charity at http://firstgiving.com/edwilts ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Script for finding long running backups
Hello All I have made this little perl script: #!/usr/bin/perl -w @BPDBJOBS_ALL=`/veritas/netbackup/bin/admincmd/bpdbjobs -report -all_columns`; foreach $line (@BPDBJOBS_ALL) { @TMPLIST=split(,,$line); $state=$TMPLIST[2]; $policy=$TMPLIST[4]; $schedule=$TMPLIST[5]; $elapsedsec=$TMPLIST[9]; if ( ( $state != 3) ( $elapsedsec 86400 )) { print $policy, ,$schedule, ,$elapsedsec,\n; } } which prints backups which has elapesed more than 24 hours and isn't done. Regards Michael ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] script to duplicate 2nd copy of images
It's all in the bpduplicate command. Be sure to use the -cn option to specify you want to duplicate your second copy. From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Rolf C Sent: Thursday, May 08, 2008 9:25 AM To: veritas-bu@mailman.eng.auburn.edu Subject: [Veritas-bu] script to duplicate 2nd copy of images We have two Virtual Tape Libraries on different locations. Data is backupped to the VTL in Site A and duplicated to as a secondary image to the VTL on Site B. As a Life Cycle Policy we want to duplicate the the secondary images on the VTL in site B to tape. This is not possible without scripting because standard you only can duplicate Primary images. Does anyone have a script or the commands to find the secondary images created f.e. the past 24 hours and duplicate them to tape? We are using NB6.5 on Windows. Thanks! Stay in touch when you're away with Windows Live Messenger. IM anytime you're online. http://www.windowslive.com/messenger/overview.html?ocid=TXT_TAGLM_WL_Re fresh_messenger_052008 ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] script user backups of Exchange 2007.
Ah. In that case, we're doing something similar. Snapmanager makes a snapshot of the disk (iSCSI) that Exchange lives on, we mount that disk on another NT box and back it up directly. It's all driven by some post-snap script that calls bpbackup and sends the files to a policy with a user-backup type of schedule. It's kludgy but it works. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Michitsch, John Sent: Thursday, March 27, 2008 5:02 PM To: Michitsch, John; veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] script user backups of Exchange 2007. Excuse the typo, that should read we are using Network Appliance Snapmanager for Exchange -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Michitsch, John Sent: 27 March, 2008 6:50 PM To: veritas-bu@mailman.eng.auburn.edu Subject: [Veritas-bu] script user backups of Exchange 2007. Does anyone know if you can script a user directed backup in NBU 6.5.1? We do not want NBU to truncate the transaction logs as we are using Netbackup Snapmanager for Exchange to truncate the logs. Looking at the documentation, I only see how to create a user backup, but it doesn't look like I can script it. Thanks. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] script user backups of Exchange 2007.
Does anyone know if you can script a user directed backup in NBU 6.5.1? We do not want NBU to truncate the transaction logs as we are using Netbackup Snapmanager for Exchange to truncate the logs. Looking at the documentation, I only see how to create a user backup, but it doesn't look like I can script it. Thanks. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] script user backups of Exchange 2007.
Excuse the typo, that should read we are using Network Appliance Snapmanager for Exchange -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Michitsch, John Sent: 27 March, 2008 6:50 PM To: veritas-bu@mailman.eng.auburn.edu Subject: [Veritas-bu] script user backups of Exchange 2007. Does anyone know if you can script a user directed backup in NBU 6.5.1? We do not want NBU to truncate the transaction logs as we are using Netbackup Snapmanager for Exchange to truncate the logs. Looking at the documentation, I only see how to create a user backup, but it doesn't look like I can script it. Thanks. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script Restores?
Sure, look up bprestore. But, is there any reason you wouldn't just connect a 9840 to your new system, import the tapes and dupe the image to LTO3. I'd give it a try before going the restore - backup route. Paul -- -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of bthessel Sent: January 3, 2008 2:36 PM To: VERITAS-BU@mailman.eng.auburn.edu Subject: [Veritas-bu] Script Restores? Is it possible to script restore jobs? I have about 20 9840 tapes containing about 100 jobs on a NB 5.1 system that I need to restore and then copy the data over to a new location to be backed up in NB 6 to LTO3. Doing it manually is taking forever since I have to do one job at a time. Any help is appreciated, I don't want to be doing this for the next month straight. La version française suit le texte anglais. This email may contain privileged and/or confidential information, and the Bank of Canada does not waive any related rights. Any distribution, use, or copying of this email or the information it contains by other than the intended recipient is unauthorized. If you received this email in error please delete it immediately from your system and notify the sender promptly by email that you have done so. Le présent courriel peut contenir de l'information privilégiée ou confidentielle. La Banque du Canada ne renonce pas aux droits qui s'y rapportent. Toute diffusion, utilisation ou copie de ce courriel ou des renseignements qu'il contient par une personne autre que le ou les destinataires désignés est interdite. Si vous recevez ce courriel par erreur, veuillez le supprimer immédiatement et envoyer sans délai à l'expéditeur un message électronique pour l'aviser que vous avez éliminé de votre ordinateur toute copie du courriel reçu. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script Restores?
Of course you can script them. Just use the bprestore command in a script. Just make sure to use the -L option and log each restore to a different file, so you can see how they worked. --- W. Curtis Preston Backup Blog @ www.backupcentral.com VP Data Protection, GlassHouse Technologies -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of bthessel Sent: Thursday, January 03, 2008 11:36 AM To: VERITAS-BU@mailman.eng.auburn.edu Subject: [Veritas-bu] Script Restores? Is it possible to script restore jobs? I have about 20 9840 tapes containing about 100 jobs on a NB 5.1 system that I need to restore and then copy the data over to a new location to be backed up in NB 6 to LTO3. Doing it manually is taking forever since I have to do one job at a time. Any help is appreciated, I don't want to be doing this for the next month straight. +-- |This was sent by [EMAIL PROTECTED] via Backup Central. |Forward SPAM to [EMAIL PROTECTED] +-- ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Script Restores?
Is it possible to script restore jobs? I have about 20 9840 tapes containing about 100 jobs on a NB 5.1 system that I need to restore and then copy the data over to a new location to be backed up in NB 6 to LTO3. Doing it manually is taking forever since I have to do one job at a time. Any help is appreciated, I don't want to be doing this for the next month straight. +-- |This was sent by [EMAIL PROTECTED] via Backup Central. |Forward SPAM to [EMAIL PROTECTED] +-- ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script Restores?
Sure - at least on UNIX/Linux. Just do your script around the bprestore command. For example we use this for doing data refreshes from a backup run on one server to a development database on another one: /usr/openv/netbackup/bin/bprestore -R change script -L restorelog -C client that backed it up -D client to restore to -S master server -s MM/DD/YY hh:mm -e MM/DD/YY hh:mm -f list of files to restore The -s specifies the date/time the backup was started and the -e specifies the end of the range you want to search. The -f specifies a separate file in which you specify which items you wish to restore (e.g. we do a backup that includes data and binaries but in this list we only put in the selections that would be for data as we don't do binary refreshes with this process). The -R specifies a separate file that gives alternate paths for selections. e.g. original backup directories shown in the earlier list might be /database/prod1 and /database/prod2. We would equate /database/prod1 with /database/dev1 then /database/prod2 with /database/dev2 so it would use the dev paths as the alternate paths for restore. We also set the bp.conf to do FORCE_MEDIA_RESTORE from the -C client to the -D client as both are media servers in our environment. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of bthessel Sent: Thursday, January 03, 2008 2:36 PM To: VERITAS-BU@mailman.eng.auburn.edu Subject: [Veritas-bu] Script Restores? Is it possible to script restore jobs? I have about 20 9840 tapes containing about 100 jobs on a NB 5.1 system that I need to restore and then copy the data over to a new location to be backed up in NB 6 to LTO3. Doing it manually is taking forever since I have to do one job at a time. Any help is appreciated, I don't want to be doing this for the next month straight. +-- |This was sent by [EMAIL PROTECTED] via Backup Central. |Forward SPAM to [EMAIL PROTECTED] +-- ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu -- CONFIDENTIALITY NOTICE: This e-mail may contain privileged or confidential information and is for the sole use of the intended recipient(s). If you are not the intended recipient, any disclosure, copying, distribution, or use of the contents of this information is prohibited and may be unlawful. If you have received this electronic transmission in error, please reply immediately to the sender that you have received the message in error, and delete it. Thank you. -- ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script Restores?
You can restore from the command-line using bprestore, and you can backup using bpbackup. As far as choosing what you're going restore and from when, I'm not sure exactly how your backups are laid out or anything so you're going to have to look at the Command Reference or man pages for bprestore to see if you can find a relatively easy way to script it for your needs. But the tools are available from the command-line to make the restores happen from a script. - Original Message - From: bthessel [EMAIL PROTECTED] To: VERITAS-BU@mailman.eng.auburn.edu Sent: Thursday, January 3, 2008 1:35:51 PM (GMT-0600) America/Chicago Subject: [Veritas-bu] Script Restores? Is it possible to script restore jobs? I have about 20 9840 tapes containing about 100 jobs on a NB 5.1 system that I need to restore and then copy the data over to a new location to be backed up in NB 6 to LTO3. Doing it manually is taking forever since I have to do one job at a time. Any help is appreciated, I don't want to be doing this for the next month straight. +-- |This was sent by [EMAIL PROTECTED] via Backup Central. |Forward SPAM to [EMAIL PROTECTED] +-- ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to label expired tapes in a VTL
Hi Larry This sounds as though it may be an answer. The thing to look out for is that the data on the tape is cleared. This can only be tested in a lab as there is a portencial for backups failing! Kind Regards, Clem Kruger -Original Message- From: Larry Mascarenhas [mailto:[EMAIL PROTECTED] Sent: 09 October 2007 00:58 AM To: [EMAIL PROTECTED] Cc: Curtis Preston; Clem Kruger; VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL Hi Clem, Spoke to Symantec. There is a notify script called media_deasssign_notify in the goodies directory (netbackup 60, not sure of other versions). It is called whenever a piece of media is de-assigned and sent to the scratch pool. So I have modified the script to do the following. 1. Verify that the media is indeed in the scratch pool and is from the VTL. 2. If it is, then bplabel it. 3. Else, ignore this volume. I think it is simple and elegant. Your thoughts. Larry Mascarenhas wrote: Hmm.. That's a problem. Oh well, back to the drawing board. Curtis Preston wrote: This is because an expired tape gets labelled and put into the Scratch pool automatically. No it doesn't. It gets put in the Scratch, but it is not relabeled. -- Larry Mascarenhas [EMAIL PROTECTED] ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to label expired tapes in a VTL
I have a similar question...I think I have retired three media servers, well actually rebuilt two with new names and new IP and renamed the third...(All Windows 2003 NBU 6.0 MP4) I know NBU does not like renaming...and no like a dope I did not follow the retire media server documentation. Lesson learned for anyone out there that is looking to rename a box. Follow the white paper on retiring a media server. Anyway to my question...I still have my old media servers listed under hosts, they are all deactivated but I cannot get rid of them. I believe it is due to the fact that I still have tapes assigned to those media servers. Anyone out there and an idea on how I can get those tapes re-assigned to the new media servers. The bpmedia -movedb -m media ID -oldserver oldserver name -newserver newserver name is not doing it for me. It looks like it runs thru, but I still see the old media servers assigned to the tapes after I run an inventory. Thanks Dan -Original Message- From: Larry Mascarenhas [mailto:[EMAIL PROTECTED] Sent: Monday, October 08, 2007 6:58 PM To: [EMAIL PROTECTED] Cc: VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL Hi Clem, Spoke to Symantec. There is a notify script called media_deasssign_notify in the goodies directory (netbackup 60, not sure of other versions). It is called whenever a piece of media is de-assigned and sent to the scratch pool. So I have modified the script to do the following. 1. Verify that the media is indeed in the scratch pool and is from the VTL. 2. If it is, then bplabel it. 3. Else, ignore this volume. I think it is simple and elegant. Your thoughts. Larry Mascarenhas wrote: Hmm.. That's a problem. Oh well, back to the drawing board. Curtis Preston wrote: This is because an expired tape gets labelled and put into the Scratch pool automatically. No it doesn't. It gets put in the Scratch, but it is not relabeled. -- Larry Mascarenhas [EMAIL PROTECTED] ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu This message (including any attachments) contains confidential information intended for a specific individual and purpose, and is protected by law. If you are not the intended recipient, you should delete this message and are hereby notified that any disclosure, copying, or distribution of this message, or the taking of any action based on it, is strictly prohibited. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to label expired tapes in a VTL
Hi Clem, Spoke to Symantec. There is a notify script called media_deasssign_notify in the goodies directory (netbackup 60, not sure of other versions). It is called whenever a piece of media is de-assigned and sent to the scratch pool. So I have modified the script to do the following. 1. Verify that the media is indeed in the scratch pool and is from the VTL. 2. If it is, then bplabel it. 3. Else, ignore this volume. I think it is simple and elegant. Your thoughts. Larry Mascarenhas wrote: Hmm.. That's a problem. Oh well, back to the drawing board. Curtis Preston wrote: This is because an expired tape gets labelled and put into the Scratch pool automatically. No it doesn't. It gets put in the Scratch, but it is not relabeled. -- Larry Mascarenhas [EMAIL PROTECTED] ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to label expired tapes in a VTL
Hi Stuart, We also decided to use the backend of the VTL attached to 98 and 9940's. The problem that we discovered was the one tape that was faulty and the bar codes became out of sequence. This caused us a problem. Kind Regards, Clem Kruger -Original Message- From: Curtis Preston [mailto:[EMAIL PROTECTED] Sent: 25 September 2007 00:56 AM To: Liddle, Stuart; Paul Keating; Clem Kruger; VERITAS-BU@mailman.eng.auburn.edu Subject: RE: Re: [Veritas-bu] Script to label expired tapes in a VTL I think you nailed it, Stu. I remember your previous posts on this topic, and that you said you went to this method because the NBU Vault method wasn't duping the tapes fast enough for you. As I recall, it was because your backups had millions of files in them, and this was slowing down your dupe process. You went to the tape-out functionality of your VTL because it made the copies faster (significantly so), and were willing to live with any downsides because it made the copies possible. You are correct. Most people do not use their VTLs this way. Part of the reason is a good amount of FUD put out by the backup vendors. Another reason is that it does come with some major downsides. In your case, you had to choose which downsides were worse, and in your case, the downside of not getting the copies done at all was unacceptable, so you decided to deal with the downsides of the other method. --- W. Curtis Preston Backup Blog @ www.backupcentral.com VP Data Protection, GlassHouse Technologies -Original Message- From: Liddle, Stuart [mailto:[EMAIL PROTECTED] Sent: Monday, September 24, 2007 4:55 PM To: Curtis Preston; Paul Keating; Clem Kruger; VERITAS-BU@mailman.eng.auburn.edu Subject: RE: Re: [Veritas-bu] Script to label expired tapes in a VTL I think I'm beginning to understand my confusion to some of the earlier comments and now see from the conversations that are taking place that the way we are using our VTL's is vastly different from the way that most of the respondents to this thread are using theirs. Correct me if I'm wrong, but most of you have been describing the method for using your VTL's as one of what I'll call self-contained VTL's and that there is no real connection to the physical tapes. In other words, in order to get data from the virtual tapes you have to use Vault or some other method of duplication to get the data off-site. So, the tapes are always in the VTL and are re-cycled just as physical tapes are in a physical tape library. Hence the need to delete and/or re-label. We abandoned that method in favor of having our VTL's manage a partition of the physical tape library and have a direct link to the physical tapes. In other words, a barcode in the virtual library is the same as a barcode on a physical tape. So, for us, when a tape is full or we want to eject it and send it offsite, it gets cloned to physical tape and it's no longer visible to NetBackup in the virtual library. But, we have set up our VTL to use a shadow pool where the virtual tape is still available until the VTL needs the space. In some instances, the data can be available for up to 10 days. If we need a tape for a restore, we just import it read-only from the shadow pool and inventory the virtual library in NetBackup and off we go. When we are done, we just eject it from the virtual library and since it's already in sync with the physical tape, nothing more is required. Now, this might sound messy from the standpoint that you don't know where the physical tape really is according to NetBackupas far as it knows, it's just not in the library and since you didn't use Vault, it's whereabouts are unknown. In our experience this doesn't matter because we have a separate app to track our off-site tapes. So, the whole discussion about re-labeling the virtual tapes is just an interesting discussion to me because we don't do that method. --stuart -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Curtis Preston Sent: Monday, September 24, 2007 12:15 PM To: Paul Keating; Clem Kruger; VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL The problem is not de-dupe; the problem is thin provisioning and oversubscription. There are a lot of VTLs that allow both (with or w/o de-dupe), and if you define more tapes than you actually have disk, you will have this problem. I'll concede that oversubscription is a natural state in a de-dupe VTL, as you define probably 20 times more tapes than you have real storage for. The problem I see you're describing is this: 1. You define more tapes than you really have capacity for (again, this is normal in the de-dupe world) 2. You have a bunch that are partially full 3. You have a bunch that are in scratch, but have not been relabeled. 4. You may even have some that are brand new tapes that haven't been used at all. 5. You're
Re: [Veritas-bu] Script to label expired tapes in a VTL
This is because an expired tape gets labelled and put into the Scratch pool automatically. No it doesn't. It gets put in the Scratch, but it is not relabeled. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to label expired tapes in a VTL
Yes, the disk space is still in use until you reuse the tape. This is the same as a tape library. Technically the rest of a tape is in use until you start writing to it from the beginning. Then the rest of the space on the tape is not used. Say you've got a 100-slot library with 1 TB tapes. That's 100 TB of disk. Say you fill them all up, then expire 20 of them out of NBU, but do not relabel them. In NBU, the library now shows it's 20% free, but the VTL doesn't know that. But NBU does. If it needs a tape, it puts one of them in a virtual drive and starts using it. The second that happens the rest of the space on the tape is reclaimed. This is because NBU starts writing to the front of the tape, causing the VTL to say oh! I'm supposed to delete the rest of the blocks. Does that help? --- W. Curtis Preston Backup Blog @ www.backupcentral.com VP Data Protection, GlassHouse Technologies From: Clem Kruger [mailto:[EMAIL PROTECTED] Sent: Sunday, September 23, 2007 1:18 PM To: Liddle, Stuart; Curtis Preston; VERITAS-BU@mailman.eng.auburn.edu Subject: RE: Re: [Veritas-bu] Script to label expired tapes in a VTL Hi Stuart, In my experience we had to as the DISK SPACE was still in use! Kind Regards, Clem Kruger From: Liddle, Stuart [mailto:[EMAIL PROTECTED] Sent: 22 September 2007 21:35 PM To: Clem Kruger; Curtis Preston; VERITAS-BU@mailman.eng.auburn.edu Subject: RE: Re: [Veritas-bu] Script to label expired tapes in a VTL Clem, You have made a rather curious comment. You don't have to delete the tape to get the space returned. (My experience is with the NetApp VTL.) There are settings on the VTL that you can set to allow for how long you keep a virtual tape in the shadow pool once it has been cloned to physical tape. If you are not cloning to physical tape and are just keeping images on virtual tape, then you would not be deleting the tapes, you would be expiring images...just like Curtis said about the DSU. That's one of the nice features of the NetApp VTL. If you have the disk space, as long as you have cloned to physical tape it will keep the virtual tapes around until the VTL needs to free up space for newer backups. It does this for you automatically! --stuart From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Clem Kruger Sent: Saturday, September 22, 2007 2:33 AM To: Curtis Preston; VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL Hi Curtis, You have to delete the tape to get your space returned. This is the real pain and cost Clem. -Original Message- From: Curtis Preston [mailto:[EMAIL PROTECTED] mailto:%5bmailto:[EMAIL PROTECTED] Sent: 22 September 2007 11:15 AM To: Clem Kruger; VERITAS-BU@mailman.eng.auburn.edu Subject: RE: [Veritas-bu] Script to label expired tapes in a VTL And you don't get the space back on a DSU until you expire the image. So what? I also argue that what Steve is asking for isn't necessary. (I think he's MAKING it necessary by oversubscribing, but that's not the VTL's fault.) Oversubscription aside, once his tapes are expired, the space taken up by those tapes is immediately available for reuse. The next time the tape gets written to, it will delete all pointers to the space taken up by that tape. As to the VTL vs disk debate, I still think you should bring in all disk devices and let them duke it out before excluding an entire category of them. You're going to exclude a lot of really good products if you just no VTLs. Remember that saying I don't want a VTL but I do want de-dupe means that you're going to use NAS. While that will meet a whole lot of needs for a whole lot of people, there's also some really big backups that need a lot more than you can push over IP. For those backups, you're going to want a block transfer protocol (i.e. SCSI), and for that, you're currently going to be buying a VTL. (Unless you're just going to buy a non-deduped disk in which case I'd say you're REALLY wasting your money.) --- W. Curtis Preston Backup Blog @ www.backupcentral.com VP Data Protection, GlassHouse Technologies -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Clem Kruger Sent: Saturday, September 22, 2007 4:24 AM To: VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL Hi Steve, This is the downer on VTL's. You do not get your tape space back automatically. It is for these reasons I recommend that one never go VTL's. NetBackup 6.0 and 6.5 allow disk to disk backups; the images are easily replicated to an offsite facility. The time for all tape has come and gone. The de-duplication facility in 6.5 makes life even easier. Why VTL's (which does SCSI emulation
Re: [Veritas-bu] Script to label expired tapes in a VTL
I try not to comment on specific named products in a public forum. (People tend to do crazy things like sue me.) Having said that, make sure you ask an SE familiar with that product what type of performance you should expect. --- W. Curtis Preston Backup Blog @ www.backupcentral.com VP Data Protection, GlassHouse Technologies -Original Message- From: Ed Wilts [mailto:[EMAIL PROTECTED] Sent: Saturday, September 22, 2007 2:24 PM To: Curtis Preston; 'Clem Kruger'; VERITAS-BU@mailman.eng.auburn.edu Subject: RE: [Veritas-bu] Script to label expired tapes in a VTL Remember that saying I don't want a VTL but I do want de-dupe means that you're going to use NAS Actually it doesn't. Don't forget about PureDisk as a NetBackup storage unit. Write to locally attached disk, whether it's local SATA or SAN-attached. .../Ed -- Ed Wilts, RHCE, BCFP, BCSD Mounds View, MN, USA mailto:[EMAIL PROTECTED] ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to label expired tapes in a VTL
In the Legato world, relabelling the VTL volume resulted in the space being returned to the disk. This is true even for an expired tape. ie I needed to relabel it. In Netbackup, I think it is significantly better. This is because an expired tape gets labelled and put into the Scratch pool automatically. No, the volume is merely abandoned at expiration time. All the data remains on it, just like a Networker volume. Netbackup no longer tracks any information about the volume, so it can be transferred to the Scratch pool. Networker continues to track save set data after expiration, so the volume is not transferred until after the relabel. -- Darren Dunham [EMAIL PROTECTED] Senior Technical Consultant TAOShttp://www.taos.com/ Got some Dr Pepper? San Francisco, CA bay area This line left intentionally blank to confuse you. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to label expired tapes in a VTL
Not entirely true, Curtis. When your virutal tape expires, the VTL has no way of knowing this untill the tape is written to again. Depending on the VTL, this may be too late. I've got about 2TB of free space on my VTL, and about 1000 scratch VTs (2800 total). After a couple of weeks of Netbackup using and expiring VTs, The VTs are going back to Scratch, but untill they're re-written, the pointers in the repository still exist, therefore the VTL thinks the space is still in useso if you're using a de-duping VTL (or DSU to a de-duping FS) and you're only doing real time freeing of space (ie, re-labelling a VT only when you re-write it, or letting NBU delete images from the DSU only as the DSU approaches a high disk utilization threshold), then your target will need to do some high-perf defragging in order to provide you with sufficient free space to write more images. Non-de-dup TLs such as Quantums, which hard allocate a fixed chunk of disk for each cart will not have this problem, nor will a DSU on a standard FS, but with my current VTL, it's definitely a requirement to occasionally kick off a script to bplabel recently expired tapes, so that the defrag process can run at a higher priority (when IO to the TL is lower.) Paul -- -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Curtis Preston Sent: September 22, 2007 5:15 AM To: Clem Kruger; VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL Oversubscription aside, once his tapes are expired, the space taken up by those tapes is immediately available for reuse. The next time the tape gets written to, it will delete all pointers to the space taken up by that tape. As to the VTL vs disk debate, I still think you should bring in all disk devices and let them duke it out before excluding an entire category of them. You're going to exclude a lot of really good products if you just no VTLs. Remember that saying I don't want a VTL but I do want de-dupe means that you're going to use NAS. While that will meet a whole lot of needs for a whole lot of people, there's also some really big backups that need a lot more than you can push over IP. For those backups, you're going to want a block transfer protocol (i.e. SCSI), and for that, you're currently going to be buying a VTL. (Unless you're just going to buy a non-deduped disk in which case I'd say you're REALLY wasting your money.) --- W. Curtis Preston Backup Blog @ www.backupcentral.com VP Data Protection, GlassHouse Technologies -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Clem Kruger Sent: Saturday, September 22, 2007 4:24 AM To: VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL Hi Steve, This is the downer on VTL's. You do not get your tape space back automatically. It is for these reasons I recommend that one never go VTL's. NetBackup 6.0 and 6.5 allow disk to disk backups; the images are easily replicated to an offsite facility. The time for all tape has come and gone. The de-duplication facility in 6.5 makes life even easier. Why VTL's (which does SCSI emulation) when you and use disk which is faster and has more protection? Clem. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of swaltner Sent: 21 September 2007 17:32 PM To: VERITAS-BU@mailman.eng.auburn.edu Subject: [Veritas-bu] Script to label expired tapes in a VTL We deployed a VTL last month, which has been working very nicely. This is in a NetBackup 5.1 environment with the VTL attached to our Solaris based master server as well as to our NAS server for local NDMP backups. One thing I'd like to do is over-subscribe on the back-end storage, but before I do that I'd like to automate the process of freeing up the disk space used in the VTL when a NetBackup tape is expired. Just curious if anyone has already written such a beast and would like to share with me as a starting point. If not, I suspect I'll use the following logic: - Every day (at noon??), query the robots defined in the VTL and keep a record of tapes that are allocated. - When a tape goes from allocated to non-allocated from one day to the next, use a command like the following to erase the tape's contents: bplabel -erase -o -d dlt -m VTL123 This would write a small label at the beginning of the virtual tape, causing the VTL to drop all the other data that had been stored on the tape. Any reason this wouldn't work? Any gotchas with writing this script that I should look out for? Steve +- - |This was sent by [EMAIL PROTECTED] via Backup Central. |Forward SPAM to [EMAIL PROTECTED
Re: [Veritas-bu] Script to label expired tapes in a VTL
I agree with Paul on this issue. The same is true with the VTL that I currently use. Kevin Whittaker -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Paul Keating Sent: Monday, September 24, 2007 9:34 AM To: Curtis Preston; Clem Kruger; VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL Not entirely true, Curtis. When your virutal tape expires, the VTL has no way of knowing this untill the tape is written to again. Depending on the VTL, this may be too late. I've got about 2TB of free space on my VTL, and about 1000 scratch VTs (2800 total). After a couple of weeks of Netbackup using and expiring VTs, The VTs are going back to Scratch, but untill they're re-written, the pointers in the repository still exist, therefore the VTL thinks the space is still in useso if you're using a de-duping VTL (or DSU to a de-duping FS) and you're only doing real time freeing of space (ie, re-labelling a VT only when you re-write it, or letting NBU delete images from the DSU only as the DSU approaches a high disk utilization threshold), then your target will need to do some high-perf defragging in order to provide you with sufficient free space to write more images. Non-de-dup TLs such as Quantums, which hard allocate a fixed chunk of disk for each cart will not have this problem, nor will a DSU on a standard FS, but with my current VTL, it's definitely a requirement to occasionally kick off a script to bplabel recently expired tapes, so that the defrag process can run at a higher priority (when IO to the TL is lower.) Paul -- -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Curtis Preston Sent: September 22, 2007 5:15 AM To: Clem Kruger; VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL Oversubscription aside, once his tapes are expired, the space taken up by those tapes is immediately available for reuse. The next time the tape gets written to, it will delete all pointers to the space taken up by that tape. As to the VTL vs disk debate, I still think you should bring in all disk devices and let them duke it out before excluding an entire category of them. You're going to exclude a lot of really good products if you just no VTLs. Remember that saying I don't want a VTL but I do want de-dupe means that you're going to use NAS. While that will meet a whole lot of needs for a whole lot of people, there's also some really big backups that need a lot more than you can push over IP. For those backups, you're going to want a block transfer protocol (i.e. SCSI), and for that, you're currently going to be buying a VTL. (Unless you're just going to buy a non-deduped disk in which case I'd say you're REALLY wasting your money.) --- W. Curtis Preston Backup Blog @ www.backupcentral.com VP Data Protection, GlassHouse Technologies -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Clem Kruger Sent: Saturday, September 22, 2007 4:24 AM To: VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL Hi Steve, This is the downer on VTL's. You do not get your tape space back automatically. It is for these reasons I recommend that one never go VTL's. NetBackup 6.0 and 6.5 allow disk to disk backups; the images are easily replicated to an offsite facility. The time for all tape has come and gone. The de-duplication facility in 6.5 makes life even easier. Why VTL's (which does SCSI emulation) when you and use disk which is faster and has more protection? Clem. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of swaltner Sent: 21 September 2007 17:32 PM To: VERITAS-BU@mailman.eng.auburn.edu Subject: [Veritas-bu] Script to label expired tapes in a VTL We deployed a VTL last month, which has been working very nicely. This is in a NetBackup 5.1 environment with the VTL attached to our Solaris based master server as well as to our NAS server for local NDMP backups. One thing I'd like to do is over-subscribe on the back-end storage, but before I do that I'd like to automate the process of freeing up the disk space used in the VTL when a NetBackup tape is expired. Just curious if anyone has already written such a beast and would like to share with me as a starting point. If not, I suspect I'll use the following logic: - Every day (at noon??), query the robots defined in the VTL and keep a record of tapes that are allocated. - When a tape goes from allocated to non-allocated from one day to the next, use a command like the following to erase the tape's contents: bplabel -erase -o -d dlt -m VTL123 This would write a small label at the beginning of the virtual tape, causing the VTL to drop all
Re: [Veritas-bu] Script to label expired tapes in a VTL
NBU does not relabel expired tapes before assigning back to Scratch. Inline copy to physical and virtual tape is a pain because you lose the advantage of defining as many virtual drives as you want, and are limited by the number of physical drives, unless you have priorities on data...ie, your important stuff gets ITC to phys and virt, while less important (lab/dev) gets written to VT only, then when the prod jobs are finished with the physical drives, you Vault your Dev/lab to phys tape. -- -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Larry Mascarenhas Sent: September 23, 2007 3:27 PM To: Clem Kruger Cc: VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL In Netbackup, I think it is significantly better. This is because an expired tape gets labelled and put into the Scratch pool automatically. This way the number of volumes to be managed is reduced significantly. With a wee bit of planning, I think it might be possible to eliminate the need for relabelling. I'm toying with various options. One of them is to do in-line copy for off-site. The primary copy with lesser retention time will stay in the VTL. The off-site physical volume will have the correct retention time. La version française suit le texte anglais. This email may contain privileged and/or confidential information, and the Bank of Canada does not waive any related rights. Any distribution, use, or copying of this email or the information it contains by other than the intended recipient is unauthorized. If you received this email in error please delete it immediately from your system and notify the sender promptly by email that you have done so. Le présent courriel peut contenir de l'information privilégiée ou confidentielle. La Banque du Canada ne renonce pas aux droits qui s'y rapportent. Toute diffusion, utilisation ou copie de ce courriel ou des renseignements qu'il contient par une personne autre que le ou les destinataires désignés est interdite. Si vous recevez ce courriel par erreur, veuillez le supprimer immédiatement et envoyer sans délai à l'expéditeur un message électronique pour l'aviser que vous avez éliminé de votre ordinateur toute copie du courriel reçu. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to label expired tapes in a VTL
unless the VTL has the option to free the disk space on a schedule, which it sounds like what Stuart is saying about the NetApp. ie, your tape retention is set to 3 weeks, then your VTL essentially has a 3+ week time to live on pointers. would be kinda scarey if you entended the retention on a tape and your VTL doesn't get the message. But in other cases, yes, as you said, even though Netbackup expires a VT, the VTL doesn't know it's allowed to delete the pointers for the VT untill NBU does a bplabel on that Cart ID. Paul -- -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Clem Kruger Sent: September 23, 2007 1:18 PM To: Liddle, Stuart; Curtis Preston; VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL Hi Stuart, In my experience we had to as the DISK SPACE was still in use! Kind Regards, Clem Kruger-bu La version française suit le texte anglais. This email may contain privileged and/or confidential information, and the Bank of Canada does not waive any related rights. Any distribution, use, or copying of this email or the information it contains by other than the intended recipient is unauthorized. If you received this email in error please delete it immediately from your system and notify the sender promptly by email that you have done so. Le présent courriel peut contenir de l'information privilégiée ou confidentielle. La Banque du Canada ne renonce pas aux droits qui s'y rapportent. Toute diffusion, utilisation ou copie de ce courriel ou des renseignements qu'il contient par une personne autre que le ou les destinataires désignés est interdite. Si vous recevez ce courriel par erreur, veuillez le supprimer immédiatement et envoyer sans délai à l'expéditeur un message électronique pour l'aviser que vous avez éliminé de votre ordinateur toute copie du courriel reçu. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to label expired tapes in a VTL
Hi All, This is exactly right. The space is not available! Let us assume that you need to write an urgent backup to a different set of tapes. Although there are tapes that have expired, you may not have space on the DISK to write to those tapes, your backup will fail. Now go back to the directors and tell them you now need more space because it has become so easy to create new tape drives as well as new tapes. The administration becomes extremely difficult if you are not using Vaulting. Especially in large environments where you backup 10's of TB every night. It is not that I have anything against VTL's, it is my contention that if you want disk to disk, rather do that. It is easier to manage. Why be bothered still managing TAPE albeit virtual? Kind Regards, Clem Kruger -Original Message- From: Kevin Whittaker [mailto:[EMAIL PROTECTED] Sent: 24 September 2007 16:41 PM To: Paul Keating; Curtis Preston; Clem Kruger; VERITAS-BU@mailman.eng.auburn.edu Subject: RE: [Veritas-bu] Script to label expired tapes in a VTL I agree with Paul on this issue. The same is true with the VTL that I currently use. Kevin Whittaker -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Paul Keating Sent: Monday, September 24, 2007 9:34 AM To: Curtis Preston; Clem Kruger; VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL Not entirely true, Curtis. When your virutal tape expires, the VTL has no way of knowing this untill the tape is written to again. Depending on the VTL, this may be too late. I've got about 2TB of free space on my VTL, and about 1000 scratch VTs (2800 total). After a couple of weeks of Netbackup using and expiring VTs, The VTs are going back to Scratch, but untill they're re-written, the pointers in the repository still exist, therefore the VTL thinks the space is still in useso if you're using a de-duping VTL (or DSU to a de-duping FS) and you're only doing real time freeing of space (ie, re-labelling a VT only when you re-write it, or letting NBU delete images from the DSU only as the DSU approaches a high disk utilization threshold), then your target will need to do some high-perf defragging in order to provide you with sufficient free space to write more images. Non-de-dup TLs such as Quantums, which hard allocate a fixed chunk of disk for each cart will not have this problem, nor will a DSU on a standard FS, but with my current VTL, it's definitely a requirement to occasionally kick off a script to bplabel recently expired tapes, so that the defrag process can run at a higher priority (when IO to the TL is lower.) Paul -- -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Curtis Preston Sent: September 22, 2007 5:15 AM To: Clem Kruger; VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL Oversubscription aside, once his tapes are expired, the space taken up by those tapes is immediately available for reuse. The next time the tape gets written to, it will delete all pointers to the space taken up by that tape. As to the VTL vs disk debate, I still think you should bring in all disk devices and let them duke it out before excluding an entire category of them. You're going to exclude a lot of really good products if you just no VTLs. Remember that saying I don't want a VTL but I do want de-dupe means that you're going to use NAS. While that will meet a whole lot of needs for a whole lot of people, there's also some really big backups that need a lot more than you can push over IP. For those backups, you're going to want a block transfer protocol (i.e. SCSI), and for that, you're currently going to be buying a VTL. (Unless you're just going to buy a non-deduped disk in which case I'd say you're REALLY wasting your money.) --- W. Curtis Preston Backup Blog @ www.backupcentral.com VP Data Protection, GlassHouse Technologies -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Clem Kruger Sent: Saturday, September 22, 2007 4:24 AM To: VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL Hi Steve, This is the downer on VTL's. You do not get your tape space back automatically. It is for these reasons I recommend that one never go VTL's. NetBackup 6.0 and 6.5 allow disk to disk backups; the images are easily replicated to an offsite facility. The time for all tape has come and gone. The de-duplication facility in 6.5 makes life even easier. Why VTL's (which does SCSI emulation) when you and use disk which is faster and has more protection? Clem. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of swaltner Sent: 21 September 2007 17:32 PM To: VERITAS-BU@mailman.eng.auburn.edu
Re: [Veritas-bu] Script to label expired tapes in a VTL
It's not as complicated as you make it sound. Like tape, you need to keep some overhead in free disk. If you want to maximize the contiguous free disk available, then you would bplable tapes as they expire and go back to scratch. As you write to a scratch tape, the space that cart previously occupied is released, so as you occupy more space with that tape, the data previously on that tape is again available for use...the background defragger will reclaim that space for a subsequent backup. I'd like to know how this problem goes away with a de-duping disk as disk target. If you write an image to a disk-as-disk target, and later the netbackup image expires, how are you ahead of the same position you'd be in with a VTL when a tape expires? Paul -- -Original Message- From: Clem Kruger [mailto:[EMAIL PROTECTED] Sent: September 24, 2007 12:20 PM To: Kevin Whittaker; Paul Keating; Curtis Preston; VERITAS-BU@mailman.eng.auburn.edu Subject: RE: [Veritas-bu] Script to label expired tapes in a VTL Hi All, This is exactly right. The space is not available! Let us assume that you need to write an urgent backup to a different set of tapes. Although there are tapes that have expired, you may not have space on the DISK to write to those tapes, your backup will fail. Now go back to the directors and tell them you now need more space because it has become so easy to create new tape drives as well as new tapes. The administration becomes extremely difficult if you are not using Vaulting. Especially in large environments where you backup 10's of TB every night. It is not that I have anything against VTL's, it is my contention that if you want disk to disk, rather do that. It is easier to manage. Why be bothered still managing TAPE albeit virtual? Kind Regards, Clem Kruger La version française suit le texte anglais. This email may contain privileged and/or confidential information, and the Bank of Canada does not waive any related rights. Any distribution, use, or copying of this email or the information it contains by other than the intended recipient is unauthorized. If you received this email in error please delete it immediately from your system and notify the sender promptly by email that you have done so. Le présent courriel peut contenir de l'information privilégiée ou confidentielle. La Banque du Canada ne renonce pas aux droits qui s'y rapportent. Toute diffusion, utilisation ou copie de ce courriel ou des renseignements qu'il contient par une personne autre que le ou les destinataires désignés est interdite. Si vous recevez ce courriel par erreur, veuillez le supprimer immédiatement et envoyer sans délai à l'expéditeur un message électronique pour l'aviser que vous avez éliminé de votre ordinateur toute copie du courriel reçu. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to label expired tapes in a VTL
Haha, Yes Paul, when you have made life so easy that DBA's decide they can make backups without letting the storage group know, it is not so easy. Kind Regards, Clem Kruger -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Paul Keating Sent: 24 September 2007 18:44 PM To: VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL It's not as complicated as you make it sound. Like tape, you need to keep some overhead in free disk. If you want to maximize the contiguous free disk available, then you would bplable tapes as they expire and go back to scratch. As you write to a scratch tape, the space that cart previously occupied is released, so as you occupy more space with that tape, the data previously on that tape is again available for use...the background defragger will reclaim that space for a subsequent backup. I'd like to know how this problem goes away with a de-duping disk as disk target. If you write an image to a disk-as-disk target, and later the netbackup image expires, how are you ahead of the same position you'd be in with a VTL when a tape expires? Paul -- -Original Message- From: Clem Kruger [mailto:[EMAIL PROTECTED] Sent: September 24, 2007 12:20 PM To: Kevin Whittaker; Paul Keating; Curtis Preston; VERITAS-BU@mailman.eng.auburn.edu Subject: RE: [Veritas-bu] Script to label expired tapes in a VTL Hi All, This is exactly right. The space is not available! Let us assume that you need to write an urgent backup to a different set of tapes. Although there are tapes that have expired, you may not have space on the DISK to write to those tapes, your backup will fail. Now go back to the directors and tell them you now need more space because it has become so easy to create new tape drives as well as new tapes. The administration becomes extremely difficult if you are not using Vaulting. Especially in large environments where you backup 10's of TB every night. It is not that I have anything against VTL's, it is my contention that if you want disk to disk, rather do that. It is easier to manage. Why be bothered still managing TAPE albeit virtual? Kind Regards, Clem Kruger La version française suit le texte anglais. This email may contain privileged and/or confidential information, and the Bank of Canada does not waive any related rights. Any distribution, use, or copying of this email or the information it contains by other than the intended recipient is unauthorized. If you received this email in error please delete it immediately from your system and notify the sender promptly by email that you have done so. Le présent courriel peut contenir de l'information privilégiée ou confidentielle. La Banque du Canada ne renonce pas aux droits qui s'y rapportent. Toute diffusion, utilisation ou copie de ce courriel ou des renseignements qu'il contient par une personne autre que le ou les destinataires désignés est interdite. Si vous recevez ce courriel par erreur, veuillez le supprimer immédiatement et envoyer sans délai à l'expéditeur un message électronique pour l'aviser que vous avez éliminé de votre ordinateur toute copie du courriel reçu. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to label expired tapes in a VTL
Per my Data Domain rep - when a DSU image expires, NBU deletes it. Data Domain's product then checks all the blocks associated with that image file and removes any that are not shared by any other backups. -Jonathan -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Paul Keating Sent: Monday, September 24, 2007 12:44 PM To: VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL It's not as complicated as you make it sound. Like tape, you need to keep some overhead in free disk. If you want to maximize the contiguous free disk available, then you would bplable tapes as they expire and go back to scratch. As you write to a scratch tape, the space that cart previously occupied is released, so as you occupy more space with that tape, the data previously on that tape is again available for use...the background defragger will reclaim that space for a subsequent backup. I'd like to know how this problem goes away with a de-duping disk as disk target. If you write an image to a disk-as-disk target, and later the netbackup image expires, how are you ahead of the same position you'd be in with a VTL when a tape expires? Paul -- -Original Message- From: Clem Kruger [mailto:[EMAIL PROTECTED] Sent: September 24, 2007 12:20 PM To: Kevin Whittaker; Paul Keating; Curtis Preston; VERITAS-BU@mailman.eng.auburn.edu Subject: RE: [Veritas-bu] Script to label expired tapes in a VTL Hi All, This is exactly right. The space is not available! Let us assume that you need to write an urgent backup to a different set of tapes. Although there are tapes that have expired, you may not have space on the DISK to write to those tapes, your backup will fail. Now go back to the directors and tell them you now need more space because it has become so easy to create new tape drives as well as new tapes. The administration becomes extremely difficult if you are not using Vaulting. Especially in large environments where you backup 10's of TB every night. It is not that I have anything against VTL's, it is my contention that if you want disk to disk, rather do that. It is easier to manage. Why be bothered still managing TAPE albeit virtual? Kind Regards, Clem Kruger La version française suit le texte anglais. This email may contain privileged and/or confidential information, and the Bank of Canada does not waive any related rights. Any distribution, use, or copying of this email or the information it contains by other than the intended recipient is unauthorized. If you received this email in error please delete it immediately from your system and notify the sender promptly by email that you have done so. Le présent courriel peut contenir de l'information privilégiée ou confidentielle. La Banque du Canada ne renonce pas aux droits qui s'y rapportent. Toute diffusion, utilisation ou copie de ce courriel ou des renseignements qu'il contient par une personne autre que le ou les destinataires désignés est interdite. Si vous recevez ce courriel par erreur, veuillez le supprimer immédiatement et envoyer sans délai à l'expéditeur un message électronique pour l'aviser que vous avez éliminé de votre ordinateur toute copie du courriel reçu. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to label expired tapes in a VTL
What filesystem is on the appliance? Does the app then defrag the small chunks of dereferenced space into contiguous chunks? Or does the next backup write to whatever chunks of free space it can find (performance?) -- -Original Message- From: Martin, Jonathan [mailto:[EMAIL PROTECTED] Sent: September 24, 2007 1:35 PM To: Paul Keating; VERITAS-BU@mailman.eng.auburn.edu Subject: RE: [Veritas-bu] Script to label expired tapes in a VTL Per my Data Domain rep - when a DSU image expires, NBU deletes it. Data Domain's product then checks all the blocks associated with that image file and removes any that are not shared by any other backups. -Jonathan La version française suit le texte anglais. This email may contain privileged and/or confidential information, and the Bank of Canada does not waive any related rights. Any distribution, use, or copying of this email or the information it contains by other than the intended recipient is unauthorized. If you received this email in error please delete it immediately from your system and notify the sender promptly by email that you have done so. Le présent courriel peut contenir de l'information privilégiée ou confidentielle. La Banque du Canada ne renonce pas aux droits qui s'y rapportent. Toute diffusion, utilisation ou copie de ce courriel ou des renseignements qu'il contient par une personne autre que le ou les destinataires désignés est interdite. Si vous recevez ce courriel par erreur, veuillez le supprimer immédiatement et envoyer sans délai à l'expéditeur un message électronique pour l'aviser que vous avez éliminé de votre ordinateur toute copie du courriel reçu. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to label expired tapes in a VTL
My understanding is that the file system is completely virtual. The file list you can pull as a CIFS or NFS share, but each file is made up of chunks on the back end. I think by definition deduplication involves LOTS of fragments. :) I questioned the performance myself - I haven't test driven a box yet so I really can't speak to it. Anyone else? -Jonathan -Original Message- From: Paul Keating [mailto:[EMAIL PROTECTED] Sent: Monday, September 24, 2007 1:38 PM To: Martin, Jonathan; VERITAS-BU@mailman.eng.auburn.edu Subject: RE: [Veritas-bu] Script to label expired tapes in a VTL What filesystem is on the appliance? Does the app then defrag the small chunks of dereferenced space into contiguous chunks? Or does the next backup write to whatever chunks of free space it can find (performance?) -- -Original Message- From: Martin, Jonathan [mailto:[EMAIL PROTECTED] Sent: September 24, 2007 1:35 PM To: Paul Keating; VERITAS-BU@mailman.eng.auburn.edu Subject: RE: [Veritas-bu] Script to label expired tapes in a VTL Per my Data Domain rep - when a DSU image expires, NBU deletes it. Data Domain's product then checks all the blocks associated with that image file and removes any that are not shared by any other backups. -Jonathan La version française suit le texte anglais. This email may contain privileged and/or confidential information, and the Bank of Canada does not waive any related rights. Any distribution, use, or copying of this email or the information it contains by other than the intended recipient is unauthorized. If you received this email in error please delete it immediately from your system and notify the sender promptly by email that you have done so. Le présent courriel peut contenir de l'information privilégiée ou confidentielle. La Banque du Canada ne renonce pas aux droits qui s'y rapportent. Toute diffusion, utilisation ou copie de ce courriel ou des renseignements qu'il contient par une personne autre que le ou les destinataires désignés est interdite. Si vous recevez ce courriel par erreur, veuillez le supprimer immédiatement et envoyer sans délai à l'expéditeur un message électronique pour l'aviser que vous avez éliminé de votre ordinateur toute copie du courriel reçu. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to label expired tapes in a VTL
The problem is not de-dupe; the problem is thin provisioning and oversubscription. There are a lot of VTLs that allow both (with or w/o de-dupe), and if you define more tapes than you actually have disk, you will have this problem. I'll concede that oversubscription is a natural state in a de-dupe VTL, as you define probably 20 times more tapes than you have real storage for. The problem I see you're describing is this: 1. You define more tapes than you really have capacity for (again, this is normal in the de-dupe world) 2. You have a bunch that are partially full 3. You have a bunch that are in scratch, but have not been relabeled. 4. You may even have some that are brand new tapes that haven't been used at all. 5. You're out of real free space 6. Since NBU prefers to append rather than use a new tape, it will grab the #2 tapes before the #3 tapes. Had it grabbed the #3 tapes, it would have cleared the space they're taking up and you wouldn't have the problem, but that's not how NBU (or any other backup s/w) works. Here's a thought. Isn't there a way to tell NBU to mark tapes full/frozen/something after a backup? If you did that, additional backups wouldn't append to those tapes, and you wouldn't have to worry about labeling. Would that work? Of course, this whole labeling thing really isn't that big of a deal. A simple shell script could handle it easy enough. --- W. Curtis Preston Backup Blog @ www.backupcentral.com VP Data Protection, GlassHouse Technologies -Original Message- From: Paul Keating [mailto:[EMAIL PROTECTED] Sent: Monday, September 24, 2007 9:34 AM To: Curtis Preston; Clem Kruger; VERITAS-BU@mailman.eng.auburn.edu Subject: RE: [Veritas-bu] Script to label expired tapes in a VTL Not entirely true, Curtis. When your virutal tape expires, the VTL has no way of knowing this untill the tape is written to again. Depending on the VTL, this may be too late. I've got about 2TB of free space on my VTL, and about 1000 scratch VTs (2800 total). After a couple of weeks of Netbackup using and expiring VTs, The VTs are going back to Scratch, but untill they're re-written, the pointers in the repository still exist, therefore the VTL thinks the space is still in useso if you're using a de-duping VTL (or DSU to a de-duping FS) and you're only doing real time freeing of space (ie, re-labelling a VT only when you re-write it, or letting NBU delete images from the DSU only as the DSU approaches a high disk utilization threshold), then your target will need to do some high-perf defragging in order to provide you with sufficient free space to write more images. Non-de-dup TLs such as Quantums, which hard allocate a fixed chunk of disk for each cart will not have this problem, nor will a DSU on a standard FS, but with my current VTL, it's definitely a requirement to occasionally kick off a script to bplabel recently expired tapes, so that the defrag process can run at a higher priority (when IO to the TL is lower.) Paul -- -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Curtis Preston Sent: September 22, 2007 5:15 AM To: Clem Kruger; VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL Oversubscription aside, once his tapes are expired, the space taken up by those tapes is immediately available for reuse. The next time the tape gets written to, it will delete all pointers to the space taken up by that tape. As to the VTL vs disk debate, I still think you should bring in all disk devices and let them duke it out before excluding an entire category of them. You're going to exclude a lot of really good products if you just no VTLs. Remember that saying I don't want a VTL but I do want de-dupe means that you're going to use NAS. While that will meet a whole lot of needs for a whole lot of people, there's also some really big backups that need a lot more than you can push over IP. For those backups, you're going to want a block transfer protocol (i.e. SCSI), and for that, you're currently going to be buying a VTL. (Unless you're just going to buy a non-deduped disk in which case I'd say you're REALLY wasting your money.) --- W. Curtis Preston Backup Blog @ www.backupcentral.com VP Data Protection, GlassHouse Technologies -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Clem Kruger Sent: Saturday, September 22, 2007 4:24 AM To: VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL Hi Steve, This is the downer on VTL's. You do not get your tape space back automatically. It is for these reasons I recommend that one never go VTL's. NetBackup 6.0 and 6.5 allow disk to disk backups; the images are easily replicated to an offsite facility. The time for all tape has come and gone. The de-duplication facility in 6.5 makes
Re: [Veritas-bu] Script to label expired tapes in a VTL
I think I'm beginning to understand my confusion to some of the earlier comments and now see from the conversations that are taking place that the way we are using our VTL's is vastly different from the way that most of the respondents to this thread are using theirs. Correct me if I'm wrong, but most of you have been describing the method for using your VTL's as one of what I'll call self-contained VTL's and that there is no real connection to the physical tapes. In other words, in order to get data from the virtual tapes you have to use Vault or some other method of duplication to get the data off-site. So, the tapes are always in the VTL and are re-cycled just as physical tapes are in a physical tape library. Hence the need to delete and/or re-label. We abandoned that method in favor of having our VTL's manage a partition of the physical tape library and have a direct link to the physical tapes. In other words, a barcode in the virtual library is the same as a barcode on a physical tape. So, for us, when a tape is full or we want to eject it and send it offsite, it gets cloned to physical tape and it's no longer visible to NetBackup in the virtual library. But, we have set up our VTL to use a shadow pool where the virtual tape is still available until the VTL needs the space. In some instances, the data can be available for up to 10 days. If we need a tape for a restore, we just import it read-only from the shadow pool and inventory the virtual library in NetBackup and off we go. When we are done, we just eject it from the virtual library and since it's already in sync with the physical tape, nothing more is required. Now, this might sound messy from the standpoint that you don't know where the physical tape really is according to NetBackupas far as it knows, it's just not in the library and since you didn't use Vault, it's whereabouts are unknown. In our experience this doesn't matter because we have a separate app to track our off-site tapes. So, the whole discussion about re-labeling the virtual tapes is just an interesting discussion to me because we don't do that method. --stuart -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Curtis Preston Sent: Monday, September 24, 2007 12:15 PM To: Paul Keating; Clem Kruger; VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL The problem is not de-dupe; the problem is thin provisioning and oversubscription. There are a lot of VTLs that allow both (with or w/o de-dupe), and if you define more tapes than you actually have disk, you will have this problem. I'll concede that oversubscription is a natural state in a de-dupe VTL, as you define probably 20 times more tapes than you have real storage for. The problem I see you're describing is this: 1. You define more tapes than you really have capacity for (again, this is normal in the de-dupe world) 2. You have a bunch that are partially full 3. You have a bunch that are in scratch, but have not been relabeled. 4. You may even have some that are brand new tapes that haven't been used at all. 5. You're out of real free space 6. Since NBU prefers to append rather than use a new tape, it will grab the #2 tapes before the #3 tapes. Had it grabbed the #3 tapes, it would have cleared the space they're taking up and you wouldn't have the problem, but that's not how NBU (or any other backup s/w) works. Here's a thought. Isn't there a way to tell NBU to mark tapes full/frozen/something after a backup? If you did that, additional backups wouldn't append to those tapes, and you wouldn't have to worry about labeling. Would that work? Of course, this whole labeling thing really isn't that big of a deal. A simple shell script could handle it easy enough. --- W. Curtis Preston Backup Blog @ www.backupcentral.com VP Data Protection, GlassHouse Technologies -Original Message- From: Paul Keating [mailto:[EMAIL PROTECTED] Sent: Monday, September 24, 2007 9:34 AM To: Curtis Preston; Clem Kruger; VERITAS-BU@mailman.eng.auburn.edu Subject: RE: [Veritas-bu] Script to label expired tapes in a VTL Not entirely true, Curtis. When your virutal tape expires, the VTL has no way of knowing this untill the tape is written to again. Depending on the VTL, this may be too late. I've got about 2TB of free space on my VTL, and about 1000 scratch VTs (2800 total). After a couple of weeks of Netbackup using and expiring VTs, The VTs are going back to Scratch, but untill they're re-written, the pointers in the repository still exist, therefore the VTL thinks the space is still in useso if you're using a de-duping VTL (or DSU to a de-duping FS) and you're only doing real time freeing of space (ie, re-labelling a VT only when you re-write it, or letting NBU delete images from the DSU only as the DSU approaches a high disk utilization threshold), then your target will need to do
Re: [Veritas-bu] Script to label expired tapes in a VTL
I think you nailed it, Stu. I remember your previous posts on this topic, and that you said you went to this method because the NBU Vault method wasn't duping the tapes fast enough for you. As I recall, it was because your backups had millions of files in them, and this was slowing down your dupe process. You went to the tape-out functionality of your VTL because it made the copies faster (significantly so), and were willing to live with any downsides because it made the copies possible. You are correct. Most people do not use their VTLs this way. Part of the reason is a good amount of FUD put out by the backup vendors. Another reason is that it does come with some major downsides. In your case, you had to choose which downsides were worse, and in your case, the downside of not getting the copies done at all was unacceptable, so you decided to deal with the downsides of the other method. --- W. Curtis Preston Backup Blog @ www.backupcentral.com VP Data Protection, GlassHouse Technologies -Original Message- From: Liddle, Stuart [mailto:[EMAIL PROTECTED] Sent: Monday, September 24, 2007 4:55 PM To: Curtis Preston; Paul Keating; Clem Kruger; VERITAS-BU@mailman.eng.auburn.edu Subject: RE: Re: [Veritas-bu] Script to label expired tapes in a VTL I think I'm beginning to understand my confusion to some of the earlier comments and now see from the conversations that are taking place that the way we are using our VTL's is vastly different from the way that most of the respondents to this thread are using theirs. Correct me if I'm wrong, but most of you have been describing the method for using your VTL's as one of what I'll call self-contained VTL's and that there is no real connection to the physical tapes. In other words, in order to get data from the virtual tapes you have to use Vault or some other method of duplication to get the data off-site. So, the tapes are always in the VTL and are re-cycled just as physical tapes are in a physical tape library. Hence the need to delete and/or re-label. We abandoned that method in favor of having our VTL's manage a partition of the physical tape library and have a direct link to the physical tapes. In other words, a barcode in the virtual library is the same as a barcode on a physical tape. So, for us, when a tape is full or we want to eject it and send it offsite, it gets cloned to physical tape and it's no longer visible to NetBackup in the virtual library. But, we have set up our VTL to use a shadow pool where the virtual tape is still available until the VTL needs the space. In some instances, the data can be available for up to 10 days. If we need a tape for a restore, we just import it read-only from the shadow pool and inventory the virtual library in NetBackup and off we go. When we are done, we just eject it from the virtual library and since it's already in sync with the physical tape, nothing more is required. Now, this might sound messy from the standpoint that you don't know where the physical tape really is according to NetBackupas far as it knows, it's just not in the library and since you didn't use Vault, it's whereabouts are unknown. In our experience this doesn't matter because we have a separate app to track our off-site tapes. So, the whole discussion about re-labeling the virtual tapes is just an interesting discussion to me because we don't do that method. --stuart -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Curtis Preston Sent: Monday, September 24, 2007 12:15 PM To: Paul Keating; Clem Kruger; VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL The problem is not de-dupe; the problem is thin provisioning and oversubscription. There are a lot of VTLs that allow both (with or w/o de-dupe), and if you define more tapes than you actually have disk, you will have this problem. I'll concede that oversubscription is a natural state in a de-dupe VTL, as you define probably 20 times more tapes than you have real storage for. The problem I see you're describing is this: 1. You define more tapes than you really have capacity for (again, this is normal in the de-dupe world) 2. You have a bunch that are partially full 3. You have a bunch that are in scratch, but have not been relabeled. 4. You may even have some that are brand new tapes that haven't been used at all. 5. You're out of real free space 6. Since NBU prefers to append rather than use a new tape, it will grab the #2 tapes before the #3 tapes. Had it grabbed the #3 tapes, it would have cleared the space they're taking up and you wouldn't have the problem, but that's not how NBU (or any other backup s/w) works. Here's a thought. Isn't there a way to tell NBU to mark tapes full/frozen/something after a backup? If you did that, additional backups wouldn't append to those tapes, and you wouldn't have to worry about
Re: [Veritas-bu] Script to label expired tapes in a VTL
Hmm.. That's a problem. Oh well, back to the drawing board. Curtis Preston wrote: This is because an expired tape gets labelled and put into the Scratch pool automatically. No it doesn't. It gets put in the Scratch, but it is not relabeled. -- Larry Mascarenhas [EMAIL PROTECTED] ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to label expired tapes in a VTL
Curtis, Yes, that is correct. I am remembering all of the PAIN associated with having NetBackup Vault make copies to physical tape. It went something like this: 1) do the backup to VTL 2) vault images from VTL to physical tape 3) keep track of the stuff that has been vaulted and then expire images 4) once all images on a tape have been expired, then do a bpexpdate -deassignempty on a virtual tape (which, by the way, Symantec told us there was a rare, but fatal bug with this method). 5) try to keep Vault running ahead of the backups so that there would be enough virtual tapes available to use for backups 6) rerun failed vault jobs to allow for proper image expiration 7) repeat steps 1 through 6 several times Agghhh the pain!!! -Original Message- From: Curtis Preston [mailto:[EMAIL PROTECTED] Sent: Monday, September 24, 2007 3:56 PM To: Liddle, Stuart; Paul Keating; Clem Kruger; VERITAS-BU@mailman.eng.auburn.edu Subject: RE: Re: [Veritas-bu] Script to label expired tapes in a VTL I think you nailed it, Stu. I remember your previous posts on this topic, and that you said you went to this method because the NBU Vault method wasn't duping the tapes fast enough for you. As I recall, it was because your backups had millions of files in them, and this was slowing down your dupe process. You went to the tape-out functionality of your VTL because it made the copies faster (significantly so), and were willing to live with any downsides because it made the copies possible. You are correct. Most people do not use their VTLs this way. Part of the reason is a good amount of FUD put out by the backup vendors. Another reason is that it does come with some major downsides. In your case, you had to choose which downsides were worse, and in your case, the downside of not getting the copies done at all was unacceptable, so you decided to deal with the downsides of the other method. --- W. Curtis Preston Backup Blog @ www.backupcentral.com VP Data Protection, GlassHouse Technologies -Original Message- From: Liddle, Stuart [mailto:[EMAIL PROTECTED] Sent: Monday, September 24, 2007 4:55 PM To: Curtis Preston; Paul Keating; Clem Kruger; VERITAS-BU@mailman.eng.auburn.edu Subject: RE: Re: [Veritas-bu] Script to label expired tapes in a VTL I think I'm beginning to understand my confusion to some of the earlier comments and now see from the conversations that are taking place that the way we are using our VTL's is vastly different from the way that most of the respondents to this thread are using theirs. Correct me if I'm wrong, but most of you have been describing the method for using your VTL's as one of what I'll call self-contained VTL's and that there is no real connection to the physical tapes. In other words, in order to get data from the virtual tapes you have to use Vault or some other method of duplication to get the data off-site. So, the tapes are always in the VTL and are re-cycled just as physical tapes are in a physical tape library. Hence the need to delete and/or re-label. We abandoned that method in favor of having our VTL's manage a partition of the physical tape library and have a direct link to the physical tapes. In other words, a barcode in the virtual library is the same as a barcode on a physical tape. So, for us, when a tape is full or we want to eject it and send it offsite, it gets cloned to physical tape and it's no longer visible to NetBackup in the virtual library. But, we have set up our VTL to use a shadow pool where the virtual tape is still available until the VTL needs the space. In some instances, the data can be available for up to 10 days. If we need a tape for a restore, we just import it read-only from the shadow pool and inventory the virtual library in NetBackup and off we go. When we are done, we just eject it from the virtual library and since it's already in sync with the physical tape, nothing more is required. Now, this might sound messy from the standpoint that you don't know where the physical tape really is according to NetBackupas far as it knows, it's just not in the library and since you didn't use Vault, it's whereabouts are unknown. In our experience this doesn't matter because we have a separate app to track our off-site tapes. So, the whole discussion about re-labeling the virtual tapes is just an interesting discussion to me because we don't do that method. --stuart -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Curtis Preston Sent: Monday, September 24, 2007 12:15 PM To: Paul Keating; Clem Kruger; VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL The problem is not de-dupe; the problem is thin provisioning and oversubscription. There are a lot of VTLs that allow both (with or w/o de-dupe), and if you define more tapes than you actually have disk, you will have this problem. I'll
Re: [Veritas-bu] Script to label expired tapes in a VTL
Hi Stuart, In my experience we had to as the DISK SPACE was still in use! Kind Regards, Clem Kruger From: Liddle, Stuart [mailto:[EMAIL PROTECTED] Sent: 22 September 2007 21:35 PM To: Clem Kruger; Curtis Preston; VERITAS-BU@mailman.eng.auburn.edu Subject: RE: Re: [Veritas-bu] Script to label expired tapes in a VTL Clem, You have made a rather curious comment. You don't have to delete the tape to get the space returned. (My experience is with the NetApp VTL.) There are settings on the VTL that you can set to allow for how long you keep a virtual tape in the shadow pool once it has been cloned to physical tape. If you are not cloning to physical tape and are just keeping images on virtual tape, then you would not be deleting the tapes, you would be expiring images...just like Curtis said about the DSU. That's one of the nice features of the NetApp VTL. If you have the disk space, as long as you have cloned to physical tape it will keep the virtual tapes around until the VTL needs to free up space for newer backups. It does this for you automatically! --stuart From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Clem Kruger Sent: Saturday, September 22, 2007 2:33 AM To: Curtis Preston; VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL Hi Curtis, You have to delete the tape to get your space returned. This is the real pain and cost Clem. -Original Message- From: Curtis Preston [mailto:[EMAIL PROTECTED] mailto:%5bmailto:[EMAIL PROTECTED] Sent: 22 September 2007 11:15 AM To: Clem Kruger; VERITAS-BU@mailman.eng.auburn.edu Subject: RE: [Veritas-bu] Script to label expired tapes in a VTL And you don't get the space back on a DSU until you expire the image. So what? I also argue that what Steve is asking for isn't necessary. (I think he's MAKING it necessary by oversubscribing, but that's not the VTL's fault.) Oversubscription aside, once his tapes are expired, the space taken up by those tapes is immediately available for reuse. The next time the tape gets written to, it will delete all pointers to the space taken up by that tape. As to the VTL vs disk debate, I still think you should bring in all disk devices and let them duke it out before excluding an entire category of them. You're going to exclude a lot of really good products if you just no VTLs. Remember that saying I don't want a VTL but I do want de-dupe means that you're going to use NAS. While that will meet a whole lot of needs for a whole lot of people, there's also some really big backups that need a lot more than you can push over IP. For those backups, you're going to want a block transfer protocol (i.e. SCSI), and for that, you're currently going to be buying a VTL. (Unless you're just going to buy a non-deduped disk in which case I'd say you're REALLY wasting your money.) --- W. Curtis Preston Backup Blog @ www.backupcentral.com VP Data Protection, GlassHouse Technologies -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Clem Kruger Sent: Saturday, September 22, 2007 4:24 AM To: VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL Hi Steve, This is the downer on VTL's. You do not get your tape space back automatically. It is for these reasons I recommend that one never go VTL's. NetBackup 6.0 and 6.5 allow disk to disk backups; the images are easily replicated to an offsite facility. The time for all tape has come and gone. The de-duplication facility in 6.5 makes life even easier. Why VTL's (which does SCSI emulation) when you and use disk which is faster and has more protection? Clem. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of swaltner Sent: 21 September 2007 17:32 PM To: VERITAS-BU@mailman.eng.auburn.edu Subject: [Veritas-bu] Script to label expired tapes in a VTL We deployed a VTL last month, which has been working very nicely. This is in a NetBackup 5.1 environment with the VTL attached to our Solaris based master server as well as to our NAS server for local NDMP backups. One thing I'd like to do is over-subscribe on the back-end storage, but before I do that I'd like to automate the process of freeing up the disk space used in the VTL when a NetBackup tape is expired. Just curious if anyone has already written such a beast and would like to share with me as a starting point. If not, I suspect I'll use the following logic: - Every day (at noon??), query the robots defined in the VTL and keep a record of tapes that are allocated. - When a tape goes from allocated to non-allocated from one day to the next, use a command like the following to erase the tape's contents: bplabel -erase -o -d dlt -m
Re: [Veritas-bu] Script to label expired tapes in a VTL
Clem, I'm moving from Legato to Netbackup. In the Legato world, relabelling the VTL volume resulted in the space being returned to the disk. This is true even for an expired tape. ie I needed to relabel it. In Netbackup, I think it is significantly better. This is because an expired tape gets labelled and put into the Scratch pool automatically. This way the number of volumes to be managed is reduced significantly. With a wee bit of planning, I think it might be possible to eliminate the need for relabelling. I'm toying with various options. One of them is to do in-line copy for off-site. The primary copy with lesser retention time will stay in the VTL. The off-site physical volume will have the correct retention time. Please let us know what you decide and how it is working out. It would certainly help the community as a whole bunch of us are working on the same issues. Clem Kruger wrote: Hi Stuart, In my experience we had to as the “DISK SPACE” was still in use! *Kind Regards,* *Clem Kruger* *From:* Liddle, Stuart [mailto:[EMAIL PROTECTED] *Sent:* 22 September 2007 21:35 PM *To:* Clem Kruger; Curtis Preston; VERITAS-BU@mailman.eng.auburn.edu *Subject:* RE: Re: [Veritas-bu] Script to label expired tapes in a VTL Clem, You have made a rather curious comment. You don’t have to delete the tape to get the space returned. (My experience is with the NetApp VTL.) There are settings on the VTL that you can set to allow for how long you keep a virtual tape in the “shadow” pool once it has been “cloned” to physical tape. If you are not cloning to physical tape and are just keeping images on virtual tape, then you would not be “deleting” the tapes, you would be expiring images…just like Curtis said about the DSU. That’s one of the nice features of the NetApp VTL. If you have the disk space, as long as you have cloned to physical tape it will keep the virtual tapes around until the VTL needs to free up space for newer backups. It does this for you automatically! --stuart *From:* [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] *On Behalf Of *Clem Kruger *Sent:* Saturday, September 22, 2007 2:33 AM *To:* Curtis Preston; VERITAS-BU@mailman.eng.auburn.edu *Subject:* Re: [Veritas-bu] Script to label expired tapes in a VTL Hi Curtis, You have to delete the tape to get your space returned. This is the real pain and cost Clem. -Original Message- From: Curtis Preston [mailto:[EMAIL PROTECTED] mailto:%5bmailto:[EMAIL PROTECTED] Sent: 22 September 2007 11:15 AM To: Clem Kruger; VERITAS-BU@mailman.eng.auburn.edu Subject: RE: [Veritas-bu] Script to label expired tapes in a VTL And you don't get the space back on a DSU until you expire the image. So what? I also argue that what Steve is asking for isn't necessary. (I think he's MAKING it necessary by oversubscribing, but that's not the VTL's fault.) Oversubscription aside, once his tapes are expired, the space taken up by those tapes is immediately available for reuse. The next time the tape gets written to, it will delete all pointers to the space taken up by that tape. As to the VTL vs disk debate, I still think you should bring in all disk devices and let them duke it out before excluding an entire category of them. You're going to exclude a lot of really good products if you just no VTLs. Remember that saying I don't want a VTL but I do want de-dupe means that you're going to use NAS. While that will meet a whole lot of needs for a whole lot of people, there's also some really big backups that need a lot more than you can push over IP. For those backups, you're going to want a block transfer protocol (i.e. SCSI), and for that, you're currently going to be buying a VTL. (Unless you're just going to buy a non-deduped disk in which case I'd say you're REALLY wasting your money.) --- W. Curtis Preston Backup Blog @ www.backupcentral.com VP Data Protection, GlassHouse Technologies -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Clem Kruger Sent: Saturday, September 22, 2007 4:24 AM To: VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL Hi Steve, This is the downer on VTL's. You do not get your tape space back automatically. It is for these reasons I recommend that one never go VTL's. NetBackup 6.0 and 6.5 allow disk to disk backups; the images are easily replicated to an offsite facility. The time for all tape has come and gone. The de-duplication facility in 6.5 makes life even easier. Why
Re: [Veritas-bu] Script to label expired tapes in a VTL
Hi Steve, This is the downer on VTL's. You do not get your tape space back automatically. It is for these reasons I recommend that one never go VTL's. NetBackup 6.0 and 6.5 allow disk to disk backups; the images are easily replicated to an offsite facility. The time for all tape has come and gone. The de-duplication facility in 6.5 makes life even easier. Why VTL's (which does SCSI emulation) when you and use disk which is faster and has more protection? Clem. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of swaltner Sent: 21 September 2007 17:32 PM To: VERITAS-BU@mailman.eng.auburn.edu Subject: [Veritas-bu] Script to label expired tapes in a VTL We deployed a VTL last month, which has been working very nicely. This is in a NetBackup 5.1 environment with the VTL attached to our Solaris based master server as well as to our NAS server for local NDMP backups. One thing I'd like to do is over-subscribe on the back-end storage, but before I do that I'd like to automate the process of freeing up the disk space used in the VTL when a NetBackup tape is expired. Just curious if anyone has already written such a beast and would like to share with me as a starting point. If not, I suspect I'll use the following logic: - Every day (at noon??), query the robots defined in the VTL and keep a record of tapes that are allocated. - When a tape goes from allocated to non-allocated from one day to the next, use a command like the following to erase the tape's contents: bplabel -erase -o -d dlt -m VTL123 This would write a small label at the beginning of the virtual tape, causing the VTL to drop all the other data that had been stored on the tape. Any reason this wouldn't work? Any gotchas with writing this script that I should look out for? Steve +-- |This was sent by [EMAIL PROTECTED] via Backup Central. |Forward SPAM to [EMAIL PROTECTED] +-- ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to label expired tapes in a VTL
And you don't get the space back on a DSU until you expire the image. So what? I also argue that what Steve is asking for isn't necessary. (I think he's MAKING it necessary by oversubscribing, but that's not the VTL's fault.) Oversubscription aside, once his tapes are expired, the space taken up by those tapes is immediately available for reuse. The next time the tape gets written to, it will delete all pointers to the space taken up by that tape. As to the VTL vs disk debate, I still think you should bring in all disk devices and let them duke it out before excluding an entire category of them. You're going to exclude a lot of really good products if you just no VTLs. Remember that saying I don't want a VTL but I do want de-dupe means that you're going to use NAS. While that will meet a whole lot of needs for a whole lot of people, there's also some really big backups that need a lot more than you can push over IP. For those backups, you're going to want a block transfer protocol (i.e. SCSI), and for that, you're currently going to be buying a VTL. (Unless you're just going to buy a non-deduped disk in which case I'd say you're REALLY wasting your money.) --- W. Curtis Preston Backup Blog @ www.backupcentral.com VP Data Protection, GlassHouse Technologies -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Clem Kruger Sent: Saturday, September 22, 2007 4:24 AM To: VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL Hi Steve, This is the downer on VTL's. You do not get your tape space back automatically. It is for these reasons I recommend that one never go VTL's. NetBackup 6.0 and 6.5 allow disk to disk backups; the images are easily replicated to an offsite facility. The time for all tape has come and gone. The de-duplication facility in 6.5 makes life even easier. Why VTL's (which does SCSI emulation) when you and use disk which is faster and has more protection? Clem. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of swaltner Sent: 21 September 2007 17:32 PM To: VERITAS-BU@mailman.eng.auburn.edu Subject: [Veritas-bu] Script to label expired tapes in a VTL We deployed a VTL last month, which has been working very nicely. This is in a NetBackup 5.1 environment with the VTL attached to our Solaris based master server as well as to our NAS server for local NDMP backups. One thing I'd like to do is over-subscribe on the back-end storage, but before I do that I'd like to automate the process of freeing up the disk space used in the VTL when a NetBackup tape is expired. Just curious if anyone has already written such a beast and would like to share with me as a starting point. If not, I suspect I'll use the following logic: - Every day (at noon??), query the robots defined in the VTL and keep a record of tapes that are allocated. - When a tape goes from allocated to non-allocated from one day to the next, use a command like the following to erase the tape's contents: bplabel -erase -o -d dlt -m VTL123 This would write a small label at the beginning of the virtual tape, causing the VTL to drop all the other data that had been stored on the tape. Any reason this wouldn't work? Any gotchas with writing this script that I should look out for? Steve +-- |This was sent by [EMAIL PROTECTED] via Backup Central. |Forward SPAM to [EMAIL PROTECTED] +-- ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to label expired tapes in a VTL
Hi Curtis, You have to delete the tape to get your space returned. This is the real pain and cost Clem. -Original Message- From: Curtis Preston [mailto:[EMAIL PROTECTED] mailto:%5bmailto:[EMAIL PROTECTED] Sent: 22 September 2007 11:15 AM To: Clem Kruger; VERITAS-BU@mailman.eng.auburn.edu Subject: RE: [Veritas-bu] Script to label expired tapes in a VTL And you don't get the space back on a DSU until you expire the image. So what? I also argue that what Steve is asking for isn't necessary. (I think he's MAKING it necessary by oversubscribing, but that's not the VTL's fault.) Oversubscription aside, once his tapes are expired, the space taken up by those tapes is immediately available for reuse. The next time the tape gets written to, it will delete all pointers to the space taken up by that tape. As to the VTL vs disk debate, I still think you should bring in all disk devices and let them duke it out before excluding an entire category of them. You're going to exclude a lot of really good products if you just no VTLs. Remember that saying I don't want a VTL but I do want de-dupe means that you're going to use NAS. While that will meet a whole lot of needs for a whole lot of people, there's also some really big backups that need a lot more than you can push over IP. For those backups, you're going to want a block transfer protocol (i.e. SCSI), and for that, you're currently going to be buying a VTL. (Unless you're just going to buy a non-deduped disk in which case I'd say you're REALLY wasting your money.) --- W. Curtis Preston Backup Blog @ www.backupcentral.com VP Data Protection, GlassHouse Technologies -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Clem Kruger Sent: Saturday, September 22, 2007 4:24 AM To: VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL Hi Steve, This is the downer on VTL's. You do not get your tape space back automatically. It is for these reasons I recommend that one never go VTL's. NetBackup 6.0 and 6.5 allow disk to disk backups; the images are easily replicated to an offsite facility. The time for all tape has come and gone. The de-duplication facility in 6.5 makes life even easier. Why VTL's (which does SCSI emulation) when you and use disk which is faster and has more protection? Clem. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of swaltner Sent: 21 September 2007 17:32 PM To: VERITAS-BU@mailman.eng.auburn.edu Subject: [Veritas-bu] Script to label expired tapes in a VTL We deployed a VTL last month, which has been working very nicely. This is in a NetBackup 5.1 environment with the VTL attached to our Solaris based master server as well as to our NAS server for local NDMP backups. One thing I'd like to do is over-subscribe on the back-end storage, but before I do that I'd like to automate the process of freeing up the disk space used in the VTL when a NetBackup tape is expired. Just curious if anyone has already written such a beast and would like to share with me as a starting point. If not, I suspect I'll use the following logic: - Every day (at noon??), query the robots defined in the VTL and keep a record of tapes that are allocated. - When a tape goes from allocated to non-allocated from one day to the next, use a command like the following to erase the tape's contents: bplabel -erase -o -d dlt -m VTL123 This would write a small label at the beginning of the virtual tape, causing the VTL to drop all the other data that had been stored on the tape. Any reason this wouldn't work? Any gotchas with writing this script that I should look out for? Steve +-- |This was sent by [EMAIL PROTECTED] via Backup Central. |Forward SPAM to [EMAIL PROTECTED] +-- ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to label expired tapes in a VTL
Clem, You have made a rather curious comment. You don't have to delete the tape to get the space returned. (My experience is with the NetApp VTL.) There are settings on the VTL that you can set to allow for how long you keep a virtual tape in the shadow pool once it has been cloned to physical tape. If you are not cloning to physical tape and are just keeping images on virtual tape, then you would not be deleting the tapes, you would be expiring images...just like Curtis said about the DSU. That's one of the nice features of the NetApp VTL. If you have the disk space, as long as you have cloned to physical tape it will keep the virtual tapes around until the VTL needs to free up space for newer backups. It does this for you automatically! --stuart From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Clem Kruger Sent: Saturday, September 22, 2007 2:33 AM To: Curtis Preston; VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL Hi Curtis, You have to delete the tape to get your space returned. This is the real pain and cost Clem. -Original Message- From: Curtis Preston [mailto:[EMAIL PROTECTED]mailto:%5bmailto:[EMAIL PROTECTED] Sent: 22 September 2007 11:15 AM To: Clem Kruger; VERITAS-BU@mailman.eng.auburn.edu Subject: RE: [Veritas-bu] Script to label expired tapes in a VTL And you don't get the space back on a DSU until you expire the image. So what? I also argue that what Steve is asking for isn't necessary. (I think he's MAKING it necessary by oversubscribing, but that's not the VTL's fault.) Oversubscription aside, once his tapes are expired, the space taken up by those tapes is immediately available for reuse. The next time the tape gets written to, it will delete all pointers to the space taken up by that tape. As to the VTL vs disk debate, I still think you should bring in all disk devices and let them duke it out before excluding an entire category of them. You're going to exclude a lot of really good products if you just no VTLs. Remember that saying I don't want a VTL but I do want de-dupe means that you're going to use NAS. While that will meet a whole lot of needs for a whole lot of people, there's also some really big backups that need a lot more than you can push over IP. For those backups, you're going to want a block transfer protocol (i.e. SCSI), and for that, you're currently going to be buying a VTL. (Unless you're just going to buy a non-deduped disk in which case I'd say you're REALLY wasting your money.) --- W. Curtis Preston Backup Blog @ www.backupcentral.com VP Data Protection, GlassHouse Technologies -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Clem Kruger Sent: Saturday, September 22, 2007 4:24 AM To: VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL Hi Steve, This is the downer on VTL's. You do not get your tape space back automatically. It is for these reasons I recommend that one never go VTL's. NetBackup 6.0 and 6.5 allow disk to disk backups; the images are easily replicated to an offsite facility. The time for all tape has come and gone. The de-duplication facility in 6.5 makes life even easier. Why VTL's (which does SCSI emulation) when you and use disk which is faster and has more protection? Clem. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of swaltner Sent: 21 September 2007 17:32 PM To: VERITAS-BU@mailman.eng.auburn.edu Subject: [Veritas-bu] Script to label expired tapes in a VTL We deployed a VTL last month, which has been working very nicely. This is in a NetBackup 5.1 environment with the VTL attached to our Solaris based master server as well as to our NAS server for local NDMP backups. One thing I'd like to do is over-subscribe on the back-end storage, but before I do that I'd like to automate the process of freeing up the disk space used in the VTL when a NetBackup tape is expired. Just curious if anyone has already written such a beast and would like to share with me as a starting point. If not, I suspect I'll use the following logic: - Every day (at noon??), query the robots defined in the VTL and keep a record of tapes that are allocated. - When a tape goes from allocated to non-allocated from one day to the next, use a command like the following to erase the tape's contents: bplabel -erase -o -d dlt -m VTL123 This would write a small label at the beginning of the virtual tape, causing the VTL to drop all the other data that had been stored on the tape. Any reason this wouldn't work? Any gotchas with writing this script that I should look out for? Steve +-- |This was sent by [EMAIL PROTECTED] via Backup Central. |Forward SPAM
Re: [Veritas-bu] Script to label expired tapes in a VTL
My understanding with Netbackup Pure Disk is that you can manage it like a DSU but in reality its a server with storage (not a media server) like most other de-duplication softwares. I was quite excited to see the new functionality, but when the Symantec rep told me that it pretty much negated the advantage of Puredisk over other de-duplication softwares. Unless I'm missing something? -Jonathan From: [EMAIL PROTECTED] on behalf of Ed Wilts Sent: Sat 9/22/2007 2:23 PM To: 'Curtis Preston'; 'Clem Kruger'; VERITAS-BU@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to label expired tapes in a VTL Remember that saying I don't want a VTL but I do want de-dupe means that you're going to use NAS Actually it doesn't. Don't forget about PureDisk as a NetBackup storage unit. Write to locally attached disk, whether it's local SATA or SAN-attached. .../Ed -- Ed Wilts, RHCE, BCFP, BCSD Mounds View, MN, USA mailto:[EMAIL PROTECTED] ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Script to label expired tapes in a VTL
We deployed a VTL last month, which has been working very nicely. This is in a NetBackup 5.1 environment with the VTL attached to our Solaris based master server as well as to our NAS server for local NDMP backups. One thing I'd like to do is over-subscribe on the back-end storage, but before I do that I'd like to automate the process of freeing up the disk space used in the VTL when a NetBackup tape is expired. Just curious if anyone has already written such a beast and would like to share with me as a starting point. If not, I suspect I'll use the following logic: - Every day (at noon??), query the robots defined in the VTL and keep a record of tapes that are allocated. - When a tape goes from allocated to non-allocated from one day to the next, use a command like the following to erase the tape's contents: bplabel -erase -o -d dlt -m VTL123 This would write a small label at the beginning of the virtual tape, causing the VTL to drop all the other data that had been stored on the tape. Any reason this wouldn't work? Any gotchas with writing this script that I should look out for? Steve +-- |This was sent by [EMAIL PROTECTED] via Backup Central. |Forward SPAM to [EMAIL PROTECTED] +-- ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Script to duplicate NDMP in BPvault configuration
Hello all, Anyone could send me a good script (ksh) to duplicate NDMP after backup completed in the BPVault configuration. Actually I use a simple script with command vltrun in the bpend notify but I have too many errors CODE : 252. Many Thanks Didier ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Script to see skipped files
Does anyone out there have a script to allow NBU to send you the list of skipped files for a status 1 job? Or know of a way to get NOM to report these without having to go through each job one by one to track them down...I'm spending way to much time each day hunting these little buggers down trying to clean them up! Michael Lawler Systems Administrator, I http://www.cooperstandard.com/ + Address: 207 South West Street, Auburn, IN 46706 * E-Mail: [EMAIL PROTECTED] * Phone: 260.927.3477 * Fax: 260.927.1348 image001.jpg___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to see skipped files
In the Windows gui you can run a general problems report and parse that for them. I'm not sure how to parse this information from the command line. Perhaps its in log file somewhere? Probably on the client. Anyhow Reports -- Problems. -Jonathan From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Lawler, Michael C. Sent: Thursday, September 13, 2007 8:11 AM To: veritas-bu@mailman.eng.auburn.edu Subject: [Veritas-bu] Script to see skipped files Does anyone out there have a script to allow NBU to send you the list of skipped files for a status 1 job? Or know of a way to get NOM to report these without having to go through each job one by one to track them down...I'm spending way to much time each day hunting these little buggers down trying to clean them up! Michael Lawler Systems Administrator, I http://www.cooperstandard.com/ + Address: 207 South West Street, Auburn, IN 46706 * E-Mail: [EMAIL PROTECTED] * Phone: 260.927.3477 * Fax: 260.927.1348 image001.jpg___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to see skipped files
I've worked with that a bit, but I'm having the same issue as you, trouble parseing it down into something readable. There are a couple of reporting tools out there that will give it to me, but the cost they are charging is just a bit to much to make it worth it...one would have though that NOM would have included a report of this nature, but I guess that was just to much to ask from a reporting and management tool :P - Michael Lawler From: Martin, Jonathan [mailto:[EMAIL PROTECTED] Sent: Thursday, September 13, 2007 8:27 AM To: Lawler, Michael C.; veritas-bu@mailman.eng.auburn.edu Subject: RE: [Veritas-bu] Script to see skipped files In the Windows gui you can run a general problems report and parse that for them. I'm not sure how to parse this information from the command line. Perhaps its in log file somewhere? Probably on the client. Anyhow Reports -- Problems. -Jonathan From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Lawler, Michael C. Sent: Thursday, September 13, 2007 8:11 AM To: veritas-bu@mailman.eng.auburn.edu Subject: [Veritas-bu] Script to see skipped files Does anyone out there have a script to allow NBU to send you the list of skipped files for a status 1 job? Or know of a way to get NOM to report these without having to go through each job one by one to track them down...I'm spending way to much time each day hunting these little buggers down trying to clean them up! Michael Lawler Systems Administrator, I http://www.cooperstandard.com/ + Address: 207 South West Street, Auburn, IN 46706 * E-Mail: [EMAIL PROTECTED] * Phone: 260.927.3477 * Fax: 260.927.1348 image001.jpg___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to see skipped files
I just ran a quick test. Copy and paste from the report to a txt file. Open it with Excel, delimited type by tab and : (colon.) Sort by column K and delete every row that doesn't start with WRN - Can't open file. I don't know that you are a windows shop, but you could easily parse this information with grep, awk and/or perl. I just don't know how to get this data out of Netbackup without using the GUI for the problems report. -Jonathan From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Lawler, Michael C. Sent: Thursday, September 13, 2007 8:31 AM To: veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to see skipped files I've worked with that a bit, but I'm having the same issue as you, trouble parseing it down into something readable. There are a couple of reporting tools out there that will give it to me, but the cost they are charging is just a bit to much to make it worth it...one would have though that NOM would have included a report of this nature, but I guess that was just to much to ask from a reporting and management tool :P - Michael Lawler From: Martin, Jonathan [mailto:[EMAIL PROTECTED] Sent: Thursday, September 13, 2007 8:27 AM To: Lawler, Michael C.; veritas-bu@mailman.eng.auburn.edu Subject: RE: [Veritas-bu] Script to see skipped files In the Windows gui you can run a general problems report and parse that for them. I'm not sure how to parse this information from the command line. Perhaps its in log file somewhere? Probably on the client. Anyhow Reports -- Problems. -Jonathan From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Lawler, Michael C. Sent: Thursday, September 13, 2007 8:11 AM To: veritas-bu@mailman.eng.auburn.edu Subject: [Veritas-bu] Script to see skipped files Does anyone out there have a script to allow NBU to send you the list of skipped files for a status 1 job? Or know of a way to get NOM to report these without having to go through each job one by one to track them down...I'm spending way to much time each day hunting these little buggers down trying to clean them up! Michael Lawler Systems Administrator, I http://www.cooperstandard.com/ + Address: 207 South West Street, Auburn, IN 46706 * E-Mail: [EMAIL PROTECTED] * Phone: 260.927.3477 * Fax: 260.927.1348 image001.jpg___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to see skipped files
Windows or Unix env ? Dave From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Martin, Jonathan Sent: 13 September 2007 13:56 To: Lawler, Michael C.; veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to see skipped files I just ran a quick test. Copy and paste from the report to a txt file. Open it with Excel, delimited type by tab and : (colon.) Sort by column K and delete every row that doesn't start with WRN - Can't open file. I don't know that you are a windows shop, but you could easily parse this information with grep, awk and/or perl. I just don't know how to get this data out of Netbackup without using the GUI for the problems report. -Jonathan From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Lawler, Michael C. Sent: Thursday, September 13, 2007 8:31 AM To: veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to see skipped files I've worked with that a bit, but I'm having the same issue as you, trouble parseing it down into something readable. There are a couple of reporting tools out there that will give it to me, but the cost they are charging is just a bit to much to make it worth it...one would have though that NOM would have included a report of this nature, but I guess that was just to much to ask from a reporting and management tool :P - Michael Lawler From: Martin, Jonathan [mailto:[EMAIL PROTECTED] Sent: Thursday, September 13, 2007 8:27 AM To: Lawler, Michael C.; veritas-bu@mailman.eng.auburn.edu Subject: RE: [Veritas-bu] Script to see skipped files In the Windows gui you can run a general problems report and parse that for them. I'm not sure how to parse this information from the command line. Perhaps its in log file somewhere? Probably on the client. Anyhow Reports -- Problems. -Jonathan From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Lawler, Michael C. Sent: Thursday, September 13, 2007 8:11 AM To: veritas-bu@mailman.eng.auburn.edu Subject: [Veritas-bu] Script to see skipped files Does anyone out there have a script to allow NBU to send you the list of skipped files for a status 1 job? Or know of a way to get NOM to report these without having to go through each job one by one to track them down...I'm spending way to much time each day hunting these little buggers down trying to clean them up! Michael Lawler Systems Administrator, I http://www.cooperstandard.com/ + Address: 207 South West Street, Auburn, IN 46706 * E-Mail: [EMAIL PROTECTED] * Phone: 260.927.3477 * Fax: 260.927.1348 Notice to recipient: The information in this internet e-mail and any attachments is confidential and may be privileged. It is intended solely for the addressee. If you are not the intended addressee please notify the sender immediately by telephone. If you are not the intended recipient, any disclosure, copying, distribution or any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. When addressed to external clients any opinions or advice contained in this internet e-mail are subject to the terms and conditions expressed in any applicable governing terms of business or client engagement letter issued by the pertinent Bank of America group entity. If this email originates from the U.K. please note that Bank of America, N.A., London Branch and Banc of America Securities Limited are authorised and regulated by the Financial Services Authority. attachment: image001.jpg___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to see skipped files
If unix bperror -backstat -hoursago 24 -U | grep ^ 1 | awk '{print $2'} | sort -u | while read CLIENT; do bperror -problems -hoursago 24 -client $CLIENT -columns 200 -U; done Dave From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Clooney, David Sent: 13 September 2007 14:03 To: Martin, Jonathan; Lawler, Michael C.; veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to see skipped files Windows or Unix env ? Dave From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Martin, Jonathan Sent: 13 September 2007 13:56 To: Lawler, Michael C.; veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to see skipped files I just ran a quick test. Copy and paste from the report to a txt file. Open it with Excel, delimited type by tab and : (colon.) Sort by column K and delete every row that doesn't start with WRN - Can't open file. I don't know that you are a windows shop, but you could easily parse this information with grep, awk and/or perl. I just don't know how to get this data out of Netbackup without using the GUI for the problems report. -Jonathan From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Lawler, Michael C. Sent: Thursday, September 13, 2007 8:31 AM To: veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to see skipped files I've worked with that a bit, but I'm having the same issue as you, trouble parseing it down into something readable. There are a couple of reporting tools out there that will give it to me, but the cost they are charging is just a bit to much to make it worth it...one would have though that NOM would have included a report of this nature, but I guess that was just to much to ask from a reporting and management tool :P - Michael Lawler From: Martin, Jonathan [mailto:[EMAIL PROTECTED] Sent: Thursday, September 13, 2007 8:27 AM To: Lawler, Michael C.; veritas-bu@mailman.eng.auburn.edu Subject: RE: [Veritas-bu] Script to see skipped files In the Windows gui you can run a general problems report and parse that for them. I'm not sure how to parse this information from the command line. Perhaps its in log file somewhere? Probably on the client. Anyhow Reports -- Problems. -Jonathan From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Lawler, Michael C. Sent: Thursday, September 13, 2007 8:11 AM To: veritas-bu@mailman.eng.auburn.edu Subject: [Veritas-bu] Script to see skipped files Does anyone out there have a script to allow NBU to send you the list of skipped files for a status 1 job? Or know of a way to get NOM to report these without having to go through each job one by one to track them down...I'm spending way to much time each day hunting these little buggers down trying to clean them up! Michael Lawler Systems Administrator, I http://www.cooperstandard.com/ + Address: 207 South West Street, Auburn, IN 46706 * E-Mail: [EMAIL PROTECTED] * Phone: 260.927.3477 * Fax: 260.927.1348 Notice to recipient: The information in this internet e-mail and any attachments is confidential and may be privileged. It is intended solely for the addressee. If you are not the intended addressee please notify the sender immediately by telephone. If you are not the intended recipient, any disclosure, copying, distribution or any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. When addressed to external clients any opinions or advice contained in this internet e-mail are subject to the terms and conditions expressed in any applicable governing terms of business or client engagement letter issued by the pertinent Bank of America group entity. If this email originates from the U.K. please note that Bank of America, N.A., London Branch and Banc of America Securities Limited are authorised and regulated by the Financial Services Authority. attachment: image001.jpg___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to see skipped files
It's a Windows environment. - Michael Lawler From: Clooney, David [mailto:[EMAIL PROTECTED] Sent: Thursday, September 13, 2007 9:08 AM To: Clooney, David; Martin, Jonathan; Lawler, Michael C.; veritas-bu@mailman.eng.auburn.edu Subject: RE: [Veritas-bu] Script to see skipped files If unix bperror -backstat -hoursago 24 -U | grep ^ 1 | awk '{print $2'} | sort -u | while read CLIENT; do bperror -problems -hoursago 24 -client $CLIENT -columns 200 -U; done Dave From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Clooney, David Sent: 13 September 2007 14:03 To: Martin, Jonathan; Lawler, Michael C.; veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to see skipped files Windows or Unix env ? Dave From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Martin, Jonathan Sent: 13 September 2007 13:56 To: Lawler, Michael C.; veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to see skipped files I just ran a quick test. Copy and paste from the report to a txt file. Open it with Excel, delimited type by tab and : (colon.) Sort by column K and delete every row that doesn't start with WRN - Can't open file. I don't know that you are a windows shop, but you could easily parse this information with grep, awk and/or perl. I just don't know how to get this data out of Netbackup without using the GUI for the problems report. -Jonathan From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Lawler, Michael C. Sent: Thursday, September 13, 2007 8:31 AM To: veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to see skipped files I've worked with that a bit, but I'm having the same issue as you, trouble parseing it down into something readable. There are a couple of reporting tools out there that will give it to me, but the cost they are charging is just a bit to much to make it worth it...one would have though that NOM would have included a report of this nature, but I guess that was just to much to ask from a reporting and management tool :P - Michael Lawler From: Martin, Jonathan [mailto:[EMAIL PROTECTED] Sent: Thursday, September 13, 2007 8:27 AM To: Lawler, Michael C.; veritas-bu@mailman.eng.auburn.edu Subject: RE: [Veritas-bu] Script to see skipped files In the Windows gui you can run a general problems report and parse that for them. I'm not sure how to parse this information from the command line. Perhaps its in log file somewhere? Probably on the client. Anyhow Reports -- Problems. -Jonathan From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Lawler, Michael C. Sent: Thursday, September 13, 2007 8:11 AM To: veritas-bu@mailman.eng.auburn.edu Subject: [Veritas-bu] Script to see skipped files Does anyone out there have a script to allow NBU to send you the list of skipped files for a status 1 job? Or know of a way to get NOM to report these without having to go through each job one by one to track them down...I'm spending way to much time each day hunting these little buggers down trying to clean them up! Michael Lawler Systems Administrator, I http://www.cooperstandard.com/ + Address: 207 South West Street, Auburn, IN 46706 * E-Mail: [EMAIL PROTECTED] * Phone: 260.927.3477 * Fax: 260.927.1348 Notice to recipient: The information in this internet e-mail and any attachments is confidential and may be privileged. It is intended solely for the addressee. If you are not the intended addressee please notify the sender immediately by telephone. If you are not the intended recipient, any disclosure, copying, distribution or any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. When addressed to external clients any opinions or advice contained in this internet e-mail are subject to the terms and conditions expressed in any applicable governing terms of business or client engagement letter issued by the pertinent Bank of America group entity. If this email originates from the U.K. please note that Bank of America, N.A., London Branch and Banc of America Securities Limited are authorised and regulated by the Financial Services Authority. image001.jpg___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to see skipped files
Aptare has a script for this. = Carl Stehman IT Distributed Services Team Pepco Holdings, Inc. 202-331-6619 Pager 301-765-2703 [EMAIL PROTECTED] Lawler, Michael C. [EMAIL PROTECTED] Sent by: [EMAIL PROTECTED] 09/13/2007 08:36 AM To veritas-bu@mailman.eng.auburn.edu cc Subject Re: [Veritas-bu] Script to see skipped files I?ve worked with that a bit, but I?m having the same issue as you, trouble parseing it down into something readable. There are a couple of reporting tools out there that will give it to me, but the cost they are charging is just a bit to much to make it worth it?one would have though that NOM would have included a report of this nature, but I guess that was just to much to ask from a reporting and management tool :P - Michael Lawler From: Martin, Jonathan [mailto:[EMAIL PROTECTED] Sent: Thursday, September 13, 2007 8:27 AM To: Lawler, Michael C.; veritas-bu@mailman.eng.auburn.edu Subject: RE: [Veritas-bu] Script to see skipped files In the Windows gui you can run a general problems report and parse that for them. I'm not sure how to parse this information from the command line. Perhaps its in log file somewhere? Probably on the client. Anyhow Reports -- Problems. -Jonathan From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Lawler, Michael C. Sent: Thursday, September 13, 2007 8:11 AM To: veritas-bu@mailman.eng.auburn.edu Subject: [Veritas-bu] Script to see skipped files Does anyone out there have a script to allow NBU to send you the list of skipped files for a status 1 job? Or know of a way to get NOM to report these without having to go through each job one by one to track them down?I?m spending way to much time each day hunting these little buggers down trying to clean them up! Michael Lawler Systems Administrator, I + Address: 207 South West Street, Auburn, IN 46706 * E-Mail: [EMAIL PROTECTED] ( Phone: 260.927.3477 7 Fax: 260.927.1348 ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu This Email message and any attachment may contain information that is proprietary, legally privileged, confidential and/or subject to copyright belonging to Pepco Holdings, Inc. or its affiliates (PHI). This Email is intended solely for the use of the person(s) to which it is addressed. If you are not an intended recipient, or the employee or agent responsible for delivery of this Email to the intended recipient(s), you are hereby notified that any dissemination, distribution or copying of this Email is strictly prohibited. If you have received this message in error, please immediately notify the sender and permanently delete this Email and any copies. PHI policies expressly prohibit employees from making defamatory or offensive statements and infringing any copyright or any other legal right by Email communication. PHI will not accept any liability in respect of such communications. inline: image/jpeg___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to see skipped files
Dave wrote the following in response to this thread: If unix bperror -backstat -hoursago 24 -U | grep ^ 1 | awk '{print $2'} | sort -u | while read CLIENT; do bperror -problems -hoursago 24 -client $CLIENT -columns 200 -U; done Dave You could also use the following: bperror -all -problems -backstat -hoursago 24 | awk ' $19 == 1 {print $6, $19, $12, $14, $16}' | awk '{print $3}' | sort -u | xargs -i bperror -problems -hoursago 24 -client {} -columns 200 -U OR For an individual jobid: cat /usr/openv/netbackup/db/jobs/trylogs/jobid.t | grep ^LOG _ From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Lawler, Michael C. Sent: Thursday, September 13, 2007 6:11 AM To: veritas-bu@mailman.eng.auburn.edu Subject: Re: [Veritas-bu] Script to see skipped files ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Script Help - BPIMMEDIA Output
I'm trying to get a script using BPIMMEDIA to output the media id, client name, backup id, schedule type, and backup date. Here's what I have so far: DATE=`date +%m%d%y_%T` NBUPATH=/usr/openv/netbackup/bin/admincmd CUSTVLTPATH=/usr/openv/netbackup/vault/sessions/Vault LASTSID=`cat $CUSTVLTPATH/session.last` CUSTSIDPATH=/usr/openv/netbackup/vault/sessions/Vault/sid$LASTSID OUTFILE=/var/tmp/vltsid$LASTSID_$DATE for MEDIAID in `more +2 $CUSTSIDPATH/eject.list | awk '{print $1}'`; do printf $MEDIAID\n $OUTFILE $NBUPATH/bpimmedia -mediaid $MEDIAID -l | grep IMAGE | awk '{print $2,$4,$5}' $OUTFILE printf \n $OUTFILE done This script gives me output with the mediaid on the line above all the images, but instead, I want it repeated at the beginning of each line of images. I also need to get the backup date in a human readable format and cannot figure out how to separate the ctime from the backupid to run it against bpdbm -ctime to get the real time. I have tried to use read, but it would not work for me. All help for a scripting newbie is appreciated! Offlist replies are welcome. Rusty Major, MCSE, BCFP Sr. Data Assurance Engineer (281) 584-4693 VeriCenter, Inc. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script Help - BPIMMEDIA Output
Here's what I have so far: =20 DATE=3D`date +%m%d%y_%T` Can I ask why that date format? :-) Something that sorts nicely is usually worth it. NBUPATH=3D/usr/openv/netbackup/bin/admincmd CUSTVLTPATH=3D/usr/openv/netbackup/vault/sessions/Vault LASTSID=3D`cat $CUSTVLTPATH/session.last` CUSTSIDPATH=3D/usr/openv/netbackup/vault/sessions/Vault/sid$LASTSID OUTFILE=3D/var/tmp/vltsid$LASTSID_$DATE =20 for MEDIAID in `more +2 $CUSTSIDPATH/eject.list | awk '{print $1}'`; do=20 printf $MEDIAID\n $OUTFILE $NBUPATH/bpimmedia -mediaid $MEDIAID -l | grep IMAGE | awk '{print $2,$4,$5}' $OUTFILE printf \n $OUTFILE done=20 =20 This script gives me output with the mediaid on the line above all the images, but instead, I want it repeated at the beginning of each line of images. You'd need to add it in your awk's 'print' statement. However with the single quotes, that makes it tricky. Maybe something like: ... | awk {print \$MEDIAID\ \$2,\$4,\$5} $OUTFILE I also need to get the backup date in a human readable format and cannot figure out how to separate the ctime from the backupid to run it against bpdbm -ctime to get the real time. I have tried to use read, but it would not work for me. You could use 'tr' to strip all non-numerics. echo $MEDIAID | tr -d -c '0-9' Of course I prefer to do all this in perl in most cases, but that's just me. -- Darren Dunham [EMAIL PROTECTED] Senior Technical Consultant TAOShttp://www.taos.com/ Got some Dr Pepper? San Francisco, CA bay area This line left intentionally blank to confuse you. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script Help - BPIMMEDIA Output
You could use 'tr' to strip all non-numerics. echo $MEDIAID | tr -d -c '0-9' Oops. Not good enough. Numerics may obviously be present in the hostname portion as well. echo $MEDIAID | sed 's/^.*_//' -- Darren Dunham [EMAIL PROTECTED] Senior Technical Consultant TAOShttp://www.taos.com/ Got some Dr Pepper? San Francisco, CA bay area This line left intentionally blank to confuse you. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to stop/start media server on Windows fromUNIX/Linux
Dear Jeff, You can type following commands for daemons restart on Windows media server: On Media server: C:\ bpps C:\ bpdown -v -f C:\ bpup -v -f C:\ bpps Thanks Regards, Gaurav Rakheja, mailto:[EMAIL PROTECTED] _ From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Jeff Lightner Sent: Friday, February 09, 2007 11:02 PM To: veritas-bu@mailman.eng.auburn.edu Subject: [Veritas-bu] Script to stop/start media server on Windows fromUNIX/Linux Does anyone have a script that will run on a UNIX (or Linux) master to do a remote stop of the NBU daemons on a Windows Media Server? Currently I have a script that does this on all my UNIX media servers from the master but of course it won't work on Windows. -- This e-mail message may contain confidential, proprietary or legally privileged information. It should not be used by anyone who is not the original intended recipient. If you have erroneously received this message, please delete it immediately and notify the sender. The recipient acknowledges that ICICI Bank or its subsidiaries and associated companies, (collectively ICICI Group), are unable to exercise control or ensure or guarantee the integrity of/over the contents of the information contained in e-mail transmissions and further acknowledges that any views expressed in this message are those of the individual sender and no binding nature of the message shall be implied or assumed unless the sender does so expressly with due authority of ICICI Group.Before opening any attachments please check them for viruses and defects. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to stop/start media server on Windows fromUNIX/Linux
Thanks. Nice to know the DOS commands.However, my question was how can I have the UNIX master server tell the Windows media server to stop its daemons (and later to restart them). I was hoping someone had scripted a solution already. Alternatively - does anyone know how I could make UNIX kick off a bat file on the Windows side so that I could issue the commands below and get status back? From: GAURAV RAKHEJA /RTGSADM/INFOTECH/BKC [mailto:[EMAIL PROTECTED] Sent: Monday, February 12, 2007 8:17 AM To: Jeff Lightner Cc: veritas-bu@mailman.eng.auburn.edu Subject: RE: [Veritas-bu] Script to stop/start media server on Windows fromUNIX/Linux Dear Jeff, You can type following commands for daemons restart on Windows media server: On Media server: C:\ bpps C:\ bpdown -v -f C:\ bpup -v -f C:\ bpps Thanks Regards, Gaurav Rakheja, mailto:[EMAIL PROTECTED] From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Jeff Lightner Sent: Friday, February 09, 2007 11:02 PM To: veritas-bu@mailman.eng.auburn.edu Subject: [Veritas-bu] Script to stop/start media server on Windows fromUNIX/Linux Does anyone have a script that will run on a UNIX (or Linux) master to do a remote stop of the NBU daemons on a Windows Media Server? Currently I have a script that does this on all my UNIX media servers from the master but of course it won't work on Windows. This e-mail message may contain confidential, proprietary or legally privileged information. It should not be used by anyone who is not the original intended recipient. If you have erroneously received this message, please delete it immediately and notify the sender. The recipient acknowledges that ICICI Bank or its subsidiaries and associated companies, (collectively ICICI Group), are unable to exercise control or ensure or guarantee the integrity of/over the contents of the information contained in e-mail transmissions and further acknowledges that any views expressed in this message are those of the individual sender and no binding nature of the message shall be implied or assumed unless the sender does so expressly with due authority of ICICI Group.Before opening any attachments please check them for viruses and defects. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Script to stop/start media server on Windows from UNIX/Linux
Does anyone have a script that will run on a UNIX (or Linux) master to do a remote stop of the NBU daemons on a Windows Media Server? Currently I have a script that does this on all my UNIX media servers from the master but of course it won't work on Windows. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Script for Daily Backup Totals
I have NBU 5.1 MP5 on Windows. I was curious if anyone had a script for getting a daily backup total. I am using bpcatlist but it comes back with a value like 2G, 400M, 760k. Is there a command that will return a value just in kilobytes? Thanks Mike _ From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Hindle, Greg Sent: Thursday, January 18, 2007 9:17 AM To: NB List Mail Subject: [Veritas-bu] moving assigned media Solaris 9 nb 5.0 mp6 Is there any easy way to move assigned media from one volume pool to another? We have recreated our volume pools to meet new internal standards but I have a bunch of tapes that cannot be moved because they are assigned. The last time I talked to Symantec they said it was messy trying to move tapes from one pool to another. Does anyone have a easy way to do this? Greg This e-mail and any attachments are confidential, may contain legal, professional or other privileged information, and are intended solely for the addressee. If you are not the intended recipient, do not use the information in this e-mail in any way, delete this e-mail and notify the sender. CEG-IP2 ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script for Daily Backup Totals
TOTAL=`/usr/openv/netbackup/bin/admincmd/bpimagelist -U -hoursago 24 | awk '{t+=$5}END{print t/100}'` Prints it out the total data backe up in GB. Steve _ From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Conner, Mike Sent: Thursday, January 18, 2007 11:06 AM To: NB List Mail Subject: [Veritas-bu] Script for Daily Backup Totals I have NBU 5.1 MP5 on Windows. I was curious if anyone had a script for getting a daily backup total. I am using bpcatlist but it comes back with a value like 2G, 400M, 760k. Is there a command that will return a value just in kilobytes? Thanks Mike _ From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Hindle, Greg Sent: Thursday, January 18, 2007 9:17 AM To: NB List Mail Subject: [Veritas-bu] moving assigned media Solaris 9 nb 5.0 mp6 Is there any easy way to move assigned media from one volume pool to another? We have recreated our volume pools to meet new internal standards but I have a bunch of tapes that cannot be moved because they are assigned. The last time I talked to Symantec they said it was messy trying to move tapes from one pool to another. Does anyone have a easy way to do this? Greg This e-mail and any attachments are confidential, may contain legal, professional or other privileged information, and are intended solely for the addressee. If you are not the intended recipient, do not use the information in this e-mail in any way, delete this e-mail and notify the sender. CEG-IP2 ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script for Daily Backup Totals
Does that work on Windows? Patrick Whelan NetBackup Specialist Architect Engineering +44 20 7863 5243 Of all the things I've lost, I miss my mind the most! - Unknown There are only 10 kinds of people on earth - those who understand binary and those who don't. ... Als sie mich holten, gab es keinen mehr, der protestieren konnte -- Martin Niemöller -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Steve Fogarty Sent: 18 January 2007 15:48 To: 'Conner, Mike'; 'NB List Mail' Subject: Re: [Veritas-bu] Script for Daily Backup Totals TOTAL=`/usr/openv/netbackup/bin/admincmd/bpimagelist -U -hoursago 24 | awk '{t+=$5}END{print t/100}'` Prints it out the total data backe up in GB. Steve From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Conner, Mike Sent: Thursday, January 18, 2007 11:06 AM To: NB List Mail Subject: [Veritas-bu] Script for Daily Backup Totals I have NBU 5.1 MP5 on Windows. I was curious if anyone had a script for getting a daily backup total. I am using bpcatlist but it comes back with a value like 2G, 400M, 760k. Is there a command that will return a value just in kilobytes? Thanks Mike From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Hindle, Greg Sent: Thursday, January 18, 2007 9:17 AM To: NB List Mail Subject: [Veritas-bu] moving assigned media Solaris 9 nb 5.0 mp6 Is there any easy way to move assigned media from one volume pool to another? We have recreated our volume pools to meet new internal standards but I have a bunch of tapes that cannot be moved because they are assigned. The last time I talked to Symantec they said it was messy trying to move tapes from one pool to another. Does anyone have a easy way to do this? Greg This e-mail and any attachments are confidential, may contain legal, professional or other privileged information, and are intended solely for the addressee. If you are not the intended recipient, do not use the information in this e-mail in any way, delete this e-mail and notify the sender. CEG-IP2 * The message is intended for the named addressee only and may not be disclosed to or used by anyone else, nor may it be copied in any way. The contents of this message and its attachments are confidential and may also be subject to legal privilege. If you are not the named addressee and/or have received this message in error, please advise us by e-mailing [EMAIL PROTECTED] and delete the message and any attachments without retaining any copies. Internet communications are not secure and COLT does not accept responsibility for this message, its contents nor responsibility for any viruses. No contracts can be created or varied on behalf of COLT Telecommunications, its subsidiaries or affiliates (COLT) and any other party by email Communications unless expressly agreed in writing with such other party. Please note that incoming emails will be automatically scanned to eliminate potential viruses and unsolicited promotional emails. For more information refer to www.colt.net or contact us on +44(0)20 7390 3900. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script for Daily Backup Totals
Ahh Windows... The bpimagelist.exe exists (in C:\Program Files\VERITAS\NetBackup\bin), so you can ge the totals, but you will have to find another way to awk the total column and add them up. Alternatively you could install CYGWIN, and use the command as if you were on UNIX. ;-) Steve _ From: Whelan, Patrick [mailto:[EMAIL PROTECTED] Sent: Thursday, January 18, 2007 12:00 PM To: Steve Fogarty; Conner, Mike; NB List Mail Subject: RE: [Veritas-bu] Script for Daily Backup Totals Does that work on Windows? Patrick Whelan NetBackup Specialist Architect Engineering +44 20 7863 5243 Of all the things I've lost, I miss my mind the most! - Unknown There are only 10 kinds of people on earth - those who understand binary and those who don't. ... Als sie mich holten, gab es keinen mehr, der protestieren konnte -- Martin Niemöller -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Steve Fogarty Sent: 18 January 2007 15:48 To: 'Conner, Mike'; 'NB List Mail' Subject: Re: [Veritas-bu] Script for Daily Backup Totals TOTAL=`/usr/openv/netbackup/bin/admincmd/bpimagelist -U -hoursago 24 | awk '{t+=$5}END{print t/100}'` Prints it out the total data backe up in GB. Steve _ From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Conner, Mike Sent: Thursday, January 18, 2007 11:06 AM To: NB List Mail Subject: [Veritas-bu] Script for Daily Backup Totals I have NBU 5.1 MP5 on Windows. I was curious if anyone had a script for getting a daily backup total. I am using bpcatlist but it comes back with a value like 2G, 400M, 760k. Is there a command that will return a value just in kilobytes? Thanks Mike _ From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Hindle, Greg Sent: Thursday, January 18, 2007 9:17 AM To: NB List Mail Subject: [Veritas-bu] moving assigned media Solaris 9 nb 5.0 mp6 Is there any easy way to move assigned media from one volume pool to another? We have recreated our volume pools to meet new internal standards but I have a bunch of tapes that cannot be moved because they are assigned. The last time I talked to Symantec they said it was messy trying to move tapes from one pool to another. Does anyone have a easy way to do this? Greg This e-mail and any attachments are confidential, may contain legal, professional or other privileged information, and are intended solely for the addressee. If you are not the intended recipient, do not use the information in this e-mail in any way, delete this e-mail and notify the sender. CEG-IP2 * The message is intended for the named addressee only and may not be disclosed to or used by anyone else, nor may it be copied in any way. The contents of this message and its attachments are confidential and may also be subject to legal privilege. If you are not the named addressee and/or have received this message in error, please advise us by e-mailing [EMAIL PROTECTED] and delete the message and any attachments without retaining any copies. Internet communications are not secure and COLT does not accept responsibility for this message, its contents nor responsibility for any viruses. No contracts can be created or varied on behalf of COLT Telecommunications, its subsidiaries or affiliates (COLT) and any other party by email Communications unless expressly agreed in writing with such other party. Please note that incoming emails will be automatically scanned to eliminate potential viruses and unsolicited promotional emails. For more information refer to www.colt.net or contact us on +44(0)20 7390 3900. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script for Daily Backup Totals
Sssshhh... you'll anger the *nix Nazis. Try gawk - http://gnuwin32.sourceforge.net/packages/gawk.htm -Jonathan From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Whelan, Patrick Sent: Thursday, January 18, 2007 11:00 AM To: Steve Fogarty; Conner, Mike; NB List Mail Subject: Re: [Veritas-bu] Script for Daily Backup Totals Does that work on Windows? Patrick Whelan NetBackup Specialist Architect Engineering +44 20 7863 5243 Of all the things I've lost, I miss my mind the most! - Unknown There are only 10 kinds of people on earth - those who understand binary and those who don't. ... Als sie mich holten, gab es keinen mehr, der protestieren konnte -- Martin Niemöller -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Steve Fogarty Sent: 18 January 2007 15:48 To: 'Conner, Mike'; 'NB List Mail' Subject: Re: [Veritas-bu] Script for Daily Backup Totals TOTAL=`/usr/openv/netbackup/bin/admincmd/bpimagelist -U -hoursago 24 | awk '{t+=$5}END{print t/100}'` Prints it out the total data backe up in GB. Steve From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Conner, Mike Sent: Thursday, January 18, 2007 11:06 AM To: NB List Mail Subject: [Veritas-bu] Script for Daily Backup Totals I have NBU 5.1 MP5 on Windows. I was curious if anyone had a script for getting a daily backup total. I am using bpcatlist but it comes back with a value like 2G, 400M, 760k. Is there a command that will return a value just in kilobytes? Thanks Mike From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Hindle, Greg Sent: Thursday, January 18, 2007 9:17 AM To: NB List Mail Subject: [Veritas-bu] moving assigned media Solaris 9 nb 5.0 mp6 Is there any easy way to move assigned media from one volume pool to another? We have recreated our volume pools to meet new internal standards but I have a bunch of tapes that cannot be moved because they are assigned. The last time I talked to Symantec they said it was messy trying to move tapes from one pool to another. Does anyone have a easy way to do this? Greg This e-mail and any attachments are confidential, may contain legal, professional or other privileged information, and are intended solely for the addressee. If you are not the intended recipient, do not use the information in this e-mail in any way, delete this e-mail and notify the sender. CEG-IP2 * The message is intended for the named addressee only and may not be disclosed to or used by anyone else, nor may it be copied in any way. The contents of this message and its attachments are confidential and may also be subject to legal privilege. If you are not the named addressee and/or have received this message in error, please advise us by e-mailing [EMAIL PROTECTED] and delete the message and any attachments without retaining any copies. Internet communications are not secure and COLT does not accept responsibility for this message, its contents nor responsibility for any viruses. No contracts can be created or varied on behalf of COLT Telecommunications, its subsidiaries or affiliates (COLT) and any other party by email Communications unless expressly agreed in writing with such other party. Please note that incoming emails will be automatically scanned to eliminate potential viruses and unsolicited promotional emails. For more information refer to www.colt.net or contact us on +44(0)20 7390 3900. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Script to query Logging level on all clients
Title: Script to query Logging level on all clients Is there any CLI or script used to poll all the clients for their logging level? For sql client too :) Thanks, Hadrian ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] script writing for netbackup
need to learn writing scripting using perl in netbackup, guide me pls. That's a rather broad category. What area are you concerned about? Do you know perl and netbackup already? I don't think this forum is appropriate for teaching perl (or any language's) basics. What do you want to accomplish? NBU has many command line interfaces that are appropriate for automation tools. 'vmquery', 'bpmedialist', 'bpimagelist', 'bppllist' are all especially useful for gathering information. And 'vmchange', 'bpexpdate', 'bpduplicate', 'vmphyinv' and others are useful for making updates and modifications to the configuration. The man pages are the best start for those tools, but some of the output formats are not documented. You can usually find them with some good google searching. -- Darren Dunham [EMAIL PROTECTED] Senior Technical Consultant TAOShttp://www.taos.com/ Got some Dr Pepper? San Francisco, CA bay area This line left intentionally blank to confuse you. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] script writing for netbackup
Hi all, need to learn writing scripting using perl in netbackup, guide me pls. thank u all, __ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to check if bpsched is running
are you on Unix or Windows ? Quoting Cynthia Christensen [EMAIL PROTECTED]: Does anyone have a script to verify that bpsched is running and have it send you an email if it isn't (or another suggestion as to how to detect bpsched not running)? Last night bpsched died so no scheduled jobs kicked off. I'm on NetBackup 5.1 MP3. Thanks, Cindy -- Sebastian Schönwetter Open2 BVBA Steenweg op Brussel 149 1780 Wemmel Belgium Tel : 0485 / 844 368 Fax : 02 / 460 39 86 BTW. nr : 866.285.026 Ond. nr : 0866285026 ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to check if bpsched is running
On 9/29/2006 1:27 PM, Cynthia Christensen wrote: Does anyone have a script to verify that bpsched is running and have it send you an email if it isn't (or another suggestion as to how to detect bpsched not running)? Last night bpsched died so no scheduled jobs kicked off. I'm on NetBackup 5.1 MP3. There are dozens of mechanisms to see if a process or a service is running. Depending on the platform, you could use NetIQ, BigBrother, Nagios, or one of many other possible packages. .../Ed -- Ed Wilts, Mounds View, MN, USA mailto:[EMAIL PROTECTED] ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Script to check if bpsched is running
Does anyone have a script to verify that bpsched is running and have it send you an email if it isn't (or another suggestion as to how to detect bpsched not running)? Last night bpsched died so no scheduled jobs kicked off. I'm on NetBackup 5.1 MP3. Thanks, Cindy ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to check if bpsched is running
bpps -a |grep -i bpsched Cynthia Christensen wrote: Does anyone have a script to verify that bpsched is running and have it send you an email if it isn't (or another suggestion as to how to detect bpsched not running)? Last night bpsched died so no scheduled jobs kicked off. I'm on NetBackup 5.1 MP3. Thanks, Cindy ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu -- === Steven L. Sesar Lead Operating Systems Programmer/Analyst UNIX Application Services R101 The MITRE Corporation 202 Burlington Road - MS K101 Bedford, MA 01730 tel: (781) 271-7702 fax: (781) 271-2600 mobile: (617) 519-8933 email: [EMAIL PROTECTED] === ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Script to collect hourly data...
Well I wrote a script to check the amount of backups that look back one hr and list the amount on a per media server basis: Please check it out: #** Cut Here **# #!/bin/ksh # Script to collect Data ## Variables HRS=$1 ADMINCMD=/usr/openv/netbackup/bin/admincmd MYHOME=/home/jdespres/bin BPCONF=/usr/openv/netbackup/bp.conf MedisS=/home/jdespres/HourlyData/MediaS.txt TMP1=/home/jdespres/HourlyData/orignalbpconf.txt DATELOG=`date +%m%d%Y%H%M%S` LOGFILE=/home/jdespres/HourlyData/VolumeAmount.rpt Who_Cares=[EMAIL PROTECTED] Get a list of all the media servers and sort it as well! grep ^SERVER $BPCONF|sed '1,1'd|awk '{print $3}' $TMP1 cat $TMP1 | sort $MedisS Function to collect data collect_data() { date for i in `cat $MedisS` do echo $i \c $ADMINCMD/bpimagelist -l -hoursago $HRS|egrep ^FRAG|grep -v \-1| grep $i|awk '{ tot+=$4 } END {printf %9.5f\n, (tot/1024)/1024}' done } collect_data $LOGFILE.$DATELOG /usr/bin/mailx -s `hostname` Hourly Volume info `date '+%m/%d/%y %H:%M'` $Who_Cares $LOGFILE.$DATELOG #** Cut Here **# Does this make sense. it seems to give up the correct info: Joe Despres... This is a PRIVATE message. If you are not the intended recipient, please delete without copying and kindly advise us by e-mail of the mistake in delivery. NOTE: Regardless of content, this e-mail shall not operate to bind CSC to any order or other contract unless pursuant to explicit written agreement or government initiative expressly permitting the use of e-mail for such purpose. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script(s) needed for amount backed up and howfa st.........
Title: Message Joe to be honest, I am not sure (unless a 3rd part built in app is used), maybe the reports can provide some additional details. Also, speedwise - again not sure what benefit you will get if you see the average speed, as it could well depend on the type of files / folders it was backing up at the time. What I have tended to do (where possible), is roughly work out what kb/sec I get and based it on an hours usage. But when it hits smaller files, sometimes the speed drops alot (which I expect). Regards Simon Weaver3rd Line Technical SupportWindows Domain Administrator EADS Astrium Limited, B23AA IM (DCS)Anchorage Road, Portsmouth, PO3 5PU Email: [EMAIL PROTECTED] -Original Message-From: Joseph Despres [mailto:[EMAIL PROTECTED] Sent: 26 July 2006 18:54To: veritas-bu@mailman.eng.auburn.eduSubject: [Veritas-bu] Script(s) needed for amount backed up and howfast.There are two bits of info I need to generate: 1. Amount backed up per client within a 24 hrs window.. 2. Average speed of a media server on a per hourly basis Does anyone have a short simple script that would help with these two? Thanks. Joe Despres...This is a PRIVATE message. If you are not the intended recipient, please delete without copying and kindly advise us by e-mail of the mistake in delivery. NOTE: Regardless of content, this e-mail shall not operate to bind CSC to any order or other contract unless pursuant to explicit written agreement or government initiative expressly permitting the use of e-mail for such purpose. This email is for the intended addressee only. If you have received it in error then you must not use, retain, disseminate or otherwise deal with it. Please notify the sender by return email. The views of the author may not necessarily constitute the views of Astrium Limited. Nothing in this email shall bind Astrium Limited in any contract or obligation. Astrium Limited, Registered in England and Wales No. 2449259 Registered Office: Gunnels Wood Road, Stevenage, Hertfordshire, SG1 2AS, England ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Script(s) needed for amount backed up and how fast.........
There are two bits of info I need to generate: 1. Amount backed up per client within a 24 hrs window.. 2. Average speed of a media server on a per hourly basis Does anyone have a short simple script that would help with these two? Thanks. Joe Despres... This is a PRIVATE message. If you are not the intended recipient, please delete without copying and kindly advise us by e-mail of the mistake in delivery. NOTE: Regardless of content, this e-mail shall not operate to bind CSC to any order or other contract unless pursuant to explicit written agreement or government initiative expressly permitting the use of e-mail for such purpose. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Script to audit backups based upon STREAMS files
Greetings, Attached is a tarball containing a perl script I wrote to look for backups that were overdue. It focuses mainly on full backups and knows only about frequency based scheduling, so it is not completely generalized, but it should be of help if someone needs to check up on the scheduler. It has an option (-o) to set a floor-threshold on the number of days overdue, and another (-f) that says to report only on full backups. It compares the contents of all the STREAMS files against policy data looking only at active streams, and then uses birth-time, retention, and frequency information to determine if a stream should be reported on. Usage: bppllist -allpolicies -l | ./audit-coverage.pl [-df] [-o overDueDays] -d -- debug -f -- report only on FULL backups -o days -- report only on backups overdue by more than 'days' Output is of the form: client path policy schedule (type) due on DATE (x days overdue) client path policy schedule (type) INITIAL due I wrote this due to the number of scheduling problems observed with NBU 6 when I needed a means of seeing where my biggest problem areas were. Please let me know if you either find this of use, or if you have fixes for it (like adding calendar based scheduling support). It should work with NetBackup [56] on *IX master servers with perl 5 or better, and probably a Windows master if you have perl and change the path to netbackup/db/images in the call to File::Find::find(). --Larry -- Larry Fahnoe, Fahnoe Technology Consulting, [EMAIL PROTECTED] 952/925-0744 Minneapolis, Minnesota www.FahnoeTech.com audit-coverage.tar Description: Unix tar archive ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Script to audit backups based upon STREAMS files
I have received feedback about my interpretation of the data in the STREAMS files from some informed sources. As it currently stands, my audit-coverage.pl script DOES NOT do a thorough job of handling the case where there is a 0 birth-time for a stream, thus any messages of the form: client path policy schedule (type) INITIAL due are probably erroneous and should be ignored. As I have some time I'll take another crack at this and send an update when I have better data. Please keep in mind that because this script relies upon my interpretation of undocumented and unsupported data structures, it is neither supported nor supportable by Symantec. --Larry On Tue, Jul 18, 2006 at 10:48:41AM -0500, Larry Fahnoe wrote: Greetings, Attached is a tarball containing a perl script I wrote to look for backups that were overdue. It focuses mainly on full backups and knows only about frequency based scheduling, so it is not completely generalized, but it should be of help if someone needs to check up on the scheduler. It has an option (-o) to set a floor-threshold on the number of days overdue, and another (-f) that says to report only on full backups. It compares the contents of all the STREAMS files against policy data looking only at active streams, and then uses birth-time, retention, and frequency information to determine if a stream should be reported on. Usage: bppllist -allpolicies -l | ./audit-coverage.pl [-df] [-o overDueDays] -d -- debug -f -- report only on FULL backups -o days -- report only on backups overdue by more than 'days' Output is of the form: client path policy schedule (type) due on DATE (x days overdue) client path policy schedule (type) INITIAL due I wrote this due to the number of scheduling problems observed with NBU 6 when I needed a means of seeing where my biggest problem areas were. Please let me know if you either find this of use, or if you have fixes for it (like adding calendar based scheduling support). It should work with NetBackup [56] on *IX master servers with perl 5 or better, and probably a Windows master if you have perl and change the path to netbackup/db/images in the call to File::Find::find(). ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu -- Larry Fahnoe, Fahnoe Technology Consulting, [EMAIL PROTECTED] 952/925-0744 Minneapolis, Minnesota www.FahnoeTech.com ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
RE: [Veritas-bu] Script to list servers
ok thanks will give it a try... Greg From: Steven L. Sesar [mailto:[EMAIL PROTECTED] Sent: Tuesday, April 11, 2006 10:29 AMTo: Hindle, GregCc: veritas-bu@mailman.eng.auburn.eduSubject: Re: [Veritas-bu] Script to list servers Try this:#!/opt/openv/perl/bin/perlmy $COMMAND = "/opt/openv/netbackup/bin/admincmd/bpclclients -allunique -l";my @data;my %OS;my $TOTAL = 0;open CMD, "$COMMAND|" or die "Can't run $COMMAND: $?\n";while (CMD){ chomp; @data = "" " "; if ( $OS{$data[3]} ){ $OS{$data[3]}++; } else { $OS{$data[3]} = 1; }}foreach my $client ( keys %OS ){ printf "%15s%6d\n", $client, $OS{$client}; $TOTAL += $OS{$client};}printf "\n%15s%6d\n", "Total", $TOTAL;exit 0;Hindle, Greg wrote: Does anyone have a script to list the servers you backup and if there are windows or UNIX based? I need to make a list for management and thought somebody had to have a simple script that collects this info. Thanks! Greg This e-mail and any attachments are confidential, may contain legal, professional or other privileged information, and are intended solely for the addressee. If you are not the intended recipient, do not use the information in this e-mail in any way, delete this e-mail and notify the sender. CEG-IP2 -- === Steven L. Sesar Senior Operating Systems Programmer/Analyst UNIX Application Services R101 The MITRE Corporation 202 Burlington Road - KS101 Bedford, MA 01730 tel: (781) 271-7702 fax: (781) 271-2600 mobile: (617) 893-9635 email: [EMAIL PROTECTED] ===
AW: [Veritas-bu] Script to list servers
Title: Nachricht What about bpplclients?! Heiko --Vodafone Information Systems GmbHStorage Management (VIS-THDS)Dipl.-Ing. Heiko HansenRehhecke 50D-40885 RatingenPost:Postfach 104264D-40853 RatingenTel. +49 2102 97-1030Fax +49 2102 97-70-1030mailto:[EMAIL PROTECTED]http://www.vodafone-is.de -Ursprüngliche Nachricht-Von: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Im Auftrag von Hindle, GregGesendet: Dienstag, 11. April 2006 16:24An: veritas-bu@mailman.eng.auburn.eduBetreff: [Veritas-bu] Script to list servers Does anyone have a script to list the servers you backup and if there are windows or UNIX based? I need to make a list for management and thought somebody had to have a simple script that collects this info. Thanks! Greg This e-mail and any attachments are confidential, may contain legal, professional or other privileged information, and are intended solely for the addressee. If you are not the intended recipient, do not use the information in this e-mail in any way, delete this e-mail and notify the sender. CEG-IP2
Re: [Veritas-bu] Script to list servers
Try this: #!/opt/openv/perl/bin/perl my $COMMAND = "/opt/openv/netbackup/bin/admincmd/bpclclients -allunique -l"; my @data; my %OS; my $TOTAL = 0; open CMD, "$COMMAND|" or die "Can't run $COMMAND: $?\n"; while (CMD){ chomp; @data = "" " "; if ( $OS{$data[3]} ){ $OS{$data[3]}++; } else { $OS{$data[3]} = 1; } } foreach my $client ( keys %OS ){ printf "%15s%6d\n", $client, $OS{$client}; $TOTAL += $OS{$client}; } printf "\n%15s%6d\n", "Total", $TOTAL; exit 0; Hindle, Greg wrote: Script to list servers Does anyone have a script to list the servers you backup and if there are windows or UNIX based? I need to make a list for management and thought somebody had to have a simple script that collects this info. Thanks! Greg This e-mail and any attachments are confidential, may contain legal, professional or other privileged information, and are intended solely for the addressee. If you are not the intended recipient, do not use the information in this e-mail in any way, delete this e-mail and notify the sender. CEG-IP2 -- === Steven L. Sesar Senior Operating Systems Programmer/Analyst UNIX Application Services R101 The MITRE Corporation 202 Burlington Road - KS101 Bedford, MA 01730 tel: (781) 271-7702 fax: (781) 271-2600 mobile: (617) 893-9635 email: [EMAIL PROTECTED] ===
[Veritas-bu] Script or command to check for tapes that should be offsite
Does someone have a script or an easy way to check for tapes that should be offsite. I.e, a 3 year backup that was ran, sent offsite, requested back for a restore, and then we forgot to send it back offsite so its stuck in the library? -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Deiter Scott Sent: Thursday, November 03, 2005 11:07 AM To: veritas-bu@mailman.eng.auburn.edu Subject: RE: [Veritas-bu] Pending request for Tape Here is the script we use. Of course there are three running. One for each site where the operators are located near the media servers. We have cron run this every 20 minutes. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Vikash Gupta Sent: Thursday, November 03, 2005 9:13 AM To: veritas-bu@mailman.eng.auburn.edu Subject: [Veritas-bu] Pending request for Tape Hi, I need some sort of notification email from NetBackup server side when there is a pending request for Tape. This is required because while doing the restore NetBackup gives huge list of tapes and I know it's bogus list. This email will help usthe NetBackup admins to quickly looks for the tapes and deposit them. How can I do the above activity ? Thanks Regards Vikash Gupta