Re: [Veritas-bu] Media Server offline for disk (now DSSU stuff)
> The high watermark serves two purposes - (1) It prevents > any new backup jobs from being sent to the STU, and (2) > It triggers image expirations on the STU. The function > #1 is not applicable to Disk Staging STU; however, the > functionality #2 should work for it. So, if you lower > HWM for the Disk Staging STU, it would trigger image > expirations earlier so that when the backup jobs are > sent to the> STU, NetBackup does not have to expire > images then (potentially saving time for the backup). > > Hope this helps. I agree, the documentation is little > unclear on this. That's an understatement! 6.5 DSSU behavior is re-described in technote 316679. HWM, LWM and DS[S]U behavior have never, to my knowledge, been correctly described in one place, and the incorrect descriptions have been most unhelpful. Let's hope this technote is a step in the right direction. As long as this has morphed to DSSUs, I had to look up how to display actual available space on my 6.5 Basic Disk DSSU setup now that the .ds files are gone. In case it helps anyone else, it's something like ~/admincmd/nbdevquery -listdv -stype BasicDisk -dp DSSU-a -D See the 6.5 NetBackup Administrator's Guide, Volume 1, p 242 or so. ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Media Server offline for disk
The high watermark serves two purposes - (1) It prevents any new backup jobs from being sent to the STU, and (2) It triggers image expirations on the STU. The function #1 is not applicable to Disk Staging STU; however, the functionality #2 should work for it. So, if you lower HWM for the Disk Staging STU, it would trigger image expirations earlier so that when the backup jobs are sent to the STU, NetBackup does not have to expire images then (potentially saving time for the backup). Hope this helps. I agree, the documentation is little unclear on this. /Girish - Original Message From: WALLEBROEK Bart To: Girish Jorapurkar ; "veritas-bu@mailman.eng.auburn.edu" Sent: Thursday, July 16, 2009 8:16:44 AM Subject: RE: [Veritas-bu] Media Server offline for disk Extract from the NetBackup help file: The high water mark does not apply to storage units that are used for basic disk staging. For more information about this type of disk staging, see Basic disk staging limitations. Best Regards, Bart WALLEBROEK Backup admin Enterprise Applications Delivery - Infrastructure Management S.W.I.F.T. SCRL >-Original Message- >From: Girish Jorapurkar [mailto:giris...@yahoo.com] >Sent: Thursday, July 16, 2009 3:07 PM >To: WALLEBROEK Bart; Martin, Jonathan; veritas-bu@mailman.eng.auburn.edu >Subject: Re: [Veritas-bu] Media Server offline for disk > > >There you go - setting a lower value to RE_READ_INTERVAL, I belive, is the >problem. NetBackup will mark a media >server "offline for disk" if does not receive heartbeat in 30 seconds, in your >case. And, that applies to all media >servers - which can be hard to meet in a very busy system/time. So, I suggest >that you revert RE_READ_INTERVAL to >default (5 mins = 300 seconds) > >To address your original concern, you should be able to change/configure >high-water mark (upper threshold) for a >BasicDisk STU using GUI/CLI. > >/Girish > > ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Media Server offline for disk
Extract from the NetBackup help file: The high water mark does not apply to storage units that are used for basic disk staging. For more information about this type of disk staging, see Basic disk staging limitations. Best Regards, Bart WALLEBROEK Backup admin Enterprise Applications Delivery - Infrastructure Management S.W.I.F.T. SCRL >-Original Message- >From: Girish Jorapurkar [mailto:giris...@yahoo.com] >Sent: Thursday, July 16, 2009 3:07 PM >To: WALLEBROEK Bart; Martin, Jonathan; veritas-bu@mailman.eng.auburn.edu >Subject: Re: [Veritas-bu] Media Server offline for disk > > >There you go - setting a lower value to RE_READ_INTERVAL, I belive, is the >problem. NetBackup will mark a media >server "offline for disk" if does not receive heartbeat in 30 seconds, in your >case. And, that applies to all media >servers - which can be hard to meet in a very busy system/time. So, I suggest >that you revert RE_READ_INTERVAL to >default (5 mins = 300 seconds) > >To address your original concern, you should be able to change/configure >high-water mark (upper threshold) for a >BasicDisk STU using GUI/CLI. > >/Girish > > ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Media Server offline for disk
There you go - setting a lower value to RE_READ_INTERVAL, I belive, is the problem. NetBackup will mark a media server "offline for disk" if does not receive heartbeat in 30 seconds, in your case. And, that applies to all media servers - which can be hard to meet in a very busy system/time. So, I suggest that you revert RE_READ_INTERVAL to default (5 mins = 300 seconds) To address your original concern, you should be able to change/configure high-water mark (upper threshold) for a BasicDisk STU using GUI/CLI. /Girish - Original Message From: WALLEBROEK Bart To: Girish Jorapurkar ; "Martin, Jonathan" ; "veritas-bu@mailman.eng.auburn.edu" Sent: Thursday, July 16, 2009 1:49:54 AM Subject: RE: [Veritas-bu] Media Server offline for disk Girish, I already changed this parameter. I did not put in a higher value but a lower value (30 seconds) as I believed it was because of the fact that the Media Server did not cleaned up the staging disk fast enough so that the disk becomes full and the Media Server for Disk was set offline. The upper threshold is apparently hardcoded to 98% for Basic Disk (which is, in my mind, ridiculous) so it has very little time to start cleaning up when backups are coming in at a rate of almost 100 MB/sec). But this did not solve the issue. We are suspecting something else right now. Best Regards, Bart WALLEBROEK Backup admin Enterprise Applications Delivery - Infrastructure Management S.W.I.F.T. SCRL >-Original Message- >From: Girish Jorapurkar [mailto:giris...@yahoo.com] >Sent: Wednesday, July 15, 2009 4:11 PM >To: WALLEBROEK Bart; Martin, Jonathan; veritas-bu@mailman.eng.auburn.edu >Subject: Re: [Veritas-bu] Media Server offline for disk > > >In 6.5/6.5.x, a service (nbrmms) running on all master/media servers sends a >heartbeat/capacity-update regarding >disk storage units on the server. If the master server service (nbemm), for >some reason, does not receive the >heartbeat/update in the required time interval, then NetBackup marks the >server "offline for disk". There may be >some valid reasons (load on master/media server) that the heartbeat/update has >not been delievered in time. It is >possible to configure the heartbeat/update interval - which applies to ALL >media servers. > >GUI: Host Properties -> Master server -> General Server properties -> Check >capacity of disk storage units (interval >in seconds) >bp.conf: RE_READ_INTERVAL = > >Remember that setting this value too high might lead to NetBackup trying to >run (and failing) backups on media >servers that are really really "offline". > >Hope this helps, >/Girish > ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Media Server offline for disk
Girish, I already changed this parameter. I did not put in a higher value but a lower value (30 seconds) as I believed it was because of the fact that the Media Server did not cleaned up the staging disk fast enough so that the disk becomes full and the Media Server for Disk was set offline. The upper threshold is apparently hardcoded to 98% for Basic Disk (which is, in my mind, ridiculous) so it has very little time to start cleaning up when backups are coming in at a rate of almost 100 MB/sec). But this did not solve the issue. We are suspecting something else right now. Best Regards, Bart WALLEBROEK Backup admin Enterprise Applications Delivery - Infrastructure Management S.W.I.F.T. SCRL >-Original Message- >From: Girish Jorapurkar [mailto:giris...@yahoo.com] >Sent: Wednesday, July 15, 2009 4:11 PM >To: WALLEBROEK Bart; Martin, Jonathan; veritas-bu@mailman.eng.auburn.edu >Subject: Re: [Veritas-bu] Media Server offline for disk > > >In 6.5/6.5.x, a service (nbrmms) running on all master/media servers sends a >heartbeat/capacity-update regarding >disk storage units on the server. If the master server service (nbemm), for >some reason, does not receive the >heartbeat/update in the required time interval, then NetBackup marks the >server "offline for disk". There may be >some valid reasons (load on master/media server) that the heartbeat/update has >not been delievered in time. It is >possible to configure the heartbeat/update interval - which applies to ALL >media servers. > >GUI: Host Properties -> Master server -> General Server properties -> Check >capacity of disk storage units (interval >in seconds) >bp.conf: RE_READ_INTERVAL = > >Remember that setting this value too high might lead to NetBackup trying to >run (and failing) backups on media >servers that are really really "offline". > >Hope this helps, >/Girish > ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Media Server offline for disk
In 6.5/6.5.x, a service (nbrmms) running on all master/media servers sends a heartbeat/capacity-update regarding disk storage units on the server. If the master server service (nbemm), for some reason, does not receive the heartbeat/update in the required time interval, then NetBackup marks the server "offline for disk". There may be some valid reasons (load on master/media server) that the heartbeat/update has not been delievered in time. It is possible to configure the heartbeat/update interval - which applies to ALL media servers. GUI: Host Properties -> Master server -> General Server properties -> Check capacity of disk storage units (interval in seconds) bp.conf: RE_READ_INTERVAL = Remember that setting this value too high might lead to NetBackup trying to run (and failing) backups on media servers that are really really "offline". Hope this helps, /Girish - Original Message From: WALLEBROEK Bart To: "Martin, Jonathan" ; "veritas-bu@mailman.eng.auburn.edu" Sent: Tuesday, July 14, 2009 12:30:42 AM Subject: Re: [Veritas-bu] Media Server offline for disk The Media Manager is active when going to devices --> Media>Servers and selecting the server. It is only after a complete stop and start of the NetBackup services (bpdown/bpup) on this Media Server that the queued jobs go back to running state. To me it seems it has something to do with bpbrm as I need to kill 1 or more services manually every time because they don't get stopped by bpdown. Best Regards, Bart WALLEBROEK Backup admin Enterprise Applications Delivery - Infrastructure Management S.W.I.F.T. SCRL >-Original Message- >From: Martin, Jonathan [mailto:jmart...@intersil.com] >Sent: Friday, July 10, 2009 5:25 PM >To: WALLEBROEK Bart; veritas-bu@mailman.eng.auburn.edu >Subject: RE: [Veritas-bu] Media Server offline for disk > >You can reactivate the server for disk by going to devices --> Media >Servers and selecting the server and hitting "Activate". Check Reports >--> Problems for disk errors. > >-Jonathan > >-Original Message- >From: veritas-bu-boun...@mailman.eng.auburn.edu >[mailto:veritas-bu-boun...@mailman.eng.auburn.edu] On Behalf Of >WALLEBROEK Bart >Sent: Friday, July 10, 2009 11:18 AM >To: veritas-bu@mailman.eng.auburn.edu >Subject: [Veritas-bu] Media Server offline for disk > >We are using DSU (basic disk) since a couple of weeks and in this time I >saw that we had 4 occasions where I came in in the morning noticing that >backup jobs towards this Media Server were all queued with the message >"Media Server is offline for disk". All it takes is a restart of the >services on this Windows based disk staging Media Server and after a >couple of minutes the queued backup jobs return to running and are >completed successfully in the end. > >I cannot find anything related to this in the logs. Disk space when the >Media Server is giving this error is still enough (200 - 380 GB) on a 2 >TB disk. > >Someone any idea ? > > >Best Regards, >Bart WALLEBROEK >Backupadmin >Enterprise Applications Delivery - Infrastructure Management S.W.I.F.T. >SCRL > >___ >Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu >http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Media Server offline for disk
The Media Manager is active when going to devices --> Media>Servers and selecting the server. It is only after a complete stop and start of the NetBackup services (bpdown/bpup) on this Media Server that the queued jobs go back to running state. To me it seems it has something to do with bpbrm as I need to kill 1 or more services manually every time because they don't get stopped by bpdown. Best Regards, Bart WALLEBROEK Backup admin Enterprise Applications Delivery - Infrastructure Management S.W.I.F.T. SCRL >-Original Message- >From: Martin, Jonathan [mailto:jmart...@intersil.com] >Sent: Friday, July 10, 2009 5:25 PM >To: WALLEBROEK Bart; veritas-bu@mailman.eng.auburn.edu >Subject: RE: [Veritas-bu] Media Server offline for disk > >You can reactivate the server for disk by going to devices --> Media >Servers and selecting the server and hitting "Activate". Check Reports >--> Problems for disk errors. > >-Jonathan > >-Original Message- >From: veritas-bu-boun...@mailman.eng.auburn.edu >[mailto:veritas-bu-boun...@mailman.eng.auburn.edu] On Behalf Of >WALLEBROEK Bart >Sent: Friday, July 10, 2009 11:18 AM >To: veritas-bu@mailman.eng.auburn.edu >Subject: [Veritas-bu] Media Server offline for disk > >We are using DSU (basic disk) since a couple of weeks and in this time I >saw that we had 4 occasions where I came in in the morning noticing that >backup jobs towards this Media Server were all queued with the message >"Media Server is offline for disk". All it takes is a restart of the >services on this Windows based disk staging Media Server and after a >couple of minutes the queued backup jobs return to running and are >completed successfully in the end. > >I cannot find anything related to this in the logs. Disk space when the >Media Server is giving this error is still enough (200 - 380 GB) on a 2 >TB disk. > >Someone any idea ? > > >Best Regards, >Bart WALLEBROEK >Backupadmin >Enterprise Applications Delivery - Infrastructure Management S.W.I.F.T. >SCRL > >___ >Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu >http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Media Server offline for disk
Martin, Thanx for the (very) quick reply. Any idea what specific NetBackup logs I should look into ? Best Regards, Bart WALLEBROEK Backup admin Enterprise Applications Delivery - Infrastructure Management S.W.I.F.T. SCRL >-Original Message- >From: Martin, Jonathan [mailto:jmart...@intersil.com] >Sent: Friday, July 10, 2009 5:25 PM >To: WALLEBROEK Bart; veritas-bu@mailman.eng.auburn.edu >Subject: RE: [Veritas-bu] Media Server offline for disk > >You can reactivate the server for disk by going to devices --> Media >Servers and selecting the server and hitting "Activate". Check Reports >--> Problems for disk errors. > >-Jonathan > >-Original Message- >From: veritas-bu-boun...@mailman.eng.auburn.edu >[mailto:veritas-bu-boun...@mailman.eng.auburn.edu] On Behalf Of >WALLEBROEK Bart >Sent: Friday, July 10, 2009 11:18 AM >To: veritas-bu@mailman.eng.auburn.edu >Subject: [Veritas-bu] Media Server offline for disk > >We are using DSU (basic disk) since a couple of weeks and in this time I >saw that we had 4 occasions where I came in in the morning noticing that >backup jobs towards this Media Server were all queued with the message >"Media Server is offline for disk". All it takes is a restart of the >services on this Windows based disk staging Media Server and after a >couple of minutes the queued backup jobs return to running and are >completed successfully in the end. > >I cannot find anything related to this in the logs. Disk space when the >Media Server is giving this error is still enough (200 - 380 GB) on a 2 >TB disk. > >Someone any idea ? > > >Best Regards, >Bart WALLEBROEK >Backupadmin >Enterprise Applications Delivery - Infrastructure Management S.W.I.F.T. >SCRL > >___ >Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu >http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
Re: [Veritas-bu] Media Server offline for disk
You can reactivate the server for disk by going to devices --> Media Servers and selecting the server and hitting "Activate". Check Reports --> Problems for disk errors. -Jonathan -Original Message- From: veritas-bu-boun...@mailman.eng.auburn.edu [mailto:veritas-bu-boun...@mailman.eng.auburn.edu] On Behalf Of WALLEBROEK Bart Sent: Friday, July 10, 2009 11:18 AM To: veritas-bu@mailman.eng.auburn.edu Subject: [Veritas-bu] Media Server offline for disk We are using DSU (basic disk) since a couple of weeks and in this time I saw that we had 4 occasions where I came in in the morning noticing that backup jobs towards this Media Server were all queued with the message "Media Server is offline for disk". All it takes is a restart of the services on this Windows based disk staging Media Server and after a couple of minutes the queued backup jobs return to running and are completed successfully in the end. I cannot find anything related to this in the logs. Disk space when the Media Server is giving this error is still enough (200 - 380 GB) on a 2 TB disk. Someone any idea ? Best Regards, Bart WALLEBROEK Backupadmin Enterprise Applications Delivery - Infrastructure Management S.W.I.F.T. SCRL ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
[Veritas-bu] Media Server offline for disk
We are using DSU (basic disk) since a couple of weeks and in this time I saw that we had 4 occasions where I came in in the morning noticing that backup jobs towards this Media Server were all queued with the message "Media Server is offline for disk". All it takes is a restart of the services on this Windows based disk staging Media Server and after a couple of minutes the queued backup jobs return to running and are completed successfully in the end. I cannot find anything related to this in the logs. Disk space when the Media Server is giving this error is still enough (200 - 380 GB) on a 2 TB disk. Someone any idea ? Best Regards, Bart WALLEBROEK Backupadmin Enterprise Applications Delivery - Infrastructure Management S.W.I.F.T. SCRL ___ Veritas-bu maillist - Veritas-bu@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu
