TSM 5.1 - 5.2
Howdy all, I am getting ready to upgrade my TSM 5.1 environment to TSM 5.2 on Solaris 9. I can source plenty of documents for Windows and AIX though its proving difficult for Solaris. Can someone point me in the right direction and maybe any gotchyas would be appreciated. Thankyou Mark
Re: Primary disk pool volume limit
One thing to keep in mind: If you ever have to restore your TSM database from backup, you will need to audit all of your [random access] disk storage pool volumes. The more you have, the longer this will take. At 12:16 AM 1/5/2006, Andy Huebner wrote: Is there or what is the practical limit on the number of disk pool volumes and the total size of a disk pool? I am running 5.2.2.4 on AIX 5.1. -- Paul ZarnowskiPh: 607-255-4757 Manager, Storage Systems Fx: 607-255-8521 719 Rhodes Hall, Ithaca, NY 14853-3801Em: [EMAIL PROTECTED]
Splitting a MS-Windows node filesystem?
It's a new year, and the new questions are crawling out of the wood-work here. We have an NT fileserver with four 'filesystems' (drives), co-located by filesystem. It's about to be replaced, and in the process the 'X:' drive will be split into the 'X:' and'Y:' drives. How do I handle this at the server level so that I don't loose backup generations? It looks like I need to do an export node with the filespace specified, rename the filespace on the node, and then do an import -- this will, of course, double the data until my expire inventory reaches the retainextra/retainonly limits after the first backup. Is there a better way? TIA Tom Kauffman NIBCO, Inc
Running tapes off-site multiple times in a day?
Like I said -- the questions are crawling out of the wood-work. Our management wants to reduce the possible data loss in the event of a disaster by taking copies off-site both in the early morning and again at the end of first shift. Is anyone else doing this? Will this be as painfull as I expect it to be? I know I'll have issues with reclaims -- I currently run expire inventory at noon, with reclaims kicking in shortly thereafter and sometimes running to 8:00 PM, so I'll have to implement a reclaim window. Electronic off-siting isn't an option -- I've seen us cut 400 MB Oracle redo logs for our SAP/R3 database at the rate of one every 2.5 minutes for extended time periods (and this is explicitly the data that has to go off-site). I'd need multiple T1 lines to cover the traffic, and the cost of a single T1 is considered to be too high. I'm currently running TSM 5.1.6.3, planning on upgrading to 5.3.current in the next two weeks. TIA Tom Kauffman NIBCO Inc
Re: Running tapes off-site multiple times in a day?
On Jan 5, 2006, at 9:54 AM, Kauffman, Tom wrote: Our management wants to reduce the possible data loss in the event of a disaster by taking copies off-site both in the early morning and again at the end of first shift. ... Tom - That implies that they are thinking of running backups and then Backup Stgpool during prime shift - something which isn't usually done due to impact on production. Not knowing all the factors, I might think of using mirroring (perhaps even through FC to a disk array in a safe building) for failure protection during the day, and stick with conventional overnight backups for corruption, DR, and auditing reasons. I'd encourage them to step back and look at the big picture, in conjunction with prevailing technology opportunities. Richard Sims
Re: VTL experiences?
I decided on a VTL because I wanted to have LAN-free backup ability and compression with no load on the TSM clients or TSM server. We have been using Sepaton's ES2100 VTL for over a year with no problems (HP rebrands Sepaton's product). There have been numerous threads in this list about VTL implementations: File dev. type vs. VTL, VTL experiences?, Sizing for a virtual tape library, VTS or san disk storage, Questions for people using Virtual tape libraries The big advantage VTLs, and DEVCLASS=FILE volume virtualizers, have over physical tape libraries are sub-second tape mounts, rewinds and dismounts. Combined with fast seek times those characteristics have eliminated my need for collocation. I have been very satisfied with the VTL choice. H. Milton Johnson -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Dearman, Richard Sent: Wednesday, January 04, 2006 2:42 PM To: ADSM-L@VM.MARIST.EDU Subject: VTL experiences? Anyone out there have any good or bad experiences with VTL solutions. I was thinking about budgeting for 1 or 2 in order to phase out the current san file system I am using for TSM disk storage. There are several vendors out there with VTL solutions most notably IBM and EMC. My first choice would be to choose IBM but it is a new product and EMC has been in the market longer. Any comment or recommendation appreciated. Thanks **EMAIL DISCLAIMER*** This email and any files transmitted with it may be confidential and are intended solely for the use of the individual or entity to whom they are addressed. If you are not the intended recipient or the individual responsible for delivering the e-mail to the intended recipient, any disclosure, copying, distribution or any action taken or omitted to be taken in reliance on it, is strictly prohibited. If you have received this e-mail in error, please delete it and notify the sender or contact Health Information Management 312.413.4947.
Re: Running tapes off-site multiple times in a day?
No backups, just Oracle redo logs -- but I can generate 20 GB of redo in the prime shift window on a good day. We currently run the redo logs to TSM every 15 minutes; two copies, to two separate storage pools, backed up to two separate backup copypools. We have sites doing production and shipment updates to SAP 24 X 7, with invoices being generated and faxed multiple times per day. This is the activity we really don't want to loose. I have a dedicated p5-550 TSM server, all disk is ESS raid-5, and my tape is LTO-2 in a fiber-attached 3584. The 'safe' building is our hangar at the local airport -- 13 miles away direct line. We've looked at the various fiber extenders, iSCSI, and all the other options -- and can't make a business case for the cost. The best option we've come up with was an Intel-based system, running linux, with a local raid array and DAT tape -- but the monthly charge for the circuit was a project killer. Tom -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Richard Sims Sent: Thursday, January 05, 2006 10:11 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: Running tapes off-site multiple times in a day? On Jan 5, 2006, at 9:54 AM, Kauffman, Tom wrote: Our management wants to reduce the possible data loss in the event of a disaster by taking copies off-site both in the early morning and again at the end of first shift. ... Tom - That implies that they are thinking of running backups and then Backup Stgpool during prime shift - something which isn't usually done due to impact on production. Not knowing all the factors, I might think of using mirroring (perhaps even through FC to a disk array in a safe building) for failure protection during the day, and stick with conventional overnight backups for corruption, DR, and auditing reasons. I'd encourage them to step back and look at the big picture, in conjunction with prevailing technology opportunities. Richard Sims
Re: Running tapes off-site multiple times in a day?
I'm thinking you're going to need to add tape drives before thinking of doing something like this. You are going to shorten your current daily maintenance window because you have to squeeze in a portion of it to do a second run. Could be done if you can shorten your current window enough, but I would think that would mean adding tape drives. Getting your reclaims done is going to be a problem as well with only single threaded reclamation processes - if you currently run until 8pm sometimes and you are going to need to shorten that - will be tough unless you break your data up into more pools. Sounds awfully ugly to me. I think the correct answer is yes it is technically possible, but do we REALLY need to do it this way. __ John Monahan Senior Consultant Enterprise Solutions Computech Resources, Inc. Office: 952-833-0930 ext 109 Cell: 952-221-6938 http://www.computechresources.com Kauffman, Tom [EMAIL PROTECTED] COM To Sent by: ADSM: ADSM-L@VM.MARIST.EDU Dist Stor cc Manager [EMAIL PROTECTED] Subject .EDU Running tapes off-site multiple times in a day? 01/05/2006 08:54 AM Please respond to ADSM: Dist Stor Manager [EMAIL PROTECTED] .EDU Like I said -- the questions are crawling out of the wood-work. Our management wants to reduce the possible data loss in the event of a disaster by taking copies off-site both in the early morning and again at the end of first shift. Is anyone else doing this? Will this be as painfull as I expect it to be? I know I'll have issues with reclaims -- I currently run expire inventory at noon, with reclaims kicking in shortly thereafter and sometimes running to 8:00 PM, so I'll have to implement a reclaim window. Electronic off-siting isn't an option -- I've seen us cut 400 MB Oracle redo logs for our SAP/R3 database at the rate of one every 2.5 minutes for extended time periods (and this is explicitly the data that has to go off-site). I'd need multiple T1 lines to cover the traffic, and the cost of a single T1 is considered to be too high. I'm currently running TSM 5.1.6.3, planning on upgrading to 5.3.current in the next two weeks. TIA Tom Kauffman NIBCO Inc
Re: VTL experiences?
I have been using file device class disk backups for the past 5 years via san storage and just have not been satisfied with the storage systems. I have asked others in this forum before whether they experience problems with san based storage when using TSM because TSM seems to push storage systems with such high amounts of I/O that the controllers cann't handle the speed very well and the controller hangs or even crashes regardless of the storage vendor. I also have totally threw out the idea of using a large san storage system to share amongst other servers and applications with TSM because TSM will hog the san storage controller and cause problems on the other attached systems. My main reasons for looking at VTL was speed I heard was very good pushing large amounts of data, it is a separate disk based storage system for TSM only to use and compression. My concern on the EMC VTL side is where the compression is being done? Is it software based compression or hardware based? Our IBM rep stated that IBM's TS7510 is currently using software based compression and using compression will tax the controllers cpu and actually recommended not to use it. He also said they are currently testing hardware based compression and will be coming out with the TS7510 using hardware based compression that will off load the cpu cycles from the linux management server onto an adapter and compression will be much faster and less taxing to the management servers. The VTL systems just seem to be faster, more stable, allows compression so you get a bigger bang for you buck and manages like a tape library all give the VTL an advantage over device class FILE based storage. -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of TSM_User Sent: Thursday, January 05, 2006 12:18 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: VTL experiences? Much of the documentation out there will tell you that the benefit of the VTL is the speed. It is true the VTL is very fast. Some of that same documentation talks about not turning on the virtual compression because it will slow the speed. I've seen in cut the speed in half. But... I've seen a VTL with Virtualized compression turned on still operate as fast as real tape. I make this point because I think you should use the virtualized compression. This way the same 5 TB's of disk space you were using for your file device class might yield 10 to 15 TB's or more of backup space under the VTL. True you could turn on client side compression. But, I like the compression being done on the back end so that there is no stress put on the servers that are backing up themselves. One thing I should also clear up. In my last post I mentioned IBM with SATA disk. I got a friendly reminder from EMC that the CDL's have been shipping with SATA disk since this past November. That also reminded me that the IBM VTL called the TS7510 is using the IBM DS line of disk which has been out for some time now. I remember EMC making the same note when it first came out with the CDL. See the disk subsystem's under both the IBM and EMC VTLs have been out for some time. So just like EMC correctly noted when the CDL first came out you should note today about the IBM TS7510. They really are not new products when it comes to the disk subsystem. In both cases you could choose to purchase the disk subsystems used by the VTLs directly from either IBM or EMC and use them with a file device class. Granted I realize that both EMC and IBM have a specific configuration of their disk subsystems that they put under their VTLs. In my own experience I've used a file device class with TSM V5.2 and earlier and an EMC CDL. I liked the CDL a great deal. We had the same class of EMC disk behind a clarion setup to use a file device class. The same amount of disk behind the CDL performed better. I believe part of the reason is the logic in the FalconStor software. It uses disk for its virtual tapes in 5 GB increments and uses logic to ensure it picks the least busy disk for the next 5 GB that is used. I know with V5.3 giving you the ability to write to multiple filespaces which could be on multiple LUNS gives you something over V5.2. I still think that cycling through separate LUNS though isn't as good as the way the VTL allocates in 5 GB chunks across many more LUNS. FalconStor may have a white paper on how they do it but I would encourage you to ask your vendor who ever it is to come on site and discuss this with you in greater detail. Whether you pick a VTL from EMC or IBM (or someone else for that matter), or you pick a disk subsystem with the file device class you must test yourself to see what will work best in your environment. I make no claim that a VTL is for everyone or that it will outperform real tape in every situation. I simply think it should be one of the things you strongly consider. More and more of us are seeing the benefit of moving small
Problems restoring on Linux
TSM Server 5.3.2.1 on AIX 5.3 TSM Client 5.2.4.0 on Linux86 2.4.9-e.5 The admin is trying to restore an entire filesystem onto a newly formatted server. The restore gets interrupted with ANS1028S errors and the dsmerror.log file shows: 01/04/2006 18:52:29 TransErrno: Unexpected error from open, errno = 4 01/04/2006 18:52:31 ANS1028S Internal program error. Please see your service representative. The restore will fail at different points after just a few files restored or after several 10,000's. Search IBM, ADMS-L and Google don't get me any relevant hits. If it's the same errono as AIX the 4 is interrupted system call. Any ideas?? Bill Boyer Growing old is mandatory, growing up is optional - ??
Re: Running tapes off-site multiple times in a day?
We'll be adding 6 more drives in a few weeks -- to a total of 16. I have 6 off-site copy pools, one of which never goes through reclaim as it's a 21-day archive pool. I'm most concerned about the process for wrapping up an in-process reclaim and getting the tape out of the drive by the time the afternoon database backup finishes (I do full backups to LTO -- currently runs about 20 minutes). I figure I'll need to open a reclaim window in the 2 AM to 6 AM time frame in order to get everything done. And I'd REALLY like to spend the money and put in the telecom circuit instead. Tom -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of John Monahan Sent: Thursday, January 05, 2006 11:10 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: Running tapes off-site multiple times in a day? I'm thinking you're going to need to add tape drives before thinking of doing something like this. You are going to shorten your current daily maintenance window because you have to squeeze in a portion of it to do a second run. Could be done if you can shorten your current window enough, but I would think that would mean adding tape drives. Getting your reclaims done is going to be a problem as well with only single threaded reclamation processes - if you currently run until 8pm sometimes and you are going to need to shorten that - will be tough unless you break your data up into more pools. Sounds awfully ugly to me. I think the correct answer is yes it is technically possible, but do we REALLY need to do it this way. __ John Monahan Senior Consultant Enterprise Solutions Computech Resources, Inc. Office: 952-833-0930 ext 109 Cell: 952-221-6938 http://www.computechresources.com Kauffman, Tom [EMAIL PROTECTED] COM To Sent by: ADSM: ADSM-L@VM.MARIST.EDU Dist Stor cc Manager [EMAIL PROTECTED] Subject .EDU Running tapes off-site multiple times in a day? 01/05/2006 08:54 AM Please respond to ADSM: Dist Stor Manager [EMAIL PROTECTED] .EDU Like I said -- the questions are crawling out of the wood-work. Our management wants to reduce the possible data loss in the event of a disaster by taking copies off-site both in the early morning and again at the end of first shift. Is anyone else doing this? Will this be as painfull as I expect it to be? I know I'll have issues with reclaims -- I currently run expire inventory at noon, with reclaims kicking in shortly thereafter and sometimes running to 8:00 PM, so I'll have to implement a reclaim window. Electronic off-siting isn't an option -- I've seen us cut 400 MB Oracle redo logs for our SAP/R3 database at the rate of one every 2.5 minutes for extended time periods (and this is explicitly the data that has to go off-site). I'd need multiple T1 lines to cover the traffic, and the cost of a single T1 is considered to be too high. I'm currently running TSM 5.1.6.3, planning on upgrading to 5.3.current in the next two weeks. TIA Tom Kauffman NIBCO Inc
Re: Running tapes off-site multiple times in a day?
It will help once you get to TSM 5.3 as you can use the reclaim stgpool command with the duration parameter. It will cancel the reclamation process when the duration has expired, so you will just have to wait for that last aggregate to finish being moved instead of waiting for the entire volume to finish its reclaim. As long as your mount retention is low, everything should be done and out of the tape drives after 20 minutes or so beyond the reclamation duration. The reclaim window from 2am to 6am sounds like a good idea too. __ John Monahan Senior Consultant Enterprise Solutions Computech Resources, Inc. Office: 952-833-0930 ext 109 Cell: 952-221-6938 http://www.computechresources.com Kauffman, Tom [EMAIL PROTECTED] COM To Sent by: ADSM: ADSM-L@VM.MARIST.EDU Dist Stor cc Manager [EMAIL PROTECTED] Subject .EDU Re: Running tapes off-site multiple times in a day? 01/05/2006 10:31 AM Please respond to ADSM: Dist Stor Manager [EMAIL PROTECTED] .EDU We'll be adding 6 more drives in a few weeks -- to a total of 16. I have 6 off-site copy pools, one of which never goes through reclaim as it's a 21-day archive pool. I'm most concerned about the process for wrapping up an in-process reclaim and getting the tape out of the drive by the time the afternoon database backup finishes (I do full backups to LTO -- currently runs about 20 minutes). I figure I'll need to open a reclaim window in the 2 AM to 6 AM time frame in order to get everything done. And I'd REALLY like to spend the money and put in the telecom circuit instead. Tom -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of John Monahan Sent: Thursday, January 05, 2006 11:10 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: Running tapes off-site multiple times in a day? I'm thinking you're going to need to add tape drives before thinking of doing something like this. You are going to shorten your current daily maintenance window because you have to squeeze in a portion of it to do a second run. Could be done if you can shorten your current window enough, but I would think that would mean adding tape drives. Getting your reclaims done is going to be a problem as well with only single threaded reclamation processes - if you currently run until 8pm sometimes and you are going to need to shorten that - will be tough unless you break your data up into more pools. Sounds awfully ugly to me. I think the correct answer is yes it is technically possible, but do we REALLY need to do it this way. __ John Monahan Senior Consultant Enterprise Solutions Computech Resources, Inc. Office: 952-833-0930 ext 109 Cell: 952-221-6938 http://www.computechresources.com Kauffman, Tom [EMAIL PROTECTED] COM To Sent by: ADSM: ADSM-L@VM.MARIST.EDU Dist Stor cc Manager [EMAIL PROTECTED] Subject .EDU Running tapes off-site multiple times in a day? 01/05/2006 08:54 AM Please respond to ADSM: Dist Stor Manager [EMAIL PROTECTED] .EDU Like I said -- the questions are crawling out of the wood-work. Our management wants to reduce the possible data loss in the event of a disaster by taking copies off-site both in the early morning and again at the end of first shift. Is anyone else doing this? Will this be as painfull as I expect it to be? I know I'll have issues with reclaims -- I currently run expire inventory at noon, with reclaims kicking in shortly thereafter and sometimes running to 8:00 PM, so I'll have to implement a reclaim window. Electronic off-siting isn't an option -- I've seen us cut 400 MB Oracle redo logs for our SAP/R3 database at the rate of one every 2.5 minutes for extended time periods (and this is explicitly the data that has to go off-site). I'd need multiple T1 lines to cover the traffic, and the cost of a single T1 is considered to be too high. I'm currently running TSM 5.1.6.3, planning on upgrading to 5.3.current in the next two weeks. TIA Tom Kauffman NIBCO Inc
Re: Running tapes off-site multiple times in a day?
When you get to TSM 5.3, you can do RECLAIM STGPOOL DURATION=nn That will make sure the reclaim shuts itself down in time for the afternoon courier run. Also, for the afternoon run, you could use a DB incremental instead of the full. -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Kauffman, Tom Sent: Thursday, January 05, 2006 11:31 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: Running tapes off-site multiple times in a day? We'll be adding 6 more drives in a few weeks -- to a total of 16. I have 6 off-site copy pools, one of which never goes through reclaim as it's a 21-day archive pool. I'm most concerned about the process for wrapping up an in-process reclaim and getting the tape out of the drive by the time the afternoon database backup finishes (I do full backups to LTO -- currently runs about 20 minutes). I figure I'll need to open a reclaim window in the 2 AM to 6 AM time frame in order to get everything done. And I'd REALLY like to spend the money and put in the telecom circuit instead. Tom -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of John Monahan Sent: Thursday, January 05, 2006 11:10 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: Running tapes off-site multiple times in a day? I'm thinking you're going to need to add tape drives before thinking of doing something like this. You are going to shorten your current daily maintenance window because you have to squeeze in a portion of it to do a second run. Could be done if you can shorten your current window enough, but I would think that would mean adding tape drives. Getting your reclaims done is going to be a problem as well with only single threaded reclamation processes - if you currently run until 8pm sometimes and you are going to need to shorten that - will be tough unless you break your data up into more pools. Sounds awfully ugly to me. I think the correct answer is yes it is technically possible, but do we REALLY need to do it this way. __ John Monahan Senior Consultant Enterprise Solutions Computech Resources, Inc. Office: 952-833-0930 ext 109 Cell: 952-221-6938 http://www.computechresources.com Kauffman, Tom [EMAIL PROTECTED] COM To Sent by: ADSM: ADSM-L@VM.MARIST.EDU Dist Stor cc Manager [EMAIL PROTECTED] Subject .EDU Running tapes off-site multiple times in a day? 01/05/2006 08:54 AM Please respond to ADSM: Dist Stor Manager [EMAIL PROTECTED] .EDU Like I said -- the questions are crawling out of the wood-work. Our management wants to reduce the possible data loss in the event of a disaster by taking copies off-site both in the early morning and again at the end of first shift. Is anyone else doing this? Will this be as painfull as I expect it to be? I know I'll have issues with reclaims -- I currently run expire inventory at noon, with reclaims kicking in shortly thereafter and sometimes running to 8:00 PM, so I'll have to implement a reclaim window. Electronic off-siting isn't an option -- I've seen us cut 400 MB Oracle redo logs for our SAP/R3 database at the rate of one every 2.5 minutes for extended time periods (and this is explicitly the data that has to go off-site). I'd need multiple T1 lines to cover the traffic, and the cost of a single T1 is considered to be too high. I'm currently running TSM 5.1.6.3, planning on upgrading to 5.3.current in the next two weeks. TIA Tom Kauffman NIBCO Inc
Re: VTL experiences?
My concern on the EMC VTL side is where the compression is being done? Is it software based compression or hardware based? I might be a little out of date with some of the latest iterations of vendors' offerings, but I think that the Quantum range of VTLs are the only ones offering hardware/in-line compression at the moment - is/has anyone used these and can offer a benchmark/judgement/experiences on how/whether compression affects throughput when off-loaded in hardware? David McClelland Storage and Systems Management Specialist IBM Tivoli Certified Deployment Professional (ITSM 5.2) SSO UK Service Delivery Storage Services IBM Global Services IBM United Kingdom Dearman, Richard [EMAIL PROTECTED] Sent by: ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU 05/01/2006 16:14 Please respond to ADSM: Dist Stor Manager To ADSM-L@VM.MARIST.EDU cc Subject Re: [ADSM-L] VTL experiences? I have been using file device class disk backups for the past 5 years via san storage and just have not been satisfied with the storage systems. I have asked others in this forum before whether they experience problems with san based storage when using TSM because TSM seems to push storage systems with such high amounts of I/O that the controllers cann't handle the speed very well and the controller hangs or even crashes regardless of the storage vendor. I also have totally threw out the idea of using a large san storage system to share amongst other servers and applications with TSM because TSM will hog the san storage controller and cause problems on the other attached systems. My main reasons for looking at VTL was speed I heard was very good pushing large amounts of data, it is a separate disk based storage system for TSM only to use and compression. My concern on the EMC VTL side is where the compression is being done? Is it software based compression or hardware based? Our IBM rep stated that IBM's TS7510 is currently using software based compression and using compression will tax the controllers cpu and actually recommended not to use it. He also said they are currently testing hardware based compression and will be coming out with the TS7510 using hardware based compression that will off load the cpu cycles from the linux management server onto an adapter and compression will be much faster and less taxing to the management servers. The VTL systems just seem to be faster, more stable, allows compression so you get a bigger bang for you buck and manages like a tape library all give the VTL an advantage over device class FILE based storage. -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of TSM_User Sent: Thursday, January 05, 2006 12:18 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: VTL experiences? Much of the documentation out there will tell you that the benefit of the VTL is the speed. It is true the VTL is very fast. Some of that same documentation talks about not turning on the virtual compression because it will slow the speed. I've seen in cut the speed in half. But... I've seen a VTL with Virtualized compression turned on still operate as fast as real tape. I make this point because I think you should use the virtualized compression. This way the same 5 TB's of disk space you were using for your file device class might yield 10 to 15 TB's or more of backup space under the VTL. True you could turn on client side compression. But, I like the compression being done on the back end so that there is no stress put on the servers that are backing up themselves. One thing I should also clear up. In my last post I mentioned IBM with SATA disk. I got a friendly reminder from EMC that the CDL's have been shipping with SATA disk since this past November. That also reminded me that the IBM VTL called the TS7510 is using the IBM DS line of disk which has been out for some time now. I remember EMC making the same note when it first came out with the CDL. See the disk subsystem's under both the IBM and EMC VTLs have been out for some time. So just like EMC correctly noted when the CDL first came out you should note today about the IBM TS7510. They really are not new products when it comes to the disk subsystem. In both cases you could choose to purchase the disk subsystems used by the VTLs directly from either IBM or EMC and use them with a file device class. Granted I realize that both EMC and IBM have a specific configuration of their disk subsystems that they put under their VTLs. In my own experience I've used a file device class with TSM V5.2 and earlier and an EMC CDL. I liked the CDL a great deal. We had the same class of EMC disk behind a clarion setup to use a file device class. The same amount of disk behind the CDL performed better. I believe part of the reason is the logic in the FalconStor software. It uses disk for its virtual tapes in 5 GB increments and uses logic to ensure it picks the least busy disk for the next 5 GB
Re: Running tapes off-site multiple times in a day?
Tom, Sounds like a story most of us are familiar with - increase data protection, but do it for free. Based on your limitations, I can only think of a couple of options, none of them quick/easy/simple/free: 1. Go ahead and use your LTO-2 tapes to make 2nd stgpool backups at the end of the day and send the tape offsite. You will need more tapes, be wasting a lot of space on each tape, and reclamation will have to be considered, but this is the most straight-forward method. 2. Invest in a small library using lower capacity tapes just for these backups. Send them offsite daily and don't reclaim at all, just wait for them to roll off. 3. Use some type of data reduction tool to get the moved data size small enough to work over a T1 pipe - check out vendors such as Data Domain, Avamar, etc. Some of these will work with TSM, others would not. Good luck! Steve Schaub Systems Engineer, WNI BlueCross BlueShield of Tennessee 423-752-6574 (desk) 423-785-7347 (cell) -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Kauffman, Tom Sent: Thursday, January 05, 2006 10:29 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] Running tapes off-site multiple times in a day? No backups, just Oracle redo logs -- but I can generate 20 GB of redo in the prime shift window on a good day. We currently run the redo logs to TSM every 15 minutes; two copies, to two separate storage pools, backed up to two separate backup copypools. We have sites doing production and shipment updates to SAP 24 X 7, with invoices being generated and faxed multiple times per day. This is the activity we really don't want to loose. I have a dedicated p5-550 TSM server, all disk is ESS raid-5, and my tape is LTO-2 in a fiber-attached 3584. The 'safe' building is our hangar at the local airport -- 13 miles away direct line. We've looked at the various fiber extenders, iSCSI, and all the other options -- and can't make a business case for the cost. The best option we've come up with was an Intel-based system, running linux, with a local raid array and DAT tape -- but the monthly charge for the circuit was a project killer. Tom -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Richard Sims Sent: Thursday, January 05, 2006 10:11 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: Running tapes off-site multiple times in a day? On Jan 5, 2006, at 9:54 AM, Kauffman, Tom wrote: Our management wants to reduce the possible data loss in the event of a disaster by taking copies off-site both in the early morning and again at the end of first shift. ... Tom - That implies that they are thinking of running backups and then Backup Stgpool during prime shift - something which isn't usually done due to impact on production. Not knowing all the factors, I might think of using mirroring (perhaps even through FC to a disk array in a safe building) for failure protection during the day, and stick with conventional overnight backups for corruption, DR, and auditing reasons. I'd encourage them to step back and look at the big picture, in conjunction with prevailing technology opportunities. Richard Sims Please see the following link for the BlueCross BlueShield of Tennessee E-mail disclaimer: http://www.bcbst.com/email_disclaimer.shtm
Re: Problems restoring on Linux
On Jan 5, 2006, at 11:25 AM, William Boyer wrote: TSM Server 5.3.2.1 on AIX 5.3 TSM Client 5.2.4.0 on Linux86 2.4.9-e.5 The admin is trying to restore an entire filesystem onto a newly formatted server. The restore gets interrupted with ANS1028S errors and the dsmerror.log file shows: 01/04/2006 18:52:29 TransErrno: Unexpected error from open, errno = 4 01/04/2006 18:52:31 ANS1028S Internal program error. Please see your service representative. The restore will fail at different points after just a few files restored or after several 10,000's. Search IBM, ADMS-L and Google don't get me any relevant hits. If it's the same errono as AIX the 4 is interrupted system call. Well, Bill, that situation certainly left you as the customer with useless information. Errno 4 is EINTR, which is the general error number for when a program has received a Signal as it was sitting waiting for a (slow) system call to complete. Ostensibly, the open() was being performed on the latest file system object being restored. The key to this would be the signal number. Look in the Linux /var/log/messages to see if anything there. You may be dealing with a problem disk or a finicky configured operating system. (Maybe trying to run Security Enhanced Linux, with all its caveats?) You might try a recursive copy of some other file system into that area, and see if that, too, fails: that failure might provide more info as to what's going on. Richard Sims
Re: error
Lately we get a lot of the following errors, it is not node specific . I have no idea what to do Appreciate any help ? ANR2579E Schedule WIN_DISK_DAILY in domain WIN_DISK_DOMAIN for node FW256 failed (return code 12). (SESSION: 47469) Thanks, Ashok
AW: [ADSM-L] error
Return code 12 means: The operation completed with at least one error message (except for error messages for skipped files). For scheduled events, the status will be Failed. Review the dsmerror.log file (and dsmsched.log file for scheduled events) to determine what error messages were issued and to assess their impact on the operation. As a general rule, this return code means that the error was severe enough to prevent the successful completion of the operation. For example, an error that prevents an entire drive from being processed yields return code 12. When a file is not found the operation yields return code 12. See chapter Return codes from the command line interface in the client installation and users guide. HTH Thomas Rupp -Ursprüngliche Nachricht- Von: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] Im Auftrag von Vats.Ashok Gesendet: Donnerstag, 05. Jänner 2006 18:03 An: ADSM-L@VM.MARIST.EDU Betreff: Re: [ADSM-L] error Lately we get a lot of the following errors, it is not node specific . I have no idea what to do Appreciate any help ? ANR2579E Schedule WIN_DISK_DAILY in domain WIN_DISK_DOMAIN for node FW256 failed (return code 12). (SESSION: 47469) Thanks, Ashok
Re: Splitting a MS-Windows node filesystem?
ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU wrote on 01/05/2006 08:43:38 AM: We have an NT fileserver with four 'filesystems' (drives), co-located by filesystem. It's about to be replaced, and in the process the 'X:' drive will be split into the 'X:' and'Y:' drives. How do I handle this at the server level so that I don't loose backup generations? It looks like I need to do an export node with the filespace specified, rename the filespace on the node, and then do an import -- this will, of course, double the data until my expire inventory reaches the retainextra/retainonly limits after the first backup. Rename the old filespace rename filespace foobar \\foobar\x \\foobar\x_old The first backup with the new filesystems will create a new filespace for each new filesystem. -- Mark Stapleton ([EMAIL PROTECTED]) MR Backup and Recovery Management 262.790.3190 -- Electronic Privacy Notice. This e-mail, and any attachments, contains information that is, or may be, covered by electronic communications privacy laws, and is also confidential and proprietary in nature. If you are not the intended recipient, please be advised that you are legally prohibited from retaining, using, copying, distributing, or otherwise disclosing this information in any manner. Instead, please reply to the sender that you have received this communication in error, and then immediately delete it. Thank you in advance for your cooperation. ==
performance scaling question
My server is an IBM x235 with a single Xeon 2.8ghz (533mhz fsb), running windows2003. I've noticed that the cpu gets pretty consistently pegged every night during backups, and I was wondering what would do more good replacing the single 2.8 with a 3.2, or leaving the 2.8 and adding a second one? Confidentiality Notice follows: The information in this message (and the documents attached to it, if any) is confidential and may be legally privileged. It is intended solely for the addressee. Access to this message by anyone else is unauthorized. If you are not the intended recipient, any disclosure, copying, distribution or any action taken, or omitted to be taken in reliance on it is prohibited and may be unlawful. If you have received this message in error, please delete all electronic copies of this message (and the documents attached to it, if any), destroy any hard copies you may have created and notify me immediately by replying to this email. Thank you.
Re: JR- backupset file list
ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU wrote on 01/04/2006 04:17:59 PM: Is it possible to list out the files that are in a backupset from the dsmc program on the client for which the backupset was created? QUERY BACKUPSETCONTENTS -- Mark Stapleton ([EMAIL PROTECTED]) MR Backup and Recovery Management 262.790.3190 -- Electronic Privacy Notice. This e-mail, and any attachments, contains information that is, or may be, covered by electronic communications privacy laws, and is also confidential and proprietary in nature. If you are not the intended recipient, please be advised that you are legally prohibited from retaining, using, copying, distributing, or otherwise disclosing this information in any manner. Instead, please reply to the sender that you have received this communication in error, and then immediately delete it. Thank you in advance for your cooperation. ==
Re: JR- backupset file list
Mark, I am running TSM 5.2 and the query backupsetcontents doesn't work when running it as follows: NetWare 5.1 server console Type: dsmc dsmcquery backupsetcontents This command runs on the TSM server but not from a client node. JR Trimark Storage Administrator Lead Aurora Health Care 414.647.3256 Voice 414.647.4999 Fax 414.222.2219 Pager [EMAIL PROTECTED] Mark Stapleton [EMAIL PROTECTED] Sent by: ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU 01/05/2006 03:36 PM Please respond to ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU To ADSM-L@VM.MARIST.EDU cc Subject Re: [ADSM-L] JR- backupset file list ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU wrote on 01/04/2006 04:17:59 PM: Is it possible to list out the files that are in a backupset from the dsmc program on the client for which the backupset was created? QUERY BACKUPSETCONTENTS -- Mark Stapleton ([EMAIL PROTECTED]) MR Backup and Recovery Management 262.790.3190 -- Electronic Privacy Notice. This e-mail, and any attachments, contains information that is, or may be, covered by electronic communications privacy laws, and is also confidential and proprietary in nature. If you are not the intended recipient, please be advised that you are legally prohibited from retaining, using, copying, distributing, or otherwise disclosing this information in any manner. Instead, please reply to the sender that you have received this communication in error, and then immediately delete it. Thank you in advance for your cooperation. ==
Re: Running tapes off-site multiple times in a day?
How well segregated is your data? I'd advise having the SAP data and logs in their own pools. Since this type of data tends to expire in groups, do you need to reclaim the tapes in these pools at all? The hardest part, with a system like this, is getting the tapes idle to be able to run backup stg against. You may want to look at having the data written to both the primary and copypools at the same time, or doing something to idle the tapes you need to copy (mark them ReadOnly to force new tapes to be used, something like that). How busy your system is makes this harder. Nick Cassimatis - Forwarded by Nicholas Cassimatis/Raleigh/IBM on 01/05/2006 12:04 PM - ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU wrote on 01/05/2006 11:31:11 AM: We'll be adding 6 more drives in a few weeks -- to a total of 16. I have 6 off-site copy pools, one of which never goes through reclaim as it's a 21-day archive pool. I'm most concerned about the process for wrapping up an in-process reclaim and getting the tape out of the drive by the time the afternoon database backup finishes (I do full backups to LTO -- currently runs about 20 minutes). I figure I'll need to open a reclaim window in the 2 AM to 6 AM time frame in order to get everything done. And I'd REALLY like to spend the money and put in the telecom circuit instead. Tom -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of John Monahan Sent: Thursday, January 05, 2006 11:10 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: Running tapes off-site multiple times in a day? I'm thinking you're going to need to add tape drives before thinking of doing something like this. You are going to shorten your current daily maintenance window because you have to squeeze in a portion of it to do a second run. Could be done if you can shorten your current window enough, but I would think that would mean adding tape drives. Getting your reclaims done is going to be a problem as well with only single threaded reclamation processes - if you currently run until 8pm sometimes and you are going to need to shorten that - will be tough unless you break your data up into more pools. Sounds awfully ugly to me. I think the correct answer is yes it is technically possible, but do we REALLY need to do it this way. __ John Monahan Senior Consultant Enterprise Solutions Computech Resources, Inc. Office: 952-833-0930 ext 109 Cell: 952-221-6938 http://www.computechresources.com Kauffman, Tom [EMAIL PROTECTED] COM To Sent by: ADSM: ADSM-L@VM.MARIST.EDU Dist Stor cc Manager [EMAIL PROTECTED] Subject .EDU Running tapes off-site multiple times in a day? 01/05/2006 08:54 AM Please respond to ADSM: Dist Stor Manager [EMAIL PROTECTED] .EDU Like I said -- the questions are crawling out of the wood-work. Our management wants to reduce the possible data loss in the event of a disaster by taking copies off-site both in the early morning and again at the end of first shift. Is anyone else doing this? Will this be as painfull as I expect it to be? I know I'll have issues with reclaims -- I currently run expire inventory at noon, with reclaims kicking in shortly thereafter and sometimes running to 8:00 PM, so I'll have to implement a reclaim window. Electronic off-siting isn't an option -- I've seen us cut 400 MB Oracle redo logs for our SAP/R3 database at the rate of one every 2.5 minutes for extended time periods (and this is explicitly the data that has to go off-site). I'd need multiple T1 lines to cover the traffic, and the cost of a single T1 is considered to be too high. I'm currently running TSM 5.1.6.3, planning on upgrading to 5.3.current in the next two weeks. TIA Tom Kauffman NIBCO Inc
JR- specify backup set location for NetWare
I am running NetWare 5.1 SP7 with the TSM 5.2 client. I am trying to do a backup set restore using the Backup-Archive client. When I select Backup Sets | Local and type in the location of my backup set (e.g. g:\test.ost) I keep getting file not found. Any ideas?
Re: Running tapes off-site multiple times in a day?
If it's just an Oracle DB issue, no backups, then how about using Oracle Data Guard at the 'safe' site and transmit the logs via T1 and put a TSM server and tape solution on the 'safe' site server. We've been using this type of option for many years now. Kauffman, Tom [EMAIL PROTECTED] Sent by: ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU 01/05/2006 07:29 AM Please respond to ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU To ADSM-L@VM.MARIST.EDU cc Subject Re: [ADSM-L] Running tapes off-site multiple times in a day? No backups, just Oracle redo logs -- but I can generate 20 GB of redo in the prime shift window on a good day. We currently run the redo logs to TSM every 15 minutes; two copies, to two separate storage pools, backed up to two separate backup copypools. We have sites doing production and shipment updates to SAP 24 X 7, with invoices being generated and faxed multiple times per day. This is the activity we really don't want to loose. I have a dedicated p5-550 TSM server, all disk is ESS raid-5, and my tape is LTO-2 in a fiber-attached 3584. The 'safe' building is our hangar at the local airport -- 13 miles away direct line. We've looked at the various fiber extenders, iSCSI, and all the other options -- and can't make a business case for the cost. The best option we've come up with was an Intel-based system, running linux, with a local raid array and DAT tape -- but the monthly charge for the circuit was a project killer. Tom -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Richard Sims Sent: Thursday, January 05, 2006 10:11 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: Running tapes off-site multiple times in a day? On Jan 5, 2006, at 9:54 AM, Kauffman, Tom wrote: Our management wants to reduce the possible data loss in the event of a disaster by taking copies off-site both in the early morning and again at the end of first shift. ... Tom - That implies that they are thinking of running backups and then Backup Stgpool during prime shift - something which isn't usually done due to impact on production. Not knowing all the factors, I might think of using mirroring (perhaps even through FC to a disk array in a safe building) for failure protection during the day, and stick with conventional overnight backups for corruption, DR, and auditing reasons. I'd encourage them to step back and look at the big picture, in conjunction with prevailing technology opportunities. Richard Sims
Re: Running tapes off-site multiple times in a day?
If its mostly the SAP data that you are interested in... Here are a few off-the-wall suggestions Suggestion 1. The SAP TDP can back up to two TSM Servers at once. Set up a second server and run its housekeeping 8 or 12 hours opposed to the first one. Suggestion 2. Use simultaneous write so your copypools are ready as soon as the backup is done. Suggestion 3. Backup your storagepool to two copypools. Sync one for the first offsite run and the the second for the other offsite run. As I say, off-the-wall (well 1 and 3 anyway) but maybe there's something you can use there. Regards Steve Steve Harris AIX and TSM Admin Queensland Australia -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Nicholas Cassimatis Sent: Friday, 6 January 2006 3:14 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] Running tapes off-site multiple times in a day? How well segregated is your data? I'd advise having the SAP data and logs in their own pools. Since this type of data tends to expire in groups, do you need to reclaim the tapes in these pools at all? The hardest part, with a system like this, is getting the tapes idle to be able to run backup stg against. You may want to look at having the data written to both the primary and copypools at the same time, or doing something to idle the tapes you need to copy (mark them ReadOnly to force new tapes to be used, something like that). How busy your system is makes this harder. Nick Cassimatis - Forwarded by Nicholas Cassimatis/Raleigh/IBM on 01/05/2006 12:04 PM - ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU wrote on 01/05/2006 11:31:11 AM: We'll be adding 6 more drives in a few weeks -- to a total of 16. I have 6 off-site copy pools, one of which never goes through reclaim as it's a 21-day archive pool. I'm most concerned about the process for wrapping up an in-process reclaim and getting the tape out of the drive by the time the afternoon database backup finishes (I do full backups to LTO -- currently runs about 20 minutes). I figure I'll need to open a reclaim window in the 2 AM to 6 AM time frame in order to get everything done. And I'd REALLY like to spend the money and put in the telecom circuit instead. Tom -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of John Monahan Sent: Thursday, January 05, 2006 11:10 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: Running tapes off-site multiple times in a day? I'm thinking you're going to need to add tape drives before thinking of doing something like this. You are going to shorten your current daily maintenance window because you have to squeeze in a portion of it to do a second run. Could be done if you can shorten your current window enough, but I would think that would mean adding tape drives. Getting your reclaims done is going to be a problem as well with only single threaded reclamation processes - if you currently run until 8pm sometimes and you are going to need to shorten that - will be tough unless you break your data up into more pools. Sounds awfully ugly to me. I think the correct answer is yes it is technically possible, but do we REALLY need to do it this way. __ John Monahan Senior Consultant Enterprise Solutions Computech Resources, Inc. Office: 952-833-0930 ext 109 Cell: 952-221-6938 http://www.computechresources.com Kauffman, Tom [EMAIL PROTECTED] COM To Sent by: ADSM: ADSM-L@VM.MARIST.EDU Dist Stor cc Manager [EMAIL PROTECTED] Subject .EDU Running tapes off-site multiple times in a day? 01/05/2006 08:54 AM Please respond to ADSM: Dist Stor Manager [EMAIL PROTECTED] .EDU Like I said -- the questions are crawling out of the wood-work. Our management wants to reduce the possible data loss in the event of a disaster by taking copies off-site both in the early morning and again at the end of first shift. Is anyone else doing this? Will this be as painfull as I expect it to be? I know I'll have issues with reclaims -- I currently run expire inventory at noon, with reclaims kicking in shortly thereafter and sometimes running to 8:00 PM, so I'll have to implement a reclaim window. Electronic off-siting isn't an option -- I've seen us cut 400 MB Oracle redo logs for our SAP/R3 database at the rate of one every 2.5 minutes for extended time periods (and this is explicitly the data that has to go off-site). I'd need multiple T1 lines
Re: Running tapes off-site multiple times in a day?
A single T1 won't handle the load. We average about 22 GB of redo log per day, and I've seen peaks over 45 GB. Multiple T1s gets interesting in terms of making them look like a single fat pipe to the application -- and to handle our peak environment, the T1 count actually gets to a price-match with a T3. And the company isn't willing to spring the monthly cost for multiple Ts (there was some consternation at the cost of a single T1, and a lot of consternation when I said it wouldn't be enough). Oh -- and these volumes are for the *single* copy of the redo logs. Tom -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Larry Peifer Sent: Thursday, January 05, 2006 8:12 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: Running tapes off-site multiple times in a day? If it's just an Oracle DB issue, no backups, then how about using Oracle Data Guard at the 'safe' site and transmit the logs via T1 and put a TSM server and tape solution on the 'safe' site server. We've been using this type of option for many years now. Kauffman, Tom [EMAIL PROTECTED] Sent by: ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU 01/05/2006 07:29 AM Please respond to ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU To ADSM-L@VM.MARIST.EDU cc Subject Re: [ADSM-L] Running tapes off-site multiple times in a day? No backups, just Oracle redo logs -- but I can generate 20 GB of redo in the prime shift window on a good day. We currently run the redo logs to TSM every 15 minutes; two copies, to two separate storage pools, backed up to two separate backup copypools. We have sites doing production and shipment updates to SAP 24 X 7, with invoices being generated and faxed multiple times per day. This is the activity we really don't want to loose. I have a dedicated p5-550 TSM server, all disk is ESS raid-5, and my tape is LTO-2 in a fiber-attached 3584. The 'safe' building is our hangar at the local airport -- 13 miles away direct line. We've looked at the various fiber extenders, iSCSI, and all the other options -- and can't make a business case for the cost. The best option we've come up with was an Intel-based system, running linux, with a local raid array and DAT tape -- but the monthly charge for the circuit was a project killer. Tom -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Richard Sims Sent: Thursday, January 05, 2006 10:11 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: Running tapes off-site multiple times in a day? On Jan 5, 2006, at 9:54 AM, Kauffman, Tom wrote: Our management wants to reduce the possible data loss in the event of a disaster by taking copies off-site both in the early morning and again at the end of first shift. ... Tom - That implies that they are thinking of running backups and then Backup Stgpool during prime shift - something which isn't usually done due to impact on production. Not knowing all the factors, I might think of using mirroring (perhaps even through FC to a disk array in a safe building) for failure protection during the day, and stick with conventional overnight backups for corruption, DR, and auditing reasons. I'd encourage them to step back and look at the big picture, in conjunction with prevailing technology opportunities. Richard Sims
Re: Running tapes off-site multiple times in a day?
As a coworker once had posted on his door (Hey John, if you're out there!): There are three kinds of work: Reliable Fast Cheap You may pick two. And it looks like you're in the unfortunate position where the powers that be are asking for all three. Backups are just like insurance - you may be at the point where you have to get them to evaluate what point on the cost/protection scale they want/need to be. A nice Compliance rule (SOX, HIPPA, etc) can often help you out there. Nick Cassimatis - Forwarded by Nicholas Cassimatis/Raleigh/IBM on 01/05/2006 11:00 PM - ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU wrote on 01/05/2006 10:46:46 PM: A single T1 won't handle the load. We average about 22 GB of redo log per day, and I've seen peaks over 45 GB. Multiple T1s gets interesting in terms of making them look like a single fat pipe to the application -- and to handle our peak environment, the T1 count actually gets to a price-match with a T3. And the company isn't willing to spring the monthly cost for multiple Ts (there was some consternation at the cost of a single T1, and a lot of consternation when I said it wouldn't be enough). Oh -- and these volumes are for the *single* copy of the redo logs. Tom
Re: Running tapes off-site multiple times in a day?
The problem is not the redo log data. All I need to do is ba stg prdlog1-lt prdlog1-lt-copy ba stg prdlog2-lt arch-lt-copy, and ba db devc=lto t=f and check out the tapes. My problem is that I will have run reclaims on NT-Exchange tapes off-site, and this database knows the current off-site tapes are 'pending' with no data on them. So the Exchange tapes need to come out. No problem. But I've also probably got a reclaim running on Windows backups (usually trigger at 35%) -- and these take forever to run. 30% of 492 GB is still a respectable number. It's also about the point the tapes go 'stagnant', which is to say the rest of the data on the bloody tape will never expire, so I've got to do the reclaim. And this process needs to be nuked, and the partial tape(s) shipped off as well. My checkout is automated -- q vol stg=*copy acce=readw,reado st=fil,ful, shove the result into a perl script which does the checkout to the I/O port and updates the status to offsite as well as finding the most recent database backup in the volume history and checks it out as well. Maybe if I only run the reclaims for the INCR-LT-COPY between midnight and 7 AM (my copy pool for all backups, Windows, linux, and AIX). My head hurts. Tom -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Steven Harris Sent: Thursday, January 05, 2006 9:05 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: Running tapes off-site multiple times in a day? If its mostly the SAP data that you are interested in... Here are a few off-the-wall suggestions Suggestion 1. The SAP TDP can back up to two TSM Servers at once. Set up a second server and run its housekeeping 8 or 12 hours opposed to the first one. Suggestion 2. Use simultaneous write so your copypools are ready as soon as the backup is done. Suggestion 3. Backup your storagepool to two copypools. Sync one for the first offsite run and the the second for the other offsite run. As I say, off-the-wall (well 1 and 3 anyway) but maybe there's something you can use there. Regards Steve Steve Harris AIX and TSM Admin Queensland Australia -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Nicholas Cassimatis Sent: Friday, 6 January 2006 3:14 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] Running tapes off-site multiple times in a day? How well segregated is your data? I'd advise having the SAP data and logs in their own pools. Since this type of data tends to expire in groups, do you need to reclaim the tapes in these pools at all? The hardest part, with a system like this, is getting the tapes idle to be able to run backup stg against. You may want to look at having the data written to both the primary and copypools at the same time, or doing something to idle the tapes you need to copy (mark them ReadOnly to force new tapes to be used, something like that). How busy your system is makes this harder. Nick Cassimatis - Forwarded by Nicholas Cassimatis/Raleigh/IBM on 01/05/2006 12:04 PM - ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU wrote on 01/05/2006 11:31:11 AM: We'll be adding 6 more drives in a few weeks -- to a total of 16. I have 6 off-site copy pools, one of which never goes through reclaim as it's a 21-day archive pool. I'm most concerned about the process for wrapping up an in-process reclaim and getting the tape out of the drive by the time the afternoon database backup finishes (I do full backups to LTO -- currently runs about 20 minutes). I figure I'll need to open a reclaim window in the 2 AM to 6 AM time frame in order to get everything done. And I'd REALLY like to spend the money and put in the telecom circuit instead. Tom -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of John Monahan Sent: Thursday, January 05, 2006 11:10 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: Running tapes off-site multiple times in a day? I'm thinking you're going to need to add tape drives before thinking of doing something like this. You are going to shorten your current daily maintenance window because you have to squeeze in a portion of it to do a second run. Could be done if you can shorten your current window enough, but I would think that would mean adding tape drives. Getting your reclaims done is going to be a problem as well with only single threaded reclamation processes - if you currently run until 8pm sometimes and you are going to need to shorten that - will be tough unless you break your data up into more pools. Sounds awfully ugly to me. I think the correct answer is yes it is technically possible, but do we REALLY need to do it this way. __ John Monahan Senior Consultant Enterprise Solutions Computech Resources, Inc. Office: 952-833-0930 ext 109
Re: Running tapes off-site multiple times in a day?
There's cheap and then there's cost-effective. For what the telco wanted for a T3 to our hangar (our off-site storage facility) we could pay wages and full benefits to TWO clerical types to do nothing but snag and shuttle tapes. I don't remember the exact number, but I seem to recall that the monthly fee ran to around $90,000 per year. It would be cheaper if we crossed a state line, so that federal tariffs applied. Tom -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Nicholas Cassimatis Sent: Thursday, January 05, 2006 11:05 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: Running tapes off-site multiple times in a day? As a coworker once had posted on his door (Hey John, if you're out there!): There are three kinds of work: Reliable Fast Cheap You may pick two. And it looks like you're in the unfortunate position where the powers that be are asking for all three. Backups are just like insurance - you may be at the point where you have to get them to evaluate what point on the cost/protection scale they want/need to be. A nice Compliance rule (SOX, HIPPA, etc) can often help you out there. Nick Cassimatis - Forwarded by Nicholas Cassimatis/Raleigh/IBM on 01/05/2006 11:00 PM - ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU wrote on 01/05/2006 10:46:46 PM: A single T1 won't handle the load. We average about 22 GB of redo log per day, and I've seen peaks over 45 GB. Multiple T1s gets interesting in terms of making them look like a single fat pipe to the application -- and to handle our peak environment, the T1 count actually gets to a price-match with a T3. And the company isn't willing to spring the monthly cost for multiple Ts (there was some consternation at the cost of a single T1, and a lot of consternation when I said it wouldn't be enough). Oh -- and these volumes are for the *single* copy of the redo logs. Tom
Re: Primary disk pool volume limit
Maybe I should have pointed out that this is not a theoretical question. Are 1800 volumes too many? We have been experiencing TCP connection failures since reaching this number. The reason for the large number of volumes is both sad and tragic and the situation will be corrected in the next few weeks. Until the new VTL's are on-line I am stuck and TSM requires several restarts to make it though the night. The number of volumes may not be the problem, but it is the last thing done between the time it was working and when it went bad. And IBM is working on the problem. Andy Huebner -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Paul Zarnowski Sent: Thursday, January 05, 2006 8:37 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] Primary disk pool volume limit One thing to keep in mind: If you ever have to restore your TSM database from backup, you will need to audit all of your [random access] disk storage pool volumes. The more you have, the longer this will take. At 12:16 AM 1/5/2006, Andy Huebner wrote: Is there or what is the practical limit on the number of disk pool volumes and the total size of a disk pool? I am running 5.2.2.4 on AIX 5.1. -- Paul ZarnowskiPh: 607-255-4757 Manager, Storage Systems Fx: 607-255-8521 719 Rhodes Hall, Ithaca, NY 14853-3801Em: [EMAIL PROTECTED] This e-mail (including any attachments) is confidential and may be legally privileged. If you are not an intended recipient or an authorized representative of an intended recipient, you are prohibited from using, copying or distributing the information in this e-mail or its attachments. If you have received this e-mail in error, please notify the sender immediately by return e-mail and delete all copies of this message and any attachments. Thank you.