Re: Please tell me about your LTO3 / LTO4 performance
What model are your SVC nodes? 4F2, 8F2, 8G4? How many nodes in your cluster? Are you directing the vdisks for your TSM server across all I/O groups, or just a single? I'd be interested in more details of your config. -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Ochs, Duane Sent: Thursday, July 03, 2008 9:45 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: Please tell me about your LTO3 / LTO4 performance We have three TSM servers using diskpools and DBs behind an SVC. Each has approximately 2.5 tb of space on MDGs of 48 disks or more on either DS4500s or a DS8300. There is a very significant performance difference between that and a fourth site that has a dedicated 4200 configured with 500gb sata drives. In the grand scheme of things I don't feel that the SVC disks are necessary to achieve the performance we needed when we were writing across a 1gbit lan/wan or to the LTO2 drives we had. Recently we migrated to LTO4 and our diskpool migrations are running much faster, which is probably directly related to the SVC and large MDGs being able to keep the data flowing to the tape drives. If you are looking for specific info, let me know. Duane Information Systems - Unix,Storage and Retention Quad/Graphics Inc. Sussex, Wisconsin [EMAIL PROTECTED] www.QG.com -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Orville Lantto Sent: Wednesday, July 02, 2008 8:51 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: Please tell me about your LTO3 / LTO4 performance Any more thoughts on using TSM through a SVC? I am about to configure such a system and have reservations about putting TSM disk storage pools on SVC LUNs. Orville L. Lantto From: Justin Miller Sent: Wed 7/2/2008 16:19 To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] Please tell me about your LTO3 / LTO4 performance Are you using the RMAN interface for your SAP backups? We are using it here and I'm curious to see how others have things configured when using RMAN. Justin Miller Eric Bourgi [EMAIL PROTECTED] Sent by: ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU 07/02/2008 12:53 AM Please respond to ADSM: Dist Stor Manager To: ADSM-L@VM.MARIST.EDU cc: Subject:Re: [ADSM-L] Please tell me about your LTO3 / LTO4 performance For large client ,and it feasable do not use your LAN , but LANFREE backup , so your master Tsm server as a Library manager . Here is an example of backup (TDP for mysap ) 3 lto3 tape drives as target and 7 multiplexing ( so 21 threads ) The speed goes from 600 GB/Hour to over 1TB/hour, it depend on the client disk load We went from 2GB HBA/switch to 4GB HBA/switch and could not see a significant impact Note that we also use TDP compression ( which is not a real compression but helps ) Parallel sessions : 3 Multiplexed files : 7 BKI1215I: Average transmission rate was 821.396 GB/h (233.641 MB/sec). BKI1227I: Average compression factor was 1.148. BKI0020I: End of program at: Wed Jul 02 03:00:00 2008 . BKI0021I: Elapsed time: 05 h 57 min 01 sec . -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Thach, Kevin G Sent: Tuesday, July 01, 2008 7:17 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: Please tell me about your LTO3 / LTO4 performance There are two 2Gb ISL's going to each switch for a total bandwidth of 4Gb to each edge. Our SAN monitoring tool (EFCM) doesn't show that we're maxing out the ISL's, but I can easily add one to see what happens. I'll also try the alternate pathing ASAP. Thanks for the suggestions! -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Kauffman, Tom Sent: Tuesday, July 01, 2008 12:07 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: Please tell me about your LTO3 / LTO4 performance Two items, then. Alternate pathing may help. Also, what is the available bandwidth of the ISL to the edge switches? For your system, it should be at least 6 Gb; 8 would be marginally better (three paired ports at 2 Gb/port, or two paired ports at 4 Gb/port). -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Thach, Kevin G Sent: Tuesday, July 01, 2008 11:52 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: Please tell me about your LTO3 / LTO4 performance I am set up very similar to you. My TSM LPAR HBAS connect to a director class switch which has an ISL to each of the edge switches that the tape drives themselves connect to (odd drives on one and even on the other like yourself.) Therefore, I have 64 rmt devices at the AIX level for my LTO3 drives, as each tape HBA sees each of the 14 drives. I am not using the alternate pathing. -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Kauffman, Tom Sent: Tuesday, July 01, 2008 11:42 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: Please tell me about your LTO3 / LTO4
Please tell me about your LTO3 / LTO4 performance
Hi all- For quite some time now, I have been trying to track down an elusive bottleneck in my TSM environment relating to disk-to-tape performance. This is a long read, but I would be very greatful for any suggestions. Hopefully some of you folks much smarter than me out there will be able to point me in the right direction. If any other LTO3 or LTO4 users out there could give me some examples of their real-world performance along with a little detail on their config, that would be most helpful as well! My current environment consists of: * TSM server = p570 LPAR w/4 1.9GHz processors and 8GB RAM, (6) 2Gb HBAS (2 for disk and 4 for tape traffic), and a 10Gb Ethernet adapter. * TSM 5.4.1.2 on AIX 5.3 TL6 * 3584 w/14 LTO3 drives at primary site * 3584 w/12 LTO1 drives at DR/hotsite (copypool volumes are written directly to this library via SAN routing) * DB (80GB -- 4GB DBVOL size) residing on IBM DS8300 behind IBM SVC * Log (11GB - single LOGVOL) residing on IBM DS8300 behind IBM SVC * Primary Storage pool in question (2.5TB -- 20GB volume size), DISK device class, residing on IBMDS8300 behind IBM SVC I currently back up about 4.5TB / night, of which ~2TB is written directly to my primary LTO3 tape pool with a simultaneous write to my copypool across town. So, each morning I'm left with about 2.5TB of data to copy and migrate from my disk pool(s) to copypool and onsite tape respectively. My backup stg performance to LTO1 tape (copypool) is about what I would expect. I run 5 threads for this process (5 mount points used), and I consistently average 20-25MB/sec/drive. Fair enough. I don't know of anyone getting a whole lot more than that out of an LTO1 drive. After that is complete, I then migrate that data to my LTO3 tape here onsite. That performance is pretty lousy compared to what I would expect to get out of LTO3. I run 6 migration threads (6 mount points used), and I average around 25MB/sec/drive going to LT03 as well. All SAN links between the TSM server and the LT03 drives are a minimum of 2Gb, so that is my lowest common denominator. I've tried using less threads to see if perhaps I was saturating an HBA rather than the drive. Same speed. I've tried separating my DB and STG pools on different storage subsystems. Same speed. I've opened PMR's with IBM support, and they have poured over all of my TSM server settings / config and found nothing to go on. We've had IBM ATS teams evaluate the situation, and they've never been able to pinpoint a problem. I've tried various tools--tapewrite, nmon, filemon, etc. and I've not found a smoking gun. At this point, my gut is that SVC is the bottleneck, but for those of you familiar with SVC, you know that trying to obtain meaningful performance statistics on the SVC cluster itself is frustrating. I know there are folks out there getting much better performance out of LTO3 drives, so please tell me how you're doing it! Suggestions? Questions? Thank you! -Kevin - This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865)374-4900 or notify us by E-mail at [EMAIL PROTECTED]
Re: Please tell me about your LTO3 / LTO4 performance
I am set up very similar to you. My TSM LPAR HBAS connect to a director class switch which has an ISL to each of the edge switches that the tape drives themselves connect to (odd drives on one and even on the other like yourself.) Therefore, I have 64 rmt devices at the AIX level for my LTO3 drives, as each tape HBA sees each of the 14 drives. I am not using the alternate pathing. -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Kauffman, Tom Sent: Tuesday, July 01, 2008 11:42 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: Please tell me about your LTO3 / LTO4 performance How are your tape drives attached to your TSM HBAs? Presumably by SAN switch, so how do you have the drives zoned? Ideally, every drive should be visible on every fiber and alternate path support should be enabled (chdev -l rmtx -a alt_pathing=yes) (do NOT do for the SMC if you do not have path failover; may not work for LTO3 if you do not have path failover). I have 10 LTO4 and 6 LTO2 drives, and 10 fibers to tape from my TSM LPAR; two SAN switches, with the even-numbered drives in one and the odd-numbered drives in the other. The result is 80 rmt (tape) devices for the LPAR. I know I'm network limited - so I only get a maximum of 110 MB/sec per drive/network interface in my nightly SAP backups. (dedicated Gb networks, one per concurrent backup session - Gigabit Ethernet NICs are cheap!) My off-site copy processes run at LTO2 drive speed (the 'twos are only used for offsite tapes). This is for 4 concurrent sessions over two network interfaces: BKI1215I: Average transmission rate was 762.364 GB/h (216.850 MB/sec). BKI1227I: Average compression factor was 1.000. BKI0020I: End of program at: Mon Jun 30 20:55:08 EDT 2008 . BKI0021I: Elapsed time: 01 h 52 min 00 sec . BKI0024I: Return code is: 0. So I averaged 108 MB/sec over the NIC, and 54 MB/sec to the drive. Tom Kauffman NIBCO, Inc -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Thach, Kevin G Sent: Tuesday, July 01, 2008 10:41 AM To: ADSM-L@VM.MARIST.EDU Subject: Please tell me about your LTO3 / LTO4 performance Hi all- For quite some time now, I have been trying to track down an elusive bottleneck in my TSM environment relating to disk-to-tape performance. This is a long read, but I would be very greatful for any suggestions. Hopefully some of you folks much smarter than me out there will be able to point me in the right direction. If any other LTO3 or LTO4 users out there could give me some examples of their real-world performance along with a little detail on their config, that would be most helpful as well! My current environment consists of: * TSM server = p570 LPAR w/4 1.9GHz processors and 8GB RAM, (6) 2Gb HBAS (2 for disk and 4 for tape traffic), and a 10Gb Ethernet adapter. * TSM 5.4.1.2 on AIX 5.3 TL6 * 3584 w/14 LTO3 drives at primary site * 3584 w/12 LTO1 drives at DR/hotsite (copypool volumes are written directly to this library via SAN routing) * DB (80GB -- 4GB DBVOL size) residing on IBM DS8300 behind IBM SVC * Log (11GB - single LOGVOL) residing on IBM DS8300 behind IBM SVC * Primary Storage pool in question (2.5TB -- 20GB volume size), DISK device class, residing on IBMDS8300 behind IBM SVC I currently back up about 4.5TB / night, of which ~2TB is written directly to my primary LTO3 tape pool with a simultaneous write to my copypool across town. So, each morning I'm left with about 2.5TB of data to copy and migrate from my disk pool(s) to copypool and onsite tape respectively. My backup stg performance to LTO1 tape (copypool) is about what I would expect. I run 5 threads for this process (5 mount points used), and I consistently average 20-25MB/sec/drive. Fair enough. I don't know of anyone getting a whole lot more than that out of an LTO1 drive. After that is complete, I then migrate that data to my LTO3 tape here onsite. That performance is pretty lousy compared to what I would expect to get out of LTO3. I run 6 migration threads (6 mount points used), and I average around 25MB/sec/drive going to LT03 as well. All SAN links between the TSM server and the LT03 drives are a minimum of 2Gb, so that is my lowest common denominator. I've tried using less threads to see if perhaps I was saturating an HBA rather than the drive. Same speed. I've tried separating my DB and STG pools on different storage subsystems. Same speed. I've opened PMR's with IBM support, and they have poured over all of my TSM server settings / config and found nothing to go on. We've had IBM ATS teams evaluate the situation, and they've never been able to pinpoint a problem. I've tried various tools--tapewrite, nmon, filemon, etc. and I've not found a smoking gun. At this point, my gut is that SVC is the bottleneck, but for those of you familiar with SVC, you know that trying to obtain meaningful
Re: Please tell me about your LTO3 / LTO4 performance
There are two 2Gb ISL's going to each switch for a total bandwidth of 4Gb to each edge. Our SAN monitoring tool (EFCM) doesn't show that we're maxing out the ISL's, but I can easily add one to see what happens. I'll also try the alternate pathing ASAP. Thanks for the suggestions! -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Kauffman, Tom Sent: Tuesday, July 01, 2008 12:07 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: Please tell me about your LTO3 / LTO4 performance Two items, then. Alternate pathing may help. Also, what is the available bandwidth of the ISL to the edge switches? For your system, it should be at least 6 Gb; 8 would be marginally better (three paired ports at 2 Gb/port, or two paired ports at 4 Gb/port). -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Thach, Kevin G Sent: Tuesday, July 01, 2008 11:52 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: Please tell me about your LTO3 / LTO4 performance I am set up very similar to you. My TSM LPAR HBAS connect to a director class switch which has an ISL to each of the edge switches that the tape drives themselves connect to (odd drives on one and even on the other like yourself.) Therefore, I have 64 rmt devices at the AIX level for my LTO3 drives, as each tape HBA sees each of the 14 drives. I am not using the alternate pathing. -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Kauffman, Tom Sent: Tuesday, July 01, 2008 11:42 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: Please tell me about your LTO3 / LTO4 performance How are your tape drives attached to your TSM HBAs? Presumably by SAN switch, so how do you have the drives zoned? Ideally, every drive should be visible on every fiber and alternate path support should be enabled (chdev -l rmtx -a alt_pathing=yes) (do NOT do for the SMC if you do not have path failover; may not work for LTO3 if you do not have path failover). I have 10 LTO4 and 6 LTO2 drives, and 10 fibers to tape from my TSM LPAR; two SAN switches, with the even-numbered drives in one and the odd-numbered drives in the other. The result is 80 rmt (tape) devices for the LPAR. I know I'm network limited - so I only get a maximum of 110 MB/sec per drive/network interface in my nightly SAP backups. (dedicated Gb networks, one per concurrent backup session - Gigabit Ethernet NICs are cheap!) My off-site copy processes run at LTO2 drive speed (the 'twos are only used for offsite tapes). This is for 4 concurrent sessions over two network interfaces: BKI1215I: Average transmission rate was 762.364 GB/h (216.850 MB/sec). BKI1227I: Average compression factor was 1.000. BKI0020I: End of program at: Mon Jun 30 20:55:08 EDT 2008 . BKI0021I: Elapsed time: 01 h 52 min 00 sec . BKI0024I: Return code is: 0. So I averaged 108 MB/sec over the NIC, and 54 MB/sec to the drive. Tom Kauffman NIBCO, Inc -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Thach, Kevin G Sent: Tuesday, July 01, 2008 10:41 AM To: ADSM-L@VM.MARIST.EDU Subject: Please tell me about your LTO3 / LTO4 performance Hi all- For quite some time now, I have been trying to track down an elusive bottleneck in my TSM environment relating to disk-to-tape performance. This is a long read, but I would be very greatful for any suggestions. Hopefully some of you folks much smarter than me out there will be able to point me in the right direction. If any other LTO3 or LTO4 users out there could give me some examples of their real-world performance along with a little detail on their config, that would be most helpful as well! My current environment consists of: * TSM server = p570 LPAR w/4 1.9GHz processors and 8GB RAM, (6) 2Gb HBAS (2 for disk and 4 for tape traffic), and a 10Gb Ethernet adapter. * TSM 5.4.1.2 on AIX 5.3 TL6 * 3584 w/14 LTO3 drives at primary site * 3584 w/12 LTO1 drives at DR/hotsite (copypool volumes are written directly to this library via SAN routing) * DB (80GB -- 4GB DBVOL size) residing on IBM DS8300 behind IBM SVC * Log (11GB - single LOGVOL) residing on IBM DS8300 behind IBM SVC * Primary Storage pool in question (2.5TB -- 20GB volume size), DISK device class, residing on IBMDS8300 behind IBM SVC I currently back up about 4.5TB / night, of which ~2TB is written directly to my primary LTO3 tape pool with a simultaneous write to my copypool across town. So, each morning I'm left with about 2.5TB of data to copy and migrate from my disk pool(s) to copypool and onsite tape respectively. My backup stg performance to LTO1 tape (copypool) is about what I would expect. I run 5 threads for this process (5 mount points used), and I consistently average 20-25MB/sec/drive. Fair enough. I don't know of anyone getting a whole lot more than that out of an LTO1 drive. After that is complete, I
Question about backup log file(s) verbosity
Hello, I have a question regarding verbosity levels of the backup log file. For our Windows clients, we use the default action of Incremental for our backup schedules, and so everything gets logged to the dsmsched.log file. There is a date / timestamp on each line. For our Unix clients, we use a command action which calls a script that executes a few things along with a dsmc incr -verbose, and redirects the output to a unique log file each day. There is not a date / timestamp on each line using this method. My question is this... Is there another option that can be passed to the dsmc incr command that will log the date / timestamp on each line? Our internal audit department is wanting to set up some monitoring processes to know exactly what time particular files are examined for backup. We can do it on our Windows clients, but not on our Unix clients under their current setup. Thanks for any assistance, Kevin - This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865)374-4900 or notify us by E-mail at [EMAIL PROTECTED]
Re: Select statement for space occupied by type of file?
Thanks very much guys! -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of William Boyer Sent: Friday, October 19, 2007 9:13 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: Select statement for space occupied by type of file? Maybe the easiest is to either from the original server or from another Windows box with the TSM client, start the client CLI and run a QUERY BACKUP for *.PST files with -SUBDIR=YES. If you want all, the include the -INA flag to get the inactive version(s), too. It's quick and easy. Pipe the output to a file and you might be able to import it in to Excel. Sure beats trying to query the BACKUPS table! :-) Bill Boyer I haven't lost my mind...it's backed up on tape somewhere! - ?? -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Thach, Kevin G Sent: Friday, October 19, 2007 8:20 AM To: ADSM-L@VM.MARIST.EDU Subject: Select statement for space occupied by type of file? Hello- I'm trying to determine the amount of space occupied by .pst files for a certain node. I cannot figure out a good way to gather this information. The backups table doesn't have size information, and the occupancy table doesn't have file information. Can anyone offer up a select statement that would work? Thanks so much! - This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865)374-4900 or notify us by E-mail at [EMAIL PROTECTED]
Select statement for space occupied by type of file?
Hello- I'm trying to determine the amount of space occupied by .pst files for a certain node. I cannot figure out a good way to gather this information. The backups table doesn't have size information, and the occupancy table doesn't have file information. Can anyone offer up a select statement that would work? Thanks so much! - This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865)374-4900 or notify us by E-mail at [EMAIL PROTECTED]
Somewhat off-topic: TSMManager software users?
I've recently completed an evaluation of the TSMManager product, and am wanting to purchase it. However, I can't get the Tivoli Associates reseller to call me back. I literally can't give my money away!! Can someone that is using this product provide me with a contact for support, or any other live person that will be able to get me in touch with the right people? - This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865)374-4900 or notify us by E-mail at [EMAIL PROTECTED]
Re: Somewhat off-topic: TSMManager software users?
Thanks, I appreciate that. I hope this isn't an indicator of what it is like when you need tech support. -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Zoltan Forray/AC/VCU Sent: Friday, December 08, 2006 3:25 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: Somewhat off-topic: TSMManager software users? I am a beta tester for the product owner/developer. I will send them an email with this message and your email. BTW, I know what you are going through. Their representatives in the US are pretty bad. We went through grief trying to get a bill straight (and getting the license key) from them. Zoltan Forray Virginia Commonwealth University Office of Technology Services University Computing Center e-mail: [EMAIL PROTECTED] voice: 804-828-4807 Thach, Kevin G [EMAIL PROTECTED] Sent by: ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU 12/08/2006 03:20 PM Please respond to ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU To ADSM-L@VM.MARIST.EDU cc Subject [ADSM-L] Somewhat off-topic: TSMManager software users? I've recently completed an evaluation of the TSMManager product, and am wanting to purchase it. However, I can't get the Tivoli Associates reseller to call me back. I literally can't give my money away!! Can someone that is using this product provide me with a contact for support, or any other live person that will be able to get me in touch with the right people? - This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865)374-4900 or notify us by E-mail at [EMAIL PROTECTED]
Re: Somewhat off-topic: TSMManager software users?
Thanks. I've already been down that road. They haven't responded to emails or voice mails. -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Lawrence Clark Sent: Friday, December 08, 2006 3:45 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: Somewhat off-topic: TSMManager software users? www.tsmmanager.com; info@ [EMAIL PROTECTED] 12/08/06 3:20 PM I've recently completed an evaluation of the TSMManager product, and am wanting to purchase it. However, I can't get the Tivoli Associates reseller to call me back. I literally can't give my money away!! Can someone that is using this product provide me with a contact for support, or any other live person that will be able to get me in touch with the right people? - This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865)374-4900 or notify us by E-mail at [EMAIL PROTECTED] The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain information that is confidential, privileged, and/or otherwise exempt from disclosure under applicable law. If this electronic message is from an attorney or someone in the Legal Department, it may also contain confidential attorney-client communications which may be privileged and protected from disclosure. If you are not the intended recipient, be advised that you have received this message in error and that any use, dissemination, forwarding, printing, or copying is strictly prohibited. Please notify the New York State Thruway Authority immediately by either responding to this e-mail or calling (518) 436-2700, and destroy all copies of this message and any attachments.
Re: TSM on P5 LPAR
I run my TSM server on a p570 LPAR. I migrated it over from a standalone 6H1. It works great, and runs like a scalded dog. -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Paul van Dongen Sent: Wednesday, August 16, 2006 7:42 AM To: ADSM-L@VM.MARIST.EDU Subject: TSM on P5 LPAR Hello all, Is anybody using TSM server installed on a P5 LPAR with AIX? The question is: Are there any differences between installations on LPAR and single-image (non-partitioned) machines? Environment soulhd be TSM 5.3.3 on AIX 5.3. Thanks in advance, Paul van Dongen -- Outgoing mail has been checked by TrendMicro InterScan VirusWall - This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865)374-4900 or notify us by E-mail at [EMAIL PROTECTED]
Re: Stgpool backup behavior change in 5.3.x?
I first noticed this behavior after migrating to 5.2.6.2, and I did open a PMR with support. After several weeks of traces and more phone calls than you can count, this is their official response... Hi Kevin, I have finished my review and, per our phone conversation, I believe I know exactly what is causing this performance problem. The fix for APAR IC45931 was introduced in the 5.2.6.2 level of TSM Server code (which you are running) and part of this fix is to prevent our backup optimization processing from invalidly skipping files on a volume which have not been backed up. This is causing a performance problem in your environment since we have to re-examine alot of the same files during each backup stgpool run. This examination is done under a thread which is not registered as a process which is why you see what appears to be a hang after you issue the backup command. The extent of the performance degradation is dependent on how many volumes are in the storage pool and how many do not have current optimization entries. In your case, I would say 80% of the volumes being analyzed are not current. There is no true workaround for this but if any of these volumes are written to again (forcing backup stgpool to process the volume), it will force TSM to update the optimization. What I need to do is 1) find out why the last volume entry that was written was not updated for optimization purposes and 2) find out if we can somehow update the optimization once we determine that we are out of sync. I will continue to pursue these 2 points and will be discussing with our development team. There is potential for an APAR in this condition but I want to discuss with our development team before moving any further. I will keep you posted on our findings. Let me know if you have any questions. -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Ben Bullock Sent: Wednesday, December 28, 2005 12:47 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: Stgpool backup behavior change in 5.3.x? We too have seen this issue and I agree, it's annoying. It behaves kinda like you put the wait=yes option on the command so that it will not return the prompt until the command completes. One of our foreign sites opened up a case with Tivoli about it, but I have not heard what the outcome is. I will let you know if they find anything out. Since we are still at 5.2, I haven't had to battle that problem yet at my location. Ben -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Allen S. Rout Sent: Wednesday, December 28, 2005 9:56 AM To: ADSM-L@VM.MARIST.EDU Subject: Stgpool backup behavior change in 5.3.x? I recently upgraded from 5.2.mumble to 5.3.2.1; In the intervening weeks, I've noticed a behavior change which I don't see addressed in the change notes. I'm hoping for corroboration, and perhaps a comment from one of our onlooking developers. In 5.2, my user interaction looked like this: 1) Run BACKUP STGPOOL primpool copypool 2) New process appears in process listing 3) prompt returns 4) process looks for uncopied data, has status numbers of 0 files, 0 bytes until it finds some. It might never find any, in which case it reports success, with 0 files, 0 bytes as additional information. In 5.3, the following happens 1) Run BACKUP STGPOOL primpool copypool 2) prompt does not return 3) a process starts, not reflected in the process listing, and looks for uncopied data. 4) if the process finds uncopied data, THEN: 4a) The prompt returns 4b) a process appears in the process listing, life goes on as before. 5) if the process does not find uncopied data THEN: 5a) The prompt returns with a ANR2111W, 'no data to process'. 5b) no process appears I Can tell that 3) happens, because if I try to run another backup stgpool, I get the conventional 'backup already in progress' message. But it's not reflected in the process table. I have several servers which take 8hrs to run a good stgpool backup, even if they do no new copying work. That's a long time to have something going on behind the scenes. This block-the-command-flow behavior is really disruptive; the process once started is declared as 'background', and WAIT still defaults to no. But this is definitely a foreground process. So: Do you-all share my impression here, and any IBMers want to comment? - Allen S. Rout
Strange backup stg behavior
I recently upgraded to version 5.2.6.2 of TSM running on an AIX server (5.2ML5), and I've noticed some weird behavior. I can't say for sure whether or not it began happening immediately after the upgrade, because I just noticed it a few days ago, but I have verified the behavior did not exist at my previous version of 5.1.7.3. Basically what I'm seeing is that when issuing the following command: tsm backup stg nocotape copypool maxproc=4 (nocotape is a tape pool, as is copypool) It just sits there for about 45 minutes before the actual processes get started. Then things run as normal until all the data is backed up to the copypool. Then, each process just sits there and does nothing for 1-2 hours before finally ending successfully. Things only behave this way for a tape to tape copy. Backing up a disk pool to copypool works just fine. Interestingly enough, I see the delay when issuing the backup stg command with preview=yes as well. There aren't any issues with available mount points, scratch tapes, or any other resource I can think of, so I'm hoping this is a known issue? Anyone have any idea what is going on? Thanks!!
Re: Tape monitoring? was: Re: Platform change to Windows?
Wanda, What utility are you using to monitor the %busy for the tape scsi bus on AIX? That would be very helpful to me to be able to see that information. Thanks! -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Prather, Wanda Sent: Monday, November 14, 2005 12:52 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: Tape monitoring? was: Re: Platform change to Windows? Allen, I don't actually have anything I LIKE on any platform except the mainframe! On AIX, at least I can see %busy on the SCSI bus that has tape - I can tell something is going on, or not. And on Windows I can get %idle time on disk, but NOTHING on tape. Any suggestions? Wanda -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Allen S. Rout Sent: Friday, November 11, 2005 11:40 PM To: ADSM-L@VM.MARIST.EDU Subject: Tape monitoring? was: Re: Platform change to Windows? == On Wed, 9 Nov 2005 16:38:47 -0500, Prather, Wanda [EMAIL PROTECTED] said: I've talked with people from Tivoli and from Microsoft and from SHARE; there is NO instrumentation in Windows that will let you monitor what is going on over a non-disk I/O bus. You hook tape to a Windows host, and it's a mystery what happens. When I'm doing tape-to-tape operations, I can't tell WHERE the bottleneck is. I don't have a really good notion of how much data you can push through a Windows box, given you have multiple HBA's/SCSI connections, but there is only 1 or 2 internal buses. I can't tell how much memory is being used for the TAPE I/O buffers, or if that is an issue. Wanda, could I elicit a short summary of how you like to monitor tape bandwidth? What tools do you like, c? - Allen S. Rout
5.1.10.2 to 5.2.6.2 upgrade path question
I'm currently running 5.1.10.2 on AIX 5.2 ML5. I believe the correct upgrade path is 5.2.0.0, to 5.2.6.0, and finally to 5.2.6.2 However, I've seen several posts that reference the need of an interim level of 5.2.2.0. Is that really the case? Am I forced to go to 5.2.2.0 before going to 5.2.6.0? If anyone could provide clarification on this, I would be very appreciative!! Thanks
Using multiple Ethernet adapters on AIX TSM server?
I am currently using one GigE adapter on my TSM server, and I have so much traffic coming into it during the night that I need to add another. The new adatper will have a different IP, but will be on the same subnet as the first one. I am not sure of the right / best way to configure it. It's my understanding that provided this second adapter has its own IP address, that I can specify that address in the dsm.opt file on certain clients that I want to come in over that adapter. Correct? From an AIX standpoint, do I set the default gateway for the new adapter to be the same as the other one? Or do I make the first adapter the default gateway for the second one? If anyone can offer some insight, I'd very much appreciate it. A screenshot of someone's routing table where this is currently set up would be fantastic. Thanks very much! This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865)374-4900 or notify us by E-mail at [EMAIL PROTECTED]
Re: AIX Restore
We have a test database server that we frequently have to refresh by performing a virtualnode restore of the production database onto it. Occasionally, we perform the same restore again after some application testing has been performed to return to the baseline. Even when doing the EXACT same restore (exact same data, exact same tapes, exact same client, and no reclamation has been run), sometimes it multi-threads, sometimes it doesn't. To me, that's a bug. -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Richard Sims Sent: Monday, February 14, 2005 8:41 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: AIX Restore On Feb 14, 2005, at 4:03 PM, Thach, Kevin G wrote: We see the exact same behavior when attempting to perform multi-threaded restores using the resourceutilization parameter and the maxnummp = x. As you say, some of the time it works as expected, sometimes it does not. ... What I think is going on in all this... The amount of parallelism you can achieve in such a restoral is limited by practical realities. Various IBM site Technotes supplement the client manual in providing further insights into NQR restorals. For example, recent Technote 1067365 says that the server starts sending data to the client as soon as it comes up with some candidates, and resumes plowing through the database. We all know how painful it is to perform a Select on the Contents table, particularly in large TSM servers housing hundreds of millions of files. Even running at non-SQL, native database search speed, it's going to take time for the server to gather up all the candidates - worse so as the restoral request is more complex. (Some options cause fall-over to Classic Restore on the client, which can make things even slower, as clients are usually less powerful than a server system.) This is all to say that the entire list of candidate files may not be available as the restoral starts - and we would be complaining about restoral times if the scheme was that the full list be constituted before the restoral process begins. The only answer here may be dramatically better and far more modern database technology, to better deal with the enormous object populations of contemporary data processing - particularly as regulatory requirements call for retaining more data than ever. Richard Sims This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865)374-4900 or notify us by E-mail at [EMAIL PROTECTED]
Re: AIX Restore
We see the exact same behavior when attempting to perform multi-threaded restores using the resourceutilization parameter and the maxnummp = x. As you say, some of the time it works as expected, sometimes it does not. I can guarantee that my restores have not been flowing from a disk pool. All the data was coming from tape(s). It just flat out doesn't work sometimes. We see the behavior on Windows clients as well. If you find a cause, post your findings to the group please! -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Wheelock, Michael D Sent: Monday, February 14, 2005 1:28 PM To: ADSM-L@VM.MARIST.EDU Subject: AIX Restore Hi, I have a restore that we do occasionally to create a test environment for one of our applications. The storage pool for this restore is a tape based storage pool with collocation set to no. Consequently, there are lots of tape mounts done to effect this restore. To alleviate this at least in part, we have set the resourceutilization parameter on the client and the maximum mount points allowed to 6. This should theoretically allow the client to open six sessions and go about its business. In reality, it is about 50/50. Half of the time it will open multiple streams, half the time it will not. There are always free tape drives on the TSM server. There are always two filesystems being restored over multiple (10) tapes. Here are the various version info: TSM Server: AIX 5.2 ML4 TSM 5.3.0.0 (though the same was seen on 5.2.3.4) Client: AIX 5.2 ML4 TSM Client 5.2 When we opened a support call, the only answer provided was that in the cases where we saw multiple streams, the data must have been flowing from a disk storage pool. I accept that, but I believe that I would never see these process (sessions) go into mediaw status (fyi, we currently only have disk class disk storage pools ahead of these tape ones...no file class storage pools). TSM should know where the data is (ie. On multiple tapes) and allow the client to open the multiple streams to increase the throughput. Any ideas why I am seeing what I am seeing? Michael Wheelock Integris Health ** This e-mail may contain identifiable health information that is subject to protection under state and federal law. This information is intended to be for the use of the individual named above. If you are not the intended recipient, be aware that any disclosure, copying, distribution or use of the contents of this information is prohibited and may be punishable by law. If you have received this electronic transmission in error, please notify us immediately by electronic mail (reply). This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865)374-4900 or notify us by E-mail at [EMAIL PROTECTED]
Upgrade Path suggestions? AIX 5.1 ML5 (32-bit), and TSM 5.1.7.3 ---- AIX 5.2 ML4 and TSM 5.X.X.X?
We are moving our TSM server to a new p570, which requires a minimum OS level of AIX 5.2 ML4. I'd like to upgrade just the OS at first without having to upgrade the TSM version, but I've read a few posts on here that TSM 5.1 isn't supported on AIX 5.2. Is that accurate? I've looked for clarification in the Tivoli Quick Start guides, but can't find it. Also, can anyone recommend a stable version of TSM 5.2.X.X that I should consider moving to? It looks as if 5.2.3.3 is the latest, but history has proven that the latest version of TSM isn't always stable. If TSM 5.1 is indeed NOT supported on AIX 5.2, then my plan is to go ahead and upgrade to TSM 5.2.X.X, and then upgrade AIX to 5.2 ML4. If TSM 5.1 is supported, then I'm just going to upgrade the OS for now and go ahead and switch servers. Then, I'll upgrade TSM later once I know I'm stable on the new hardware platform. Any suggestions? Thanks!
Re: Upgrade Path suggestions? AIX 5.1 ML5 (32-bit), and TSM 5.1.7.3 ---- AIX 5.2 ML4 and TSM 5.X.X.
What ever version of TSM you upgrade to was the latest version at the time it came out! That's true, but I like for other people to be the guinea pigs first before I take the plunge. =) -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of David E Ehresman Sent: Thursday, October 14, 2004 11:30 AM To: [EMAIL PROTECTED] Subject: Re: Upgrade Path suggestions? AIX 5.1 ML5 (32-bit), and TSM 5.1.7.3 AIX 5.2 ML4 and TSM 5.X.X. It looks as if 5.2.3.3 is the latest, but history has proven that the latest version of TSM isn't always stable. What ever version of TSM you upgrade to was the latest version at the time it came out! I'm running TSM 5.2.3.1 on AIX 5.1 64 bit. Will upgrade to 5.2.3.4 when it comes out at the end of the month. David
Re: D2D on AIX
Could someone please email me the presentation as well? Or send me the link? I just spent 20 minutes on IBM's website and couldn't find it. Thanks! -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Robert HECKO Sent: Wednesday, September 22, 2004 4:14 AM To: [EMAIL PROTECTED] Subject: Re: D2D on AIX Hello Can you send this presentation also to me ? thank you. best regards Robert Hecko - Original Message - From: Johnson, Milton [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Monday, September 20, 2004 7:57 PM Subject: Re: D2D on AIX It depends upon how you configure things. For dynamic allocation of volumes, then yes you are limited to the size of the file system that you mount on that mount point. However if you define the stgpool volumes explicitly using the DEFINE VOLUME command, you can place the volumes across as many file systems as you want. I will email you a PDF presentation IBM has on Disk Only backups. H. Milton Johnson -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Eliza Lau Sent: Monday, September 20, 2004 12:11 PM To: [EMAIL PROTECTED] Subject: D2D on AIX Our 3494 with 3590K tapes in 3 frames is getting full. Instead of adding another frame or upgrading to 3590H or 3592 tapes we are looking into setting up a bunch of cheap ATA disks as primary storage. The FILE devclass defines a directory as its destination and JFS2 has a max file system size of 1TB. Does it mean the largest stgpool I can define is 1TB? My Exchange stgpool alone has 8TB of data. Do I have to split it up into 8 pieces? server: TSM 5.2.2.5 on AIX 5.2 database 90GB at 70% Total backup data - 22TB Eliza Lau Virginia Tech Computing Center [EMAIL PROTECTED]
Off-Topic: Question regarding IBM vs. EMC storage
My organization currently has three IBM ESS's in place with about 37TB of disk total. For storage and midrange servers, we are almost exclusively an IBM shop. We are evaluating purchasing a large amount of EMC storage, and from everything I can tell, and the customer references we have talked to, they really seem to have their act together. I know there are numerous people on this forum using EMC storage, and I'd appreciate it if a few of you wouldn't mind giving me your opinion of their products and customer service. Anyone having experience with both vendors would really be helpful. Thank you!
Sizing for a virtual tape library
Greetings- We are looking at purchasing an EMC CDL (virtual tape library), and I'm trying to figure out exactly how much disk I'm going to need to meet my requirements. select sum(physical_mb) from occupancy where stgpool_name='tapepool' Gives me ~62TB. Is that number the compressed value, or the actual value? In other words, assuming I do no compression with the new setup, would I be able to get by with ~62TB of disk? Or would I need more? I've read that compression is transparent to TSM since I'm doing compression on my tape drives, so that number should represent what was sent to the drives, correct? It should therefore be the actual size of the data before compression, right? I did a search and found some past threads about this, but they confused me even more! =) If someone could set me straight, I'd appreciate it. Thanks, Kevin
Infrastructure design questions -- I need input please
My organization is developing a DR hotsite at one of our other facilities across town, and we are considering making some radical changes to our TSM environment. I know there are several folks on this list that are heavy into TSM design and I could use all the input I can get. Our current environment consists of the following: * TSM server running 5.1.7.3 on AIX. The server is a 6-processor 6H1 w/ 8GB RAM and four 2Gb HBAs. * Approximately 350 clients, and backup 1.5 TB nightly * We use a SAN-attached 3584 with 12 LTO-1 tape drives. 60-day retention policy for everything, so we are maintaining ~90 TB in our local and offsite (copypool) tape pools. * Disk storage pools, DB, Log, are all on SAN-attached IBM Shark disk Our objective is to take advantage of the hotsite not only to improve our DR methods, but to improve TSM restore times. This is what we're considering: * Purchasing approximately 120-140 TB worth of SATA disk, which will live at our current site. All backup data will be retained on disk which should improve restore performance. * Move the tape library to the hotsite, and install a second TSM server there as well. We would no longer create two tape copies of our data, but we would create a single tape copy across town. * The two sites will be connected by dark fiber, so the speed at which we can deliver the data to the 3584 should not be a problem. Is anyone doing something similar to this? Are there any major flaws that I'm not considering? Any advice and input is appreciated. Also, I realize I need to go back and brush up on my TSM manuals, but since I don't run a two-TSM server environment, I have forgotten exactly how that will work in the kind of situation I describe. Would I only use the secondary server in the event of a disaster on the primary? Or would the secondary server at the hotsite manage the library? Etc? If someone can point me in the right direction on that aspect, I'd appreciate it. Thanks in advance, Kevin
Re: Infrastructure design questions -- I need input please
I hadn't thought of server-to-server communications slowing me down. Good point! Thanks to everyone for their input so far! -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Prather, Wanda Sent: Wednesday, July 28, 2004 10:29 AM To: [EMAIL PROTECTED] Subject: Re: Infrastructure design questions -- I need input please I would recommend using the second server only in the event of a disaster. Since you are connected by fibre, the primary server can send the data directly to the tape drives in the library at fibre speeds. You don't want to try and make the 2 servers talk to each other via server-to-server communications, 'cause that will just slow you down to TCP/IP speeds. -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Thach, Kevin G Sent: Wednesday, July 28, 2004 9:39 AM To: [EMAIL PROTECTED] Subject: Infrastructure design questions -- I need input please My organization is developing a DR hotsite at one of our other facilities across town, and we are considering making some radical changes to our TSM environment. I know there are several folks on this list that are heavy into TSM design and I could use all the input I can get. Our current environment consists of the following: * TSM server running 5.1.7.3 on AIX. The server is a 6-processor 6H1 w/ 8GB RAM and four 2Gb HBAs. * Approximately 350 clients, and backup 1.5 TB nightly * We use a SAN-attached 3584 with 12 LTO-1 tape drives. 60-day retention policy for everything, so we are maintaining ~90 TB in our local and offsite (copypool) tape pools. * Disk storage pools, DB, Log, are all on SAN-attached IBM Shark disk Our objective is to take advantage of the hotsite not only to improve our DR methods, but to improve TSM restore times. This is what we're considering: * Purchasing approximately 120-140 TB worth of SATA disk, which will live at our current site. All backup data will be retained on disk which should improve restore performance. * Move the tape library to the hotsite, and install a second TSM server there as well. We would no longer create two tape copies of our data, but we would create a single tape copy across town. * The two sites will be connected by dark fiber, so the speed at which we can deliver the data to the 3584 should not be a problem. Is anyone doing something similar to this? Are there any major flaws that I'm not considering? Any advice and input is appreciated. Also, I realize I need to go back and brush up on my TSM manuals, but since I don't run a two-TSM server environment, I have forgotten exactly how that will work in the kind of situation I describe. Would I only use the secondary server in the event of a disaster on the primary? Or would the secondary server at the hotsite manage the library? Etc? If someone can point me in the right direction on that aspect, I'd appreciate it. Thanks in advance, Kevin
Re: raw partitions
If possible, I would be interested in obtaining a copy of the pdf document you refer to. Thanks! -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Stef Coene Sent: Wednesday, June 30, 2004 12:52 PM To: [EMAIL PROTECTED] Subject: Re: raw partitions On Tuesday 29 June 2004 20:33, [EMAIL PROTECTED] wrote: == In article [EMAIL PROTECTED], Joni Moyer [EMAIL PROTECTED] writes: Hello all! I was reading the performance tuning guide and it states that we should use raw partitions for server db, log and disk storage pool volumes for an AIX server and I was just wondering if this is true and what the benefits are of configuring volumes in this manner? Simpler, faster, less space overhead. Euh, yes and no. For AIX and jfs2 file systems, you can enable CIO (in /etc/filesystems: options = rw,cio). If you do so, your file systems are as fast as raw devices. So you have the benefits of a file system and the speed of a raw device. The I/O requests are directly done on the disk, all cache is skipped. I have a pdf file about this setup for oracle and the speed you can get. We once enabled this on a very busy AIX server and the oracle database was very, very fast. As I understand it, if we configure raw logical volumes, the AIX volume group will need to be applied to a raw logical volume, as opposed to a standard UNIX filesytem. For each disk and logical volume, there is a /dev/r* device that you can use. This is the raw device version of the normal /dev/* device. Stef -- [EMAIL PROTECTED]  Using Linux as bandwidth manager    http://www.docum.org/
Query / Select help needed
Hello- I'm trying to determine a query or a select statement that will tell me the total number of files managed by the TSM database for a particular client, and the total amount of tape space occupied for that client. q occ shows me the number of files and space occupied, but it isn't totaled. I need to obtain this information for over 300 clients, so I really don't want to have to add all of them manually. Can anyone help me out? Is there a simple way to obtain the totals, or am I going to have to write a shell script? Thanks! -Kevin
Re: Query / Select help needed
Thank you very much! I think that will give me everything I need. -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Andrew Raibeck Sent: Thursday, May 20, 2004 12:47 PM To: [EMAIL PROTECTED] Subject: Re: Query / Select help needed How about something like this: select stgpool_name, sum(num_files) as Total Files, sum(physical_mb) as Physical MB, sum(logical_mb) as Logical MB from occupancy where node_name='STORMAN' group by stgpool_name (instead of STORMAN put in your node name in UPPER CASE) If you know which storage pools in particular you want info for, and you *don't* want to see other pools, then just add some conditions to the WHERE clause, i.e. where node_name='STORMAN' and stgpool_name='POOL1' and stgpool_name='POOL2' ... or where node_name='STORMAN' and not stgpool_name = 'DISKPOOLNAME' ... Regards, Andy Andy Raibeck IBM Software Group Tivoli Storage Manager Client Development Internal Notes e-mail: Andrew Raibeck/Tucson/[EMAIL PROTECTED] Internet e-mail: [EMAIL PROTECTED] The only dumb question is the one that goes unasked. The command line is your friend. Good enough is the enemy of excellence. ADSM: Dist Stor Manager [EMAIL PROTECTED] wrote on 05/20/2004 08:56:20: Hello- I'm trying to determine a query or a select statement that will tell me the total number of files managed by the TSM database for a particular client, and the total amount of tape space occupied for that client. q occ shows me the number of files and space occupied, but it isn't totaled. I need to obtain this information for over 300 clients, so I really don't want to have to add all of them manually. Can anyone help me out? Is there a simple way to obtain the totals, or am I going to have to write a shell script? Thanks! -Kevin
Re: Exclude on AIX
I could be mistaken, but you should just be able to move the exclude.fs * to the top. That should do it since it reads from the bottom up, and uses the first match it comes to. -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Loon, E.J. van - SPLXM Sent: Tuesday, April 20, 2004 8:26 AM To: [EMAIL PROTECTED] Subject: Exclude on AIX Hi *SM-ers! One of our AIX guys wants to exclude all filespaces and then include specific others. We have tried the following: include.fs /home include.fs /usr exclude.fs * But that doesn't work. I don't know how to accomplish this. Because they want to use our standard way for excluding files (include-exclude file) using the domains statement is not an option. Can someone please help us here? Thank you very much in advance! Kindest regards, Eric van Loon KLM Royal Dutch Airlines ** For information, services and offers, please visit our web site: http://www.klm.com. This e-mail and any attachment may contain confidential and privileged material intended for the addressee only. If you are not the addressee, you are notified that no part of the e-mail or any attachment may be disclosed, copied or distributed, and that any other action related to this e-mail or attachment is strictly prohibited, and may be unlawful. If you have received this e-mail by error, please notify the sender immediately by return e-mail, and delete this message. Koninklijke Luchtvaart Maatschappij NV (KLM), its subsidiaries and/or its employees shall not be liable for the incorrect or incomplete transmission of this e-mail or any attachments, nor responsible for any delay in receipt. **
Question about recovery log
I'm confused about how I should go about changing the configuration of my recovery log. I'm hoping someone can point me in the right direction. I currently have eight, 1GB log volumes, and I'm wanting to replace these with a single 13GB volume. Normally, I would just create and define the new volume using the def dbvol command, and then remove the old volumes, but since there is a 13GB limit on the recovery log, I can't do that. What's the best way for me to do this? Is there any way I can do it with the server up and running? Switch to Normal mode, remove the old volumes, create the new one, etc. I'm assuming that TSM will not allow me to completely get rid of all my log volumes while the server is up (even if in Normal mode), which is what I would have to do in order to add the 13GB one. Do I need to shut down the server, remove the old volumes and define the new one with the dsmfmt -m -log command? I'm running TSM 5.1.7.3 on AIX 5.1 Thanks!
Re: Question about recovery log
That's what I do with my DB, but by defining the new log volume and adding it, I will be over the 13GB limit until I've removed all the old volumes. Will TSM let me do that? I guess I could try it and see. -Original Message- From: Davidson, Becky [mailto:[EMAIL PROTECTED] Sent: Thursday, March 25, 2004 2:50 PM To: [EMAIL PROTECTED] Subject: Re: Question about recovery log Define the new and add it and then delete the old. Don't forget to mirror. -Original Message- From: Thach, Kevin G [mailto:[EMAIL PROTECTED] Sent: Thursday, March 25, 2004 1:42 PM To: [EMAIL PROTECTED] Subject: Question about recovery log I'm confused about how I should go about changing the configuration of my recovery log. I'm hoping someone can point me in the right direction. I currently have eight, 1GB log volumes, and I'm wanting to replace these with a single 13GB volume. Normally, I would just create and define the new volume using the def dbvol command, and then remove the old volumes, but since there is a 13GB limit on the recovery log, I can't do that. What's the best way for me to do this? Is there any way I can do it with the server up and running? Switch to Normal mode, remove the old volumes, create the new one, etc. I'm assuming that TSM will not allow me to completely get rid of all my log volumes while the server is up (even if in Normal mode), which is what I would have to do in order to add the 13GB one. Do I need to shut down the server, remove the old volumes and define the new one with the dsmfmt -m -log command? I'm running TSM 5.1.7.3 on AIX 5.1 Thanks!
Re: Question about recovery log
It's not a requirement, I am just acting on IBM's recommendation to put the log on a single volume for performance reasons. 2 would still be better than the 8 I have now. Thanks! -Original Message- From: Prather, Wanda [mailto:[EMAIL PROTECTED] Sent: Thursday, March 25, 2004 3:01 PM To: [EMAIL PROTECTED] Subject: Re: Question about recovery log I believe you are correct. But why do you have a requirement to have only 1 log file? The log is written sequentially, so I don't see that it would hurt you to have two 6.5 GB logs, instead of one 13GB log... -Original Message- From: Thach, Kevin G [mailto:[EMAIL PROTECTED] Sent: Thursday, March 25, 2004 2:57 PM To: [EMAIL PROTECTED] Subject: Re: Question about recovery log That's what I do with my DB, but by defining the new log volume and adding it, I will be over the 13GB limit until I've removed all the old volumes. Will TSM let me do that? I guess I could try it and see. -Original Message- From: Davidson, Becky [mailto:[EMAIL PROTECTED] Sent: Thursday, March 25, 2004 2:50 PM To: [EMAIL PROTECTED] Subject: Re: Question about recovery log Define the new and add it and then delete the old. Don't forget to mirror. -Original Message- From: Thach, Kevin G [mailto:[EMAIL PROTECTED] Sent: Thursday, March 25, 2004 1:42 PM To: [EMAIL PROTECTED] Subject: Question about recovery log I'm confused about how I should go about changing the configuration of my recovery log. I'm hoping someone can point me in the right direction. I currently have eight, 1GB log volumes, and I'm wanting to replace these with a single 13GB volume. Normally, I would just create and define the new volume using the def dbvol command, and then remove the old volumes, but since there is a 13GB limit on the recovery log, I can't do that. What's the best way for me to do this? Is there any way I can do it with the server up and running? Switch to Normal mode, remove the old volumes, create the new one, etc. I'm assuming that TSM will not allow me to completely get rid of all my log volumes while the server is up (even if in Normal mode), which is what I would have to do in order to add the 13GB one. Do I need to shut down the server, remove the old volumes and define the new one with the dsmfmt -m -log command? I'm running TSM 5.1.7.3 on AIX 5.1 Thanks!
Re: LTO1 and LTO2 drives in a 3584
Thanks for the response. So, if I don't have any LTO2 media, I can just leave the mountlimit set to DRIVES? But you're saying that TSM will use the LTO1 drives until they are all utilized before using an LTO2 drive? -Original Message- From: Volker Reinen [mailto:[EMAIL PROTECTED] Sent: Friday, February 06, 2004 3:44 AM To: [EMAIL PROTECTED] Subject: LTO1 and LTO2 drives in a 3584 Moin Kevin, This week we added two LTO2 drive into an Frame with four LTO1 Drives. It works. We changes the devc in the way you describe it. In the LTO1 Devclass we changes also the parameter mountlimit to numbers of LTO1 + half of LTO2 = 5. So we have one LTO2 drive for LTO2 Media. The recommodation from IBM is this formular or mounlimit = numbers of LTO1 because TSM uses for LTO1 Media the LTO1 Drives first. We added a second devc with format=ultrium2c for stgpools with LTO2 Media. Mit freundlichen Gruessen - Best regards Volker Reinen Enterprise Computing Solutions CC CompuNet AG Co. oHG A part of Computacenter plc Severinstrasse 42, 45127 Essen, Germany Phone: +49-(0)201-2012-650, Fax: +49-(0)201-2012-217, Mobile: +49-(0)173-3507643 E-Mail : [EMAIL PROTECTED] Visit us on the Internet: http://www.computacenter.com Visit our Online-Shop: http://www.compunet.de/connect This email is confidential. If you are not the intended recipient, you must not disclose or use the information contained in it. If you have received this mail in error, please tell us immediately by return email and delete the document.
LTO1 and LTO2 drives in a 3584
Last week, I added a fourth frame onto our 3584, along with 4 new LTO2 tape drives. I have not defined the new drives in TSM yet, because I'm still trying to find out the best way to run in a mixed LTO1-LTO2 environment. I've read that in version 5.2.X you do not have to logically partition your library to use both drives, but I'm still confused about whether I will need to set up separate device classes and storage pools. All of my media is LTO1. Can I simply set my existing device class format from DRIVE to ultriumc, define the new drives, and just let things rip? All I really want to do is let the LTO2's perform like LTO1's since I'm not using any LTO2 media. Is anyone running a mixed LTO1-LTO2 environment? If so, how are you doing it? Any help or advice is much appreciated!
Re: Scheduling question
Do you have a pre-schedule command in place? I see the same behavior on clients that I have set up with preschedule commands. They stay in pending mode until the pre-schedule command is finished executing. -Original Message- From: Nicolas Launay [mailto:[EMAIL PROTECTED] Sent: Thursday, January 15, 2004 8:14 AM To: [EMAIL PROTECTED] Subject: Scheduling question Re Hi, When I schedule a backup, it works but the backup is always launched 10 minutes after the time I wanted. During those 10 minutes, the status of my schedule is Pending, and after it becomes Started. Is that normal? Nicolas
Possible Bug? Cache hit pct. Going crazy
I'm running TSM 5.1.7.3 on AIX 5.1 and after the server has been up for quite a while without a reboot, the Cache Hit Pct. Number starts to freak out like below. I can reset it, everything is fine for weeks, then it will do this again. I've seen it on previous versions as well. Anyone else experienced this? tsm: TSMq db f=d Available Space (MB): 40,960 Assigned Capacity (MB): 32,768 Maximum Extension (MB): 8,192 Maximum Reduction (MB): 1,120 Page Size (bytes): 4,096 Total Usable Pages: 8,388,608 Used Pages: 6,692,416 Pct Util: 79.8 Max. Pct Util: 80.0 Physical Volumes: 10 Buffer Pool Pages: 131,072 Total Buffer Requests: 24,951,870 Cache Hit Pct.: 16,987.56 Cache Wait Pct.: 0.00 Backup in Progress?: No Type of Backup In Progress: Incrementals Since Last Full: 0 Changed Since Last Backup (MB): 2,214.00 Percentage Changed: 8.47 Last Complete Backup Date/Time: 12/21/2003 13:45:37 This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED]
ANS1312E Server Media Mount Not Possible
I have some large servers that have their data bound to a management class which directs the data directly to a primary tape pool. This pool has a copystgpool defined. Therefore, when these clients backup at night, their data is simultaneously written to the onsite and offsite tape copy. My library is a 3584 with 12 LTO1 drives. Everything has been working just great for many months, but on Monday I upgraded the version and the OS on my TSM server. I went from 5.1.6.2 to 5.1.7.3 and from AIX 4.3.3ML9 to AIX 5.1.0ML3. All clients are running the 5.1.5 AIX TSM client. They have been for many months. Since the upgrade, I have started getting the ANS1312E Server Media Mount Not Possible. The RESOURCEUTILIZATION parameter was set to 4 on a few of the clients, but was not set on others. The MAXNUMMP for all the clients was set at the default of 2. As I mentioned, it worked just fine this way before the server upgrade. This morning, I read some other emails of people with a similar problem and one said to raise the MAXNUMMP to 4. I did this, and it started working again. Could someone please explain to me why I needed to do this? Each client is still only mounting two tapes (one for onsite and one for offsite). Was it broken before and now it's fixed, or vice-versa? Thanks! This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED]
AIX TSM server 4.3.3 ML10 --- 5.1.0 ML3 and TSM 5.1.6.2 --- 5.1 .X.X?
Greetings, I will be performing an OS upgrade on our TSM server in the next week or so from 4.3.3 ML10 to 5.1 ML3, and was wondering what version of TSM people have had good success with on AIX 5.1 (32-bit)? We are currently at 5.1.6.2. Is 5.1.7.3 pretty stable? Also, can someone point me to a good document that describes the TSM upgrade procedures when an OS upgrade is also involved? Do I just simply perform the OS upgrade, install the new TSM filesets, and I'm done? Or do I need to uninstall the current version of TSM, install the new, restore the database, etc.? Thanks in advance! This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED]
Re: Interesting LTO fault's symptom
Same situation here. We have a 3584 with 12 drives that have been in use for about a year. We pump about a Terabyte of data through them everyday, and our cleaning tape has been used twice in the past year. We have had numerous tapes get stuck in drives, and had to have IBM come out and take the drives apart to get the tapes out, but we have not had a read or write error on a single tape as of yet. I've spoken to our IBM engineer about the cleaning frequency and she was surprised also. Next time I talk to her I might ask her to research it a little more for me. I also noticed there is a CLEANFREQUENCY parameter that can be set at the drive level within TSM. All of our drives are set to NONE. I wonder if setting this to ASNEEDED would cause them to be cleaned more frequently. -Original Message- From: David Longo [mailto:[EMAIL PROTECTED] Sent: Monday, June 23, 2003 8:59 PM To: [EMAIL PROTECTED] Subject: Re: Interesting LTO fault's symptom Interesting. I have had an IBM 3584 library with (8) LTO1 drives, FC attached for over a year with no problem. Cleaning tape was installed initially and autoclean turned on on the library. Tape has not been used yet!. I backup nearly 700GB of data a day and make offsite copies. Don't do a lot of restores. I started with 100 tapes in system and now have 220. I remember a thread some months ago - maybe a year about cleaning. Everybody then commented that their cleaning tapes weren't getting used either. Anybody know what should be a reasonable use of the cleaning tape? David B. Longo System Administrator Health First, Inc. 3300 Fiske Blvd. Rockledge, FL 32955-4305 PH 321.434.5536 Pager 321.634.8230 Fax:321.434.5509 [EMAIL PROTECTED] [EMAIL PROTECTED] 06/23/03 20:14 PM Greeting TSMers, I have read this thread with great interest as we seem to have similar symptoms on the same kind of equipement. IBM are confounded at present but are starting to come to the same conclusion as me that the autoclean symptom on the library is not functioning as it should. We originally put this down to TSM having control of the cleaning tapes but have now resolved this and cleaning is still not happening. We use our drives (3 of them) 18-20 hours a day and the last cleaning was a manual one we did 3 months ago! The IBM engineer said he surprised it still works at all. We have thrown out 5 tapes (from a library of 110) over the last 15 months which we now believe may not have been faulty at all, just victims of a dirty drive! There is another thread related to the same errors (1117 etc) listed in this list back in February which leads me to the same conclusions. If IBM come up with a solution I will post it here. David Fosdike Senior Technical Specialist Elders Limited 08 8425 4565 0417 714 467 '...despise not the day of small things...' -Original Message- From: Tom Hrouda Ing. [mailto:[EMAIL PROTECTED] Sent: Monday, 16 June 2003 9:44 PM To: [EMAIL PROTECTED] Subject: Interesting LTO fault's symptom Hi all, during last weeks I did interesting findings at one of production LTO 3583-L18 library. There are 2 drives and both was changed past series of media faults (one of them twice) past about 1 year of operation. We have about 20 historicaly touched tapes with average 3-4 write faults. Media faults are still repeated and my finding is all that faults were done at 70-75% of estimated capacity (set by longterm using to 105GB, we use client compression) during filling the tape. It seems like all tapes were corrupted nearly at the same place, of course there is some diffusion because this is only estimated filling. Faults at these tapes are repeatedly occured at these percents of max capacity. I understand when one tape has media fault repeatedly at the same place, but about 20 tapes? Could it mean that all tapes were corrupted by one bad drive at the same place, or can be reason at microcode? We are in contact with our IBM support to solve it, but I am interested if anybody of you register similar phenomenon? Tomas ## This message is for the named person's use only. It may contain confidential, proprietary, or legally privileged information. No confidentiality or privilege is waived or lost by any mistransmission. If you receive this message in error, please immediately delete it and all copies of it from your system, destroy any hard copies of it, and notify the sender. You must not, directly or indirectly, use, disclose, distribute, print, or copy any part of this message if you are not the intended recipient. Health First reserves the right to monitor all e-mail communications through its networks. Any views or opinions expressed in this message are solely those of the individual sender, except (1) where the message states such views or opinions are on behalf of a particular entity; and (2) the sender is authorized by the entity to give
Re: Maximum number of DB volumes
According to the training manuals for TSM 4.X and 5.X, you should not have more than 12 DB volumes. Yet we have 16, and at one point we had 32 and saw no performance degradation. There seems to be no end to the debate on this issue. We are on AIX 4.3.3 and have been with this config from 4.2.X up to 5.1.6.2. -Original Message- From: Miller, Ryan [mailto:[EMAIL PROTECTED] Sent: Monday, June 16, 2003 4:20 PM To: [EMAIL PROTECTED] Subject: Re: Maximum number of DB volumes Not 100% sure about running on AIX, but we run 17 TSM servers on OS390 and have some running 30 DB vols at 2.4 GB per vol, we have no degradation from it. We have been running this way from all v 4.1 up to v 5.1.6. Ryan Miller Principal Financial Group Tivoli Certified Consultant Tivoli Storage Manager v4.1 -Original Message- From: Ford, Phillip [mailto:[EMAIL PROTECTED] Sent: Monday, June 16, 2003 3:05 PM To: [EMAIL PROTECTED] Subject: Maximum number of DB volumes We have TSM version 4.2.1.15 (moving soon to a 5... level) running on AIX 4.3.3. Another TSM manager told me that there should be a maximum of 16 DB volumes. They said that there could be more but that they had heard that there is system degradation if one was to use more that 16 DB volumes. Has anyone else heard of this. It was new to me and I was just wondering what the situation was. Thanks -- Phillip Ford Senior Software Specialist Corporate Computer Center Schering-Plough Corp. (901) 320-4462 (901) 320-4856 FAX [EMAIL PROTECTED] * This message and any attachments are solely for the intended recipient. If you are not the intended recipient, disclosure, copying, use or distribution of the information included in this message is prohibited -- Please immediately and permanently delete. This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED]
What does this message mean?
I started receiving this error message recently for certain nodes after their backup sessions end normally. Any idea what the cause is? Nothing has changed with our setup for quite some time. Date/TimeMessage -- 12/26/2002 15:00:25 ANR0403I Session 107304 ended for node ESTARFIN (AIX). 12/26/2002 15:00:26 ANRD smnode.c(18972): ThreadId95 Session exiting has no affinityId cluster This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED]
Re: What does this message mean?
No, I do not. Only after backup sessions end, and it appears to be occurring for all nodes. -Original Message- From: Jolliff, Dale [mailto:[EMAIL PROTECTED]] Sent: Thursday, December 26, 2002 3:22 PM To: [EMAIL PROTECTED] Subject: Re: What does this message mean? Do you see it during expiration? -Original Message- From: Thach, Kevin [mailto:[EMAIL PROTECTED]] Sent: Thursday, December 26, 2002 2:14 PM To: [EMAIL PROTECTED] Subject: What does this message mean? I started receiving this error message recently for certain nodes after their backup sessions end normally. Any idea what the cause is? Nothing has changed with our setup for quite some time. Date/TimeMessage -- 12/26/2002 15:00:25 ANR0403I Session 107304 ended for node ESTARFIN (AIX). 12/26/2002 15:00:26 ANRD smnode.c(18972): ThreadId95 Session exiting has no affinityId cluster This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED] This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED]
Procedures to follow after a drive with a stuck tape is replaced -- 3584 library
The other day I had to replace one of the drives in my 3584 library because a tape was jammed in it. This tape was being written to by a migration process when it jammed (during daily processing). The procedure went on to complete successfully, but a q libvol shows that the tape is still in the library in a private status even though it has been destroyed. Last night I had a restore fail (I'm guessing some of the data was on the tape that got stuck?) I basically need to know what procedures / commands need to be executed once a tape has been destroyed to ensure that the data on that tape is available on another tape. I figure an audit library will make it recognize it's gone, but how do I deal with the data? Thanks in advance, Kevin This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED]
Re: Procedures to follow after a drive with a stuck tape is repla ced -- 3584 library
I have the volumes necessary to restore the destroyed volume onsite. I checked them into the library using the command: checkin libvol ibm3584a search=bulk status=private checklabel=barcode They checked in okay, but I started my restore volume and it still says they are unavailable or offsite. What am I missing? Thanks, Kevin -Original Message- From: Cook, Dwight E [mailto:[EMAIL PROTECTED]] Sent: Thursday, December 12, 2002 9:05 AM To: Thach, Kevin Subject: RE: Procedures to follow after a drive with a stuck tape is replaced -- 3584 library upd vol volser acc=destroyed Since the other volumes are offsite (and since all the data to rebuild your destroyed volume isn't necessarily on a single volume in your offsite/copy pool) you should try a... restore vol destroyedvolser copypool=copypoolname preview=yes this will show what volumes are needed to rebuild the primary pool volume, then recall those vols and rebuild the primary pool volume for real. You might look in your activity log around the time of the failed restore... TSM ~might~ have requested some offsite volumes to be retrieved (checked in). I don't take volumes offsite because my tsm servers are offsite (we backup over the wan) but I've tested all that functionality in the past and I believe TSM asks for one of the copypool volumes to be checked in, if the data is requested by the client and the primary pool's copy isn't available. hope this helps... Dwight -Original Message- From: Thach, Kevin [mailto:[EMAIL PROTECTED]] Sent: Thursday, December 12, 2002 7:45 AM To: 'Cook, Dwight E' Subject: RE: Procedures to follow after a drive with a stuck tape is replaced -- 3584 library I do have a copy pool, but it is offsite, so if someone requests data from that volume, how will TSM handle rolling to it since it is offsite? Also, how do I mark a volume destroyed? Thanks -Original Message- From: Cook, Dwight E [mailto:[EMAIL PROTECTED]] Sent: Thursday, December 12, 2002 8:31 AM To: Thach, Kevin Subject: RE: Procedures to follow after a drive with a stuck tape is replaced -- 3584 library You have to mark it destroyed yourself. Now, do you have a copy storage pool ? If you do and you mark the primary pool's volume destroyed if a person requests data on that destroyed volume, TSM will automatically roll to the data in the copy pool. If you don't have a copypool, it is still critical to mark the volume destroyed as soon as possible because if there is data on that ~destroyed~ volume that still exists on the client(s), TSM will pick up a new copy during the next round of incrementals... Dwight -Original Message- From: Thach, Kevin [mailto:[EMAIL PROTECTED]] Sent: Thursday, December 12, 2002 7:26 AM To: [EMAIL PROTECTED] Subject: Procedures to follow after a drive with a stuck tape is replaced -- 3584 library The other day I had to replace one of the drives in my 3584 library because a tape was jammed in it. This tape was being written to by a migration process when it jammed (during daily processing). The procedure went on to complete successfully, but a q libvol shows that the tape is still in the library in a private status even though it has been destroyed. Last night I had a restore fail (I'm guessing some of the data was on the tape that got stuck?) I basically need to know what procedures / commands need to be executed once a tape has been destroyed to ensure that the data on that tape is available on another tape. I figure an audit library will make it recognize it's gone, but how do I deal with the data? Thanks in advance, Kevin This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED] This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED] This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail
Re: Relocating TSM DB (storage)
Funny you should mention that. We have been working with IBM ATS support about poor performance issues with our TSM config, and they say that our problem is because we have all 37 volumes in one AIX logical volume/filesystem. They have had us create 32 new AIX logical volumes/filesystems (don't need 37 because our db is not very full after running CLEANUP BACKUPGROUPS), each with a 1GB TSM DBvol inside, all of which are on separate ESS loops. They said the smaller DB volumes are better! Argghh!! -Original Message- From: Robert L. Rippy [mailto:[EMAIL PROTECTED]] Sent: Friday, November 22, 2002 9:35 AM To: [EMAIL PROTECTED] Subject: Re: Relocating TSM DB (storage) Yes, you are correct. Create the new DB's and extend the DB and then delete the old DB's. The data will migrate over to the new extended space. Any reason you had 37 1GB volumes for your DB's. IBM told me not to really go over 10 volumes on your DB and to be sure they aren't on the same drive if you can help it. I would suggest that if you could, create 5 8GB new volumes for a total of 40GB and move the DB over to the new 8GB partitions. Thanks, Robert Rippy From: Thach, Kevin [EMAIL PROTECTED] on 11/22/2002 09:30 AM Please respond to ADSM: Dist Stor Manager [EMAIL PROTECTED] To: [EMAIL PROTECTED] cc: Subject: Relocating TSM DB (storage) I am wanting to move our TSM DB which is currently on ESS, and has 37 1GB dbvolumes, to another set of ESS disk. If I define the new dbvolumes on the new disks, do I then just extend the db, and then do a del dbvol on the old ones? Does the delete make the data migrate over? Do I have to do a reduce db for any reason before I do the delete dbvol? Can I do the delete with the server up and running? Thanks This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED] This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED]
Re: Relocating TSM DB (storage)
We would do that, but we're moving it to a different volume group. -Original Message- From: David Longo [mailto:[EMAIL PROTECTED]] Sent: Friday, November 22, 2002 11:38 AM To: [EMAIL PROTECTED] Subject: Re: Relocating TSM DB (storage) I've followed the comments on this and have a different observation. If you just want to move to different ESS disks without any changes to TSM DB VOLs then here is an alternative, with an assumption that your TSM server is on AIX platform - you didn't say. If say you have 10 ESS disks assigned to the TSM DB, then assign 10 more wherever you want them. Then run cfgmgr to get new disks and assign them to the VG that TSM DB is on. At AIX level, create mirrors from old to new disks, by LV if you want and sync up the mirrors. Check that every thing is o.k., then break the mirror to the old disks and remove them from AIX and delete them at ESS. I haven't done this with TSM DB but have done it on AIX and ESS from a number of systems with running Oracle, Sybase and other stuff. Advantage to this is that it is totally transparent to application and users except for some performance slowness while syncing mirrors. David B. Longo System Administrator Health First, Inc. 3300 Fiske Blvd. Rockledge, FL 32955-4305 PH 321.434.5536 Pager 321.634.8230 Fax:321.434.5509 [EMAIL PROTECTED] [EMAIL PROTECTED] 11/22/02 09:30AM I am wanting to move our TSM DB which is currently on ESS, and has 37 1GB dbvolumes, to another set of ESS disk. If I define the new dbvolumes on the new disks, do I then just extend the db, and then do a del dbvol on the old ones? Does the delete make the data migrate over? Do I have to do a reduce db for any reason before I do the delete dbvol? Can I do the delete with the server up and running? Thanks This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED] MMS health-first.org made the following annotations on 11/22/2002 11:39:21 AM -- This message is for the named person's use only. It may contain confidential, proprietary, or legally privileged information. No confidentiality or privilege is waived or lost by any mistransmission. If you receive this message in error, please immediately delete it and all copies of it from your system, destroy any hard copies of it, and notify the sender. You must not, directly or indirectly, use, disclose, distribute, print, or copy any part of this message if you are not the intended recipient. Health First reserves the right to monitor all e-mail communications through its networks. Any views or opinions expressed in this message are solely those of the individual sender, except (1) where the message states such views or opinions are on behalf of a particular entity; and (2) the sender is authorized by the entity to give such views or opinions. == This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED]
System Object won't rebind to new mgt class
On all of our Win2K servers, we've recently added the following line to the client dsm.opt files: include.systemobject ALL win_sysobj All but 1 client's System Object filespaces have properly rebound to the new mgt class. One however, is still bound to the default mgt class and I can't figure out why. It HAS backed up since the change, so I know that's not it. Server is 4.2.3 on AIX 4.3.3 and Win2K client is 5.1.0.1 (same as all the others that have worked correctly) Any ideas I might try? This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED]
Re: System Object won't rebind to new mgt class
It is being backed up, just not to the proper mgt class. I think I will try Mark's suggestion to delete the filespace and see if it works correctly next time it gets backed up. Stupid question... What is the proper syntax to delete a System Object filespace? I have tried: del fi nodename 'System Object' and that doesn't work. -Original Message- From: Remeta, Mark [mailto:MRemeta;SELIGMANDATA.COM] Sent: Thursday, November 14, 2002 1:25 PM To: [EMAIL PROTECTED] Subject: Re: System Object won't rebind to new mgt class I think of you have a DOMAIN statement in the DSM.OPT that does not include the system object it will not be backed up. That is how we excluded the system objects on our Win2k servers. Most have a DOMAIN C: D: etc... in their DSM.OPT. Maybe this server has the DOMAIN statement therefore the system object is not being backed up? -Original Message- From: Mark Stapleton [mailto:stapleto;BERBEE.COM] Sent: Thursday, November 14, 2002 1:14 PM To: [EMAIL PROTECTED] Subject: Re: System Object won't rebind to new mgt class From: ADSM: Dist Stor Manager [mailto:ADSM-L;VM.MARIST.EDU]On Behalf Of Thach, Kevin On all of our Win2K servers, we've recently added the following line to the client dsm.opt files: include.systemobject ALL win_sysobj All but 1 client's System Object filespaces have properly rebound to the new mgt class. One however, is still bound to the default mgt class and I can't figure out why. It HAS backed up since the change, so I know that's not it. Server is 4.2.3 on AIX 4.3.3 and Win2K client is 5.1.0.1 (same as all the others that have worked correctly) Any ideas I might try? Delete the filespace, and let the next client backup take care of it. -- Mark Stapleton ([EMAIL PROTECTED]) Certified TSM consultant Certified AIX system engineer MCSE Confidentiality Note: The information transmitted is intended only for the person or entity to whom or which it is addressed and may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of this information by persons or entities other than the intended recipient is prohibited. If you receive this in error, please delete this material immediately. This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED]
Internal Server errors
Help, I have a TSM client whose hostname was changed this morning. I tried to rename the node on the TSM server to the new hostname and got the following error: TSM rename node newkronostest kronostest ANR0102E admnode.c(2294): Error 1 inserting row in table Extended.Attrs Ok, so then I tried to delete the node and just re-register it with a new name (it had no filespaces): TSM remove node newkronostest It let me do that. Then I tried to re-register it under the new name: TSM register node kronostest passwd contact=xxx domain=nocodom compression=no autofsrename=no archdelete=yes backdelete=no forcep=no type=client keepmp=no maxnummp=2 url=http://kronostest:1581 userid=none passexp=0 I get this error: ANR2032E Internal Server Erorr Server version is 4.2.3 on AIX 4.3.3-09. Any ideas as to what is going on? By the way, I tested renaming and registering nodes that were not kronostest/newkronostest and it let me do that. Any help is appreciated! Thank you, Kevin This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED]
Re: Daily Processing Performance (very slow - any ideas?)
We only use mirroring for rootvg. Anything on ESS we don't use mirroring for. We are using JFS. We have our TSM allocation on the ESS as follows: 144 LUNs allocated, 18 LUNS on 8 LSS's. We purchased and installed ESS drive space for TSM and took most (if not all) of that drive space up front. Therefore, the device /adapter /pair /array combination on each LSS for the TSM disk space allocation, is the same. Does that make sense? The LUN assignment looks like this: 016-19732 -- 027-19732 Pair 1, Cluster 1, Loop B, Array 2 116-19732 -- 127-19732 Pair 1, Cluster 2, Loop B, Array 1 216-19732 -- 227-19732 Pair 2, Cluster 1, Loop B, Array 2 316-19732 -- 327-19732 Pair 2, Cluster 2, Loop B, Array 1 416-19732 -- 427-19732 Pair 3, Cluster 1, Loop B, Array 2 516-19732 -- 527-19732 Pair 3, Cluster 2, Loop B, Array 1 616-19732 -- 627-19732 Pair 4, Cluster 1, Loop B, Array 2 716-19732 -- 727-19732 Pair 4, Cluster 2, Loop B, Array 1 So that breaks down to 18 LUNs, on each of 8 LSSs, on one loop per LSS. At the time of TSM disk space allocation, there were not any other loops available for assignment. We have some clients on Gigabit ethernet, but the majority are 100-Full. The TSM server is on Gigabit. By buffer pool are you referring to BUFPOOLSIZE? If so, ours is currently set to 262144. Is that okay? What are you referring to by maxperm? How can I check it/change it if it isn't set correctly? Thanks very much, Kevin -Original Message- From: Seay, Paul [mailto:seay_pd;NAPTHEON.COM] Sent: Thursday, November 07, 2002 5:12 PM To: [EMAIL PROTECTED] Subject: Re: Daily Processing Performance (very slow - any ideas?) Are you using mirroring? If so, do not, waste of resources and lots of overhead on backup db. Are you using raw or JFS? There is absolutely no value defining such small LUNs on the ESS. In fact that could be the source of all your problems especially on the database. If you are using JFS, you should use a striped set of disk throughout the ESS, 8 at a time, on on each cluster/loop combination. This maximizes the throughput of the ESS. You have a very similar environment to mine. Our's flies. Do you have Gigabit on the clients or 100baset? Do you have Gigabit on the TSM server? First thing I would do is change your bufferpool for your DB to 256MB and change maxperm to 40. That will eliminate the 85% hit ratio spikes and the paging that is probably occuring on your machine. We backup about 2TB a day and process about 2TB per day to copies. We start at 7PM and finish by 7:30AM, including 2 copies of everything plus the primary. We have 16 Magstar drives. Paul D. Seay, Jr. Technical Specialist Naptheon Inc. 757-688-8180 -Original Message- From: Thach, Kevin [mailto:KThach;COVHLTH.COM] Sent: Thursday, November 07, 2002 12:39 PM To: [EMAIL PROTECTED] Subject: Re: Daily Processing Performance (very slow - any ideas?) Okay, some of you have requested more info before trying to make a diagnosis, so let me give you some more details. The 500GB disk pool and the 250GB disk pool are on ESS--8GB vpaths. I have 144 of these vpaths allocated to our TSM server. ESS uses RAID5. Within TSM, the volumes for the disk pools are 10GB volumes. So, I have 50 volumes for the noncollocated disk pool and 25 volumes for the collocated pool. My DB and LOG use 1GB volumes. Cache hit % on the DB is 98.5 today, but I have seen it as low as 85%. We have 4 fiber adapters in the TSM server. 2 are for disk and 2 are for tape--so tape and disk are not operating on the same adapter. Here is the output of vmtune from my TSM server: vmtune: current values: -p -P-r -R -f -F -N-W minperm maxperm minpgahead maxpgahead minfree maxfree pd_npages maxrandwrt 209505 838020 2 8120 128 5242880 -M -w -k -c-b -B -u-l -d maxpin npswarn npskill numclust numfsbufs hd_pbuf_cnt lvm_bufcnt lrubucket defps 838841 162564064 1 93 2128 9 131072 1 -s -n -S -L -g -h sync_release_ilock nokilluid v_pinshm lgpg_regions lgpg_size strict_maxperm 0 0 0 000 number of valid memory pages = 1048551 maxperm=79.9% of real memory maximum pinable=80.0% of real memoryminperm=20.0% of real memory number of file memory pages = 838012numperm=79.9% of real memory Thanks again. If you need more info still, just let me know. Kevin -Original Message- From: Mark D. Rodriguez [mailto:mark;MDRCONSULT.COM] Sent: Thursday, November 07, 2002 11:19 AM To: [EMAIL PROTECTED] Subject: Re: Daily Processing Performance (very slow - any ideas?) Thach, Kevin wrote: I'm very dissapointed with the performance of our TSM environment, and I was curious what kinds of numbers some of you with similar
Daily Processing Performance (very slow - any ideas?)
I'm very dissapointed with the performance of our TSM environment, and I was curious what kinds of numbers some of you with similar environments have experienced. I've worked extensively with IBM to try and tune things, but apparently we've got everything adjusted correctly. We are in the process of cleaning up System Object stuff, so I'm wondering if I should expect things to improve dramatically once we trim all that fat. I apologize for the lenght of the post, but I want to include as much info as possible. I'm in dire need of a solution. Our basic setup: IBM 6H1 - 6 Processors / 4GB RAM TSM 4.2.3 on AIX 4.3.3-09 LTO 3584 Tape Library with 10 drives Fiber-arbitrated loop going through McData ES-1000 switches and McData 6064 Directors 500GB Non-Collocated Disk Pool on ESS 250GB Collocated Disk Pool on ESS 37GB TSM database Approximately 200 Clients (mixture of AIX and WinNT/2K) running at various client versions 200GB total / night backed up on average. Daily Processing is slow, slow, slow. Here are the steps for our daily processing (its all scheduled, but I'm just showing you what runs when): 1) 7:00:00 - Daily processing starts backup stg nocodisk copypool maxproc=4 wait=yes backup stg colodisk copypool maxproc=4 wait=yes 2) Once that is finished the migrations start (I have the maxproc on both pools set to 5) update stg nocodisk hi=0 lo=0 update stg colodisk hi=0 lo=0 3) Once Migration is finished update stg nocodisk hi=90 lo=70 update stg colodisk hi=90 lo=70 backup stg nocotape copypool maxproc=3 wait=yes backup stg colotape copypool maxproc=3 wait=yes 4) Once that is finished expire inventory 5) Once that is finished backup db devclass=ltotape type=full 6) Then backup volhist backup devconfig prepare So, the big disappointment is on steps 1 and 2. Our disk to tape performance averages about 20GB/hour per tape drive. If I reduce the number of mount points, that number goes down even more. Are LTO's really this slow? IBM says these suckers will do 50-100GB/hour. With 10 drives, we were told we could handle about 1-2 TB/day, and we're only dealing with 200GB and the entire daily processing takes more than 6 Hours!!! At one time we were using disk caching, and I was told that slowed down disk to tape performance, so we turned it off. I saw a slight improvement, but nothing major. The Noncollocated disk pool still has data in it that has not expired yet since I turned off caching. Could that still be slowing things down if the pool isn't completely flushed? What can I really expect to get as far as performance? How long should daily processing really take for only 200GB worth of data? Any help is greatly, greatly appreciated! Thanks! -Kevin This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED]
Re: Daily Processing Performance (very slow - any ideas?)
Okay, some of you have requested more info before trying to make a diagnosis, so let me give you some more details. The 500GB disk pool and the 250GB disk pool are on ESS--8GB vpaths. I have 144 of these vpaths allocated to our TSM server. ESS uses RAID5. Within TSM, the volumes for the disk pools are 10GB volumes. So, I have 50 volumes for the noncollocated disk pool and 25 volumes for the collocated pool. My DB and LOG use 1GB volumes. Cache hit % on the DB is 98.5 today, but I have seen it as low as 85%. We have 4 fiber adapters in the TSM server. 2 are for disk and 2 are for tape--so tape and disk are not operating on the same adapter. Here is the output of vmtune from my TSM server: vmtune: current values: -p -P-r -R -f -F -N-W minperm maxperm minpgahead maxpgahead minfree maxfree pd_npages maxrandwrt 209505 838020 2 8120 128 5242880 -M -w -k -c-b -B -u-l -d maxpin npswarn npskill numclust numfsbufs hd_pbuf_cnt lvm_bufcnt lrubucket defps 838841 162564064 1 93 2128 9 131072 1 -s -n -S -L -g -h sync_release_ilock nokilluid v_pinshm lgpg_regions lgpg_size strict_maxperm 0 0 0 000 number of valid memory pages = 1048551 maxperm=79.9% of real memory maximum pinable=80.0% of real memoryminperm=20.0% of real memory number of file memory pages = 838012numperm=79.9% of real memory Thanks again. If you need more info still, just let me know. Kevin -Original Message- From: Mark D. Rodriguez [mailto:mark;MDRCONSULT.COM] Sent: Thursday, November 07, 2002 11:19 AM To: [EMAIL PROTECTED] Subject: Re: Daily Processing Performance (very slow - any ideas?) Thach, Kevin wrote: I'm very dissapointed with the performance of our TSM environment, and I was curious what kinds of numbers some of you with similar environments have experienced. I've worked extensively with IBM to try and tune things, but apparently we've got everything adjusted correctly. We are in the process of cleaning up System Object stuff, so I'm wondering if I should expect things to improve dramatically once we trim all that fat. I apologize for the lenght of the post, but I want to include as much info as possible. I'm in dire need of a solution. Our basic setup: IBM 6H1 - 6 Processors / 4GB RAM TSM 4.2.3 on AIX 4.3.3-09 LTO 3584 Tape Library with 10 drives Fiber-arbitrated loop going through McData ES-1000 switches and McData 6064 Directors 500GB Non-Collocated Disk Pool on ESS 250GB Collocated Disk Pool on ESS 37GB TSM database Approximately 200 Clients (mixture of AIX and WinNT/2K) running at various client versions 200GB total / night backed up on average. Daily Processing is slow, slow, slow. Here are the steps for our daily processing (its all scheduled, but I'm just showing you what runs when): 1) 7:00:00 - Daily processing starts backup stg nocodisk copypool maxproc=4 wait=yes backup stg colodisk copypool maxproc=4 wait=yes 2) Once that is finished the migrations start (I have the maxproc on both pools set to 5) update stg nocodisk hi=0 lo=0 update stg colodisk hi=0 lo=0 3) Once Migration is finished update stg nocodisk hi=90 lo=70 update stg colodisk hi=90 lo=70 backup stg nocotape copypool maxproc=3 wait=yes backup stg colotape copypool maxproc=3 wait=yes 4) Once that is finished expire inventory 5) Once that is finished backup db devclass=ltotape type=full 6) Then backup volhist backup devconfig prepare So, the big disappointment is on steps 1 and 2. Our disk to tape performance averages about 20GB/hour per tape drive. If I reduce the number of mount points, that number goes down even more. Are LTO's really this slow? IBM says these suckers will do 50-100GB/hour. With 10 drives, we were told we could handle about 1-2 TB/day, and we're only dealing with 200GB and the entire daily processing takes more than 6 Hours!!! At one time we were using disk caching, and I was told that slowed down disk to tape performance, so we turned it off. I saw a slight improvement, but nothing major. The Noncollocated disk pool still has data in it that has not expired yet since I turned off caching. Could that still be slowing things down if the pool isn't completely flushed? What can I really expect to get as far as performance? How long should daily processing really take for only 200GB worth of data? Any help is greatly, greatly appreciated! Thanks! -Kevin This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E
Upgrading from 4.2.2.3 to 4.2.3
I'm upgrading to 4.2.3 today. Anyone had any problems upgrading to 4.2.3 or with 4.2.3 itself? Please let me know if there are any horror stories out there. This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED]
Re: Upgrading from 4.2.2.3 to 4.2.3
Sorry, my server is running on AIX 4.3.3-09. -Original Message- From: John Naylor [mailto:john.naylor;SCOTTISH-SOUTHERN.CO.UK] Sent: Monday, November 04, 2002 9:34 AM To: [EMAIL PROTECTED] Subject: Re: Upgrading from 4.2.2.3 to 4.2.3 Please specify your o/s Thach, Kevin [EMAIL PROTECTED] on 11/04/2002 01:55:19 PM Please respond to ADSM: Dist Stor Manager [EMAIL PROTECTED] To: [EMAIL PROTECTED] cc:(bcc: John Naylor/HAV/SSE) Subject: Upgrading from 4.2.2.3 to 4.2.3 I'm upgrading to 4.2.3 today. Anyone had any problems upgrading to 4.2.3 or with 4.2.3 itself? Please let me know if there are any horror stories out there. This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED] ** The information in this E-Mail is confidential and may be legally privileged. It may not represent the views of Scottish and Southern Energy plc. It is intended solely for the addressees. Access to this E-Mail by anyone else is unauthorised. If you are not the intended recipient, any disclosure, copying, distribution or any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. Any unauthorised recipient should advise the sender immediately of the error in transmission. Scottish Hydro-Electric, Southern Electric, SWALEC and S+S are trading names of the Scottish and Southern Energy Group. ** This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED]
Include statement
I've created a new management class for Win2K system objects called WIN_SYSOBJ. What is the proper include statement I need to put in the dsm.opt file to bind the system object to that mgt. class? I've tried include.systemobject win_sysobj and it said that was an invalid parameter. This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED]
Re: Include statement
Server is at 4.2.2.3. Client is 5.1.0.1. However, I figured out what was wrong. I had left out ALL. It needs to read: include.systemobject ALL win_sysobj -Original Message- From: Seay, Paul [mailto:seay_pd;NAPTHEON.COM] Sent: Tuesday, October 29, 2002 12:20 PM To: [EMAIL PROTECTED] Subject: Re: Include statement What level of TSM are you running? Paul D. Seay, Jr. Technical Specialist Naptheon Inc. 757-688-8180 -Original Message- From: Thach, Kevin [mailto:KThach;COVHLTH.COM] Sent: Tuesday, October 29, 2002 10:22 AM To: [EMAIL PROTECTED] Subject: Include statement I've created a new management class for Win2K system objects called WIN_SYSOBJ. What is the proper include statement I need to put in the dsm.opt file to bind the system object to that mgt. class? I've tried include.systemobject win_sysobj and it said that was an invalid parameter. This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED] This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED]
System Object / Mgmt. Classes / Policy Sets / Backup Groups -- Wh at's the best way??
Hi, I've been designated the TSM administrator here at my workplace, and I'm trying to educate myself as I go without making a mess of things. Our IBM partner came in and installed the server and a few clients, and handed it over to me. I now have about 200 Win2K clients, 40 AIX Clients, and about 5 Linux Clients. My question is this: The person that installed our environment basically set up 6 Policy Domains: Colodom, Exchange, Lanfree, MSSQL, Nocodom, and Oracle. 99% of the clients are in the Nocodom (non-collocated) domain, which has one policy set, and one management class which has one backup copy group with retention policies set to NOLIMIT, 3, 60, 60. So, my problem is this. It turns out that in trying to upgrade from 4.2.2.3 to 5.1.X we ran into the problem with System Objects BIGTIME. We are retaining 60 days worth of System Object files for about 200 Win2K clients, which translates to about 29,000,000 System Object files, and about 55% of our TSM database (36 GB). What we've decided to do before upgrading to 5.1.X is to upgrade to 4.2.3 and lessen the retention for the System Objects. However, I have no experience in setting up Mgmt classes, policy sets, etc, and I'm not sure what I need to do in that arena. What I'd like to get to is this: 1) System Objects retained for 7 days 2) Everything else retained for 60 days How do I set up an additional policy set for just the System Object stuff? Thanks in advance! -Kevin This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED]
Re: query storage group
We used caching at our site until just recently. When we turned it off, we saw about a 15% improvement in our disk to tape copies/migrations. So, to answer your question, it speeds up restores, but it slows down daily processing. At least that's been my experience with it. -Original Message- From: Nelson, Doug [mailto:[EMAIL PROTECTED]] Sent: Wednesday, October 16, 2002 9:25 AM To: [EMAIL PROTECTED] Subject: query storage group When I run a Query Storage Group ( Q stg) on the Disk Pool, I get the following (puzzling) results Name: Diskpool Device: Disk Capactity: 15 gig Pct Util: 92.1 Pct Migr: 54.2 High Mig: 70 Low Mig: 40 My question is, If my Migration parameters are 70/40 (and there is no migration in progress) why do I have a 92% utilized and a 54% migrated? I just had the thought that this could be because we have caching turned on. Is this correct? As a side note, has anyone had problems with caching slowing things down rather than speeding them up? Thanks, Doug Douglas C. Nelson Distributed Computing Consultant Alltel Information Services Chittenden Data Center 2 Burlington Square Burlington, Vt. 05401 802-660-2336 This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED]
Cancelling a restore session...
I have a failed restore session that isn't going away on its own, and when I try to cancel it, it says it is cancelling the session but it isn't getting rid of it. I can't restart the restore because it says there is an active restore in progress--which is the session that won't go away. Is there a way to force it? Do I need to halt the server to get this thing to go away? This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED]
TSM Upgrade 4.2.2.3 ---- 5.1.X -- HELP!
Hi, I've seen several of your posts regarding your experiences with upgrading your TSM server from 4.X to 5.X. We attempted this upgrade a few weeks back, not knowing at the time about the SYSTEM OBJECT problem, and after several hours aborted the upgrade and restored from backup. We are at 4.2.2.3, and we have about 200 Win2K clients, a 32GB TSM database (54% of which is SYSTEM OBJECTS!!). We've been retaining 60 versions of the SYSTEM OBJECT files / server, so we are going to have some major problems obviously. We did not realize the err of our ways as far as retention until we ran into the upgrade problems. We were totally blindsided by this, as it seems you and so many others have been as well. IBM has recommended the following: 1. Upgrade to 4.2.2.12, so we have the CLEANUP BACKUPGROUP utility, and the SYSTEM OBJECTS will begin to expire properly. 2. Change our retention policy on the SYSTEM OBJECT stuff gradually. 55days, 50 days, 45 days, on down to 5 days. I'm assuming the gradual stepdown is because of the time required to expire? 3. Run the CLEANUP BACKUPGROUP utility. It will take several days? I've heard you can start it after daily processing, kill the process when its time for backups to begin, and start it up again the next day. So on and so on until its finished. Have you had experience with that? 4. After the cleanup, upgrade to 5.1.X, during which the upgrade db will run. I have been told that the upgrade db could take days! Your experience? During this time, no backups/restores can be performed, correct? Bottom line, I'm getting different answers from IBM support, from our IBM reseller, from the newsgroups, etc. I am desperate for some feedback from someone who has actually made it to the other side. I'm going to have to give this another go very soon and I'm not at all looking forward to it. ANY experiences or suggestions you can share are GREATLY appreciated!! Thank you so much, Kevin This E-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended only for the use of the Individual(s) named above. If you are not the intended recipient of this E-mail, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that any dissemination or copying of this E-mail is strictly prohibited. If you have received this E-mail in error, please immediately notify us at (865) 374-4900 or notify us by E-mail at [EMAIL PROTECTED]
