Reducing SCSI timeouts?
Hi everybody, due to faulty tape drives, we have lost some of our LTO4 tape volumes, i.e. these volumes are no longer readable by any of our other tape drives. AUDIT VOLUME sometimes stalls at the first file to check and throws errors and gets reduced to a crawl. The only way out for us is currently DELETE VOLUME DISCARDD=YES, but for obvious reasons, I do a MOVE DATA beforehand to rescue the data that any of the drives is able to read. (No copy pools were yet configured) Since we have a couple of volumes to check, I'd like to get some insight if it is possible to reduce the SCSI timeout value for the tape drives, since we have to wait ~15 minutes for a single CANCEL PROCESS I tried: echo 180 /sys/class/lin_tape/IBMtapeX/device/timeout But that didn't work out. Any hints? * TSM for Linux/x86_64 - Version 6, Release 2, Level 3.100 * RedHat 5 * lin_taped 1.68.0-1 Thanks in advance! BR, Sascha
VTL's and D2D solutions
We are currently looking at adding a Disk to Disk backup solution. Our current solution has a 3584 tape library with LTO-5 drives using TKLM. We have looked at Exagrid and Data Domain. Also, I believe HP has a solution. We will need to have encryption on the device and the ability to replicate between the two disk units. Anyone have any comments or recommendations? Thanks, Kevin
Re: VTL's and D2D solutions
We are looking at vtls as well. You might check into the ibm protectier 7650. This is a head end that you attach to whatever storage you have. Emulates a lot of libraries, including the 3484 and 3494 I believe. Should know more in a couple of weeks after we review the answers to our RFPs. Gary Lee Senior System Programmer Ball State University phone: 765-285-1310 -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Kevin Boatright Sent: Monday, July 02, 2012 10:35 AM To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] VTL's and D2D solutions We are currently looking at adding a Disk to Disk backup solution. Our current solution has a 3584 tape library with LTO-5 drives using TKLM. We have looked at Exagrid and Data Domain. Also, I believe HP has a solution. We will need to have encryption on the device and the ability to replicate between the two disk units. Anyone have any comments or recommendations? Thanks, Kevin
Re: VTL's and D2D solutions
With Gary's point below using the PT Gateway you can slide in Encrypted disk underneath the other appliances don't support encryption. With using your own disk you can leverage your volume purchasing power with your existing disk vendor as well. -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Lee, Gary Sent: Monday, July 02, 2012 10:35 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] VTL's and D2D solutions We are looking at vtls as well. You might check into the ibm protectier 7650. This is a head end that you attach to whatever storage you have. Emulates a lot of libraries, including the 3484 and 3494 I believe. Should know more in a couple of weeks after we review the answers to our RFPs. Gary Lee Senior System Programmer Ball State University phone: 765-285-1310 -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Kevin Boatright Sent: Monday, July 02, 2012 10:35 AM To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] VTL's and D2D solutions We are currently looking at adding a Disk to Disk backup solution. Our current solution has a 3584 tape library with LTO-5 drives using TKLM. We have looked at Exagrid and Data Domain. Also, I believe HP has a solution. We will need to have encryption on the device and the ability to replicate between the two disk units. Anyone have any comments or recommendations? Thanks, Kevin This e-mail, including attachments, may include confidential and/or proprietary information, and may be used only by the person or entity to which it is addressed. If the reader of this e-mail is not the intended recipient or his or her authorized agent, the reader is hereby notified that any dissemination, distribution or copying of this e-mail is prohibited. If you have received this e-mail in error, please notify the sender by replying to this message and delete this e-mail immediately.
Re: Reducing SCSI timeouts?
Hi, Sascha. I don't know how to reduce the timeout, but IPLing the drives should allow the process to cancel. I used to just walk back into the datacenter and flip the power switch, it got me up from my desk, but you can IPL the drive from the 3584 Web Specialist also. On 7/2/2012 7:26 AM, Sascha Askani wrote: Hi everybody, due to faulty tape drives, we have lost some of our LTO4 tape volumes, i.e. these volumes are no longer readable by any of our other tape drives. AUDIT VOLUME sometimes stalls at the first file to check and throws errors and gets reduced to a crawl. The only way out for us is currently DELETE VOLUME DISCARDD=YES, but for obvious reasons, I do a MOVE DATA beforehand to rescue the data that any of the drives is able to read. (No copy pools were yet configured) Since we have a couple of volumes to check, I'd like to get some insight if it is possible to reduce the SCSI timeout value for the tape drives, since we have to wait ~15 minutes for a single CANCEL PROCESS I tried: echo 180 /sys/class/lin_tape/IBMtapeX/device/timeout But that didn't work out. Any hints? * TSM for Linux/x86_64 - Version 6, Release 2, Level 3.100 * RedHat 5 * lin_taped 1.68.0-1 Thanks in advance! BR, Sascha
Re: VTL's and D2D solutions
I have had good success with Data Domain both as VTL and CIFS storage for TSM. It will encrypt at rest and encrypt the replication stream to another Data Domain. Andy Huebner -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Hart, Charles A Sent: Monday, July 02, 2012 11:06 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] VTL's and D2D solutions With Gary's point below using the PT Gateway you can slide in Encrypted disk underneath the other appliances don't support encryption. With using your own disk you can leverage your volume purchasing power with your existing disk vendor as well. -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Lee, Gary Sent: Monday, July 02, 2012 10:35 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] VTL's and D2D solutions We are looking at vtls as well. You might check into the ibm protectier 7650. This is a head end that you attach to whatever storage you have. Emulates a lot of libraries, including the 3484 and 3494 I believe. Should know more in a couple of weeks after we review the answers to our RFPs. Gary Lee Senior System Programmer Ball State University phone: 765-285-1310 -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Kevin Boatright Sent: Monday, July 02, 2012 10:35 AM To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] VTL's and D2D solutions We are currently looking at adding a Disk to Disk backup solution. Our current solution has a 3584 tape library with LTO-5 drives using TKLM. We have looked at Exagrid and Data Domain. Also, I believe HP has a solution. We will need to have encryption on the device and the ability to replicate between the two disk units. Anyone have any comments or recommendations? Thanks, Kevin This e-mail, including attachments, may include confidential and/or proprietary information, and may be used only by the person or entity to which it is addressed. If the reader of this e-mail is not the intended recipient or his or her authorized agent, the reader is hereby notified that any dissemination, distribution or copying of this e-mail is prohibited. If you have received this e-mail in error, please notify the sender by replying to this message and delete this e-mail immediately. This e-mail (including any attachments) is confidential and may be legally privileged. If you are not an intended recipient or an authorized representative of an intended recipient, you are prohibited from using, copying or distributing the information in this e-mail or its attachments. If you have received this e-mail in error, please notify the sender immediately by return e-mail and delete all copies of this message and any attachments. Thank you.
TSM 6.3.1.0 Installation error
Hi All, We are trying to install TSM6.3 with patch 6.3.1.0 on AIX 7.1 machine but getting following error, I went through previous posting regarding similar error with TSM6.1 but no luck. Could you please let me know if anybody got this error and got resolved. [B]Tivoli Storage Manager Deployment Engine failed to initialize. ACUINI0082E The register or deregister request has failed. ClassName: com.ibm.ac.si.tpreg.TouchpointRegistryImpl and Options:[-p, /usr/ibm/common/acsi/wsdl/OSTP_ResourceTypesMRPs.properties]. The installer will now shutdown. Please check with the log files for a more complete description of the failure. Thanks in advance. Thanks, Edit / Delete Edit Post Quick reply to this message Reply Reply With Quote Reply With Quote Multi-Quote This Message +-- |This was sent by whereisapa...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +--
TSM backup marked inactive
Here is the situation: AIX 5.3 TSM 5.2 To a certain directory files are added daily and backed up (manual selective full backup: dsmc backup file1) A given file will never be backed up again All files in this directory are kept on disk indefinitely Each file has one and only one full backup in TSM It has been my undestanding that as long as file is on disk, it will emain active in TSM However, we are seeing that every day files backed up yesterday are marked inactive in TSM Here is what it looks like = dsmc q ba -ina /D01/user01/REG15/SECT57/ IBM Tivoli Storage Manager Command Line Backup/Archive Client Interface - Version 5, Release 2, Level 2.0 (c) Copyright by IBM Corporation and other(s) 1990, 2003. All Rights Reserved. Node Name: NODE01 Session established with server TSM: AIX-RS/6000 Server Version 5, Release 3, Level 0.0 Server date/time: 06/27/12 22:49:45 Last access: 06/27/12 22:46:18 Size Backup DateMgmt Class A/I File ----- --- 204,808,192 B 06/27/12 21:44:37DEFAULT A /D01/user01/REG15/SECT57/Z25147.TXT 22,171,648 B 06/26/12 10:20:09DEFAULT I /D01/user01/REG15/SECT57/Z25116.TXT 33,841,152 B 06/26/12 10:20:13DEFAULT I /D01/user01/REG15/SECT57/Z25117.TXT 27,746,304 B 06/26/12 10:20:20DEFAULT I /D01/user01/REG15/SECT57/Z25118.TXT 12,288 B 06/26/12 10:20:25DEFAULT I /D01/user01/REG15/SECT57/Z25119.TXT 204,808,192 B 06/26/12 23:44:37DEFAULT I /D01/user01/REG15/SECT57/Z25130.TXT 204,808,192 B 06/26/12 23:44:56DEFAULT I /D01/user01/REG15/SECT57/Z25131.TXT 204,808,192 B 06/26/12 23:45:14DEFAULT I /D01/user01/REG15/SECT57/Z25132.TXT 115,646,464 B 06/27/12 01:44:38DEFAULT I /D01/user01/REG15/SECT57/Z25133.TXT 12,288 B 06/27/12 01:45:23DEFAULT I /D01/user01/REG15/SECT57/Z25134.TXT 204,808,192 B 06/27/12 03:44:38DEFAULT I /D01/user01/REG15/SECT57/Z25135.TXT 204,808,192 B 06/27/12 13:44:37DEFAULT I /D01/user01/REG15/SECT57/Z25144.TXT 40,316,928 B 06/27/12 14:36:38DEFAULT I /D01/user01/REG15/SECT57/Z25145.TXT 7,290,880 B 06/27/12 14:50:16DEFAULT I /D01/user01/REG15/SECT57/Z25146.TXT Why are these files marked inactive? Thanks in advance +-- |This was sent by 256...@ukrpost.net via Backup Central. |Forward SPAM to ab...@backupcentral.com. +--
Re: TSM backup marked inactive
A few diagnostic questions. - You said the files are backed up individually (dsmc backup file1) Are there ever any backups that happen with wildcards or any normal incremental that happens on the file system? - Is this directory included in the domain (opt file)? - Is there an include/exclude file configured? - could you provide an output of a dsmc q inclexcl (maybe the dsm.sys and dsm.opt while you're at it. Regards, Shawn Shawn Drew Internet tsm-fo...@backupcentral.com Sent by: ADSM-L@VM.MARIST.EDU 06/27/2012 11:54 PM Please respond to ADSM-L@VM.MARIST.EDU To ADSM-L cc Subject [ADSM-L] TSM backup marked inactive Here is the situation: AIX 5.3 TSM 5.2 To a certain directory files are added daily and backed up (manual selective full backup: dsmc backup file1) A given file will never be backed up again All files in this directory are kept on disk indefinitely Each file has one and only one full backup in TSM It has been my undestanding that as long as file is on disk, it will emain active in TSM However, we are seeing that every day files backed up yesterday are marked inactive in TSM Here is what it looks like = dsmc q ba -ina /D01/user01/REG15/SECT57/ IBM Tivoli Storage Manager Command Line Backup/Archive Client Interface - Version 5, Release 2, Level 2.0 (c) Copyright by IBM Corporation and other(s) 1990, 2003. All Rights Reserved. Node Name: NODE01 Session established with server TSM: AIX-RS/6000 Server Version 5, Release 3, Level 0.0 Server date/time: 06/27/12 22:49:45 Last access: 06/27/12 22:46:18 Size Backup DateMgmt Class A/I File ----- --- 204,808,192 B 06/27/12 21:44:37DEFAULT A /D01/user01/REG15/SECT57/Z25147.TXT 22,171,648 B 06/26/12 10:20:09DEFAULT I /D01/user01/REG15/SECT57/Z25116.TXT 33,841,152 B 06/26/12 10:20:13DEFAULT I /D01/user01/REG15/SECT57/Z25117.TXT 27,746,304 B 06/26/12 10:20:20DEFAULT I /D01/user01/REG15/SECT57/Z25118.TXT 12,288 B 06/26/12 10:20:25DEFAULT I /D01/user01/REG15/SECT57/Z25119.TXT 204,808,192 B 06/26/12 23:44:37DEFAULT I /D01/user01/REG15/SECT57/Z25130.TXT 204,808,192 B 06/26/12 23:44:56DEFAULT I /D01/user01/REG15/SECT57/Z25131.TXT 204,808,192 B 06/26/12 23:45:14DEFAULT I /D01/user01/REG15/SECT57/Z25132.TXT 115,646,464 B 06/27/12 01:44:38DEFAULT I /D01/user01/REG15/SECT57/Z25133.TXT 12,288 B 06/27/12 01:45:23DEFAULT I /D01/user01/REG15/SECT57/Z25134.TXT 204,808,192 B 06/27/12 03:44:38DEFAULT I /D01/user01/REG15/SECT57/Z25135.TXT 204,808,192 B 06/27/12 13:44:37DEFAULT I /D01/user01/REG15/SECT57/Z25144.TXT 40,316,928 B 06/27/12 14:36:38DEFAULT I /D01/user01/REG15/SECT57/Z25145.TXT 7,290,880 B 06/27/12 14:50:16DEFAULT I /D01/user01/REG15/SECT57/Z25146.TXT Why are these files marked inactive? Thanks in advance +-- |This was sent by 256...@ukrpost.net via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- This message and any attachments (the message) is intended solely for the addressees and is confidential. If you receive this message in error, please delete it and immediately notify the sender. Any use not in accord with its purpose, any dissemination or disclosure, either whole or partial, is prohibited except formal approval. The internet can not guarantee the integrity of this message. BNP PARIBAS (and its subsidiaries) shall (will) not therefore be liable for the message if modified. Please note that certain functions and services for BNP Paribas may be performed by BNP Paribas RCC, Inc.
Re: VTL's and D2D solutions
On Jul 2, 2012, at 9:35 AM, Kevin Boatright wrote: We are currently looking at adding a Disk to Disk backup solution. Our current solution has a 3584 tape library with LTO-5 drives using TKLM. We have looked at Exagrid and Data Domain. Also, I believe HP has a solution. We will need to have encryption on the device and the ability to replicate between the two disk units. Why do you have to have encryption on the device? No, that wasn't a sarcastic question. If someone pulls a disk out of your DataDomain RAID, what can they do with it? Your data is striped across many drives, in chunks that are admittedly large enough to have a whole mailing address on it. Is someone afraid that someone else will steal one or more drives and then read unstructured streams of data looking for PII? Really? There's no chance that a tape will fall off a truck as you ship your backups off site. Sure, encrypt the VPN between sites, or use a dedicated network. But that doesn't mean you have to encrypt your data on the appliance, unless you're more paranoid than I am (or answer to people who are more paranoid than I am). At this point, I start worrying more about debacles from poor implementation or management of encryption than I do about loss of unencrypted data. Anyone have any comments or recommendations? Besides DataDomain, HP, and IBM, I'm sure the rest of EMC, Oracle, and even small brands like Coraid would propose different solutions. For example, why not replicate cheap disk, on top of which you build FILE devices? Do you need the cost of a DataDomain or ProtecTier front-end, or do you just replicate unduplicated data? Oracle and Coraid will sell you large arrays of cheap disk with ZFS front-ends that could replicate data if you need it and could deduplicate the data as justified. I'm not saying I'd want to bet my job on Coraid, but others find there cost advantage over DataDomain attractive. Thanks, Kevin Nick
Re: select or other command
Hi Geoff, there isn't one command to do this, but a select and then 1 or 2 show commands will find the volume name. Here is an example. tsm: WIN2select object_id from backups where node_name = 'A-NODE-NAME' and ll_name = 'OUTLOOK.PST' OBJECT_ID - 590316 tsm: WIN2show bfo 590316 Bitfile Object: 590316 Active **Archival Bitfile Entry Bitfile Type: PRIMARY Storage Format: 22 Bitfile Size: 10480218 Number of Segments: 1, flags: 0 Storage Pool ID: 8 Volume ID: 127 Volume Name: /tsm_nx331/win2/007F.BFS tsm: WIN2show invo 590316 Inventory object 590316 of copy type Backup has attributes: NodeName: A-NODE-NAME, Filespace(1): \\a-node-name\c$, ObjName: \USERS\A-NODE-NAME\APPDATA\LOCAL\MICROSOFT\OUTLOOK\OUTLOOK.PST. hlID: 0292E2463557C3F93E61EB8A7821EA1BE364A261 llID: 93534B77D3C2BC010BCA14FAF8EB123DC0ED5D7B Type: 2 (File) MC: 18 (OUTLOOK3) CG: 1 Size: 32016384 HeaderSize: 0 Active, Inserted 03/06/2012 11:25:28 AM (CUT Not Set) GroupMap , bypassRecogToken NULL Bitfile Object: 590316 Active **Archival Bitfile Entry Bitfile Type: PRIMARY Storage Format: 22 Bitfile Size: 10480218 Number of Segments: 1, flags: 0 Storage Pool ID: 8 Volume ID: 127 Volume Name: /tsm_nx331/win2/007F.BFS Sometimes the 'show bfo' is suffiecient and sometimes the 'show invo' is required depending on if the file is in an aggregate or by itself. I have used this process too many time to find files which should not have been backed up and thoroughly expunge all traces of them. You will probably need to expand the select to distinguish active and inactive versions and to improve performance on version 5 servers. On version 6 servers just supplying the ll_name is very quick. Bill Colwell Draper Lab -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Geoff Gill Sent: Thursday, June 28, 2012 8:38 PM To: ADSM-L@VM.MARIST.EDU Subject: select or other command Hello, Over the years I've saved a lot of commands but never saw one for this. I'm not sure if it is possible but I thought I'd ask to see if anyone has it. Is it possible to create a select command that I input the name of a file that was backed up and have the output tell me what tape(s) it would be on? I have a command that will tell me all the tapes a node has data on, and another to spit out the contents of a tape to a file, and from there search for the filename but I'm curious if there is an easier way. Thank You Geoff Gill
Re: VTL's and D2D solutions
If someone pulls a disk out of the array, (replacing a bad disk, etc), you can't tell a regulator/auditor that it was encrypted. A purely bureaucratic reason, but still valid. Regulations pop up all the time without actual technical consideration. (I want to punch anyone who says the words 7 years to me!) The OP's email address sounds like he's involved in the health care industry. They have the worst of it. Almost as bad as the financial industry. Regards, Shawn Shawn Drew Internet dplafla...@gmail.com Sent by: ADSM-L@VM.MARIST.EDU 07/02/2012 05:35 PM Please respond to ADSM-L@VM.MARIST.EDU To ADSM-L cc Subject Re: [ADSM-L] VTL's and D2D solutions On Jul 2, 2012, at 9:35 AM, Kevin Boatright wrote: We are currently looking at adding a Disk to Disk backup solution. Our current solution has a 3584 tape library with LTO-5 drives using TKLM. We have looked at Exagrid and Data Domain. Also, I believe HP has a solution. We will need to have encryption on the device and the ability to replicate between the two disk units. Why do you have to have encryption on the device? No, that wasn't a sarcastic question. If someone pulls a disk out of your DataDomain RAID, what can they do with it? Your data is striped across many drives, in chunks that are admittedly large enough to have a whole mailing address on it. Is someone afraid that someone else will steal one or more drives and then read unstructured streams of data looking for PII? Really? There's no chance that a tape will fall off a truck as you ship your backups off site. Sure, encrypt the VPN between sites, or use a dedicated network. But that doesn't mean you have to encrypt your data on the appliance, unless you're more paranoid than I am (or answer to people who are more paranoid than I am). At this point, I start worrying more about debacles from poor implementation or management of encryption than I do about loss of unencrypted data. Anyone have any comments or recommendations? Besides DataDomain, HP, and IBM, I'm sure the rest of EMC, Oracle, and even small brands like Coraid would propose different solutions. For example, why not replicate cheap disk, on top of which you build FILE devices? Do you need the cost of a DataDomain or ProtecTier front-end, or do you just replicate unduplicated data? Oracle and Coraid will sell you large arrays of cheap disk with ZFS front-ends that could replicate data if you need it and could deduplicate the data as justified. I'm not saying I'd want to bet my job on Coraid, but others find there cost advantage over DataDomain attractive. Thanks, Kevin Nick This message and any attachments (the message) is intended solely for the addressees and is confidential. If you receive this message in error, please delete it and immediately notify the sender. Any use not in accord with its purpose, any dissemination or disclosure, either whole or partial, is prohibited except formal approval. The internet can not guarantee the integrity of this message. BNP PARIBAS (and its subsidiaries) shall (will) not therefore be liable for the message if modified. Please note that certain functions and services for BNP Paribas may be performed by BNP Paribas RCC, Inc.
