Re: archive / hsm for windows question
Got it. Thanks. All are restored. -Original Message- From: ADSM: Dist Stor Manager On Behalf Of Stefan Bender Sent: Friday, September 28, 2018 10:38 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] archive / hsm for windows question Hi all, dsmclc is also in version 6.3 able to retrieves files to a different directory. Here is the examples that were published in the admin guide of 6.3: Retrieve the archived .xls files in the c:\big projects\2009\ directory to a new path: c:\projects\spreadsheets\. The archive copies are in file space def-hsm01. Command: dsmclc retrieve -g def-hsm01 c: "\big projects\2009" *.xls c:\projects\spreadsheets. Spaces separate the three parts of the search_pattern: c: "\big projects\2009" *.xls. Because the directory_pattern (\big projects\2009) contains a blank space, it is enclosed in quotation marks. Before running a retrieve I usually run the "dsmclc list" command with the same pattern to validate that I get the right files: List all .doc archives in the c:\big projects\2009\ directory . The archive copies are in file space def-hsm01. Command: dsmclc list -g def-hsm01 c: "\big projects\2009" *.doc Mit freundlichen Grü?en / best regards Stefan Bender IBM Deutschland / Am Weiher 24 / 65451 Kelsterbach / Germany IBM Software Development "IBM Spectrum Protect" -- IBM Deutschland Research & Development GmbH / Vorsitzende des Aufsichtsrats: Martina Koederitz Gesch?ftsführung: Dirk Wittkopp Sitz der Gesellschaft: B?blingen / Registergericht: Amtsgericht Stuttgart, HRB 243294 From: Efim To: ADSM-L@VM.MARIST.EDU Date: 25/09/2018 19:51 Subject:Re: [ADSM-L] archive / hsm for windows question Sent by:"ADSM: Dist Stor Manager" Hi, As I know you can recall HSM files only using HSM client. In version 7.1.X you can use command dsmclc retrieve for it. Don't know about 6.3. Example: https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww-01.ibm.com%2Fsupport%2Fdocview.wss%3Fuid%3Dswg21580766&data=02%7C01%7Cglee%40BSU.EDU%7Cc7fc8553e0a74371c5d308d6255067be%7C6fff909f07dc40da9e30fd7549c0f494%7C0%7C0%7C636737424606826739&sdata=jiw%2BXrWWNwzQUIpOG504CyQHu9vjS6tNplDBl3KYAAQ%3D&reserved=0 Efim > 25 сент. 2018 г., в 20:29, Lee, Gary написал(а): > > I have a server which is running hsm for windows 6.3. > > Folks have deleted the stub files for much of their data. > > I need to restore, as we are terminating tsm services for that data center. > > Is there a way to retrieve the archives avoiding the hsm client, just use the tsm client? > This would let me retrieve to another workstation to put things on a stick. > > If not, I need a little help with the hsm command line to craft a retrieval to a new directory tree. > > Thanks for any assistance.
Re: archive / hsm for windows question
Hi all, dsmclc is also in version 6.3 able to retrieves files to a different directory. Here is the examples that were published in the admin guide of 6.3: Retrieve the archived .xls files in the c:\big projects\2009\ directory to a new path: c:\projects\spreadsheets\. The archive copies are in file space def-hsm01. Command: dsmclc retrieve -g def-hsm01 c: "\big projects\2009" *.xls c:\projects\spreadsheets. Spaces separate the three parts of the search_pattern: c: "\big projects\2009" *.xls. Because the directory_pattern (\big projects\2009) contains a blank space, it is enclosed in quotation marks. Before running a retrieve I usually run the "dsmclc list" command with the same pattern to validate that I get the right files: List all .doc archives in the c:\big projects\2009\ directory . The archive copies are in file space def-hsm01. Command: dsmclc list -g def-hsm01 c: "\big projects\2009" *.doc Mit freundlichen Grü?en / best regards Stefan Bender IBM Deutschland / Am Weiher 24 / 65451 Kelsterbach / Germany IBM Software Development "IBM Spectrum Protect" -- IBM Deutschland Research & Development GmbH / Vorsitzende des Aufsichtsrats: Martina Koederitz Gesch?ftsführung: Dirk Wittkopp Sitz der Gesellschaft: B?blingen / Registergericht: Amtsgericht Stuttgart, HRB 243294 From: Efim To: ADSM-L@VM.MARIST.EDU Date: 25/09/2018 19:51 Subject:Re: [ADSM-L] archive / hsm for windows question Sent by:"ADSM: Dist Stor Manager" Hi, As I know you can recall HSM files only using HSM client. In version 7.1.X you can use command dsmclc retrieve for it. Don't know about 6.3. Example: http://www-01.ibm.com/support/docview.wss?uid=swg21580766 Efim > 25 сент. 2018 г., в 20:29, Lee, Gary написал(а): > > I have a server which is running hsm for windows 6.3. > > Folks have deleted the stub files for much of their data. > > I need to restore, as we are terminating tsm services for that data center. > > Is there a way to retrieve the archives avoiding the hsm client, just use the tsm client? > This would let me retrieve to another workstation to put things on a stick. > > If not, I need a little help with the hsm command line to craft a retrieval to a new directory tree. > > Thanks for any assistance.
Re: archive / hsm for windows question
Hi, As I know you can recall HSM files only using HSM client. In version 7.1.X you can use command dsmclc retrieve for it. Don't know about 6.3. Example: http://www-01.ibm.com/support/docview.wss?uid=swg21580766 Efim > 25 сент. 2018 г., в 20:29, Lee, Gary написал(а): > > I have a server which is running hsm for windows 6.3. > > Folks have deleted the stub files for much of their data. > > I need to restore, as we are terminating tsm services for that data center. > > Is there a way to retrieve the archives avoiding the hsm client, just use the > tsm client? > This would let me retrieve to another workstation to put things on a stick. > > If not, I need a little help with the hsm command line to craft a retrieval > to a new directory tree. > > Thanks for any assistance.
archive / hsm for windows question
I have a server which is running hsm for windows 6.3. Folks have deleted the stub files for much of their data. I need to restore, as we are terminating tsm services for that data center. Is there a way to retrieve the archives avoiding the hsm client, just use the tsm client? This would let me retrieve to another workstation to put things on a stick. If not, I need a little help with the hsm command line to craft a retrieval to a new directory tree. Thanks for any assistance.
Re: Windows HSM Recall Dialog syntax
Hi Bill, if I understand it right, you want to move you migrated files from one file server to another file server. Are you going to use HSM on that new file server as well? In that case the HSM version on the new server is probably newer. Thus you may consider to use the stub moving tools. Basically you configure a connection on your new file server to the old one and then run the dsmmove tool on the new server to pull the stubs from the old server. This is first moving the stubs around and then in the background moving the content of that files from the old TSM server to the new one. Here is the link to Info Center on stub moving http://pic.dhe.ibm.com/infocenter/tsminfo/v6r4/topic/com.ibm.itsm.hsmwin.doc/c_moving_migd_files.html . On your GUI question: I haven't tested the search in the 5.5 GUI, but it should work like this: File Space: HSM-FILESPACE Volume:D: Path: \users\Bill\ Filename: <* for all> * I hope that helps. Mit freundlichen Grüßen / best regards Stefan Bender Hechtsheimer Strasse 2 / 55131 Mainz / Germany IBM Software Group, Tivoli Software Development "Tivoli Storage Manager" Tel. ++49-6131-846989 or ++49-7034-643-2773 / Fax. ++49-6131-84-6099 / email: stefan.ben...@de.ibm.com -- IBM Deutschland Research & Development GmbH / Vorsitzende des Aufsichtsrats: Martina Koederitz Geschäftsführung: Dirk Wittkopp Sitz der Gesellschaft: Böblingen / Registergericht: Amtsgericht Stuttgart, HRB 243294 From: Bill Boyer To: ADSM-L@vm.marist.edu, Date: 11/27/2013 19:10 Subject: [ADSM-L] Windows HSM Recall Dialog syntax Sent by:"ADSM: Dist Stor Manager" This is an old system and the customer wants all the archive data copied/moved to a new server. Figured the easiest way is to use the HSM GUI recall dialog. What is the syntax in the drive and path boxes to allow me to filter what I want? Tried multiple variations but it always returns nothing. There are so many files migrated that the V5.5 client (I know..old) terminates if I ask for everything. I would like to do it one directory at a time from the volume. Any help is appreciated. Bill Boyer DSS, Inc. (610) 927-4407 "Enjoy life. It has an expiration date." - ??
Re: Windows HSM Recall Dialog syntax
Can you use an EXPORT NODE with TOSERVER? -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Bill Boyer Sent: Wednesday, November 27, 2013 12:09 PM To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] Windows HSM Recall Dialog syntax This is an old system and the customer wants all the archive data copied/moved to a new server. Figured the easiest way is to use the HSM GUI recall dialog. What is the syntax in the drive and path boxes to allow me to filter what I want? Tried multiple variations but it always returns nothing. There are so many files migrated that the V5.5 client (I know..old) terminates if I ask for everything. I would like to do it one directory at a time from the volume. Any help is appreciated. Bill Boyer DSS, Inc. (610) 927-4407 "Enjoy life. It has an expiration date." - ?? [Confidentiality notice:] *** This e-mail message, including attachments, if any, is intended for the person or entity to which it is addressed and may contain confidential or privileged information. Any unauthorized review, use, or disclosure is prohibited. If you are not the intended recipient, please contact the sender and destroy the original message, including all copies, Thank you. ***
Re: Windows HSM Recall Dialog syntax
Commonly, HSM archives are backed up as well. If that’s the case, restoral would be the much less painful method. Richard Sims, still at Boston University
Windows HSM Recall Dialog syntax
This is an old system and the customer wants all the archive data copied/moved to a new server. Figured the easiest way is to use the HSM GUI recall dialog. What is the syntax in the drive and path boxes to allow me to filter what I want? Tried multiple variations but it always returns nothing. There are so many files migrated that the V5.5 client (I know..old) terminates if I ask for everything. I would like to do it one directory at a time from the volume. Any help is appreciated. Bill Boyer DSS, Inc. (610) 927-4407 "Enjoy life. It has an expiration date." - ??
Re: trying to get the latest hsm for win32 6.3.1.x client
64-bit is here: ftp://service.boulder.ibm.com//storage/tivoli-storage-management/patches/client/v6r3/Windows/x64/v631/HSM On Tue, Oct 1, 2013 at 10:45 AM, Zoltan Forray wrote: > Have you tried going directly to the FTP site? Latest 6.3.1.1 HSM patches > are here: > > > ftp://service.boulder.ibm.com//storage/tivoli-storage-management/patches/client/v6r3/Windows/x32/v631/HSM > > > On Tue, Oct 1, 2013 at 10:37 AM, Lee, Gary wrote: > >> Have went through two tries, 1 via google, the other direct through ibm. >> Get "page not found" any time I try and download this client. >> >> Can anyone out there either point me to a good download link, or put it >> somewhere where I can get it? >> >> Using i.e. 10 64 bit if that makes a different. >> >> Need to see if this resolves a problem it created with the tsm scheduler >> and backups. >> > > > > -- > *Zoltan Forray* > TSM Software & Hardware Administrator > Virginia Commonwealth University > UCC/Office of Technology Services > zfor...@vcu.edu - 804-828-4807 > Don't be a phishing victim - VCU and other reputable organizations will > never use email to request that you reply with your password, social > security number or confidential personal information. For more details > visit http://infosecurity.vcu.edu/phishing.html > -- *Zoltan Forray* TSM Software & Hardware Administrator Virginia Commonwealth University UCC/Office of Technology Services zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://infosecurity.vcu.edu/phishing.html
Re: trying to get the latest hsm for win32 6.3.1.x client
Have you tried going directly to the FTP site? Latest 6.3.1.1 HSM patches are here: ftp://service.boulder.ibm.com//storage/tivoli-storage-management/patches/client/v6r3/Windows/x32/v631/HSM On Tue, Oct 1, 2013 at 10:37 AM, Lee, Gary wrote: > Have went through two tries, 1 via google, the other direct through ibm. > Get "page not found" any time I try and download this client. > > Can anyone out there either point me to a good download link, or put it > somewhere where I can get it? > > Using i.e. 10 64 bit if that makes a different. > > Need to see if this resolves a problem it created with the tsm scheduler > and backups. > -- *Zoltan Forray* TSM Software & Hardware Administrator Virginia Commonwealth University UCC/Office of Technology Services zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://infosecurity.vcu.edu/phishing.html
trying to get the latest hsm for win32 6.3.1.x client
Have went through two tries, 1 via google, the other direct through ibm. Get "page not found" any time I try and download this client. Can anyone out there either point me to a good download link, or put it somewhere where I can get it? Using i.e. 10 64 bit if that makes a different. Need to see if this resolves a problem it created with the tsm scheduler and backups.
Re: hsm for windows problem
Hi Gary, HSM for Windows is organizing its data in user-defined file spaces. That is different from what you know from the Backup-Archive client. The BA is creating its file spaces automatically based on the name of the host and the volume. In HSM for Windows you have to create your own file space, like 'HSM-drive-g' and specify that as target file space for your migration. With that you have the option to store all data from all volumes in one big file space. That's not recommended by me as this is making queries slower. Most customers have one file space per volume. You also may chose to migrate all your office documents to a file space called like 'office-docs' and all your videos to a file space called like 'movies' and so on. If you want to get rid of all data from your G: drive, you do not have to use reconcile. You can use the command line tool dsmclc, which is located in the HSM client's install directory. That's by default on an English system "C:\Program Files\Tivoli\TSM\hsmclient". The syntax for deletion everything that was migrated from G: is "dsmclc delete -g * *" If your file space name is HSM-drive-G the command will look like: "dsmclc delete -g HSM-drive-G G: * * " This will delete everything to the TSM server that was stored in the file space 'HSM-drive-G' and that was located at the time of migration in a path starting with the drive letter G: . If you want to verify before what data is there, you can replace the keyword "delete" by "list". In the example above it is like: "dsmclc list -g HSM-drive-G G: * * " With that you will receive a full list of all files that have been migrated from your G: drive into that file space. In case you do not know the name of the used file space, use the dsmclc command to get a list of all file spaces and run the list or delete command after that for each file space. The command to get a list of all file spaces is: "dsmclc listfilespaces * " However before you really delete things, I rather would like to understand the errors you are receiving. As far as I understand the situation, deleting the data from TSM will not resolve the errors. So I think I am missing a piece in the puzzle. Regarding your other questions: There is an FAQ on the web for HSM for Windows and it's UNIX counterpart TSM for Space Management. Here is the link: http://www.ibm.com/support/docview.wss?uid=swg21474412 I hope it has some valuable information for you. If something is missing or not clear to understand, please let me know. I will try to improve it in that case. And finally the hardware mappings: HSM is storing the data on TSM with their original names. That means with the name of the file at the time of migration. That file name includes the host or cluster name as well as the drive letter. In case you are changing a drive letter, your host or cluster name or you take a disk from one host and put it into another host, some HSM operations will not work as expected. This especially includes reconcile. If you want to get some more explanation about this, may be you start another thread on the forum. Mit freundlichen Grüßen / best regards Stefan Bender IBM Software Group, Tivoli Software Development "Tivoli Storage Manager" From: "Lee, Gary" To: ADSM-L@vm.marist.edu, Date: 03/07/2013 19:37 Subject:Re: [ADSM-L] hsm for windows problem Sent by:"ADSM: Dist Stor Manager" I am able to use the command line tools. The problem is that a partition (drive g:) has been removed. The data is no longer needed. I would like to remove it from hsm and the tsm server. I believe this would involve setting up the g: volume for a reconcile. I will also have other questions as time goes along. Are there any case studies or best practice documents? Also, how to make different drives do their hsm to different file spaces? And What are, and how do I create hardware mappings? These are just some. The reconciliation is the most urgent. Thank you for your assistance. Gary Lee Senior System Programmer Ball State University phone: 765-285-1310 -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Stefan Bender Sent: Thursday, March 07, 2013 8:22 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] hsm for windows problem Hi Gary, can you explain me a little more detail about the errors you are seeing? What kind of operation in causing the problem? What is failing? You say the GUI is not available for you. Are you able to use the command line tools of HSM for Windows? Mit freundlichen Grüßen / best regards Stefan Bender IBM Software Group, Tivoli Software Development "Tivoli Storage Manager" -
Re: hsm for windows problem
I am able to use the command line tools. The problem is that a partition (drive g:) has been removed. The data is no longer needed. I would like to remove it from hsm and the tsm server. I believe this would involve setting up the g: volume for a reconcile. I will also have other questions as time goes along. Are there any case studies or best practice documents? Also, how to make different drives do their hsm to different file spaces? And What are, and how do I create hardware mappings? These are just some. The reconciliation is the most urgent. Thank you for your assistance. Gary Lee Senior System Programmer Ball State University phone: 765-285-1310 -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Stefan Bender Sent: Thursday, March 07, 2013 8:22 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] hsm for windows problem Hi Gary, can you explain me a little more detail about the errors you are seeing? What kind of operation in causing the problem? What is failing? You say the GUI is not available for you. Are you able to use the command line tools of HSM for Windows? Mit freundlichen Grüßen / best regards Stefan Bender IBM Software Group, Tivoli Software Development "Tivoli Storage Manager" -- IBM Deutschland Research & Development GmbH / Vorsitzende des Aufsichtsrats: Martina Koederitz Geschäftsführung: Dirk Wittkopp Sitz der Gesellschaft: Böblingen / Registergericht: Amtsgericht Stuttgart, HRB 243294 From: "Lee, Gary" To: ADSM-L@vm.marist.edu, Date: 03/05/2013 08:27 AM Subject:[ADSM-L] hsm for windows problem Sent by:"ADSM: Dist Stor Manager" Hsm for windows 6.3.1, tsm server 6.2.4. HSM for windows configured on a server. The server admin destroyed a partition without letting any one know. Now hsm is complaining that drive g: cannot be found. How do I get rid of all files from drive g: and make hsm forget it ever existed. The gui is not available to me, and I must say, this does not seem to be nearly as mature a product as tsm. Any hints are appreciated. Gary Lee Senior System Programmer Ball State University phone: 765-285-1310
Re: hsm for windows problem
Hi Gary, can you explain me a little more detail about the errors you are seeing? What kind of operation in causing the problem? What is failing? You say the GUI is not available for you. Are you able to use the command line tools of HSM for Windows? Mit freundlichen Grüßen / best regards Stefan Bender IBM Software Group, Tivoli Software Development "Tivoli Storage Manager" -- IBM Deutschland Research & Development GmbH / Vorsitzende des Aufsichtsrats: Martina Koederitz Geschäftsführung: Dirk Wittkopp Sitz der Gesellschaft: Böblingen / Registergericht: Amtsgericht Stuttgart, HRB 243294 From: "Lee, Gary" To: ADSM-L@vm.marist.edu, Date: 03/05/2013 08:27 AM Subject:[ADSM-L] hsm for windows problem Sent by:"ADSM: Dist Stor Manager" Hsm for windows 6.3.1, tsm server 6.2.4. HSM for windows configured on a server. The server admin destroyed a partition without letting any one know. Now hsm is complaining that drive g: cannot be found. How do I get rid of all files from drive g: and make hsm forget it ever existed. The gui is not available to me, and I must say, this does not seem to be nearly as mature a product as tsm. Any hints are appreciated. Gary Lee Senior System Programmer Ball State University phone: 765-285-1310
hsm for windows problem
Hsm for windows 6.3.1, tsm server 6.2.4. HSM for windows configured on a server. The server admin destroyed a partition without letting any one know. Now hsm is complaining that drive g: cannot be found. How do I get rid of all files from drive g: and make hsm forget it ever existed. The gui is not available to me, and I must say, this does not seem to be nearly as mature a product as tsm. Any hints are appreciated. Gary Lee Senior System Programmer Ball State University phone: 765-285-1310
SV: HSM 6.3 problem
Hi Chavdar, If you have any issues with the HSM then should you probably send more information. I have a GPFS/HSM issue with 6.4.0.0 where it calls back to much information. Best Regards Christian Svensson Cell: +46-70-325 1577 E-mail: christian.svens...@cristie.se Säkra återläsningar. -Ursprungligt meddelande- Från: Chavdar Cholev [mailto:chavdar.cho...@gmail.com] Skickat: den 5 december 2012 23:14 Till: ADSM-L@VM.MARIST.EDU Ämne: HSM 6.3 problem Hi All, I am looking for opinion about HSM 6.3.0.1. After upgrade to HSM 6.3.0.1 form 6.1.4 and after that it stops to recall files. The configuration is two node cluster running on windows 2008 r2 Best regards Chavdar
HSM 6.3 problem
Hi All, I am looking for opinion about HSM 6.3.0.1. After upgrade to HSM 6.3.0.1 form 6.1.4 and after that it stops to recall files. The configuration is two node cluster running on windows 2008 r2 Best regards Chavdar
hsm for windows and include / exclude
Anyone out there playing with hsm for windows, are there any of the include or exclude statements useable in the dsm.opt? We are trying to implement a university wide policy of moving all files not accessed in A specified time to tsm storage. I would like to automate this as much as possible. Our backups are set with a default set of includes and excludes, so that our schedules use the standard incremental command. I want to try and create something similar for hsm. Any help and insites are appreciated. Gary Lee Senior System Programmer Ball State University phone: 765-285-1310
Re: ibm hsm for windows download
Finally got our hsm. Thanks to all. Turned out to be a combination of browser troubles, and IBM not crediting us with the purchase. Now to get it working. Latest I saw and got was 6.3. Gary Lee Senior System Programmer Ball State University phone: 765-285-1310 -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of James Choate Sent: Wednesday, September 12, 2012 2:52 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] ibm hsm for windows download Gary. The latest version I have found on the IBM site is under v6.1.5. ftp://public.dhe.ibm.com/storage/tivoli-storage-management/maintenance/client/v6r1/Windows/x64/v615/HSM/ Can you pull a 6.3 version from Passport advantage? -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Lee, Gary Sent: Wednesday, September 12, 2012 12:19 PM To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] ibm hsm for windows download I need a little help from sone one out there. Trying to download ibm hsm for windows. We have purchased it, and I even have the proof of entitlement document. However, no amount of searching in the ibm download site has lead me to the product. The closest I've gotten is a quick start guide. Can anyone out there point me in the right direction? I find tsm for space management, tsm for databases, tsm extended edition, but no hsm for windows. Thank you in advance for any assistance. Gary Lee Senior System Programmer Ball State University phone: 765-285-1310
Re: ibm hsm for windows download
Sir: That is where I've been searching all afternoon. No joy. Gary Lee Senior System Programmer Ball State University phone: 765-285-1310 -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Ehresman,David E. Sent: Wednesday, September 12, 2012 2:35 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] ibm hsm for windows download We download licensed TSM software from Passport Advantage, http://www-01.ibm.com/software/howtobuy/passportadvantage/ -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Lee, Gary Sent: Wednesday, September 12, 2012 2:19 PM To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] ibm hsm for windows download I need a little help from sone one out there. Trying to download ibm hsm for windows. We have purchased it, and I even have the proof of entitlement document. However, no amount of searching in the ibm download site has lead me to the product. The closest I've gotten is a quick start guide. Can anyone out there point me in the right direction? I find tsm for space management, tsm for databases, tsm extended edition, but no hsm for windows. Thank you in advance for any assistance. Gary Lee Senior System Programmer Ball State University phone: 765-285-1310
Re: ibm hsm for windows download
I can't even find it listed on passport advantage. Gary Lee Senior System Programmer Ball State University phone: 765-285-1310 -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of James Choate Sent: Wednesday, September 12, 2012 2:52 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] ibm hsm for windows download Gary. The latest version I have found on the IBM site is under v6.1.5. ftp://public.dhe.ibm.com/storage/tivoli-storage-management/maintenance/client/v6r1/Windows/x64/v615/HSM/ Can you pull a 6.3 version from Passport advantage? -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Lee, Gary Sent: Wednesday, September 12, 2012 12:19 PM To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] ibm hsm for windows download I need a little help from sone one out there. Trying to download ibm hsm for windows. We have purchased it, and I even have the proof of entitlement document. However, no amount of searching in the ibm download site has lead me to the product. The closest I've gotten is a quick start guide. Can anyone out there point me in the right direction? I find tsm for space management, tsm for databases, tsm extended edition, but no hsm for windows. Thank you in advance for any assistance. Gary Lee Senior System Programmer Ball State University phone: 765-285-1310
Re: ibm hsm for windows download
Gary. The latest version I have found on the IBM site is under v6.1.5. ftp://public.dhe.ibm.com/storage/tivoli-storage-management/maintenance/client/v6r1/Windows/x64/v615/HSM/ Can you pull a 6.3 version from Passport advantage? -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Lee, Gary Sent: Wednesday, September 12, 2012 12:19 PM To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] ibm hsm for windows download I need a little help from sone one out there. Trying to download ibm hsm for windows. We have purchased it, and I even have the proof of entitlement document. However, no amount of searching in the ibm download site has lead me to the product. The closest I've gotten is a quick start guide. Can anyone out there point me in the right direction? I find tsm for space management, tsm for databases, tsm extended edition, but no hsm for windows. Thank you in advance for any assistance. Gary Lee Senior System Programmer Ball State University phone: 765-285-1310
Re: ibm hsm for windows download
We download licensed TSM software from Passport Advantage, http://www-01.ibm.com/software/howtobuy/passportadvantage/ -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Lee, Gary Sent: Wednesday, September 12, 2012 2:19 PM To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] ibm hsm for windows download I need a little help from sone one out there. Trying to download ibm hsm for windows. We have purchased it, and I even have the proof of entitlement document. However, no amount of searching in the ibm download site has lead me to the product. The closest I've gotten is a quick start guide. Can anyone out there point me in the right direction? I find tsm for space management, tsm for databases, tsm extended edition, but no hsm for windows. Thank you in advance for any assistance. Gary Lee Senior System Programmer Ball State University phone: 765-285-1310
ibm hsm for windows download
I need a little help from sone one out there. Trying to download ibm hsm for windows. We have purchased it, and I even have the proof of entitlement document. However, no amount of searching in the ibm download site has lead me to the product. The closest I've gotten is a quick start guide. Can anyone out there point me in the right direction? I find tsm for space management, tsm for databases, tsm extended edition, but no hsm for windows. Thank you in advance for any assistance. Gary Lee Senior System Programmer Ball State University phone: 765-285-1310
Re: HSM + Windows 2008 DFS
yes, I did. I had two Windows 2003 with DFS, HSM works independently of each windows 2003, the stub files weren't replicated among servers. De: Bruno Para: ADSM-L@VM.MARIST.EDU Enviado: jueves 22 de septiembre de 2011 17:16 Asunto: HSM + Windows 2008 DFS Hi TSMers, has anybody tried this before? We are breaking a Windows 2003 File Server Cluster and migrating the data to a Windows 2008 R2 DFS environment with two hosts. Today this cluster has TSM 5.5 + HSM 5.5. Approximately, the HSM is handling 2 TB of data. By the nature of the DFS environment, it will constantly check and validate the data replication between the hosts. So the Windows HSM concept does not apply to this scenario, since the stub files left in the file system will be accessed "constantly" and then retrieved from the TSM Server. Is it correct? My best regards, Bruno Melo
HSM + Windows 2008 DFS
Hi TSMers, has anybody tried this before? We are breaking a Windows 2003 File Server Cluster and migrating the data to a Windows 2008 R2 DFS environment with two hosts. Today this cluster has TSM 5.5 + HSM 5.5. Approximately, the HSM is handling 2 TB of data. By the nature of the DFS environment, it will constantly check and validate the data replication between the hosts. So the Windows HSM concept does not apply to this scenario, since the stub files left in the file system will be accessed "constantly" and then retrieved from the TSM Server. Is it correct? My best regards, Bruno Melo
Re: Two HSM quesions
On Jun 24, 2011, at 1:50 AM, Mehdi Salehi wrote: > Thank you, Paul. And is it included in b/a client in Unix systems? Refer to the IBM documentation, "IBM Tivoli Storage Manager for UNIX and Linux Backup-Archive Clients: Installation and User's Guide", which summarizes what is provided in the distributions. HSM is a separate product, but is supplied in the B/A client package for convenience. Note also the need for licensing to use the product. Richard Sims
Re: Two HSM quesions
You are right Paul, I misunderstood that part of HSM for Unix, sorry Mehdi. On Thu, Jun 23, 2011 at 9:21 PM, Paul Fielding wrote: > On Thu, Jun 23, 2011 at 7:07 AM, Stefan Folkerts < > stefan.folke...@gmail.com> > wrote: > > > The trick is that the backup in TSM IS the migrated version of the file, > so > > when you migrate you backup. > > > > It's been awhile since I've used HSM on Unix, but (unless something has > changed) I disagree with this statement. > > In Unix HSM (which is the only one I've used), migrated files and backed up > files are not the same thing. a migrated file is still at risk of loss. > Migrated files use different rules than backed up files, and as such need > a > separate backup in order to ensure you're protected. > > The most prudent way to do this safely is to ensure that you have TSM set > to > require a file be backed up prior to being migrated (set MIGREQUIRESBACKUP > in mgmt class that you're using for HSM). This defines that a file will > not be migrated until it has previously been backed up. HSM data is > independent of backup data, can be kept in differing storage pools if > desired, and do indeed take up their own space. > > As long as you have this set, and run regular incremental backups, you'll > have a good backup of the data in the event the migrated file gets > deleted/corrupted/lost. You won't need to worry about the migrated state > of your files - TSM will keep the full file backed up, regardless if it is > resident or migrated. > > regards, > > Paul > > This is different in Windows where a backup and a migrated file are two > > different things because HSM for Windows is archive based and therefor > not > > as nice. > > HSM for Unix rocks! > > > > On Thu, Jun 23, 2011 at 2:05 PM, Mehdi Salehi wrote: > > > > > Hi, > > > I have two HSM questions: > > > - Is HSM for Unix included in TSM b/a client? > > > - What is the way to backup an HSM-managed filesystem? The illusion for > > me > > > is that HSM data is not fixed, some of it might be on tape today, but > > based > > > on the configurations and actually the need for data, at another time > the > > > contents of the filesystem would be totally different. How to > > > protect/backup > > > the data? > > > > > > Thank you, > > > Mehdi > > > > > >
Re: Two HSM quesions
Thank you, Paul. And is it included in b/a client in Unix systems?
Re: Two HSM quesions
On Thu, Jun 23, 2011 at 7:07 AM, Stefan Folkerts wrote: > The trick is that the backup in TSM IS the migrated version of the file, so > when you migrate you backup. > It's been awhile since I've used HSM on Unix, but (unless something has changed) I disagree with this statement. In Unix HSM (which is the only one I've used), migrated files and backed up files are not the same thing. a migrated file is still at risk of loss. Migrated files use different rules than backed up files, and as such need a separate backup in order to ensure you're protected. The most prudent way to do this safely is to ensure that you have TSM set to require a file be backed up prior to being migrated (set MIGREQUIRESBACKUP in mgmt class that you're using for HSM). This defines that a file will not be migrated until it has previously been backed up. HSM data is independent of backup data, can be kept in differing storage pools if desired, and do indeed take up their own space. As long as you have this set, and run regular incremental backups, you'll have a good backup of the data in the event the migrated file gets deleted/corrupted/lost. You won't need to worry about the migrated state of your files - TSM will keep the full file backed up, regardless if it is resident or migrated. regards, Paul This is different in Windows where a backup and a migrated file are two > different things because HSM for Windows is archive based and therefor not > as nice. > HSM for Unix rocks! > > On Thu, Jun 23, 2011 at 2:05 PM, Mehdi Salehi wrote: > > > Hi, > > I have two HSM questions: > > - Is HSM for Unix included in TSM b/a client? > > - What is the way to backup an HSM-managed filesystem? The illusion for > me > > is that HSM data is not fixed, some of it might be on tape today, but > based > > on the configurations and actually the need for data, at another time the > > contents of the filesystem would be totally different. How to > > protect/backup > > the data? > > > > Thank you, > > Mehdi > > >
Re: Two HSM quesions
The trick is that the backup in TSM IS the migrated version of the file, so when you migrate you backup. This is different in Windows where a backup and a migrated file are two different things because HSM for Windows is archive based and therefor not as nice. HSM for Unix rocks! On Thu, Jun 23, 2011 at 2:05 PM, Mehdi Salehi wrote: > Hi, > I have two HSM questions: > - Is HSM for Unix included in TSM b/a client? > - What is the way to backup an HSM-managed filesystem? The illusion for me > is that HSM data is not fixed, some of it might be on tape today, but based > on the configurations and actually the need for data, at another time the > contents of the filesystem would be totally different. How to > protect/backup > the data? > > Thank you, > Mehdi >
Two HSM quesions
Hi, I have two HSM questions: - Is HSM for Unix included in TSM b/a client? - What is the way to backup an HSM-managed filesystem? The illusion for me is that HSM data is not fixed, some of it might be on tape today, but based on the configurations and actually the need for data, at another time the contents of the filesystem would be totally different. How to protect/backup the data? Thank you, Mehdi
Re: HSM for database files!!
For databases that are directly accessed by the user (rather than behind the scenes by a background server) you could add an initialization script in front of the access session, where the user would be aware that the database content would have to be staged to disk before being usable. However, there isn't a real net gain in such a scheme in that you would have to maintain an HSM file system "window" large enough to accommodate the full size of the database for it to be recallable, meaning that you're always committing that much space anyway. Richard Sims
Re: HSM for database files!!
I think Oracle will immediately fail or will not start at all. Grigori G. Solonovitch -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Mehdi Salehi Sent: Wednesday, June 22, 2011 1:36 PM To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] HSM for database files!! Hi, Is is technically feasible to put the tablespace of a database on an HSM-managed filesystem? For example, if there are some rarely-accesed huge tables, is it possible/feasible to define their tablespace(s) on a disk space that can be migrated to tape by HSM? Thank you, Mehdi Please consider the environment before printing this Email. CONFIDENTIALITY AND WAIVER: The information contained in this electronic mail message and any attachments hereto may be legally privileged and confidential. The information is intended only for the recipient(s) named in this message. If you are not the intended recipient you are notified that any use, disclosure, copying or distribution is prohibited. If you have received this in error please contact the sender and delete this message and any attachments from your computer system. We do not guarantee that this message or any attachment to it is secure or free from errors, computer viruses or other conditions that may damage or interfere with data, hardware or software.
Re: HSM for database files!!
Is is technically feasible to put the tablespace of a database on an HSM-managed filesystem? For example, if there are some rarely-accesed huge tables, is it possible/feasible to define their tablespace(s) on a disk space that can be migrated to tape by HSM? Feasable, yes. Advisable, probably not. The 1st question that would arise is how long the app is prepared to wait/be blocked for while the data is retrieved. Steven
HSM for database files!!
Hi, Is is technically feasible to put the tablespace of a database on an HSM-managed filesystem? For example, if there are some rarely-accesed huge tables, is it possible/feasible to define their tablespace(s) on a disk space that can be migrated to tape by HSM? Thank you, Mehdi
Re: TSM/HSM
On 21 jun 2011, at 17:04, D'Antonio III, Vincent E (N-Aerotek) wrote: > Good Morning, > I am adding a new LTO3, 3310 library for use with HSM to replace the current > LTO2 library. > > The question I have is can you add a second library for use by HSM so I can > migrate the data off the LTO2's to the new LTO3's? > > If yes, what are the "best practices" to do so? > def libr lto3lib def path ... def dr ... def dev lto3dev devt=lto libr=lto3lib def stg lto3pool lto3dev maxscr=1000 upd stg lto2pool next=lto3pool reclaimstg=lto3pool and the migrate and/or reclaim the lto2pool for details, RTFM :) > Thanks > Vince -- Met vriendelijke groeten/Kind Regards, Remco Post r.p...@plcs.nl +31 6 248 21 622
TSM/HSM
Good Morning, I am adding a new LTO3, 3310 library for use with HSM to replace the current LTO2 library. The question I have is can you add a second library for use by HSM so I can migrate the data off the LTO2's to the new LTO3's? If yes, what are the "best practices" to do so? Thanks Vince
Adding a second library to TSM/HSM
Hello all, I am still very much a newbie with TSM.. I am adding a second library to use with HSM ts3310 LTO3, I have a current library active and in use. What I need to do is the following: Add new library so HSM will start using it while I migrate my data from the old LTO2 library to the new LTO3 library. Remove the old LTO2 library once all data is migrated over Add another new library to use with HSM. So I currently have one LTO2 library when done I will have 2 new LTO3 libraries. The question I really have is how or if two libraries are supported in HSM and how to make sure that the filesystem attached to HSM can use both libraries. Any help would be GREATLY APPERCIATED :) Have a great day, Vince
Re: Tsm archiving or HSM
Just one comment...there are actually 2 copies of the migrated file's data. 1 is the backup copy and the other is the migrated copy. You can configure HSM to make sure there is a backup copy of the file before migration. But since you're going on last referenced date, then probably that file was backed up when it was created or last updated. The most recent versions of HSM and the B/A client have more knowledge of each other than pre 5.5 versions. The B/A client will recognize the stub file and not back that the most recent backup copy of the file. When you restore that file from the B/A client possibly due to someone deleting the stub file, or a crash, you have the option of restoring the file data or just the stub. Just make sure that when you configure the policy for the HSM on the TSM server you change the archive retention to NOLIMIT and activate it! Believe me it's messy when TSM starts expiring the migrated archive data when there are still stub files on the filesystems. Been there...done that...and lots of teeth marks in my arse! -Original Message- From: ADSM: Dist Stor Manager [mailto:ads...@vm.marist.edu] On Behalf Of Prather, Wanda Sent: Tuesday, October 12, 2010 9:22 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: Tsm archiving or HSM There is nothing built in to TSM that does archiving based on last reference date. You can certainly write your own scripts to select the files and archive based on that. There are larger difference between archiving and HSM. Archives: -the same file can be archived multiple times on different dates -an archive file may be left in the directory, or removed from the directory after archive -to retrieve an archived file, you must deliberately open the TSM client and select the file for retrieve HSM: -There is only 1 copy of an HSM-migrated file, the migrated copy. -HSM leaves a stub file in the directory when it migrates the file out to TSM storage. Any attempt by the user to reference that file triggers an automatic recall (which has implications for your TSM hardware setup). -Original Message- From: ADSM: Dist Stor Manager [mailto:ads...@vm.marist.edu] On Behalf Of Tim Brown Sent: Tuesday, October 12, 2010 5:14 PM To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] Tsm archiving or HSM Does the archiving function allow archiving files based on last reference date or is that what TSM HSM is for ? Thanks Tim Brown Systems Specialist - Project Leader Central Hudson Gas & Electric 284 South Ave Poughkeepsie, NY 12601 Email: tbr...@cenhud.com <<mailto:tbr...@cenhud.com>> Phone: 845-486-5643 Fax: 845-486-5921 Cell: 845-235-4255
Re: Tsm archiving or HSM
There is nothing built in to TSM that does archiving based on last reference date. You can certainly write your own scripts to select the files and archive based on that. There are larger difference between archiving and HSM. Archives: -the same file can be archived multiple times on different dates -an archive file may be left in the directory, or removed from the directory after archive -to retrieve an archived file, you must deliberately open the TSM client and select the file for retrieve HSM: -There is only 1 copy of an HSM-migrated file, the migrated copy. -HSM leaves a stub file in the directory when it migrates the file out to TSM storage. Any attempt by the user to reference that file triggers an automatic recall (which has implications for your TSM hardware setup). -Original Message- From: ADSM: Dist Stor Manager [mailto:ads...@vm.marist.edu] On Behalf Of Tim Brown Sent: Tuesday, October 12, 2010 5:14 PM To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] Tsm archiving or HSM Does the archiving function allow archiving files based on last reference date or is that what TSM HSM is for ? Thanks Tim Brown Systems Specialist - Project Leader Central Hudson Gas & Electric 284 South Ave Poughkeepsie, NY 12601 Email: tbr...@cenhud.com <<mailto:tbr...@cenhud.com>> Phone: 845-486-5643 Fax: 845-486-5921 Cell: 845-235-4255
Tsm archiving or HSM
Does the archiving function allow archiving files based on last reference date or is that what TSM HSM is for ? Thanks Tim Brown Systems Specialist - Project Leader Central Hudson Gas & Electric 284 South Ave Poughkeepsie, NY 12601 Email: tbr...@cenhud.com <<mailto:tbr...@cenhud.com>> Phone: 845-486-5643 Fax: 845-486-5921 Cell: 845-235-4255
TSM HSM: Deleting files
Hi, we are using TSM HSM. When we delete migrated files (the stub files of them) from filesystem, HSM is recalling the files before deleting them. Is that normal? Is there a way to configure it? I would be nicer when TSM just mark the files in HSM as removed. Any experiences or hints? Best regards
hsm client job migration
Testing hsm client, when creating migration job. choose source files tab and whether I choose New File or New Directory when I choose browse and select drive it shows Drive C: on Server but the OK button doesnt result in any response. m Brown Systems Specialist - Project Leader Central Hudson Gas & Electric 284 South Ave Poughkeepsie, NY 12601 Email: tbr...@cenhud.com < mailto:tbr...@cenhud.com <mailto:tbr...@cenhud.com> > Phone: 845-486-5643 Fax: 845-486-5921 Cell: 845-235-4255 This message contains confidential information and is only for the intended recipient. If the reader of this message is not the intended recipient, or an employee or agent responsible for delivering this message to the intended recipient, please notify the sender immediately by replying to this note and deleting all copies and attachments. Thank you.
HSM over NAS.
I work for Rocket Software / Arkivio and we have just such a product. Utilizes FPolicy for NetApp and CFM for Celerra to do Tag (Stub) migration on each for both CIFS and NFS, along with most any other source platform that presents CIFS or NFS volumes to the network. Can migrate to (virtually) any target platform (CIFS / NFS / tape / optical). Take a look at arkivio.com for more info, or just ask me. +-- |This was sent by mbenn...@arkivio.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +--
Re: HSM over NAS.
Hi Craig, it exists a possibility to have HSM over NAS. NetApp has a file policy ( Fpolicy) integration which allows from proxy windows to do a HSM of nas files. Regards, Fran - Mensaje original De: Craig McAllister Para: ADSM-L@VM.MARIST.EDU Enviado: martes, 6 de octubre, 2009 5:33:56 Asunto: Re: HSM over NAS. Since HSM requires a passthrough driver on the filesystem for TSM, it's unlikely you're going to get a regular sort of HSM functionality, unless I'm missing something. You'd need to be installing TSM code inside the NAS... Having said that, it is not impossible to put TPC on a server, point that at the NAS and use it to drive policies which can remove files (TPC can archive items automatically to TSM based on policy). It may be possible to do this and leave the retrieve command for those files behind as some sort of batch file- I've seen this done in the past. You could also get into policy driven chargeback for space used on a user or group basis. That's probably as close as you will get to HSM, unless I'm missing something. Craig On 23/09/2009, Steven Langdale wrote: > Good luck on that one! > > We've been spending a lot of time trying to find a product to do this. > > The nearest we have got so far is Symantec Enterprise Vault, but it > doesn't do volumes that are NFS exported and you need a windows server for > it. You also need an SQL server for it's DB. > > Steven > > Steven Langdale > Global Information Services > EAME SAN/Storage Planning and Implementation > ( Phone : +44 (0)1733 584175 > ( Mob: +44 (0)7876 216782 > ü Conference: +44 (0)208 609 7400 Code: 331817 > + Email: steven.langd...@cat.com > > > > > > Francisco Molero > Sent by: "ADSM: Dist Stor Manager" > 23/09/2009 18:02 > Please respond to > "ADSM: Dist Stor Manager" > > > To > ADSM-L@VM.MARIST.EDU > cc > > Subject > [ADSM-L] HSM over NAS. > > > > > Caterpillar: Confidential Green Retain Until: 23/10/2009 > > > > Hello, > > We are working with NAS Celerra and Netapp and it is growing too quicky. > We need to take the files from NAS to storage more economical. We are > looking a solution like HSM for Windows or Space Management but > unfortunatelly these solutions don't support Celerra. Do you know any > product which can connect NAS ( Celerra and NetApp) with TSM in order to > do HSM ? > > Regards, > > Fran >
Re: HSM over NAS.
Since HSM requires a passthrough driver on the filesystem for TSM, it's unlikely you're going to get a regular sort of HSM functionality, unless I'm missing something. You'd need to be installing TSM code inside the NAS... Having said that, it is not impossible to put TPC on a server, point that at the NAS and use it to drive policies which can remove files (TPC can archive items automatically to TSM based on policy). It may be possible to do this and leave the retrieve command for those files behind as some sort of batch file- I've seen this done in the past. You could also get into policy driven chargeback for space used on a user or group basis. That's probably as close as you will get to HSM, unless I'm missing something. Craig On 23/09/2009, Steven Langdale wrote: > Good luck on that one! > > We've been spending a lot of time trying to find a product to do this. > > The nearest we have got so far is Symantec Enterprise Vault, but it > doesn't do volumes that are NFS exported and you need a windows server for > it. You also need an SQL server for it's DB. > > Steven > > Steven Langdale > Global Information Services > EAME SAN/Storage Planning and Implementation > ( Phone : +44 (0)1733 584175 > ( Mob: +44 (0)7876 216782 > ü Conference: +44 (0)208 609 7400 Code: 331817 > + Email: steven.langd...@cat.com > > > > > > Francisco Molero > Sent by: "ADSM: Dist Stor Manager" > 23/09/2009 18:02 > Please respond to > "ADSM: Dist Stor Manager" > > > To > ADSM-L@VM.MARIST.EDU > cc > > Subject > [ADSM-L] HSM over NAS. > > > > > Caterpillar: Confidential Green Retain Until: 23/10/2009 > > > > Hello, > > We are working with NAS Celerra and Netapp and it is growing too quicky. > We need to take the files from NAS to storage more economical. We are > looking a solution like HSM for Windows or Space Management but > unfortunatelly these solutions don't support Celerra. Do you know any > product which can connect NAS ( Celerra and NetApp) with TSM in order to > do HSM ? > > Regards, > > Fran >
Re: GPFS, HSM and backups
Gretchen, you might also try the server option reportretrieve yes (default is no) - I have not tried it in an HSM context but for a restore it gives you file information. Of course it requires a TSM server restart. Joerg - Original Message - From: "Gretchen L. Thiele" Date: Thursday, September 24, 2009 8:29 am Subject: Re: [ADSM-L] GPFS, HSM and backups To: ADSM-L@VM.MARIST.EDU > Thanks, Joerg, for reminding me that the accounting records > contain this info! I was hoping that there was, in addition, > something that I could spot check (using 'q act', for example) > a bit more easily (accounting is currently turned off - too > much data). > > -Original Message- > From: ADSM: Dist Stor Manager [mailto:ads...@vm.marist.edu] On > Behalf Of > Joerg Pohlmann > Sent: Thursday, September 24, 2009 11:17 AM > To: ADSM-L@VM.MARIST.EDU > Subject: Re: [ADSM-L] GPFS, HSM and backups > > Gretchen, I don't know about the first part, but as to > information about > recall activity, use the accounting records (set accounting on) - > fields > 26-29 relate to migration and recall activity. > > Joerg Pohlmann > 250-245-9863 > > - Original Message - > From: "Gretchen L. Thiele" > Date: Thursday, September 24, 2009 7:56 am > Subject: [ADSM-L] GPFS, HSM and backups > To: ADSM-L@VM.MARIST.EDU > > > We've been using GPFS-directed HSM for a while now, working > quite well > > > (with a few bugs, but they're being worked on). > > > > The 'problem' I'm seeing is the mounting of HSM media (tapes, > in > > particular) during the running of an incremental backup. Since > we have > > > the requirement that nothing can be migrated without a backup > in > > place, this just doesn't make sense to me. > > > > It's also frustrating that I don't see any type of info on the > server > > after a recall as to the size of the file being recalled, etc. > - much > > like you would see after a backup, restore, archive or > retrieve > > (separate from the issue above). > > > > Server and client (BA and HSM) all at 5.5.1.1 (upgrade to > 5.5.3.x when > > > I can get downtime in a month or so) on SLES 10. > > > > Any ideas? > > > > Gretchen Thiele > > Princeton University > > >
Re: GPFS, HSM and backups
Thanks, Joerg, for reminding me that the accounting records contain this info! I was hoping that there was, in addition, something that I could spot check (using 'q act', for example) a bit more easily (accounting is currently turned off - too much data). -Original Message- From: ADSM: Dist Stor Manager [mailto:ads...@vm.marist.edu] On Behalf Of Joerg Pohlmann Sent: Thursday, September 24, 2009 11:17 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] GPFS, HSM and backups Gretchen, I don't know about the first part, but as to information about recall activity, use the accounting records (set accounting on) - fields 26-29 relate to migration and recall activity. Joerg Pohlmann 250-245-9863 - Original Message - From: "Gretchen L. Thiele" Date: Thursday, September 24, 2009 7:56 am Subject: [ADSM-L] GPFS, HSM and backups To: ADSM-L@VM.MARIST.EDU > We've been using GPFS-directed HSM for a while now, working quite well > (with a few bugs, but they're being worked on). > > The 'problem' I'm seeing is the mounting of HSM media (tapes, in > particular) during the running of an incremental backup. Since we have > the requirement that nothing can be migrated without a backup in > place, this just doesn't make sense to me. > > It's also frustrating that I don't see any type of info on the server > after a recall as to the size of the file being recalled, etc. - much > like you would see after a backup, restore, archive or retrieve > (separate from the issue above). > > Server and client (BA and HSM) all at 5.5.1.1 (upgrade to 5.5.3.x when > I can get downtime in a month or so) on SLES 10. > > Any ideas? > > Gretchen Thiele > Princeton University >
Re: GPFS, HSM and backups
Gretchen, I don't know about the first part, but as to information about recall activity, use the accounting records (set accounting on) - fields 26-29 relate to migration and recall activity. Joerg Pohlmann 250-245-9863 - Original Message - From: "Gretchen L. Thiele" Date: Thursday, September 24, 2009 7:56 am Subject: [ADSM-L] GPFS, HSM and backups To: ADSM-L@VM.MARIST.EDU > We've been using GPFS-directed HSM for a while now, > working quite well (with a few bugs, but they're > being worked on). > > The 'problem' I'm seeing is the mounting of HSM > media (tapes, in particular) during the running of > an incremental backup. Since we have the requirement > that nothing can be migrated without a backup in > place, this just doesn't make sense to me. > > It's also frustrating that I don't see any type of > info on the server after a recall as to the size of > the file being recalled, etc. - much like you would see > after a backup, restore, archive or retrieve (separate > from the issue above). > > Server and client (BA and HSM) all at 5.5.1.1 (upgrade > to 5.5.3.x when I can get downtime in a month or so) > on SLES 10. > > Any ideas? > > Gretchen Thiele > Princeton University >
GPFS, HSM and backups
We've been using GPFS-directed HSM for a while now, working quite well (with a few bugs, but they're being worked on). The 'problem' I'm seeing is the mounting of HSM media (tapes, in particular) during the running of an incremental backup. Since we have the requirement that nothing can be migrated without a backup in place, this just doesn't make sense to me. It's also frustrating that I don't see any type of info on the server after a recall as to the size of the file being recalled, etc. - much like you would see after a backup, restore, archive or retrieve (separate from the issue above). Server and client (BA and HSM) all at 5.5.1.1 (upgrade to 5.5.3.x when I can get downtime in a month or so) on SLES 10. Any ideas? Gretchen Thiele Princeton University
Re: HSM over NAS.
Good luck on that one! We've been spending a lot of time trying to find a product to do this. The nearest we have got so far is Symantec Enterprise Vault, but it doesn't do volumes that are NFS exported and you need a windows server for it. You also need an SQL server for it's DB. Steven Steven Langdale Global Information Services EAME SAN/Storage Planning and Implementation ( Phone : +44 (0)1733 584175 ( Mob: +44 (0)7876 216782 ü Conference: +44 (0)208 609 7400 Code: 331817 + Email: steven.langd...@cat.com Francisco Molero Sent by: "ADSM: Dist Stor Manager" 23/09/2009 18:02 Please respond to "ADSM: Dist Stor Manager" To ADSM-L@VM.MARIST.EDU cc Subject [ADSM-L] HSM over NAS. Caterpillar: Confidential Green Retain Until: 23/10/2009 Hello, We are working with NAS Celerra and Netapp and it is growing too quicky. We need to take the files from NAS to storage more economical. We are looking a solution like HSM for Windows or Space Management but unfortunatelly these solutions don't support Celerra. Do you know any product which can connect NAS ( Celerra and NetApp) with TSM in order to do HSM ? Regards, Fran
Re: HSM over NAS.
Fran, Have you enabled ASIS on your NetApp? We are seeing deduplication resulting in 15-40% amount of space saved - i.e. 850GB of data is using 665GB of space for a 21% savings. Your mileage will vary depending on the type and amount of data stored. Cheers, Neil Strand Storage Engineer - Legg Mason Baltimore, MD. (410) 580-7491 Whatever you can do or believe you can, begin it. Boldness has genius, power and magic. -Original Message- From: ADSM: Dist Stor Manager [mailto:ads...@vm.marist.edu] On Behalf Of Francisco Molero Sent: Wednesday, September 23, 2009 1:00 PM To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] HSM over NAS. Hello, We are working with NAS Celerra and Netapp and it is growing too quicky. We need to take the files from NAS to storage more economical. We are looking a solution like HSM for Windows or Space Management but unfortunatelly these solutions don't support Celerra. Do you know any product which can connect NAS ( Celerra and NetApp) with TSM in order to do HSM ? Regards, Fran IMPORTANT: E-mail sent through the Internet is not secure. Legg Mason therefore recommends that you do not send any confidential or sensitive information to us via electronic mail, including social security numbers, account numbers, or personal identification numbers. Delivery, and or timely delivery of Internet mail is not guaranteed. Legg Mason therefore recommends that you do not send time sensitive or action-oriented messages to us via electronic mail. This message is intended for the addressee only and may contain privileged or confidential information. Unless you are the intended recipient, you may not use, copy or disclose to anyone any information contained in this message. If you have received this message in error, please notify the author by replying to this message and then kindly delete the message. Thank you.
HSM over NAS.
Hello, We are working with NAS Celerra and Netapp and it is growing too quicky. We need to take the files from NAS to storage more economical. We are looking a solution like HSM for Windows or Space Management but unfortunatelly these solutions don't support Celerra. Do you know any product which can connect NAS ( Celerra and NetApp) with TSM in order to do HSM ? Regards, Fran
Re: differences in work with file between HSM and TSM for Space Management
>> On Thu, 10 Sep 2009 16:35:07 +0200, Remco Post said: > On 10 sep 2009, at 15:48, Gennadiy Khramov wrote: >> Hi, may someone tells - is any differences between TSM HSM (for >> Windows) and TSM for Space Management (for Unix) in work with >> files/filesystems? > From the perspective of the filesystem, and the user there is very > little difference. Oddly, from the perspective of TSm there is a > huge difference. Where HSM for Unix uses the HSM interface to TSM, > all windows HSM clients use TSM archiving. Search the archives for my rants on this. I think the Windows HSM product is misnamed and horrible. You'll back up new versions of your files every time a file is retrieved. You'll re-archive files every time a file is "migrated to tape". You'll re-backup files every time a file is migrated to tape: this means that your active backup copy is the stub, not the full file. Consequently, if you fotch your archive settings, the backup is no good: you'd have a backup of a stub which could have itself fallen off the end of archive retention. Way to silently lose all your data. - Allen S. Rout
Re: differences in work with file between HSM and TSM for Space Management
On 10 sep 2009, at 15:48, Gennadiy Khramov wrote: Hi, may someone tells - is any differences between TSM HSM (for Windows) and TSM for Space Management (for Unix) in work with files/filesystems? From the perspective of the filesystem, and the user there is very little difference. Oddly, from the perspective of TSm there is a huge difference. Where HSM for Unix uses the HSM interface to TSM, all windows HSM clients use TSM archiving. Well, may I test how application interact with HSM stub-files in windows environment and interpret that in Unix that will be work (approximately :) )same? HSM for Unix (IMHO) allows for a far more flexible configuration, though it is a bit more complex. Since Windows and Unix are completely different beasts (though, with some effort even windows can become posix compliant), one can only say that the workings of the OS and also the HSM client is roughly the same, in a very high-level conceptual way. I would not go as far as to say that understanding of the windows HSM client would benefit you in any way if you ever had to configure HSM on Unix or vice-versa. Best Regards, Khramov Gennadiy gkhra...@computel.ru -- Met vriendelijke groeten/Kind regards, Remco Post
differences in work with file between HSM and TSM for Space Management
Hi, may someone tells - is any differences between TSM HSM (for Windows) and TSM for Space Management (for Unix) in work with files/filesystems? Well, may I test how application interact with HSM stub-files in windows environment and interpret that in Unix that will be work (approximately :) )same? Best Regards, Khramov Gennadiy gkhra...@computel.ru
Issue with HSM for Windows Client
Hi all I have a issue with HSM for Windows Client (5.5) The files's Migration work fine. Retrieve for large files (18 Gb) transfer the data server-client is done in good time, but the time to make the file available (or available for the aplication) is very high. Anyone can help me ??? Thank
Re: HSM Node Failing
Hi Danny I once had a similar problem on a Windows 2003 server running the active side of an Exchange cluster. It was impolitic to have downtime on this box so the whole team (me, windows guys and Exchange guys) struggled with it for a week. In the end it looked like a memory fragementation issue and it went away after a reboot. Regards Steve Steven Harris AIX and TSM Admin Still seeking work in Sydney Australia Danny Blair wrote: I do see an error in the dsmerror.log: 09/02/2009 02:37:48 ANSE ntrc.cpp(939): Received Win32 RC 1450 (0x05aa) from FileRead(): ReadFile '\\hi-winhsm\g$\EEGRAW\NKT\EEG2100\CA6742Y0.VOR\6742Y004.M4A'. Error desription: Insufficient system resources exist to complete the requested service. 09/02/2009 02:37:51 ANS1028S An internal program error occurred. 09/02/2009 02:37:52 ANS1512E Scheduled event 'SM-0200' failed. Return code = 12. I thought I included that in my original email, my apologies. This error is what lead me to belive there is an issue on the node itself. On Wed, Sep 2, 2009 at 10:43 AM, David McClelland wrote: At first glance, the errors below look to me like more of an issue regarding the TSM Journaling Engine on this client, rather than any HSM component. When you say 'client is failing', can you give a little more description of the symptoms which suggest this failure, perhaps some output from your dsmerror.log file with any relevant errors? /David Mc London, UK -Original Message- From: ADSM: Dist Stor Manager [mailto:ads...@vm.marist.edu] On Behalf Of Danny Blair Sent: 02 September 2009 15:31 To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] HSM Node Failing While I am new to managing TSM, I have tried to research this and have not found much other than "upgrade to 5.5.2" (we are on 5.5.1). Has anyone else seen this on you HSM clients? Client is failing. Event viewer on the client machine is full of "Journal for fs 'H:' reset:" and "Notification buffer overrun monitoring fs 'H:\', journal will be reset." 3.37 GB RAM, 60 GB free on C: anmd at least 200 gb free on each drive. It was a problem on just one drive (others where apparently working fine), but just last night it started on another. It sounds like to me that the server itself is having a problem completing the clients request. Any ideas? Thanks in advance. No virus found in this incoming message. Checked by AVG - www.avg.com Version: 8.5.409 / Virus Database: 270.13.69/2328 - Release Date: 09/02/09 05:50:00 > No virus found in this incoming message. Checked by AVG - www.avg.com Version: 8.5.409 / Virus Database: 270.13.76/2343 - Release Date: 09/03/09 05:50:00
Re: HSM Node Failing
Okay - I think this error gets us more towards the business end of your problem. Take a look at: http://support.microsoft.com/kb/909424/en-us Guessing at the history of this, if it pre-dates your involvement, an explanation could be that TSM Journaling was enabled on this backup client because it had millions of files that the BA client was trying to backup on a daily basis - this can take a long time and can sometimes fall over altogether, for example if the dsmc.exe thread reaches its upper memory limit, or another problem crops up (as per the MSKB article above). Look up in the IBM TSM client docs why Journaling is useful in these instances (http://publib.boulder.ibm.com/infocenter/tivihelp/v1r1/topic/com.ibm.itsmfd t.doc/ans699.htm#journalb). If the journaling engine keeps on falling over (and there are some troubleshooting tools), the BA client falls back to a 'normal' incremental backup - which looks now as though it's failing. If the KB article above doesn't help, there may be workarounds, including splitting the backup into smaller chunks, and a client option 'MEMORYEFFICIENTBACKUP' (http://publib.boulder.ibm.com/infocenter/tivihelp/v1r1/topic/com.ibm.itsmfd t.doc/ans6322.htm#opt6080). Have a look here too: http://www.adsm.org/forum/showthread.php?t=15867 Hope that helps, /David Mc London, UK -Original Message- From: ADSM: Dist Stor Manager [mailto:ads...@vm.marist.edu] On Behalf Of Danny Blair Sent: 02 September 2009 15:49 To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] HSM Node Failing I do see an error in the dsmerror.log: 09/02/2009 02:37:48 ANSE ntrc.cpp(939): Received Win32 RC 1450 (0x05aa) from FileRead(): ReadFile '\\hi-winhsm\g$\EEGRAW\NKT\EEG2100\CA6742Y0.VOR\6742Y004.M4A'. Error desription: Insufficient system resources exist to complete the requested service. 09/02/2009 02:37:51 ANS1028S An internal program error occurred. 09/02/2009 02:37:52 ANS1512E Scheduled event 'SM-0200' failed. Return code = 12. I thought I included that in my original email, my apologies. This error is what lead me to belive there is an issue on the node itself. On Wed, Sep 2, 2009 at 10:43 AM, David McClelland wrote: > At first glance, the errors below look to me like more of an issue > regarding > the TSM Journaling Engine on this client, rather than any HSM component. > When you say 'client is failing', can you give a little more description of > the symptoms which suggest this failure, perhaps some output from your > dsmerror.log file with any relevant errors? > > /David Mc > London, UK > > -Original Message- > From: ADSM: Dist Stor Manager [mailto:ads...@vm.marist.edu] On Behalf Of > Danny Blair > Sent: 02 September 2009 15:31 > To: ADSM-L@VM.MARIST.EDU > Subject: [ADSM-L] HSM Node Failing > > While I am new to managing TSM, I have tried to research this and have not > found much other than "upgrade to 5.5.2" (we are on 5.5.1). Has anyone else > seen this on you HSM clients? > > Client is failing. Event viewer on the client machine is full of > > "Journal for fs 'H:' reset:" > > and > > "Notification buffer overrun monitoring fs 'H:\', journal will be reset." > > 3.37 GB RAM, 60 GB free on C: anmd at least 200 gb free on each drive. > > It was a problem on just one drive (others where apparently working fine), > but just last night it started on another. > > It sounds like to me that the server itself is having a problem completing > the clients request. > > Any ideas? > > Thanks in advance. > > No virus found in this incoming message. > Checked by AVG - www.avg.com > Version: 8.5.409 / Virus Database: 270.13.69/2328 - Release Date: 09/02/09 > 05:50:00 > No virus found in this incoming message. Checked by AVG - www.avg.com Version: 8.5.409 / Virus Database: 270.13.69/2328 - Release Date: 09/02/09 05:50:00
Re: HSM Node Failing
I do see an error in the dsmerror.log: 09/02/2009 02:37:48 ANSE ntrc.cpp(939): Received Win32 RC 1450 (0x05aa) from FileRead(): ReadFile '\\hi-winhsm\g$\EEGRAW\NKT\EEG2100\CA6742Y0.VOR\6742Y004.M4A'. Error desription: Insufficient system resources exist to complete the requested service. 09/02/2009 02:37:51 ANS1028S An internal program error occurred. 09/02/2009 02:37:52 ANS1512E Scheduled event 'SM-0200' failed. Return code = 12. I thought I included that in my original email, my apologies. This error is what lead me to belive there is an issue on the node itself. On Wed, Sep 2, 2009 at 10:43 AM, David McClelland wrote: > At first glance, the errors below look to me like more of an issue > regarding > the TSM Journaling Engine on this client, rather than any HSM component. > When you say 'client is failing', can you give a little more description of > the symptoms which suggest this failure, perhaps some output from your > dsmerror.log file with any relevant errors? > > /David Mc > London, UK > > -Original Message- > From: ADSM: Dist Stor Manager [mailto:ads...@vm.marist.edu] On Behalf Of > Danny Blair > Sent: 02 September 2009 15:31 > To: ADSM-L@VM.MARIST.EDU > Subject: [ADSM-L] HSM Node Failing > > While I am new to managing TSM, I have tried to research this and have not > found much other than "upgrade to 5.5.2" (we are on 5.5.1). Has anyone else > seen this on you HSM clients? > > Client is failing. Event viewer on the client machine is full of > > "Journal for fs 'H:' reset:" > > and > > "Notification buffer overrun monitoring fs 'H:\', journal will be reset." > > 3.37 GB RAM, 60 GB free on C: anmd at least 200 gb free on each drive. > > It was a problem on just one drive (others where apparently working fine), > but just last night it started on another. > > It sounds like to me that the server itself is having a problem completing > the clients request. > > Any ideas? > > Thanks in advance. > > No virus found in this incoming message. > Checked by AVG - www.avg.com > Version: 8.5.409 / Virus Database: 270.13.69/2328 - Release Date: 09/02/09 > 05:50:00 >
Re: HSM Node Failing
James, Yes I am using journaling. Nothing has changed that I am aware of. This node was built specificly to be used for HSM. I see no journal files at all on the H: drive. On Wed, Sep 2, 2009 at 10:38 AM, James Choate wrote: > Danny, > Are you are using HSM and Jorurnaling on this particular client? > > It looks like the journaling for the H: drive on the client is having > issues. > > Have there been any recent changes made to this client, ie,. HSM > implemented, Journaling implemented? > > > From: ADSM: Dist Stor Manager [ads...@vm.marist.edu] On Behalf Of Danny > Blair [tivolid...@gmail.com] > Sent: Wednesday, September 02, 2009 8:31 AM > To: ADSM-L@VM.MARIST.EDU > Subject: HSM Node Failing > > While I am new to managing TSM, I have tried to research this and have not > found much other than "upgrade to 5.5.2" (we are on 5.5.1). Has anyone else > seen this on you HSM clients? > > Client is failing. Event viewer on the client machine is full of > > "Journal for fs 'H:' reset:" > > and > > "Notification buffer overrun monitoring fs 'H:\', journal will be reset." > > 3.37 GB RAM, 60 GB free on C: anmd at least 200 gb free on each drive. > > It was a problem on just one drive (others where apparently working fine), > but just last night it started on another. > > It sounds like to me that the server itself is having a problem completing > the clients request. > > Any ideas? > > Thanks in advance. >
Re: HSM Node Failing
At first glance, the errors below look to me like more of an issue regarding the TSM Journaling Engine on this client, rather than any HSM component. When you say 'client is failing', can you give a little more description of the symptoms which suggest this failure, perhaps some output from your dsmerror.log file with any relevant errors? /David Mc London, UK -Original Message- From: ADSM: Dist Stor Manager [mailto:ads...@vm.marist.edu] On Behalf Of Danny Blair Sent: 02 September 2009 15:31 To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] HSM Node Failing While I am new to managing TSM, I have tried to research this and have not found much other than "upgrade to 5.5.2" (we are on 5.5.1). Has anyone else seen this on you HSM clients? Client is failing. Event viewer on the client machine is full of "Journal for fs 'H:' reset:" and "Notification buffer overrun monitoring fs 'H:\', journal will be reset." 3.37 GB RAM, 60 GB free on C: anmd at least 200 gb free on each drive. It was a problem on just one drive (others where apparently working fine), but just last night it started on another. It sounds like to me that the server itself is having a problem completing the clients request. Any ideas? Thanks in advance. No virus found in this incoming message. Checked by AVG - www.avg.com Version: 8.5.409 / Virus Database: 270.13.69/2328 - Release Date: 09/02/09 05:50:00
Re: HSM Node Failing
Danny, Are you are using HSM and Jorurnaling on this particular client? It looks like the journaling for the H: drive on the client is having issues. Have there been any recent changes made to this client, ie,. HSM implemented, Journaling implemented? From: ADSM: Dist Stor Manager [ads...@vm.marist.edu] On Behalf Of Danny Blair [tivolid...@gmail.com] Sent: Wednesday, September 02, 2009 8:31 AM To: ADSM-L@VM.MARIST.EDU Subject: HSM Node Failing While I am new to managing TSM, I have tried to research this and have not found much other than "upgrade to 5.5.2" (we are on 5.5.1). Has anyone else seen this on you HSM clients? Client is failing. Event viewer on the client machine is full of "Journal for fs 'H:' reset:" and "Notification buffer overrun monitoring fs 'H:\', journal will be reset." 3.37 GB RAM, 60 GB free on C: anmd at least 200 gb free on each drive. It was a problem on just one drive (others where apparently working fine), but just last night it started on another. It sounds like to me that the server itself is having a problem completing the clients request. Any ideas? Thanks in advance.
HSM Node Failing
While I am new to managing TSM, I have tried to research this and have not found much other than "upgrade to 5.5.2" (we are on 5.5.1). Has anyone else seen this on you HSM clients? Client is failing. Event viewer on the client machine is full of "Journal for fs 'H:' reset:" and "Notification buffer overrun monitoring fs 'H:\', journal will be reset." 3.37 GB RAM, 60 GB free on C: anmd at least 200 gb free on each drive. It was a problem on just one drive (others where apparently working fine), but just last night it started on another. It sounds like to me that the server itself is having a problem completing the clients request. Any ideas? Thanks in advance.
Re: Identify HSM Migrated files on Windows
Hi, Bill. Here are a few options to get a text list: 1) Run a reconciliation - that should list all bad stubs in the hsmmonitor-orphan.log. You can then parse the hsmmonitor-orphan.log to delete the stubs or simply exclude them from the copy. 2) You might be able to get this information from the TSM DB: select hl_name, ll_name, whatever_else from archives where node_name= and filespace_name= and fsid= and archive_date before copygroup_fixed_date-365 days. However, I haven't tried this and can't confirm that HSM does HL_ and LL_ADDRESS like I would expect. 3) If you're handy with scripting, you can do a "dir /s" and parse the output for lines with "(" in them but not the string "File(s)". The file sizes of migrated files appears in parens. You can get the directory names by parsing for "Directory of". 4) I'm not too familiar with the search/restore option, but if it has a "print" function, you can print it to a tiff file or something and then do OCR on it.Yuck. :-) Alex Paschal Storage Solutions Engineer MSI Systems Integrators (503) 943-6919 - Office Your Business. Better. -Original Message- From: ADSM: Dist Stor Manager [mailto:ads...@vm.marist.edu] On Behalf Of Bill Boyer Sent: Monday, August 10, 2009 9:24 AM To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] Identify HSM Migrated files on Windows I need a way to get a list of files that have been migrated so I can exclude them from being copied to a new server. The client is using Robocopy (don't laugh!) and when it hits a migrated file the copy terminates. The problem is that HSM was not setup correctly and the archive copygroup was left at 365-days and not change to Nolimit. So after a year all this migrated data expired and is gone from the TSM server. They want to copy everything EXCEPT for the stub files to a new server. Any ideas on how to get a list? Using the search and restore option gets me a list, but I can't copy/paste from that list. Any help is appreciated. Bill Boyer "He who laughs last probably made a back-up." Murphy's law of computing This message (including any attachments) is intended only for the use of the individual or entity to which it is addressed and may contain information that is non-public, proprietary, privileged, confidential, and exempt from disclosure under applicable law or may constitute as attorney work product. If you are not the intended recipient, you are hereby notified that any use, dissemination, distribution, or copying of this communication is strictly prohibited. If you have received this communication in error, notify us immediately by telephone and (i) destroy this message if a facsimile or (ii) delete this message immediately if this is an electronic communication. Thank you.
Identify HSM Migrated files on Windows
I need a way to get a list of files that have been migrated so I can exclude them from being copied to a new server. The client is using Robocopy (don't laugh!) and when it hits a migrated file the copy terminates. The problem is that HSM was not setup correctly and the archive copygroup was left at 365-days and not change to Nolimit. So after a year all this migrated data expired and is gone from the TSM server. They want to copy everything EXCEPT for the stub files to a new server. Any ideas on how to get a list? Using the search and restore option gets me a list, but I can't copy/paste from that list. Any help is appreciated. Bill Boyer "He who laughs last probably made a back-up." Murphy's law of computing
Stop HSM clients migration jobs
> I've been asked to stop HSM clients migration jobs on a particular node. Can > anyone tell me how to do this. It's on a Windows NT platform. > CANCEL SESSION How do you do this? I'm new to this! +-- |This was sent by dcun...@hotmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +--
Stop HSM clients migration jobs
any backup, archive session can be canceled 1. open admin console (dsmadmc or a dmadmc.exe) 2. QUERY SESSION 3. CANcel SEssion [session_number] +-- |This was sent by dem...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +--
Stop HSM clients migration jobs
CANCEL SESSION +-- |This was sent by dem...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +--
TSM Client 6.1 / HSM for Windows 5.5 compatibility?
Hello everybody, we have a Windows 2003 Server with TSM Client 6.1 on which we now also installed HSM for Windows. We had to use the 5.5 Version of HSM because 6.1 only works with Server 2008 and ran into the problem that the file-backup schedules fail while trying to backup HSM migrated files. Are there any incompatibilities between TSM 6.1 and HSM 5.5? I wasn't able to find anything about it Kind regards, Stephan
Re: HSM reconcilliation (Windows-Client)
>> On Thu, 4 Jun 2009 12:11:20 +0200, Stephan Boldt >> said: > Hello everybody, > [ ... I understand HSM, but the windows HSM product doesn't behave > as I expect ...] > Why is this so? What do I have to do to get rid of the deleted file in the > archive? Search the logs; I've been ranting about the windows "HSM" product for years. I think it's a miserable product. There are folks on here who have used it and found it appropriate for their needs, but those needs are emphatically distinct from what we of TSM HSM experience think of as HSM applications. In a nutshell, the windows HSM product makes no use whatsoever of the TSM HSM concepts. It makes archives. Archives, like any other archives, stick around for RETVER days. When you write a file, the file gets backed up. When you migrate a file, the stub gets backed up. Note, you now have -no- active version of the full file. When you retrieve a file, the file gets backed up again. When you re-migrate a file, the file gets re-archived, and the stub gets backed up again. - Allen S. Rout
Explorer hangs when opening properties dialog of HSM migrated *.exe files
Hello everybody, durig my HSM tests I ran into the problem, that every time I try to open the properties dialog of migrated *.exe files, the explorer hangs. I even disabled the McAfee 8.5i services but the problem remains. Other filetypes I've tried (e.g. *.ISO) don't cause this issue. I can't even reboot the server properly because it hangs during shutdown. Any idea what could be tha cause of this behaviour or how to trace it? TSM Backup and Archive Client is 6.1, HSM Client is 5.5.2.0, TSM Server is 5.5.1.1. kind regards, Stephan
Re: HSM reconcilliation (Windows-Client)
Hminteresting. I found out, that this behaviour only occurrs when the delete file is still in the trashbin. Well that's great but I didn't expect that! Does that mean you can move migrated files without restoring them? Does that even work across different drives? Kind regards, Stephan On Thu, Jun 4, 2009 at 1:16 PM, Stephan Boldt < stephan.boldt+ads...@gmail.com > wrote: > Well, I didn't. NOW I did and 1 file has been deleted from the archive. But > I was still able to search and restore the deleted file from the HSM client > GUI!?! How the hack can that happen? Any Ideas? I'm totally confused... :-/ > > kind regards, > Stephan > > 2009/6/4 Bos, Karel > > Did you ran expire inventory? >> >> Regards, >> >> Karel >> >> >> >> Hello everybody, >> >> I'm trying to set up HSM (TSM 5.5.2) for our Windows fileserver. For >> testing purposes I've created a folder c:\temp\hsmtest and put a file >> into that folder. I set up a hsm job for that folder and ran it whicht >> worked as >> expected: The file has been moved into the tsm archive and has been >> replaced by a stub file. Retrieving the file also worked as expected. >> Next (after migrating the file into the archive again) I deleted the >> stubfile to test the reconsilliation (the archive copy groups "retain >> version" value is set to "nolimit"). I ran the reconsilliation via the >> HSM Client GUI, but after that the deleted file was still in the archive >> (is still listed when looking for it via the search & retrieve command >> in the GUI). >> >> Why is this so? What do I have to do to get rid of the deleted file in >> the archive? >> >> Thanks in advance for you help! >> >> kind regards, >> Stephan >> >> >
Re: HSM reconcilliation (Windows-Client)
Well, I didn't. NOW I did and 1 file has been deleted from the archive. But I was still able to search and restore the deleted file from the HSM client GUI!?! How the hack can that happen? Any Ideas? I'm totally confused... :-/ kind regards, Stephan 2009/6/4 Bos, Karel > Did you ran expire inventory? > > Regards, > > Karel > > > > Hello everybody, > > I'm trying to set up HSM (TSM 5.5.2) for our Windows fileserver. For > testing purposes I've created a folder c:\temp\hsmtest and put a file > into that folder. I set up a hsm job for that folder and ran it whicht > worked as > expected: The file has been moved into the tsm archive and has been > replaced by a stub file. Retrieving the file also worked as expected. > Next (after migrating the file into the archive again) I deleted the > stubfile to test the reconsilliation (the archive copy groups "retain > version" value is set to "nolimit"). I ran the reconsilliation via the > HSM Client GUI, but after that the deleted file was still in the archive > (is still listed when looking for it via the search & retrieve command > in the GUI). > > Why is this so? What do I have to do to get rid of the deleted file in > the archive? > > Thanks in advance for you help! > > kind regards, > Stephan > >
Re: HSM reconcilliation (Windows-Client)
Did you ran expire inventory? Regards, Karel Hello everybody, I'm trying to set up HSM (TSM 5.5.2) for our Windows fileserver. For testing purposes I've created a folder c:\temp\hsmtest and put a file into that folder. I set up a hsm job for that folder and ran it whicht worked as expected: The file has been moved into the tsm archive and has been replaced by a stub file. Retrieving the file also worked as expected. Next (after migrating the file into the archive again) I deleted the stubfile to test the reconsilliation (the archive copy groups "retain version" value is set to "nolimit"). I ran the reconsilliation via the HSM Client GUI, but after that the deleted file was still in the archive (is still listed when looking for it via the search & retrieve command in the GUI). Why is this so? What do I have to do to get rid of the deleted file in the archive? Thanks in advance for you help! kind regards, Stephan ÿþD i t b e r i c h t i s v e r t r o u w e l i j k e n k a n g e h e i m e i n f o r m a t i e b e v a t t e n e n k e l b e s t e m d v o o r d e g e a d r e s s e e r d e . I n d i e n d i t b e r i c h t n i e t v o o r u i s b e s t e m d , v e r z o e k e n w i j u d i t o n m i d d e l l i j k a a n o n s t e m e l d e n e n h e t b e r i c h t t e v e r n i e t i g e n . A a n g e z i e n d e i n t e g r i t e i t v a n h e t b e r i c h t n i e t v e i l i g g e s t e l d i s m i d d e l s v e r z e n d i n g v i a i n t e r n e t , k a n A t o s O r i g i n n i e t a a n s p r a k e l i j k w o r d e n g e h o u d e n v o o r d e i n h o u d d a a r v a n . H o e w e l w i j o n s i n s p a n n e n e e n v i r u s v r i j n e t w e r k t e h a n t e r e n , g e v e n w i j g e e n e n k e l e g a r a n t i e d a t d i t b e r i c h t v i r u s v r i j i s , n o c h a a n v a a r d e n w i j e n i g e a a n s p r a k e l i j k h e i d v o o r d e m o g e l i j k e a a n w e z i g h e i d v a n e e n v i r u s i n d i t b e r i c h t . O p a l o n z e r e c h t s v e r h o u d i n g e n , a a n b i e d i n g e n e n o v e r e e n k o m s t e n w a a r o n d e r A t o s O r i g i n g o e d e r e n e n / o f d i e n s t e n l e v e r t z i j n m e t u i t s l u i t i n g v a n a l l e a n d e r e v o o r w a a r d e n d e L e v e r i n g s v o o r w a a r d e n v a n A t o s O r i g i n v a n t o e p a s s i n g . D e z e w o r d e n u o p a a n v r a a g d i r e c t k o s t e l o o s t o e g e z o n d e n . T h i s e - m a i l a n d t h e d o c u m e n t s a t t a c h e d a r e c o n f i d e n t i a l a n d i n t e n d e d s o l e l y f o r t h e a d d r e s s e e ; i t m a y a l s o b e p r i v i l e g e d . I f y o u r e c e i v e t h i s e - m a i l i n e r r o r , p l e a s e n o t i f y t h e s e n d e r i m m e d i a t e l y a n d d e s t r o y i t . A s i t s i n t e g r i t y c a n n o t b e s e c u r e d o n t h e I n t e r n e t , t h e A t o s O r i g i n g r o u p l i a b i l i t y c a n n o t b e t r i g g e r e d f o r t h e m e s s a g e c o n t e n t . A l t h o u g h t h e s e n d e r e n d e a v o u r s t o m a i n t a i n a c o m p u t e r v i r u s - f r e e n e t w o r k , t h e s e n d e r d o e s n o t w a r r a n t t h a t t h i s t r a n s m i s s i o n i s v i r u s - f r e e a n d w i l l n o t b e l i a b l e f o r a n y d a m a g e s r e s u l t i n g f r o m a n y v i r u s t r a n s m i t t e d . O n a l l o f f e r s a n d a g r e e m e n t s u n d e r w h i c h A t o s O r i g i n s u p p l i e s g o o d s a n d / o r s e r v i c e s o f w h a t e v e r n a t u r e , t h e T e r m s o f D e l i v e r y f r o m A t o s O r i g i n e x c l u s i v e l y a p p l y . T h e T e r m s o f D e l i v e r y s h a l l b e p r o m p t l y s u b m i t t e d t o y o u o n y o u r r e q u e s t . A t o s O r i g i n N e d e r l a n d B . V . / U t r e c h t K v K U t r e c h t 3 0 1 3 2 7 6 2
HSM reconcilliation (Windows-Client)
Hello everybody, I'm trying to set up HSM (TSM 5.5.2) for our Windows fileserver. For testing purposes I've created a folder c:\temp\hsmtest and put a file into that folder. I set up a hsm job for that folder and ran it whicht worked as expected: The file has been moved into the tsm archive and has been replaced by a stub file. Retrieving the file also worked as expected. Next (after migrating the file into the archive again) I deleted the stubfile to test the reconsilliation (the archive copy groups "retain version" value is set to "nolimit"). I ran the reconsilliation via the HSM Client GUI, but after that the deleted file was still in the archive (is still listed when looking for it via the search & retrieve command in the GUI). Why is this so? What do I have to do to get rid of the deleted file in the archive? Thanks in advance for you help! kind regards, Stephan
Re: how HSM (Linux) works?
On 26 mei 2009, at 10:58, Gennadiy Khramov wrote: Hi, Can anyone explain HSM works. What it use for connections with tsm server and transmitting data? Which HSM? HSM for Unix/Linux is a completely different beast from HSM for Windows As I understand all options for hsm are declaring in BA client dsm.sys file. I guess we're talking HSM for unix then So, do I right understand that HSM uses Backup-archive client features for transfering data to server and return without BA Client API functions? Actually, HSM uses it's own API. There are several processes, one to identify migration candidates, on to actually perform migration and a background process that will recall data if needed. Or HSM do this by themself? And hidden question is - Will HSM correctly work, if BA client works as need or i need test it separately? You'll want to test it separately, since HSM can use a different TSM server than the BA client... Best Regards, Khramov Gennadiy gkhra...@computel.ru -- Remco
how HSM (Linux) works?
Hi, Can anyone explain HSM works. What it use for connections with tsm server and transmitting data? As I understand all options for hsm are declaring in BA client dsm.sys file. So, do I right understand that HSM uses Backup-archive client features for transfering data to server and return without BA Client API functions? Or HSM do this by themself? And hidden question is - Will HSM correctly work, if BA client works as need or i need test it separately? Best Regards, Khramov Gennadiy gkhra...@computel.ru
Re: HSM for Windows.... but... but...
Rainfinity is the EMC device/product. Andy Huebner -Original Message- From: ADSM: Dist Stor Manager [mailto:ads...@vm.marist.edu] On Behalf Of Wanda Prather Sent: Monday, December 15, 2008 11:18 AM To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] HSM for Windows but... but... I have a TSM 5.5 Windows customer who would like to implement HSM to get aged windows files moved from expensive high-end storage to cheaper storage, and really old files moved to tape. Sounds like HSM to me. Their tape library can handle it, no problem. Problem is, most of those files are on an EMC NAS device, accessed via CIFS shares. We back them up with TSM via the CIFS shares. Anybody know of a way to use/implement TSM HSM for Windows on NAS CIFS shares? CommVault Data Archiver 7 website SAYS their HSM supports both NTFS filesystems and NAS devices. Does it work like you'd want it to? Anybody have another HSM solution for a NAS box? Ow! Ow! Head hurting Wanda This e-mail (including any attachments) is confidential and may be legally privileged. If you are not an intended recipient or an authorized representative of an intended recipient, you are prohibited from using, copying or distributing the information in this e-mail or its attachments. If you have received this e-mail in error, please notify the sender immediately by return e-mail and delete all copies of this message and any attachments. Thank you.
HSM for Windows.... but... but...
I have a TSM 5.5 Windows customer who would like to implement HSM to get aged windows files moved from expensive high-end storage to cheaper storage, and really old files moved to tape. Sounds like HSM to me. Their tape library can handle it, no problem. Problem is, most of those files are on an EMC NAS device, accessed via CIFS shares. We back them up with TSM via the CIFS shares. Anybody know of a way to use/implement TSM HSM for Windows on NAS CIFS shares? CommVault Data Archiver 7 website SAYS their HSM supports both NTFS filesystems and NAS devices. Does it work like you'd want it to? Anybody have another HSM solution for a NAS box? Ow! Ow! Head hurting Wanda
Re: HSM on Linux: Anyone? How'd you get there?
>> On Mon, 13 Oct 2008 13:02:11 -0400, Richard Sims <[EMAIL PROTECTED]> said: > APAR IC52027 talks about that pre-req oversight, in the AIX environment. > Poking around, I find that in ftp.software.ibm.com there is: > /storage/tivoli-storage-management/maintenance/client/v5r4/Linux/ > Linux86/HSM_RSCT I was able to shake loose a 'update' package of rsct/csm which installed cleanly, and am now on to new and interesting errors. HSM on linux appears to be an ugly intemperate can of worms, which is very dissapointing. In AIX, it was very nice. - Allen S. Rout
Re: HSM on Linux: Anyone? How'd you get there?
Allen - APAR IC52027 talks about that pre-req oversight, in the AIX environment. Poking around, I find that in ftp.software.ibm.com there is: /storage/tivoli-storage-management/maintenance/client/v5r4/Linux/ Linux86/HSM_RSCT See if that or its associated v_r_ cousins have what you need. Richard Sims
HSM on Linux: Anyone? How'd you get there?
Hey, all. I'm in a mild pickle: I've talked up the virtues of HSM, but my opinions have all been rooted in the AIX HSM experience. Attempting to implement in Linux, I'm finding life to be a royal pain in the patoot. I've been slogging through GPFS, and I appear to actually have the bloody thing installed and a disk defined. Now, I have to find 'rsct', which I'm blithely informed "is shipped with products that exploit the technology". Only, I see no rsct here, and the GPFS install bundle only drops - gpfs.base-3.2.1-0.i386.rpm - gpfs.docs-3.2.1-0.noarch.rpm - gpfs.gpl-3.2.1-0.noarch.rpm - gpfs.gui-3.2.1-0.i386.rpm - gpfs.msg.en_US-3.2.1-0.noarch.rpm Have any of you-all implemented HSM in a linux environment? By what path did you reach function? Argh. - Allen S. Rout
TSM HSM failing
Hi We have HSM in our environment and it keep failing with following error. Any body do come across these error ? THX DSMCLC.LOG W: No file security found in reparse data, file security not initialized Concerned file: '\\CBDSAPPOSM01\E$\Tivoli\20070801\234753\NGEF4A8B4A36-98DA-4526-B977-0E B5C352B6D7206b' DSMCLC (0824:0980) ICSourceSelector::mf_implFileFound 08-06-19 15:34:33.717 E: Failure investigating reparse point changes: 0x032A (E: Not initialized) Concerned file: dir='\\CBDSAPPOSM01\E$\Tivoli\20070801\234753', file='NGEF4A8B4A36-98DA-4526-B977-0EB5C352B6D7206b' DSMCLC (0824:0980) ICFindFile::mf_implFindFiles 08-06-19 15:34:33.717 E: Failure(2) in FileFound implementation of subclass at directory='\\CBDSAPPOSM01\E$\Tivoli\20070801\234753' file='NGEF4A8B4A36-98DA-4526-B977-0EB5C352B6D7206b': 0x032A (E: Not initialized). Continuing...
PROBLEM: HSM For Windows Recalling ALL Migrated Data During B/A Client Restore
Hi TSMers I am testing HSM For Windows, using this environment: TSM AIX Server 5.4.0.1 TSM For Windows B/A Client 5.4.1.2 TSM HSM For Windows 5.4.0.3 My problem, which I am puzzled about, is that during a Restore of a deleted share, which has most of the data migrated (the size is 1.5Gb but actual size on NTFS is 17Mb), the TSM B/A client restores 2000 objects and 9Mb of data - which is about what I would expect. However, when the restore starts bringing back the stub files, I see the HSM client (different nodename) starting to Recall the data, so I end up with the share back at the original size before I ran the HSM Migration job! The restore is carried out after deleting the share, using the Web Client GUI, and restoring the latest backup copy, and to the original location. In a very busy Clustered File environment, which I want to target HSM at, this may have severe consequences! Has anyone with experience of the 5.4 HSM client seen this before, or give me any clues as to where I am going wrong with my configuration? 5.5 may be my way forward, but I would not anticipate being able to get this version into my client's Production environment for at least another 3 months. Thanks Robin Lowe Storage Consultant
HSM for Windows x64?
Can any IBM folks give me an idea of when there is going to be an HSM for Windows x64 available? Thanks, Steve Schaub Systems Engineer, Windows Blue Cross Blue Shield of Tennessee 423-535-6574 (desk) 423-785-7347 (mobile) Please see the following link for the BlueCross BlueShield of Tennessee E-mail disclaimer: http://www.bcbst.com/email_disclaimer.shtm
Lost HSM files
We appear to have lost some files in HSM. One of our users created some files ten days ago. He inadvertently deleted them four days ago. Since our migration expiration option is 7 days, the files should still be available via the dsmmigundelete command. Right? This assumes that 1.) The directory exists (it does) 2.) HSM has run reconciliation during the time that the files existed. I can't prove #2 (is it logged anywhere?), but our HSM filesystem is badly under-sized and very active, so HSM is constantly shuttling files out to the TSM server. I can't imagine that HSM went six days without doing this. Did I miss any possibilities? The other possibility is that the user is confused as to when the files were created and deleted, but I want to make sure that we don't have anything set wrong. Thanks, anker
Re: HSM for Windows
>> On Mon, 16 Jul 2007 02:20:46 -0700, Francisco Molero <[EMAIL PROTECTED]> >> said: > Hi, I don't think HSM is a bad product, I think you need to clarify > what the product does. [...] Hrm. I agree that it does what it says it does, so I think we agree that it's not a bad product. Instead, I think the fit between 'what it says it does' and the featureset usually associated with the term "Heirarchical storage management" is casual at best. > 1.- Retversion for archvie copy group . Or how many days you can store a file without activity. means you end up storing a number of copies related to the frequency of -access-, not the frequency of -change-. I consider this a game-breaker. So you write the file, Then you back up the file, Then you migrate the file. then you back up the stub. then you read the file: and back it up again. and migrate it again. and back up the stub again. then you read the file: and back it up again. and migrate it again. and back up the stub again. Each of the migrated versions stays around forever, or for however long you decided you want to keep the migrated bits of HSM. The successive retrieved versions are also backed up, which means you could have quite a few identical versions in the pipelines. These will age out in time, so they don't constitute the permanent load that the archive bits do. Because of this, the storage associated with a single file can just grow without bounds. - Allen S. Rout
Re: HSM for Windows
Hi, I don't think HSM is a bad product, I think you need to clarify what the product does. 1.- Retversion for archvie copy group . Or how many days you can store a file without activity. 2.- Archive pool -> with a copystgpool. 3.- If you run migrations with HSM and run backups with TSM. TSM BACKUPS THE STUB FILES and the lastest version will be the stub file. Then the great advantage is you can restore the stub files from TSM, quickly restore, and if you need open the files HSM will be charge of that. 4- In my opinion the major problem is the reconciliation. But like Igor said in 5.5 will be available. regards, Fran - Mensaje original De: Igor Yakovenko <[EMAIL PROTECTED]> Para: ADSM-L@VM.MARIST.EDU Enviado: lunes, 16 de julio, 2007 9:07:26 Asunto: Re: HSM for Windows Hello, In new 5.5 version of TSM (4Q2007) we are waiting reconciliation feature for HSM for Windows product. Best regards, Igor Yakovenko "Schaub, Steve" <[EMAIL PROTECTED] ST.COM>To Sent by: "ADSM: ADSM-L@VM.MARIST.EDU Dist Stor cc Manager" <[EMAIL PROTECTED] Subject .EDU> Re: [ADSM-L] HSM for Windows 14.07.2007 00:21 Please respond to "ADSM: Dist Stor Manager" <[EMAIL PROTECTED] .EDU> Allen, Thanks, I did notice that little "feature". For us, I hope it means we simply have to increase our versioning by one for files under HSM influence. One question I have not been able to figure out is whether HSM & the filesystem ever perform any sort of "reconciliation" - for example, when a user finally decides to delete his illegal mp3 collection from the corporate fileserver, how does the HSM archive receive that notice so it can be reclaimed? Or are we going to have ghosts in the attic forever? Kelly also had a good point about HSM becoming an easy-to-get-in but hard-to-get-out type of product. Unfortunately, it may be our only hope to extend the life of some fileservers, given that we are not able to enforce any sort of user quotas (don't even get me started). Thanks, Steve Schaub Systems Engineer, WNI BlueCross BlueShield of Tennessee 423-535-6574 (desk) 423-785-7347 (cell) -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Allen S. Rout Sent: Friday, July 13, 2007 3:43 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] HSM for Windows >> On Fri, 13 Jul 2007 08:02:48 -0400, "Schaub, Steve" <[EMAIL PROTECTED]> said: > We're considering implementing HSM for Windows on some large (5TB+ each) > fileservers. Has anyone undertaken something similar, and care to share > any results? Any gotchas? Take a look back in the archives: the TSM product for windows which is called 'HSM' has many, very important characteristics in which it differs from what you may be thinking if you've ever dealt with a HSM product in the past. For very prominent example: When you've migrated your data, the stub will get backed up, which will push the full version of the file to inactive status, so it'll disappear from your backups. My opinion is "Avoid, avoid, avoid." - Allen S. Rout Please see the following link for the BlueCross BlueShield of Tennessee E-mail disclaimer: http://www.bcbst.com/email_disclaimer.shtm __ LLama Gratis a cualquier PC del Mundo. Llamadas a fijos y móviles desde 1 céntimo por minuto. http://es.voice.yahoo.com
Re: HSM for Windows
Hello, In new 5.5 version of TSM (4Q2007) we are waiting reconciliation feature for HSM for Windows product. Best regards, Igor Yakovenko "Schaub, Steve" <[EMAIL PROTECTED] ST.COM>To Sent by: "ADSM: ADSM-L@VM.MARIST.EDU Dist Stor cc Manager" <[EMAIL PROTECTED] Subject .EDU> Re: [ADSM-L] HSM for Windows 14.07.2007 00:21 Please respond to "ADSM: Dist Stor Manager" <[EMAIL PROTECTED] .EDU> Allen, Thanks, I did notice that little "feature". For us, I hope it means we simply have to increase our versioning by one for files under HSM influence. One question I have not been able to figure out is whether HSM & the filesystem ever perform any sort of "reconciliation" - for example, when a user finally decides to delete his illegal mp3 collection from the corporate fileserver, how does the HSM archive receive that notice so it can be reclaimed? Or are we going to have ghosts in the attic forever? Kelly also had a good point about HSM becoming an easy-to-get-in but hard-to-get-out type of product. Unfortunately, it may be our only hope to extend the life of some fileservers, given that we are not able to enforce any sort of user quotas (don't even get me started). Thanks, Steve Schaub Systems Engineer, WNI BlueCross BlueShield of Tennessee 423-535-6574 (desk) 423-785-7347 (cell) -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Allen S. Rout Sent: Friday, July 13, 2007 3:43 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] HSM for Windows >> On Fri, 13 Jul 2007 08:02:48 -0400, "Schaub, Steve" <[EMAIL PROTECTED]> said: > We're considering implementing HSM for Windows on some large (5TB+ each) > fileservers. Has anyone undertaken something similar, and care to share > any results? Any gotchas? Take a look back in the archives: the TSM product for windows which is called 'HSM' has many, very important characteristics in which it differs from what you may be thinking if you've ever dealt with a HSM product in the past. For very prominent example: When you've migrated your data, the stub will get backed up, which will push the full version of the file to inactive status, so it'll disappear from your backups. My opinion is "Avoid, avoid, avoid." - Allen S. Rout Please see the following link for the BlueCross BlueShield of Tennessee E-mail disclaimer: http://www.bcbst.com/email_disclaimer.shtm
Re: HSM for Windows
>> On Fri, 13 Jul 2007 16:21:15 -0400, "Schaub, Steve" <[EMAIL PROTECTED]> said: > Thanks, I did notice that little "feature". For us, I hope it means > we simply have to increase our versioning by one for files under HSM > influence. Not unless you're planning on doing retextra=nolimit. And further, since you have to keep the archives forever, you'll end up with N versions of the (identical) file archived, where N is the number of times the file has been retrieved. > One question I have not been able to figure out is whether HSM & the > filesystem ever perform any sort of "reconciliation" - for example, > when a user finally decides to delete his illegal mp3 collection > from the corporate fileserver, how does the HSM archive receive that > notice so it can be reclaimed? Or are we going to have ghosts in > the attic forever? The latter. The archives have to be kept forever, unless you want the "real" files for which you've got stubs to softly and silently vanish away. > Unfortunately, it may be our only hope to extend the life of some > fileservers, given that we are not able to enforce any sort of user > quotas (don't even get me started). Not just no, but hell no. If you're visualizing this as an inexpensive way to stretch the capacity of a more or less normal fileserver, prefer just pouring bleach in your eyes. The HSM for windows developer even specified that it was only appropriate for extremely stable, extremely large installations. Think a static output directory for your ERP system to stick reports whicn we all know nobody will ever read, but some sort of beuracratic peristalysis demands N-year retention. Please, please please don't use this for anything approaching a conventional fileserver. For that application, far better to put up SAMBA in front of an AIX filesystem that uses something a real HSM, or better yet just buy some multi-TB nas-in-a-box. - Allen S. Rout
Re: HSM for Windows
On Jul 13, 2007, at 4:21 PM, Schaub, Steve wrote: One question I have not been able to figure out is whether HSM & the filesystem ever perform any sort of "reconciliation" - for example, when a user finally decides to delete his illegal mp3 collection from the corporate fileserver, how does the HSM archive receive that notice so it can be reclaimed? Or are we going to have ghosts in the attic forever? HSM for Windows is little more than the TSM API Archive facility glued to a special MS Windows file interface, as described in its manual and a Redpiece on it. Files endure in TSM server storage per Archive retention period. From all I've read, there's none of the thoroughness of the Unix HSM - no command set, no daemons, no reconciliation. I feel sorry for people who buy into HSM for Windows (or Windows itself, for that matter). Richard Sims
Re: HSM for Windows
Carefull implementation and coordination with TSM retention policy changes could overcome this issue. You could set VDE/VDD to 3 and REV/ROV to no limit (or some acceptable value) for the stub files. If the access time to the files can be minutes or hours, you might be better served by a database referencing archives. This could reduce dependency on OS/filesystem upgrades messing up the HSM and provides a small level of futureproofing your system. Cheers, Neil -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Allen S. Rout Sent: Friday, July 13, 2007 3:43 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] HSM for Windows >> On Fri, 13 Jul 2007 08:02:48 -0400, "Schaub, Steve" <[EMAIL PROTECTED]> said: > We're considering implementing HSM for Windows on some large (5TB+ > each) fileservers. Has anyone undertaken something similar, and care > to share any results? Any gotchas? Take a look back in the archives: the TSM product for windows which is called 'HSM' has many, very important characteristics in which it differs from what you may be thinking if you've ever dealt with a HSM product in the past. For very prominent example: When you've migrated your data, the stub will get backed up, which will push the full version of the file to inactive status, so it'll disappear from your backups. My opinion is "Avoid, avoid, avoid." - Allen S. Rout IMPORTANT: E-mail sent through the Internet is not secure. Legg Mason therefore recommends that you do not send any confidential or sensitive information to us via electronic mail, including social security numbers, account numbers, or personal identification numbers. Delivery, and or timely delivery of Internet mail is not guaranteed. Legg Mason therefore recommends that you do not send time sensitive or action-oriented messages to us via electronic mail. This message is intended for the addressee only and may contain privileged or confidential information. Unless you are the intended recipient, you may not use, copy or disclose to anyone any information contained in this message. If you have received this message in error, please notify the author by replying to this message and then kindly delete the message. Thank you.
Re: HSM for Windows
Allen, Thanks, I did notice that little "feature". For us, I hope it means we simply have to increase our versioning by one for files under HSM influence. One question I have not been able to figure out is whether HSM & the filesystem ever perform any sort of "reconciliation" - for example, when a user finally decides to delete his illegal mp3 collection from the corporate fileserver, how does the HSM archive receive that notice so it can be reclaimed? Or are we going to have ghosts in the attic forever? Kelly also had a good point about HSM becoming an easy-to-get-in but hard-to-get-out type of product. Unfortunately, it may be our only hope to extend the life of some fileservers, given that we are not able to enforce any sort of user quotas (don't even get me started). Thanks, Steve Schaub Systems Engineer, WNI BlueCross BlueShield of Tennessee 423-535-6574 (desk) 423-785-7347 (cell) -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Allen S. Rout Sent: Friday, July 13, 2007 3:43 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] HSM for Windows >> On Fri, 13 Jul 2007 08:02:48 -0400, "Schaub, Steve" <[EMAIL PROTECTED]> said: > We're considering implementing HSM for Windows on some large (5TB+ each) > fileservers. Has anyone undertaken something similar, and care to share > any results? Any gotchas? Take a look back in the archives: the TSM product for windows which is called 'HSM' has many, very important characteristics in which it differs from what you may be thinking if you've ever dealt with a HSM product in the past. For very prominent example: When you've migrated your data, the stub will get backed up, which will push the full version of the file to inactive status, so it'll disappear from your backups. My opinion is "Avoid, avoid, avoid." - Allen S. Rout Please see the following link for the BlueCross BlueShield of Tennessee E-mail disclaimer: http://www.bcbst.com/email_disclaimer.shtm
Re: HSM practical limit?
> We're considering using HSM HSM has been nothing but a headache for us. It's a vicious, horrible piece of code. We've been running TSM for 8 years and have been very, very happy with it--except for the data that was lost in an HSM mishap. Managing HSM is a nightmare. I would cut my own head off with a rusty hacksaw before I would implement HSM again. ...but don't let me talk you out of it , anker
Re: HSM for Windows
>> On Fri, 13 Jul 2007 08:02:48 -0400, "Schaub, Steve" <[EMAIL PROTECTED]> said: > We're considering implementing HSM for Windows on some large (5TB+ each) > fileservers. Has anyone undertaken something similar, and care to share > any results? Any gotchas? Take a look back in the archives: the TSM product for windows which is called 'HSM' has many, very important characteristics in which it differs from what you may be thinking if you've ever dealt with a HSM product in the past. For very prominent example: When you've migrated your data, the stub will get backed up, which will push the full version of the file to inactive status, so it'll disappear from your backups. My opinion is "Avoid, avoid, avoid." - Allen S. Rout
Re: HSM practical limit?
At 09:57 AM 7/13/2007, Stapleton, Mark wrote: [...] in these days of decent cheap disk getting cheaper and more decent all the time, HSM's day is pretty much past [...] Mark, I agree that HSM's value has diminished over time, and I also question whether there is still a place for it. We used TSM's HSM once before, many years ago, and abandoned it when the cost of disk came down. However, I am now facing requirements for a new application that I think might actually be a good fit for HSM. It involves (1) very large average object size (on the order of 10M-100M each), (2) vast amounts of storage (60TB/year growth), (3) an extremely low reference rate, and (4) an extremely low, or non-existant, change rate. Our mind is definitely not made up to go with HSM. We are simply evaluating it as one of a few alternatives. On paper, it still looks less expensive than the cheapest disk we can find, but I'm not sure how much of a headache it will be to manage. Thus my question. Thanks to both you and Richard for responding. ..Paul -- Paul ZarnowskiPh: 607-255-4757 Manager, Storage Services Fx: 607-255-8521 719 Rhodes Hall, Ithaca, NY 14853-3801Em: [EMAIL PROTECTED]
Re: HSM practical limit?
Mark - I agree with your point that modern disk is cheap to purchase, which can reduce the value of HSM. However, many computer rooms are struggling with the heat and power issues of a lot of rack mount systems and hot-running disk. The escalating cost of energy and pressing problems of global warming really need to be considered. As in our case, HSM often used for storing a vast amount of static information (system logs, accounting files, installation packages, etc.) which seldom needs to be looked at. It makes more sense to exploit the HSM tie to existing tape library storage to hold such bulk on dormant, rather than active, media, with stub file representation in familiar directory structures (as opposed to TSM Archive storage, where "visibility" is inconvenient). So, we accept the warts of Unix HSM for the value it provides us. Richard Sims
Re: HSM practical limit?
From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Richard Sims > Speaking from experience running HSM on AIX JFS for many years: > Applied to a file system, HSM turns it into the slowest you've ever > experienced, even on the fastest RS/6000 and disk systems. I just want to toss in my two cents on a procedural issue: HSM is a legacy infrastructure that was originally implemented for mainframe systems 50 years ago. It was built in a day when hard disk was horrendously expensive and required impressive physical resources to maintain. (Old HDs were a big reason why raised floors were originally made from preformed concrete.) Anyway, in these days of decent cheap disk getting cheaper and more decent all the time, HSM's day is pretty much past despite attempts to implement it for Microsoft OSs (which is a lost cause). If you need more storage, buy it. If you need to move seldom-accessed files to cheaper disk (which IS a legitimate goal), use something like IBM's TPC for disk to ferret out such files and move 'em. Or (even better) archive 'em with TSM with a long retention period. Why would anyone want to implement an infrastructure that turns your computer system to the cybernetic equivalent of the village idiot? -- Mark Stapleton System engineer Berbee, a CDW company www.berbee.com