Re: When hours become seconds
That Eric is me! Just kidding, a long time ago someone from IBM told me Eric was the name of the son of one of the first ADSM developers. Kind regards, Eric van Loon -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Allen S. Rout Sent: woensdag 2 november 2011 14:42 To: ADSM-L@VM.MARIST.EDU Subject: Re: When hours become seconds On 11/02/2011 08:49 AM, Zoltan Forray/AC/VCU wrote: I had an odd situation occur involving formatting disk storage volumes on a Linux server. [...] So, what gives? Is there some dramatic change in 6.2.3.0 (this is my first server upgraded to this level) effecting the behavior of creating disk storage pool volumes? It can't be the hardware since this is a 3+ year old machine. I have newer, bigger, beefier, faster servers that still take a long time to format storage volumes? I know that for a long time (back to ADSM v2, at least), volumes were formatted, and _populated_ with 'Eric'. EricEricEricEricEricEricEricEricEricEricEricEricEricEricEricEricEricEric EricEric I have often wondered who Eric was. :) This would require that every byte of that 300G get shoved down the SAN pipe, and get committed to disk. Kind of the opposite of thin allocation. This kills the cache. If they are dealing with that in some different way... - Allen S. Rout For information, services and offers, please visit our web site: http://www.klm.com. This e-mail and any attachment may contain confidential and privileged material intended for the addressee only. If you are not the addressee, you are notified that no part of the e-mail or any attachment may be disclosed, copied or distributed, and that any other action related to this e-mail or attachment is strictly prohibited, and may be unlawful. If you have received this e-mail by error, please notify the sender immediately by return e-mail, and delete this message. Koninklijke Luchtvaart Maatschappij NV (KLM), its subsidiaries and/or its employees shall not be liable for the incorrect or incomplete transmission of this e-mail or any attachments, nor responsible for any delay in receipt. Koninklijke Luchtvaart Maatschappij N.V. (also known as KLM Royal Dutch Airlines) is registered in Amstelveen, The Netherlands, with registered number 33014286
Re: When hours become seconds
There seems to be some additional mitigating factors for this to work in 2-seconds vs 2-hours. I just redid our SAN storage on another box that has 6.2.3.0 installed and it is formatting as beforegonna take hours for 300GB The big differences between this system and the other one: FAST = RH 6.1 filesystems=ext4 SLOW = RH 5.6 filesystem=ext3 Thinking it might be ext3 vs ext4, we tried to perform a mkfs.ext4 but that function/format doesn't exist until a higher kernel level that what is on our SLOW system. So, what are the details / requirements for FAST formatting vs SLOW? Is there a doc/tid to read? Zoltan Forray TSM Software Hardware Administrator Virginia Commonwealth University UCC/Office of Technology Services zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://infosecurity.vcu.edu/phishing.html From: Hans Christian Riksheim bull...@gmail.com To: ADSM-L@VM.MARIST.EDU Date: 11/02/2011 09:49 AM Subject:Re: [ADSM-L] When hours become seconds Sent by:ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU Yes, this was finally fixed for the UNIX platforms in 6.2.3. This update was released just in time for me when I had to format 40 TB of disk/file on a new server. Would have taken a week otherwise. I guess it does the same as on the windows platform so no need to write zeros on all blocks on unix anymore. Hans Chr. On Wed, Nov 2, 2011 at 1:49 PM, Zoltan Forray/AC/VCU zfor...@vcu.edu wrote: I had an odd situation occur involving formatting disk storage volumes on a Linux server. In the past, when creating and formatting storage pool volumes, a 300GB volume would normally take an hour or more. I could watch the space being allocated, piece-by-piece until it reached 300GB and then wait for the formatting to complete. This process was usually so resource intensive (never understood why???) doing something like an LS would take many seconds to respond. Yesterday, I had a need to create new volumes on a recently rebuilt server - RH Linux 5.6 and TSM server 6.2.3.0. Imagine my surprise when a 300GB volume was created in 2-seconds! Furthermore, I create 9-300GB volumes as fast as I could enter the commands! I thought for sure there was some kind of problem but all the error logs I checked were clean. I figured if I started using them they would start registering errors but nothing happened! Everything seems to be working just fine. So, what gives? Is there some dramatic change in 6.2.3.0 (this is my first server upgraded to this level) effecting the behavior of creating disk storage pool volumes? It can't be the hardware since this is a 3+ year old machine. I have newer, bigger, beefier, faster servers that still take a long time to format storage volumes? Zoltan Forray TSM Software Hardware Administrator Virginia Commonwealth University UCC/Office of Technology Services zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://infosecurity.vcu.edu/phishing.html
When hours become seconds
I had an odd situation occur involving formatting disk storage volumes on a Linux server. In the past, when creating and formatting storage pool volumes, a 300GB volume would normally take an hour or more. I could watch the space being allocated, piece-by-piece until it reached 300GB and then wait for the formatting to complete. This process was usually so resource intensive (never understood why???) doing something like an LS would take many seconds to respond. Yesterday, I had a need to create new volumes on a recently rebuilt server - RH Linux 5.6 and TSM server 6.2.3.0. Imagine my surprise when a 300GB volume was created in 2-seconds! Furthermore, I create 9-300GB volumes as fast as I could enter the commands! I thought for sure there was some kind of problem but all the error logs I checked were clean. I figured if I started using them they would start registering errors but nothing happened! Everything seems to be working just fine. So, what gives? Is there some dramatic change in 6.2.3.0 (this is my first server upgraded to this level) effecting the behavior of creating disk storage pool volumes? It can't be the hardware since this is a 3+ year old machine. I have newer, bigger, beefier, faster servers that still take a long time to format storage volumes? Zoltan Forray TSM Software Hardware Administrator Virginia Commonwealth University UCC/Office of Technology Services zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://infosecurity.vcu.edu/phishing.html
Re: When hours become seconds
On 11/02/2011 08:49 AM, Zoltan Forray/AC/VCU wrote: I had an odd situation occur involving formatting disk storage volumes on a Linux server. [...] So, what gives? Is there some dramatic change in 6.2.3.0 (this is my first server upgraded to this level) effecting the behavior of creating disk storage pool volumes? It can't be the hardware since this is a 3+ year old machine. I have newer, bigger, beefier, faster servers that still take a long time to format storage volumes? I know that for a long time (back to ADSM v2, at least), volumes were formatted, and _populated_ with 'Eric'. EricEricEricEricEricEricEricEricEricEricEricEricEricEricEricEricEricEricEricEric I have often wondered who Eric was. :) This would require that every byte of that 300G get shoved down the SAN pipe, and get committed to disk. Kind of the opposite of thin allocation. This kills the cache. If they are dealing with that in some different way... - Allen S. Rout
Re: When hours become seconds
Yes, this was finally fixed for the UNIX platforms in 6.2.3. This update was released just in time for me when I had to format 40 TB of disk/file on a new server. Would have taken a week otherwise. I guess it does the same as on the windows platform so no need to write zeros on all blocks on unix anymore. Hans Chr. On Wed, Nov 2, 2011 at 1:49 PM, Zoltan Forray/AC/VCU zfor...@vcu.edu wrote: I had an odd situation occur involving formatting disk storage volumes on a Linux server. In the past, when creating and formatting storage pool volumes, a 300GB volume would normally take an hour or more. I could watch the space being allocated, piece-by-piece until it reached 300GB and then wait for the formatting to complete. This process was usually so resource intensive (never understood why???) doing something like an LS would take many seconds to respond. Yesterday, I had a need to create new volumes on a recently rebuilt server - RH Linux 5.6 and TSM server 6.2.3.0. Imagine my surprise when a 300GB volume was created in 2-seconds! Furthermore, I create 9-300GB volumes as fast as I could enter the commands! I thought for sure there was some kind of problem but all the error logs I checked were clean. I figured if I started using them they would start registering errors but nothing happened! Everything seems to be working just fine. So, what gives? Is there some dramatic change in 6.2.3.0 (this is my first server upgraded to this level) effecting the behavior of creating disk storage pool volumes? It can't be the hardware since this is a 3+ year old machine. I have newer, bigger, beefier, faster servers that still take a long time to format storage volumes? Zoltan Forray TSM Software Hardware Administrator Virginia Commonwealth University UCC/Office of Technology Services zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://infosecurity.vcu.edu/phishing.html
Re: When hours become seconds
Thanks for the confirmation. I too am getting ready to format 20TB+ on 2-other servers so I guess I will have to update the servers to 6.2.3.0 first (or jump straight to 6.3) I wonder if this will effect FILE devclasses/processing? I have tried to use FILE devclasses numerous times and always see performance problems and have reverted back to fixed, formatted volumes. Zoltan Forray TSM Software Hardware Administrator Virginia Commonwealth University UCC/Office of Technology Services zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://infosecurity.vcu.edu/phishing.html From: Hans Christian Riksheim bull...@gmail.com To: ADSM-L@VM.MARIST.EDU Date: 11/02/2011 09:49 AM Subject:Re: [ADSM-L] When hours become seconds Sent by:ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU Yes, this was finally fixed for the UNIX platforms in 6.2.3. This update was released just in time for me when I had to format 40 TB of disk/file on a new server. Would have taken a week otherwise. I guess it does the same as on the windows platform so no need to write zeros on all blocks on unix anymore. Hans Chr. On Wed, Nov 2, 2011 at 1:49 PM, Zoltan Forray/AC/VCU zfor...@vcu.edu wrote: I had an odd situation occur involving formatting disk storage volumes on a Linux server. In the past, when creating and formatting storage pool volumes, a 300GB volume would normally take an hour or more. I could watch the space being allocated, piece-by-piece until it reached 300GB and then wait for the formatting to complete. This process was usually so resource intensive (never understood why???) doing something like an LS would take many seconds to respond. Yesterday, I had a need to create new volumes on a recently rebuilt server - RH Linux 5.6 and TSM server 6.2.3.0. Imagine my surprise when a 300GB volume was created in 2-seconds! Furthermore, I create 9-300GB volumes as fast as I could enter the commands! I thought for sure there was some kind of problem but all the error logs I checked were clean. I figured if I started using them they would start registering errors but nothing happened! Everything seems to be working just fine. So, what gives? Is there some dramatic change in 6.2.3.0 (this is my first server upgraded to this level) effecting the behavior of creating disk storage pool volumes? It can't be the hardware since this is a 3+ year old machine. I have newer, bigger, beefier, faster servers that still take a long time to format storage volumes? Zoltan Forray TSM Software Hardware Administrator Virginia Commonwealth University UCC/Office of Technology Services zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://infosecurity.vcu.edu/phishing.html
Re: When hours become seconds
Speaking of 6.2.3, I just noticed a 6.2.3.100 patch but none of the links in the README.htm file work. Anyone have the list of what is fixed for this patch? Zoltan Forray TSM Software Hardware Administrator Virginia Commonwealth University UCC/Office of Technology Services zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://infosecurity.vcu.edu/phishing.html From: Hans Christian Riksheim bull...@gmail.com To: ADSM-L@VM.MARIST.EDU Date: 11/02/2011 09:49 AM Subject:Re: [ADSM-L] When hours become seconds Sent by:ADSM: Dist Stor Manager ADSM-L@VM.MARIST.EDU Yes, this was finally fixed for the UNIX platforms in 6.2.3. This update was released just in time for me when I had to format 40 TB of disk/file on a new server. Would have taken a week otherwise. I guess it does the same as on the windows platform so no need to write zeros on all blocks on unix anymore. Hans Chr. On Wed, Nov 2, 2011 at 1:49 PM, Zoltan Forray/AC/VCU zfor...@vcu.edu wrote: I had an odd situation occur involving formatting disk storage volumes on a Linux server. In the past, when creating and formatting storage pool volumes, a 300GB volume would normally take an hour or more. I could watch the space being allocated, piece-by-piece until it reached 300GB and then wait for the formatting to complete. This process was usually so resource intensive (never understood why???) doing something like an LS would take many seconds to respond. Yesterday, I had a need to create new volumes on a recently rebuilt server - RH Linux 5.6 and TSM server 6.2.3.0. Imagine my surprise when a 300GB volume was created in 2-seconds! Furthermore, I create 9-300GB volumes as fast as I could enter the commands! I thought for sure there was some kind of problem but all the error logs I checked were clean. I figured if I started using them they would start registering errors but nothing happened! Everything seems to be working just fine. So, what gives? Is there some dramatic change in 6.2.3.0 (this is my first server upgraded to this level) effecting the behavior of creating disk storage pool volumes? It can't be the hardware since this is a 3+ year old machine. I have newer, bigger, beefier, faster servers that still take a long time to format storage volumes? Zoltan Forray TSM Software Hardware Administrator Virginia Commonwealth University UCC/Office of Technology Services zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://infosecurity.vcu.edu/phishing.html
Re: When hours become seconds
Bummer, I just formatted 30TB of disk spool on v6.2.2.2 and it took days... -- -- Skylar Thompson (skyl...@u.washington.edu) -- Genome Sciences Department, System Administrator -- Foege Building S046, (206)-685-7354 -- University of Washington School of Medicine On 11/ 2/11 06:47 AM, Hans Christian Riksheim wrote: Yes, this was finally fixed for the UNIX platforms in 6.2.3. This update was released just in time for me when I had to format 40 TB of disk/file on a new server. Would have taken a week otherwise. I guess it does the same as on the windows platform so no need to write zeros on all blocks on unix anymore. Hans Chr. On Wed, Nov 2, 2011 at 1:49 PM, Zoltan Forray/AC/VCUzfor...@vcu.edu wrote: I had an odd situation occur involving formatting disk storage volumes on a Linux server. In the past, when creating and formatting storage pool volumes, a 300GB volume would normally take an hour or more. I could watch the space being allocated, piece-by-piece until it reached 300GB and then wait for the formatting to complete. This process was usually so resource intensive (never understood why???) doing something like an LS would take many seconds to respond. Yesterday, I had a need to create new volumes on a recently rebuilt server - RH Linux 5.6 and TSM server 6.2.3.0. Imagine my surprise when a 300GB volume was created in 2-seconds! Furthermore, I create 9-300GB volumes as fast as I could enter the commands! I thought for sure there was some kind of problem but all the error logs I checked were clean. I figured if I started using them they would start registering errors but nothing happened! Everything seems to be working just fine. So, what gives? Is there some dramatic change in 6.2.3.0 (this is my first server upgraded to this level) effecting the behavior of creating disk storage pool volumes? It can't be the hardware since this is a 3+ year old machine. I have newer, bigger, beefier, faster servers that still take a long time to format storage volumes? Zoltan Forray TSM Software Hardware Administrator Virginia Commonwealth University UCC/Office of Technology Services zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://infosecurity.vcu.edu/phishing.html
Re: When hours become seconds
Hi all, I guess that IBM started using the posix fs call to allocate storage. The command finishes in seconds, but at least on AIX the actual I/O still lasts forever. Some operating systems might be able to allocate disk space a lot quicker. It all boils down to the particular unix flavor implementation of sparse files... Windoze never had sparse files, so there dsmfmt was always instant On 2 nov. 2011, at 13:49, Zoltan Forray/AC/VCU wrote: I had an odd situation occur involving formatting disk storage volumes on a Linux server. In the past, when creating and formatting storage pool volumes, a 300GB volume would normally take an hour or more. I could watch the space being allocated, piece-by-piece until it reached 300GB and then wait for the formatting to complete. This process was usually so resource intensive (never understood why???) doing something like an LS would take many seconds to respond. Yesterday, I had a need to create new volumes on a recently rebuilt server - RH Linux 5.6 and TSM server 6.2.3.0. Imagine my surprise when a 300GB volume was created in 2-seconds! Furthermore, I create 9-300GB volumes as fast as I could enter the commands! I thought for sure there was some kind of problem but all the error logs I checked were clean. I figured if I started using them they would start registering errors but nothing happened! Everything seems to be working just fine. So, what gives? Is there some dramatic change in 6.2.3.0 (this is my first server upgraded to this level) effecting the behavior of creating disk storage pool volumes? It can't be the hardware since this is a 3+ year old machine. I have newer, bigger, beefier, faster servers that still take a long time to format storage volumes? Zoltan Forray TSM Software Hardware Administrator Virginia Commonwealth University UCC/Office of Technology Services zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://infosecurity.vcu.edu/phishing.html -- Met vriendelijke groeten/Kind Regards, Remco Post r.p...@plcs.nl +31 6 248 21 622
