AW: Copy storage pools - serious data integrity issues
Hi, once I run into same issue in simillar environment but it turned out to by my fault: I did quite often successfull backup stg primary-disk-storage-pool backup-storage-pool but it occasionaly happened that migration from backup stg primary-disk-storage-pool to primary-tape-pool started before the backup stg has finished. Figuring that out, i scheduled an extra backup stg primary-tape-pool backup-storage-pool and everything went fine. regards Juraj Salak -Ursprüngliche Nachricht- Von: Neil Schofield [mailto:[EMAIL PROTECTED] Gesendet: Dienstag, 25. Februar 2003 16:32 An: [EMAIL PROTECTED] Betreff: Copy storage pools - serious data integrity issues Dear all I've been running TSM for four years or so. When we use BACKUP STGPOOL to copy a primary storage pool to a copy storage pool, I have relied on the fact that a successful completion means I have two copies of all my data. I've just discovered that a number of my files don't have a second copy. For a large number of volumes (more than 10 per server) Q CONTENT xx COPIED=NO comes back details of the files but BACKUP STGPOOL (with or without PREVIEW=YES) tells me there is no data to be copied. Some of these files were backed up from the client months (years?) ago. Some are active, some are inactive. I discovered this when testing my DR procedures. I updated the status of all my primary storage pool volumes to be DESTROYED and ran a RESTORE STGPOOL PREVIEW=YES. I was shocked at the number of 'ANR1256W Volume XX contains files that could not be restored' messages that resulted. I've logged a PMR but wondered if anybody else had experienced similar. It kind of blows a big hole in my DR plans. For info, we are running TSM Server 4.2.1.15 on Windows. Thanks Neil Schofield Yorkshire Water Services Ltd. Visit our web site to find out about our award winning Cool Schools community campaign at http://www.yorkshirewater.com/yorkshirewater/schools.html The information in this e-mail is confidential and may also be legally privileged. The contents are intended for recipient only and are subject to the legal notice available at http://www.keldagroup.com/email.htm Yorkshire Water Services Limited Registered Office Western House Halifax Road Bradford BD6 2SZ Registered in England and Wales No 2366682
Re: Copy storage pools - serious data integrity issues
I have never run into anything like this. I run this script regularly: select char(stgpool_name,12) as stgpool, - cast(sum(physical_mb)/1024 as decimal(10,1)) as Physical_GB , - cast(sum(logical_mb)/1024 as decimal(10,1)) as logical_gb, - sum(num_files) as objects - from occupancy group by stgpool_name order by 1 So that I can make sure that the number of objects in my disk pool + primary tape = number of objects in copy pool tape. The only way I KNOW of that you can get into your situation is if you have either 1) a disk dirmc pool or 2) a primary disk pool that doesn't get cleared out and you don't specifically copy it to the copypool. Whenever I do: BACKUP STGPOOL PRIMARYTAPE COPYPOOLTAPE I also do: BACKUP STGPOOL DISKPOOL COPYPOOLTAPE Because when TSM does migration from disk to tape, it does NOT necessariliy migrate the oldest data first, and you can go a VERY LONG TIME (or forever) without all the data migrating to your primary tape pool. So you need the BACKUP STGPOOL DISKPOOL COPYPOOLTAPE to make sure that stuff gets to the COPYPOOLTAPE too. If that's not it, I would be REAL interested in hearing what you eventually find... -Original Message- From: Neil Schofield [mailto:[EMAIL PROTECTED] Sent: Tuesday, February 25, 2003 10:32 AM To: [EMAIL PROTECTED] Subject: Copy storage pools - serious data integrity issues Dear all I've been running TSM for four years or so. When we use BACKUP STGPOOL to copy a primary storage pool to a copy storage pool, I have relied on the fact that a successful completion means I have two copies of all my data. I've just discovered that a number of my files don't have a second copy. For a large number of volumes (more than 10 per server) Q CONTENT xx COPIED=NO comes back details of the files but BACKUP STGPOOL (with or without PREVIEW=YES) tells me there is no data to be copied. Some of these files were backed up from the client months (years?) ago. Some are active, some are inactive. I discovered this when testing my DR procedures. I updated the status of all my primary storage pool volumes to be DESTROYED and ran a RESTORE STGPOOL PREVIEW=YES. I was shocked at the number of 'ANR1256W Volume XX contains files that could not be restored' messages that resulted. I've logged a PMR but wondered if anybody else had experienced similar. It kind of blows a big hole in my DR plans. For info, we are running TSM Server 4.2.1.15 on Windows. Thanks Neil Schofield Yorkshire Water Services Ltd. Visit our web site to find out about our award winning Cool Schools community campaign at http://www.yorkshirewater.com/yorkshirewater/schools.html The information in this e-mail is confidential and may also be legally privileged. The contents are intended for recipient only and are subject to the legal notice available at http://www.keldagroup.com/email.htm Yorkshire Water Services Limited Registered Office Western House Halifax Road Bradford BD6 2SZ Registered in England and Wales No 2366682
Re: Copy storage pools - serious data integrity issues
I noticed the same problem a couple of times and was able to track it down to so some of the clients doing their own manual backups after the copy of the disk storage pool in the morning. Once a client was upgrading his server and wanted a more current backup in case of files, another was a client who was creating brochures and wanted to get extra copies in case of problems. Shannon Bach Madison Gas Electric Co. Operations Analyst - Data Center Services Office 608-252-7260 Fax 608-252-7098 e-mail [EMAIL PROTECTED] Prather, Wanda [EMAIL PROTECTED]To: [EMAIL PROTECTED] UAPL.EDUcc: Sent by: ADSM: Subject: Re: Copy storage pools - serious data integrity Dist Stor issues Manager [EMAIL PROTECTED] .EDU 02/26/2003 12:25 PM Please respond to ADSM: Dist Stor Manager I have never run into anything like this. I run this script regularly: select char(stgpool_name,12) as stgpool, - cast(sum(physical_mb)/1024 as decimal(10,1)) as Physical_GB , - cast(sum(logical_mb)/1024 as decimal(10,1)) as logical_gb, - sum(num_files) as objects - from occupancy group by stgpool_name order by 1 So that I can make sure that the number of objects in my disk pool + primary tape = number of objects in copy pool tape. The only way I KNOW of that you can get into your situation is if you have either 1) a disk dirmc pool or 2) a primary disk pool that doesn't get cleared out and you don't specifically copy it to the copypool. Whenever I do: BACKUP STGPOOL PRIMARYTAPE COPYPOOLTAPE I also do: BACKUP STGPOOL DISKPOOL COPYPOOLTAPE Because when TSM does migration from disk to tape, it does NOT necessariliy migrate the oldest data first, and you can go a VERY LONG TIME (or forever) without all the data migrating to your primary tape pool. So you need the BACKUP STGPOOL DISKPOOL COPYPOOLTAPE to make sure that stuff gets to the COPYPOOLTAPE too. If that's not it, I would be REAL interested in hearing what you eventually find... -Original Message- From: Neil Schofield [mailto:[EMAIL PROTECTED] Sent: Tuesday, February 25, 2003 10:32 AM To: [EMAIL PROTECTED] Subject: Copy storage pools - serious data integrity issues Dear all I've been running TSM for four years or so. When we use BACKUP STGPOOL to copy a primary storage pool to a copy storage pool, I have relied on the fact that a successful completion means I have two copies of all my data. I've just discovered that a number of my files don't have a second copy. For a large number of volumes (more than 10 per server) Q CONTENT xx COPIED=NO comes back details of the files but BACKUP STGPOOL (with or without PREVIEW=YES) tells me there is no data to be copied. Some of these files were backed up from the client months (years?) ago. Some are active, some are inactive. I discovered this when testing my DR procedures. I updated the status of all my primary storage pool volumes to be DESTROYED and ran a RESTORE STGPOOL PREVIEW=YES. I was shocked at the number of 'ANR1256W Volume XX contains files that could not be restored' messages that resulted. I've logged a PMR but wondered if anybody else had experienced similar. It kind of blows a big hole in my DR plans. For info, we are running TSM Server 4.2.1.15 on Windows. Thanks Neil Schofield Yorkshire Water Services Ltd. Visit our web site to find out about our award winning Cool Schools community campaign at http://www.yorkshirewater.com/yorkshirewater/schools.html The information in this e-mail is confidential and may also be legally privileged. The contents are intended for recipient only and are subject to the legal notice available at http://www.keldagroup.com/email.htm Yorkshire Water Services Limited Registered Office Western House Halifax Road Bradford BD6 2SZ Registered in England and Wales No 2366682
Copy storage pools - serious data integrity issues
Dear all I've been running TSM for four years or so. When we use BACKUP STGPOOL to copy a primary storage pool to a copy storage pool, I have relied on the fact that a successful completion means I have two copies of all my data. I've just discovered that a number of my files don't have a second copy. For a large number of volumes (more than 10 per server) Q CONTENT xx COPIED=NO comes back details of the files but BACKUP STGPOOL (with or without PREVIEW=YES) tells me there is no data to be copied. Some of these files were backed up from the client months (years?) ago. Some are active, some are inactive. I discovered this when testing my DR procedures. I updated the status of all my primary storage pool volumes to be DESTROYED and ran a RESTORE STGPOOL PREVIEW=YES. I was shocked at the number of 'ANR1256W Volume XX contains files that could not be restored' messages that resulted. I've logged a PMR but wondered if anybody else had experienced similar. It kind of blows a big hole in my DR plans. For info, we are running TSM Server 4.2.1.15 on Windows. Thanks Neil Schofield Yorkshire Water Services Ltd. Visit our web site to find out about our award winning Cool Schools community campaign at http://www.yorkshirewater.com/yorkshirewater/schools.html The information in this e-mail is confidential and may also be legally privileged. The contents are intended for recipient only and are subject to the legal notice available at http://www.keldagroup.com/email.htm Yorkshire Water Services Limited Registered Office Western House Halifax Road Bradford BD6 2SZ Registered in England and Wales No 2366682
Re: Copy storage pools - serious data integrity issues
I did experience the same problem at a DR 3 years ago. What we found out was our Daily Process was not working properly. The BACKUP STGPOOL was not finishing to successful completion. Also, did a RESTORE STGPOOL COPYPOOL. I usually run the restore a couple of months b4 DR to help sync things up. Last year there was no tapes to restore. As long as our daily process continues to complete successfully our DR will work good. Thank You, Bill Rosette Data Center/IS/Papa Johns International WWJD Neil Schofield [EMAIL PROTECTED]To: [EMAIL PROTECTED] ATER.CO.UK cc: Sent by: ADSM: Dist Stor Subject: Copy storage pools - serious data integrity issues Manager [EMAIL PROTECTED] 02/25/2003 10:31 AM Please respond to ADSM: Dist Stor Manager Dear all I've been running TSM for four years or so. When we use BACKUP STGPOOL to copy a primary storage pool to a copy storage pool, I have relied on the fact that a successful completion means I have two copies of all my data. I've just discovered that a number of my files don't have a second copy. For a large number of volumes (more than 10 per server) Q CONTENT xx COPIED=NO comes back details of the files but BACKUP STGPOOL (with or without PREVIEW=YES) tells me there is no data to be copied. Some of these files were backed up from the client months (years?) ago. Some are active, some are inactive. I discovered this when testing my DR procedures. I updated the status of all my primary storage pool volumes to be DESTROYED and ran a RESTORE STGPOOL PREVIEW=YES. I was shocked at the number of 'ANR1256W Volume XX contains files that could not be restored' messages that resulted. I've logged a PMR but wondered if anybody else had experienced similar. It kind of blows a big hole in my DR plans. For info, we are running TSM Server 4.2.1.15 on Windows. Thanks Neil Schofield Yorkshire Water Services Ltd. Visit our web site to find out about our award winning Cool Schools community campaign at http://www.yorkshirewater.com/yorkshirewater/schools.html The information in this e-mail is confidential and may also be legally privileged. The contents are intended for recipient only and are subject to the legal notice available at http://www.keldagroup.com/email.htm Yorkshire Water Services Limited Registered Office Western House Halifax Road Bradford BD6 2SZ Registered in England and Wales No 2366682
