hypothetical situation with dedup turned on
I've had some sys admins ask me about a possible situation with using dedup on our primary storage pool. We are currently using dedup and I can't come up with a good answer. Ok, our primary storage pool is using dedup. Something (corruption, whatever) happens to one of the files in the primary pool and the data needed to recover the file in the primary pool is not available. I attempt to do a restore of the corrupt file and the needed tape is not available. How would I go about fixing that kind of a situation? Back before we started using dedup we could just do a move volume to save what we could and then do a delete volume and the next backup of the server would straighten everything out. We might lose inactive copies but the next backup cycle would catch the missing active files. With the way dedup works I'm not sure what we would do. Any suggestions? David Tyree Interface Analyst South Georgia Medical Center 229.333.1155
Re: Learning resources for VMware
If you find a good doc , please repost! I haven't found any single source. Read the TSM VE 6.4 install guide when it comes out, not the 6.3 one. (I"ve seen the Beta and It is Good.) The main thing you need to know reading the (infuriating) manual, is that the doc often uses these terms interchangeably: "vstorage backup server" "proxy server" "data mover" And the "data mover" is just an instance of the TSM scheduler on the machine you are using as a proxy server. Once you get that straight in your head, the doc is pretty follow-able. Most of the doc out there that talks about proxy servers and data movers and sizing will, I hope, become irrelevant with 6.4. The big issues with 6.2 and 6.3 were the amount of data and amount of time required to do periodic fulls of all those vmdk files. With "incremental forever" in 6.4, those problems should all go away. Another thing you need to know, - if the VM's were created in Vsphere 5, they will already have Changed Block Tracking turned on. -if the VM's were created in Vsphere 4, they may or may not have Changed Block Tracking turned on. You can tell for sure by looking at the attributes of the VM, but the VM has to be down to look at them (stupid VM thing) or change it directly. If it's not on, you can turn it on by doing the first full backup with VE, but then you will need a second (full) backup to build the track map. You will only get true CBT incrementals on the 3rd pass. Look at the scheduler log, it will tell you when CBT is in use. And other things I found painful to learn: * If you do a "backup now" from the VCenter console VE plug in, the logs are in the dsmwebcl.log on the proxy server you've chosen to use. Not Intuitively Obvious (at least for me). The scheduled backups are in the dsmsched.log for the data mover on the proxy server. * The VE server (the thing that creates and talks to the VCenter plug-in) is not required and not involved to actually run the scheduled backups. The VE server sits between VCenter and the TSM server and translates between the two of them. You can use the VCenter plug-in to create a backup schedule, and what happens is that it talks to the VE server, and the VE server talks to the TSM server and does a DEFINE SCHEDULE. But when the schedule fires, it's just the TSM server talking to the data mover (TSM scheduler service) on the proxy server. * Learn to q schedule and verify the schedules that VE creates. (You can also update them through normal TSM methods as needed.) * VMWare will frequently get tangled in its own underwear doing its snapshots, or deleting its snapshots. This is a VMware issue, not a TSM issue, and we are stuck with it at least through VSphere 5. Maybe that will save you some research :>) Wanda -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Steven Harris Sent: Wednesday, November 14, 2012 1:42 AM To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] Learning resources for VMware Hi Gang I have a customer who is bursting to get TSM for VE 6.4 up and running. So its time to get me some book-learnin'. What does a TSM admin need to know about VMware and especially vStorage in order to get a TSM for VE installation working properly? Where is the best place to obtain such info? Yes I've done some searches, but for example one document that looked promising turned out to be dated 2006, and in this fast-moving environment that is positively stone-age. Thanks Steve. Steven Harris TSM Admin Canberra Australia
Re: Learning resources for VMware
Hey Steve, Did you try here? http://www.ibm.com/developerworks/wikis/display/tivolistoragemanager/IBM+Tivoli+Storage+Manager+for+Virtual+Environments ~Rick -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Steven Harris Sent: Wednesday, November 14, 2012 1:42 AM To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] Learning resources for VMware Hi Gang I have a customer who is bursting to get TSM for VE 6.4 up and running. So its time to get me some book-learnin'. What does a TSM admin need to know about VMware and especially vStorage in order to get a TSM for VE installation working properly? Where is the best place to obtain such info? Yes I've done some searches, but for example one document that looked promising turned out to be dated 2006, and in this fast-moving environment that is positively stone-age. Thanks Steve. Steven Harris TSM Admin Canberra Australia
Re: Learning resources for VMware
Hello Steven It's not necessary to have a great knowledge of VMWare in order to install TSM for VE. I think there's two things that's good to understand how it works: snapshot and inventory hierarchy. For this, you can find a lot of information in the VMWare site. Hope this helps. On Wed, Nov 14, 2012 at 4:41 AM, Steven Harris wrote: > Hi Gang > > I have a customer who is bursting to get TSM for VE 6.4 up and running. > So its time to get me some book-learnin'. > > What does a TSM admin need to know about VMware and especially vStorage > in order to get a TSM for VE installation working properly? Where is > the best place to obtain such info? > > Yes I've done some searches, but for example one document that looked > promising turned out to be dated 2006, and in this fast-moving > environment that is positively stone-age. > > Thanks > > Steve. > > Steven Harris > TSM Admin > Canberra Australia > -- __ Leandro Mazur
Re: Exchange 2010, DAGs, and Proxies? (oh my...)
Hello Wanda, The current version of Data Protection for Exchange does not manage the backups from different servers together. The best practice in the book says: "Backups for a given database should be run from the same Exchange server, if possible. Backups performed from different Exchange servers are managed separately." This is not ideal, we understand and have taken steps to make it better. In the Data Protection for Exchange version 6.4 that will be generally available this Friday (11/16), we have enhanced the Exchange 2010 DAG support. We have resolved this limitation. You will be able to back up your Exchange 2010 DAG databases from any server and they will be managed as a single entity on the TSM Server. Thanks, Del "ADSM: Dist Stor Manager" wrote on 11/13/2012 09:23:51 PM: > From: "Prather, Wanda" > To: ADSM-L@vm.marist.edu, > Date: 11/13/2012 09:28 PM > Subject: Exchange 2010, DAGs, and Proxies? (oh my...) > Sent by: "ADSM: Dist Stor Manager" > > Backing up two Exchange 2010 servers with the 6.3 TDP for Exchange, > TSM 6.2.3 server on Windows. > There are 6 mail data bases. Half the mailboxdb's are active, half > passive on each server. > > I installed the TDP on each server, and we specify /EXCLUDEDAGACTIVE > so that only the passive copies are backed up. > > What I've noticed is that over time, these 2 servers have taken up > much more space on the TSM server than I expected. > What has happened is that the active mailboxdb's have switched back > and forth between the servers. > Over time, I've gotten copies of all 6 mailboxdb's backed up under > each node name. > And I assume that whatever the Exchange admins are doing will continue. > > Would it make sense to set up a proxy relationship so that both the > Exchange TDPs are backing up the mailboxdb's to the same node name? > That would cut back my TSM server storage when the mailboxdb's flop around. > > But the TDP book says for restores: > > The restore operation must be run on the node where the backup was created. > > I don't know if in this case "node" just refers to the TSM nodename, > or if there is something about Exchange itself so that a restore > from a proxied name doesn't work? Is proxied a proper verb? > > Anybody else run into this? > > > Wanda Prather | Senior Technical Specialist | wanda.prat...@icfi.com | > www.icfi.com > ICF International | 401 E. Pratt St, Suite 2214, Baltimore, MD > 21202 | 410.539.1135 (o) >
Re: SV: ANS1304W An active backup version could not be found.
Why are the files being excluded? Because they do not need to be backed up? Or to avoid the errors? You can back the files up and avoid the errors by runing the TSM client in a single-byte locale. Set the LANG environment variable to en_US or some other SBCS language. For more information, see: http://publib.boulder.ibm.com/infocenter/tsminfo/v6/topic/com.ibm.itsm.client.doc/c_cfg_nlsupportunix.html Best regards, Andy Raibeck IBM Software Group Tivoli Storage Manager Client Product Development Level 3 Team Lead Internal Notes e-mail: Andrew Raibeck/Hartford/IBM@IBMUS Internet e-mail: stor...@us.ibm.com IBM Tivoli Storage Manager support web page: http://www.ibm.com/support/entry/portal/Overview/Software/Tivoli/Tivoli_Storage_Manager "ADSM: Dist Stor Manager" wrote on 2012-11-14 03:05:06: > From: Christian Svensson > To: ADSM-L@vm.marist.edu, > Date: 2012-11-14 03:24 > Subject: SV: ANS1304W An active backup version could not be found. > Sent by: "ADSM: Dist Stor Manager" > > 你好 Fu Bao 先生 > Can you run a cat/type on "/opt/tivoli/tsm/client/ba/inclexcl.txt" > > Can you also run "ls -l" on does files under > /var/ibm/InstallationManager/adapters/native/IBM® Rational® Focal > Point/backupDirs > > My guess is that you maybe need to set your excludement between two > "/var/ibm/InstallationManager/.../*" because you are using spaces in > your directory structures. > > Best Regards > Christian Svensson > > Cell: +46-70-325 1577 > E-mail: christian.svens...@cristie.se > > Säkra återläsningar… > > > > > -Ursprungligt meddelande- > Från: Bao Fu Guo [mailto:gaoba...@cn.ibm.com] > Skickat: den 14 november 2012 08:46 > Till: ADSM-L@VM.MARIST.EDU > Ämne: ANS1304W An active backup version could not be found. > > Does everybody encounter the issue as below? > > I've already exclude the Upper directory. but the failed also appeared. > > Could you please help me to take a look at it ? > > Let me know If you have good method or solution to resove the issue. > > > Thanks. > > > > > [root@ratsuite88 logs]# dsmc q inclexcl > IBM Tivoli Storage Manager > Command Line Backup-Archive Client Interface > Client Version 6, Release 1, Level 0.0 > Client date/time: 11/14/2012 02:35:28 > (c) Copyright by IBM Corporation and other(s) 1990, 2009. All RightsReserved. > > Node Name: RATSUITE88.SBY.IBM.COM > Session established with server SBYTSM1: AIX-RS/6000 > Server Version 5, Release 5, Level 4.2 > Data compression forced on by the server > Server date/time: 11/14/2012 02:36:44 Last access: 11/14/2012 02:33:28 > > *** FILE INCLUDE/EXCLUDE *** > Mode Function Pattern (match from top down) Source File > - -- - Excl > Filespace /dst/install "/opt/tivoli/tsm/client/ba/inclexcl.txt" > Excl Filespace /dst/perfdata > "/opt/tivoli/tsm/client/ba/inclexcl.txt" > Excl Filespace /install > "/opt/tivoli/tsm/client/ba/inclexcl.txt" > Excl Filespace /perfdata > "/opt/tivoli/tsm/client/ba/inclexcl.txt" > Excl Directory /.../.TsmCacheDir TSM > Excl Directory /usr/share/desktop-directories "/opt/tivoli/tsm/ > client/ba/inclexcl.txt" > Excl Directory /var/ibm/InstallationManager "/opt/tivoli/tsm/client/ > ba/inclexcl.txt" > Excl Directory /etc/xdg/menus/applications-merged > "/opt/tivoli/tsm/client/ba/inclexcl.txt" > Excl Directory /mnt > "/opt/tivoli/tsm/client/ba/inclexcl.txt" > Excl Directory /scratch > "/opt/tivoli/tsm/client/ba/inclexcl.txt" > Excl Directory /tmp > "/opt/tivoli/tsm/client/ba/inclexcl.txt" > Exclude All /.../ > "/opt/tivoli/tsm/client/ba/inclexcl.txt" > Exclude All /.../ /usr/share/desktop-directories/* > "/opt/tivoli/tsm/client/ba/inclexcl.txt" > Exclude All /var/ibm/InstallationManager/* > "/opt/tivoli/tsm/client/ba/inclexcl.txt" > Exclude All /etc/xdg/menus/applications-merged/* > "/opt/tivoli/tsm/client/ba/inclexcl.txt" > Exclude All /.../ /usr/share/desktop-directories/.../* > "/opt/tivoli/tsm/client/ba/inclexcl.txt" > Exclude All /var/ibm/InstallationManager/.../* > "/opt/tivoli/tsm/client/ba/inclexcl.txt" > Exclude All /etc/xdg/menus/applications-merged/.../* > "/opt/tivoli/tsm/client/ba/inclexcl.txt" > Exclude All /etc/backups/logs/*.tmp > "/opt/tivoli/tsm/client/ba/inclexcl.txt" > Exclude All /opt/tivoli/tsm/client/ba/log/.../* > "/opt/tivoli/tsm/client/ba/inclexcl.txt" > Exclude All /var/IBM/Rational/RDS_5.1/Instance/sqllib/db2dump/.../* > "/opt/tivoli/tsm/client/ba/inclexcl.txt" > Exclude All /var/IBM/Rational/RDS_5.2.0.2/Instance/tdsadmin/.../* > "/opt/tivoli/tsm/client/ba/inclexcl.txt" > Exclude All /var/cache > "/opt/tivoli/tsm/client/ba/inclexcl.txt" > Exclude File /var/run/yum.pid > "/opt/tivoli/tsm/client/ba/inclexcl.txt" > Exclude All /var/tmp/.../* > "/opt/tivoli/tsm/client/ba/inclexcl.txt" > Exclude All /.../core > "/opt/tivoli/tsm/client/ba/inclexcl.txt" > No DFS include/exclude statements defined. > > > > [root@ratsuite88 lo
SV: ANS1304W An active backup version could not be found.
你好 Fu Bao 先生 Can you run a cat/type on "/opt/tivoli/tsm/client/ba/inclexcl.txt" Can you also run "ls -l" on does files under /var/ibm/InstallationManager/adapters/native/IBM® Rational® Focal Point/backupDirs My guess is that you maybe need to set your excludement between two "/var/ibm/InstallationManager/.../*" because you are using spaces in your directory structures. Best Regards Christian Svensson Cell: +46-70-325 1577 E-mail: christian.svens...@cristie.se Säkra återläsningar… -Ursprungligt meddelande- Från: Bao Fu Guo [mailto:gaoba...@cn.ibm.com] Skickat: den 14 november 2012 08:46 Till: ADSM-L@VM.MARIST.EDU Ämne: ANS1304W An active backup version could not be found. Does everybody encounter the issue as below? I've already exclude the Upper directory. but the failed also appeared. Could you please help me to take a look at it ? Let me know If you have good method or solution to resove the issue. Thanks. [root@ratsuite88 logs]# dsmc q inclexcl IBM Tivoli Storage Manager Command Line Backup-Archive Client Interface Client Version 6, Release 1, Level 0.0 Client date/time: 11/14/2012 02:35:28 (c) Copyright by IBM Corporation and other(s) 1990, 2009. All Rights Reserved. Node Name: RATSUITE88.SBY.IBM.COM Session established with server SBYTSM1: AIX-RS/6000 Server Version 5, Release 5, Level 4.2 Data compression forced on by the server Server date/time: 11/14/2012 02:36:44 Last access: 11/14/2012 02:33:28 *** FILE INCLUDE/EXCLUDE *** Mode Function Pattern (match from top down) Source File - -- - Excl Filespace /dst/install "/opt/tivoli/tsm/client/ba/inclexcl.txt" Excl Filespace /dst/perfdata "/opt/tivoli/tsm/client/ba/inclexcl.txt" Excl Filespace /install "/opt/tivoli/tsm/client/ba/inclexcl.txt" Excl Filespace /perfdata "/opt/tivoli/tsm/client/ba/inclexcl.txt" Excl Directory /.../.TsmCacheDir TSM Excl Directory /usr/share/desktop-directories "/opt/tivoli/tsm/client/ba/inclexcl.txt" Excl Directory /var/ibm/InstallationManager "/opt/tivoli/tsm/client/ba/inclexcl.txt" Excl Directory /etc/xdg/menus/applications-merged "/opt/tivoli/tsm/client/ba/inclexcl.txt" Excl Directory /mnt "/opt/tivoli/tsm/client/ba/inclexcl.txt" Excl Directory /scratch "/opt/tivoli/tsm/client/ba/inclexcl.txt" Excl Directory /tmp "/opt/tivoli/tsm/client/ba/inclexcl.txt" Exclude All /.../ "/opt/tivoli/tsm/client/ba/inclexcl.txt" Exclude All /.../ /usr/share/desktop-directories/* "/opt/tivoli/tsm/client/ba/inclexcl.txt" Exclude All /var/ibm/InstallationManager/* "/opt/tivoli/tsm/client/ba/inclexcl.txt" Exclude All /etc/xdg/menus/applications-merged/* "/opt/tivoli/tsm/client/ba/inclexcl.txt" Exclude All /.../ /usr/share/desktop-directories/.../* "/opt/tivoli/tsm/client/ba/inclexcl.txt" Exclude All /var/ibm/InstallationManager/.../* "/opt/tivoli/tsm/client/ba/inclexcl.txt" Exclude All /etc/xdg/menus/applications-merged/.../* "/opt/tivoli/tsm/client/ba/inclexcl.txt" Exclude All /etc/backups/logs/*.tmp "/opt/tivoli/tsm/client/ba/inclexcl.txt" Exclude All /opt/tivoli/tsm/client/ba/log/.../* "/opt/tivoli/tsm/client/ba/inclexcl.txt" Exclude All /var/IBM/Rational/RDS_5.1/Instance/sqllib/db2dump/.../* "/opt/tivoli/tsm/client/ba/inclexcl.txt" Exclude All /var/IBM/Rational/RDS_5.2.0.2/Instance/tdsadmin/.../* "/opt/tivoli/tsm/client/ba/inclexcl.txt" Exclude All /var/cache "/opt/tivoli/tsm/client/ba/inclexcl.txt" Exclude File /var/run/yum.pid "/opt/tivoli/tsm/client/ba/inclexcl.txt" Exclude All /var/tmp/.../* "/opt/tivoli/tsm/client/ba/inclexcl.txt" Exclude All /.../core "/opt/tivoli/tsm/client/ba/inclexcl.txt" No DFS include/exclude statements defined. [root@ratsuite88 logs]# grep -i 'failed' backup.TSMRAT.2012-11-14.00-00-02.log -C2 ANS1898I * Processed21,000 files * ANS1898I * Processed23,500 files * ANS1228E Sending of object '/etc/xdg/menus/kde-applications-merged/IBMIMIBM®Rational®FocalPoint1123410Rational34Applications.menu' failed ANS4042E Object name '/etc/xdg/menus/kde-applications-merged/IBMIMIBM®Rational®FocalPoint1123410Rational34Applications.menu' contains one or more unrecognised characters and is not valid. ANS1228E Sending of object '/etc/xdg/menus/kde-applications-merged/IBMIMIBM®Rational®FocalPoint12340Rational34Applications.menu' failed ANS4042E Object name '/etc/xdg/menus/kde-applications-merged/IBMIMIBM®Rational®FocalPoint12340Rational34Applications.menu' contains one or more unrecognised characters and is not valid. ANS1898I * Processed26,000 files * -- ANS1898I * Processed 109,000 files * ANS1898I * Processed 112,000 files * ANS1228E Sending of object '/usr/share/applications/IBMIMIBM®Rational®FocalPoint1123410Rational340534.desktop' failed ANS4042E Object name '/usr/share/applications/IBMIMIBM®Rational®FocalPoint1123410Rational340534.desktop' contains one
