Re: Netapp snapdiff issues having TSM client on a Linux machine, making use of NFS mounts
Brion: Here at Cornell, we have a TSM client on a Linux system backing up NFS shares via NFS mounts and snapdiff differentials - and have been doing so for years. First, the gory details: - For TSM TSM Client Version 7, Release 1, Level 6.0 (*red faced, thought I had upgraded to SP 8.1.2.0 months ago*) Running on CentOS Linux release 7.5.1804 (kernel 3.10.0-862.2.3.el7.x86_64) Accessing TSM Server for Linux Version 7, Release 1, Level 7.200 - For NetApp Filer Version Information: NetApp Release 9.3P6 We aren’t seeing your issue, and I suspect I know why. We are telling the TSM client to create its own snapshots - and not use the snapshots being created hourly (or daily or weekly even) by the team managing the Netapp - said snapshots being equivalent to the ones you are trying to take advantage of in your backups. That is, the relevant part of the daily backup schedule looks like: Schedule Name: DAILY.INCR.NFS.SNAPDIFF Description: Daily SnapDiff Incremental Action: Incremental Subaction: Options: -snapdiff -diffsnapshot=create -snapdiffhttps During a backup, then, the following type of information is written to the dsmsched.log: 09/13/2018 00:38:08 Incremental by snapshot difference of volume '/nas-backup/vol/cit-pea1-test' 09/13/2018 00:38:10 ANS2328I Using Snapshot Differential Change Log. 09/13/2018 00:38:10 Connected to NetApp Storage Virtual Machine Management Filer Host/IP Address : ccc-cdot01.cit.cornell.edu Filer Version Information: NetApp Release 9.3P6: Thu Jun 14 20:21:25 UTC 2018 Storage VM Name : cit-sfshared05 Storage VM Host/IP Address : cit-sfshared05-backup.files.cornell.edu Storage VM Volume Style : Flex Login User : tsmbackup Transport: HTTPS 09/13/2018 00:38:10 Performing a Snapshot Differential Backup of volume '/nas-backup/vol/cit-pea1-test' 09/13/2018 00:38:10 Creating Diff Snapshot. 09/13/2018 00:38:10 Using Base Snapshot 'TSM_SANT5B9759FC1AB6_CIT_PEA1_TEST_VOL' with timestamp 09/11/2018 06:00:28 09/13/2018 00:38:10 Using Diff Snapshot 'TSM_SANT5B99E9B24F814_CIT_PEA1_TEST_VOL' with timestamp 09/13/2018 04:38:10 Then, on the next backup (48 hours later thanks to a large amount of data to backup on 9/13), the Diff Snapshot becomes the base: 09/15/2018 01:29:22 ANS2328I Using Snapshot Differential Change Log. 09/15/2018 01:29:22 Connected to NetApp Storage Virtual Machine Management Filer Host/IP Address : ccc-cdot01.cit.cornell.edu Filer Version Information: NetApp Release 9.3P6: Thu Jun 14 20:21:25 UTC 2018 Storage VM Name : cit-sfshared05 Storage VM Host/IP Address : cit-sfshared05-backup.files.cornell.edu Storage VM Volume Style : Flex Login User : tsmbackup Transport: HTTPS 09/15/2018 01:29:22 Performing a Snapshot Differential Backup of volume '/nas-backup/vol/cit-pea1-test' 09/15/2018 01:29:22 Creating Diff Snapshot. 09/15/2018 01:29:22 Using Base Snapshot 'TSM_SANT5B99E9B24F814_CIT_PEA1_TEST_VOL' with timestamp 09/13/2018 04:38:10 09/15/2018 01:29:22 Using Diff Snapshot 'TSM_SANT5B9C98B1A15B2_CIT_PEA1_TEST_VOL' with timestamp 09/15/2018 05:29:21 I think that consistency is what is missing in your approach - I suspect that there are intervening snapshots with information about files that have been deleted or changed that are not part of what the TSM client is seeing. I will add that our NetApp team is very happy with this approach. The TSM client has been very efficient in its management of the snapshots, and in those rare cases when it doesn’t, the snapshots are easy to identify and clean up. FWIW, Bob Robert Talda EZ-Backup Systems Engineer Cornell University +1 607-255-8280 r...@cornell.edu > On Sep 18, 2018, at 8:35 AM, PAC Brion Arnaud > wrote: > > Hi Tommaso, > > The backup command I'm using (dsmc i /Airwarder -snapdiff -snapdiffhttps > -diffsnapshotname="daily.*" -diffsnapshot=latest -useexistingbase > -optfile=dsm_netapp.opt) includes the "useexistingbase" statement. > Based on my understanding of the documentation, this means that the S.P. > client will not trigger the creation of a new snapshot on the Netapp device, > but instead, make use of a snapshot that had been created previously by some > internal mechanism of the Netapp. > Therefore, it seems very unlikely that any process still has a grip on any of > the files being part of this snapshot ... > My humble opinion only of course, I'm waiting on others fellow members of > this list feedback ! > > In addition to this, I would like to avoid the use of any exclude statement > during the backup : I doubt that any of my customers would be very happy to > hear that I'm not able to restore some of his precious files
Re: Netapp snapdiff issues having TSM client on a Linux machine, making use of NFS mounts
Hi Arnaud, >> ... there's still the limitation that this GUI will be usable only once logged on the machine hosting the Spectrum Protect client What do you mean by "that machine"? The Backup-Archive client is not in the data path for an NDMP backup or restore. The data path is between the NetApp filer and the server's tape library (or more generally speaking the storage pools). The Backup-Archive client is reading metadata from the server to present information to the end user. This means that the user can log in to any machine (Windows/AIX/Solaris x86) that has a Backup-Archive client. When the user logs into the Spectrum Protect server (at launch of the Backup-Archive client) they are providing an admin id that is not tied to a specific machine. Del "ADSM: Dist Stor Manager" wrote on 09/18/2018 07:57:56 AM: > From: PAC Brion Arnaud > To: ADSM-L@VM.MARIST.EDU > Date: 09/18/2018 07:58 AM > Subject: Re: Netapp snapdiff issues having TSM client on a Linux > machine, making use of NFS mounts > Sent by: "ADSM: Dist Stor Manager" > > Hi Del, > > Thanks for the information, which I got as well thru other channels > (IBM support), but there's still the limitation that this GUI will > be usable only once logged on the machine hosting the Spectrum Protect client. > This means that I will be forced to grant some of my colleagues > (which were previously doing the restores on their own) specific > logging rights on that machine. Was not the case before ... > > Cheers. > > Arnaud > > -Original Message- > From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On > Behalf Of Del Hoobler > Sent: Tuesday, September 18, 2018 12:57 PM > To: ADSM-L@VM.MARIST.EDU > Subject: Re: Netapp snapdiff issues having TSM client on a Linux > machine, making use of NFS mounts > > Hi Arnaud, > > Not related to SnapDiff ... but just some info on NDMP and B/A Client... > > In Spectrum Protect BA client 8.1.6 that GAs this coming Friday (21 > September) you will be able to use the native Java GUI to handle NDMP > backups/restores. > > > Del > > > > > > > "ADSM: Dist Stor Manager" wrote on 09/18/2018 > 06:20:52 AM: > > > From: PAC Brion Arnaud > > To: ADSM-L@VM.MARIST.EDU > > Date: 09/18/2018 06:21 AM > > Subject: Netapp snapdiff issues having TSM client on a Linux > > machine, making use of NFS mounts > > Sent by: "ADSM: Dist Stor Manager" > > > > Hi All, > > > > Following to IBM's decision to withdraw the web GUI in the latest > > versions of their clients (thus making NDMP hardly usable), as well > > as to the renewal of our NAS infrastructure (now using Netapp), I'm > > trying to implement netapp snapdiffs in our shop. > > > > So far we succeeded in defining necessary user and roles on the > > Netapp, as well as to setup the TSM client in order to interact with > > our filer, but I'm now facing an issue where some files cannot be > > backed up, apparently due to access rights. > > > > Here an extract of our backup log : > > > > IBM Spectrum Protect > > Command Line Backup-Archive Client Interface > > Client Version 8, Release 1, Level 4.0 > > Client date/time: 09/18/2018 10:26:28 > > (c) Copyright by IBM Corporation and other(s) 1990, 2017. All > RightsReserved. > > > > Node Name: NETAPP_CH1_NFS > > Session established with server XXX: Linux/ppc64le > > Server Version 8, Release 1, Level 4.000 > > Server date/time: 09/18/2018 10:26:28 Last access: 09/18/2018 > 10:00:37 > > > > > > Incremental by snapshot difference of volume '/Airwarder' > > > > Connected to NetApp Storage Virtual Machine > > Management Filer Host/IP Address : > > Filer Version Information: NetApp Release 9.3P3: Wed Apr > > 04 13:07:06 UTC 2018 > > Storage VM Name : xxx > > Storage VM Host/IP Address : XX > > Storage VM Volume Style : Flex > > Login User : tsm-backup-user > > Transport: HTTPS > > > > Performing a Full Incremental Backup of volume '/Airwarder' > > Using Base Snapshot 'vserverdr.0.7b5a59c4-656c-11e8- > > bb80-00a098d614c2.2018-09-18_102500' with timestamp 09/18/2018 10:25:02 > > ANS4007E Error processing '/Airwarder/.snapshot/vserverdr.0. > > 7b5a59c4-656c-11e8-bb80-00a098d614c2.2018-09-18_102500/ > > acrimport_ref/ch': access to the object is denied > > ANS4007E Error processing '/Airwarder/.snapshot/vserverdr.0. > > 7b5a59c4-656c-11e8-bb80-00a098d614c2.2018-09-18_102500/ > > acrimport_test/ch': access to the object is denied > > ANS1898I * Processed 500 files * > > Directory--> 4,096 /Airwarder/ [Sent] > > Directory--> 4,096 /Airwarder/.etc [Sent] > > > > (skipped some lines) > > > > ANS1228E Sending of object '/Airwarder/acrimport_ref/config/ > > log4j.conf' failed. > >
Re: CONTAINER pool experiences
Zoltan, If I understood well, your storage is Isilon based : in this case do not even think of using CONTAINER pools, as performance will be horrible. Not much time to talk about this, but to make a very long story short, we are about to dump/trash /resell the brand new Isilon arrays we bought 8 months ago, and to replace them with direct attached storage (Storwize), as we never reached sufficient performance levels. Cases have been opened with IBM and EMC as well, to no result at all, beside a suspected block size issue which would refrain the Isilons to work at expected speed. If you plan to go for such a hardware configuration, my only advice is : run away, as fast as you can ! Cheers. Arnaud -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Zoltan Forray Sent: Tuesday, September 18, 2018 3:37 PM To: ADSM-L@VM.MARIST.EDU Subject: CONTAINER pool experiences We are investigating using CONTAINER pools for our offsite replica server vs the current FILE method which is killing us with the constant dedup, reclaims, etc. So, what are the "gotchas' ? We are still at V7.1.7.400 so I figure we will have to do without any new features added in the V8 branch. But is it problematic enough at V7 to avoid it? Your thoughts? Experiences? -- *Zoltan Forray* Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator Xymon Monitor Administrator VMware Administrator Virginia Commonwealth University UCC/Office of Technology Services www.ucc.vcu.edu zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://phishing.vcu.edu/
Re: CONTAINER pool experiences
Oh, and don't forget that your server requires a significant amount of CPU's when switching to container pools since all deduplication and compression is done inline during your backup window. So when you want to switch in place from file to container, make sure your server has enough cores available. Check the Spectrum Protect Blueprints for details. Kind regards, Eric van Loon Air France/KLM Storage Engineering -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Zoltan Forray Sent: dinsdag 18 september 2018 15:37 To: ADSM-L@VM.MARIST.EDU Subject: CONTAINER pool experiences We are investigating using CONTAINER pools for our offsite replica server vs the current FILE method which is killing us with the constant dedup, reclaims, etc. So, what are the "gotchas' ? We are still at V7.1.7.400 so I figure we will have to do without any new features added in the V8 branch. But is it problematic enough at V7 to avoid it? Your thoughts? Experiences? -- *Zoltan Forray* Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator Xymon Monitor Administrator VMware Administrator Virginia Commonwealth University UCC/Office of Technology Services www.ucc.vcu.edu zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://phishing.vcu.edu/ For information, services and offers, please visit our web site: http://www.klm.com. This e-mail and any attachment may contain confidential and privileged material intended for the addressee only. If you are not the addressee, you are notified that no part of the e-mail or any attachment may be disclosed, copied or distributed, and that any other action related to this e-mail or attachment is strictly prohibited, and may be unlawful. If you have received this e-mail by error, please notify the sender immediately by return e-mail, and delete this message. Koninklijke Luchtvaart Maatschappij NV (KLM), its subsidiaries and/or its employees shall not be liable for the incorrect or incomplete transmission of this e-mail or any attachments, nor responsible for any delay in receipt. Koninklijke Luchtvaart Maatschappij N.V. (also known as KLM Royal Dutch Airlines) is registered in Amstelveen, The Netherlands, with registered number 33014286
Re: CONTAINER pool experiences
That space movement issue is our biggest concern - especially since this server is maxed-out on ISILON storage (no where to grow) and to even think of converting to container would be an ordeal. No possibility of tape or expanding disk. On Tue, Sep 18, 2018 at 10:38 AM Solomon Miler wrote: > Well, if you run out of space, options nearly always were to move data > to LTO, now options are to buy an expansion to an existing storage array, > which cost slightly more than lto. > > -Original Message- > From: ADSM: Dist Stor Manager On Behalf Of Zoltan > Forray > Sent: Tuesday, September 18, 2018 10:33 AM > To: ADSM-L@VM.MARIST.EDU > Subject: [External] Re: [ADSM-L] CONTAINER pool experiences > > Thanks for the tip. Should not be an issue for us since this will be on > the Replication Target server only - for now. > > On Tue, Sep 18, 2018 at 10:14 AM Solomon Miler > wrote: > > > Dedup containers do not support 'migrate / export / move node '.The > > only way to get rid of data : expire / delete node. > > > > We are on 8.1.1.0 > > > > > > Solomon Miler > > Senior Data Protection Engineer, VP > > -- > > Desk: 201.577.313 > > Cell : 917.287.2332 > > smi...@jri-america.com > > > > > > > > > > > > -Original Message- > > From: ADSM: Dist Stor Manager On Behalf Of > > Golbin, Mikhail > > Sent: Tuesday, September 18, 2018 9:50 AM > > To: ADSM-L@VM.MARIST.EDU > > Subject: [External] Re: [ADSM-L] CONTAINER pool experiences > > > > Container pools work but you don't have defrag functionality until > > 8.1.4 - which means it does not release the space it no longer uses. > > Also you don't get much if any benefit from dedup if you commingle 2 > > or more container pools into one on the replica. > > For example you have 2 servers doing backups, storing data in > > container pools and both replicating to one offsite server. > > Each container pool is about 20Tb and there is a lot of overlap - the > > storage pool usage on the offsite will be close to 40Tb, rather than > > 25Tb that it would have been if dedup worked properly > > > > On Tue, Sep 18, 2018 at 9:37 AM Zoltan Forray wrote: > > > > > We are investigating using CONTAINER pools for our offsite replica > > > server vs the current FILE method which is killing us with the > > > constant dedup, reclaims, etc. > > > > > > So, what are the "gotchas' ? We are still at V7.1.7.400 so I figure > we > > > will have to do without any new features added in the V8 branch. But > > > is it problematic enough at V7 to avoid it? > > > > > > Your thoughts? Experiences? > > > > > > -- > > > *Zoltan Forray* > > > Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator > > > Xymon Monitor Administrator VMware Administrator Virginia > > > Commonwealth University UCC/Office of Technology Services > > > www.ucc.vcu.edu zfor...@vcu.edu - 804-828-4807 Don't be a phishing > > > victim - VCU and other reputable organizations will never use email > > > to request that you reply with your password, social security number > > > or confidential personal information. For more details visit > > > http://phishing.vcu.edu/ > > > > > > > > > > -- > > Mikhail Golbin > > bus (908)635-5705 > > cell (908)210-3393 > > RMD IT Client Services > > > > *** > > > > This email and any files transmitted with it are confidential and > > intended solely for the use of the individual or entity to whom they > > are addressed. If you have received this email in error please notify > > the sender by replying to this email and then delete it from your > > system. > > > > No reliance may be placed upon this email without written confirmation > > of its contents and any liability arising from such reliance without > > written confirmation is hereby excluded. > > > > JRI America > > > > *** > > > > > > -- > *Zoltan Forray* > Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator Xymon > Monitor Administrator VMware Administrator Virginia Commonwealth University > UCC/Office of Technology Services www.ucc.vcu.edu zfor...@vcu.edu - > 804-828-4807 Don't be a phishing victim - VCU and other reputable > organizations will never use email to request that you reply with your > password, social security number or confidential personal information. For > more details visit http://phishing.vcu.edu/ > -- *Zoltan Forray* Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator Xymon Monitor Administrator VMware Administrator Virginia Commonwealth University UCC/Office of Technology Services www.ucc.vcu.edu zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://phishing.vcu.edu/
Re: CONTAINER pool experiences
Well, if you run out of space, options nearly always were to move data to LTO, now options are to buy an expansion to an existing storage array, which cost slightly more than lto. -Original Message- From: ADSM: Dist Stor Manager On Behalf Of Zoltan Forray Sent: Tuesday, September 18, 2018 10:33 AM To: ADSM-L@VM.MARIST.EDU Subject: [External] Re: [ADSM-L] CONTAINER pool experiences Thanks for the tip. Should not be an issue for us since this will be on the Replication Target server only - for now. On Tue, Sep 18, 2018 at 10:14 AM Solomon Miler wrote: > Dedup containers do not support 'migrate / export / move node '.The > only way to get rid of data : expire / delete node. > > We are on 8.1.1.0 > > > Solomon Miler > Senior Data Protection Engineer, VP > -- > Desk: 201.577.313 > Cell : 917.287.2332 > smi...@jri-america.com > > > > > > -Original Message- > From: ADSM: Dist Stor Manager On Behalf Of > Golbin, Mikhail > Sent: Tuesday, September 18, 2018 9:50 AM > To: ADSM-L@VM.MARIST.EDU > Subject: [External] Re: [ADSM-L] CONTAINER pool experiences > > Container pools work but you don't have defrag functionality until > 8.1.4 - which means it does not release the space it no longer uses. > Also you don't get much if any benefit from dedup if you commingle 2 > or more container pools into one on the replica. > For example you have 2 servers doing backups, storing data in > container pools and both replicating to one offsite server. > Each container pool is about 20Tb and there is a lot of overlap - the > storage pool usage on the offsite will be close to 40Tb, rather than > 25Tb that it would have been if dedup worked properly > > On Tue, Sep 18, 2018 at 9:37 AM Zoltan Forray wrote: > > > We are investigating using CONTAINER pools for our offsite replica > > server vs the current FILE method which is killing us with the > > constant dedup, reclaims, etc. > > > > So, what are the "gotchas' ? We are still at V7.1.7.400 so I figure we > > will have to do without any new features added in the V8 branch. But > > is it problematic enough at V7 to avoid it? > > > > Your thoughts? Experiences? > > > > -- > > *Zoltan Forray* > > Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator > > Xymon Monitor Administrator VMware Administrator Virginia > > Commonwealth University UCC/Office of Technology Services > > www.ucc.vcu.edu zfor...@vcu.edu - 804-828-4807 Don't be a phishing > > victim - VCU and other reputable organizations will never use email > > to request that you reply with your password, social security number > > or confidential personal information. For more details visit > > http://phishing.vcu.edu/ > > > > > > -- > Mikhail Golbin > bus (908)635-5705 > cell (908)210-3393 > RMD IT Client Services > > *** > > This email and any files transmitted with it are confidential and > intended solely for the use of the individual or entity to whom they > are addressed. If you have received this email in error please notify > the sender by replying to this email and then delete it from your > system. > > No reliance may be placed upon this email without written confirmation > of its contents and any liability arising from such reliance without > written confirmation is hereby excluded. > > JRI America > > *** > > -- *Zoltan Forray* Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator Xymon Monitor Administrator VMware Administrator Virginia Commonwealth University UCC/Office of Technology Services www.ucc.vcu.edu zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://phishing.vcu.edu/
Re: CONTAINER pool experiences
Thanks for the tip. Should not be an issue for us since this will be on the Replication Target server only - and we don't use backupsets. On Tue, Sep 18, 2018 at 10:24 AM Loon, Eric van (ITOPT3) - KLM < eric-van.l...@klm.com> wrote: > Don't forget backupsets, you will lose them too with containerpools. > Kind regards, > Eric van Loon > Air France/KLM Storage Engineering > > -Original Message- > From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of > Solomon Miler > Sent: dinsdag 18 september 2018 16:11 > To: ADSM-L@VM.MARIST.EDU > Subject: Re: CONTAINER pool experiences > > Dedup containers do not support 'migrate / export / move node '.The > only way to get rid of data : expire / delete node. > > We are on 8.1.1.0 > > > Solomon Miler > Senior Data Protection Engineer, VP > -- > Desk: 201.577.313 > Cell : 917.287.2332 > smi...@jri-america.com > > > > > > -Original Message- > From: ADSM: Dist Stor Manager On Behalf Of Golbin, > Mikhail > Sent: Tuesday, September 18, 2018 9:50 AM > To: ADSM-L@VM.MARIST.EDU > Subject: [External] Re: [ADSM-L] CONTAINER pool experiences > > Container pools work but you don't have defrag functionality until 8.1.4 - > which means it does not release the space it no longer uses. > Also you don't get much if any benefit from dedup if you commingle 2 or > more container pools into one on the replica. > For example you have 2 servers doing backups, storing data in container > pools and both replicating to one offsite server. > Each container pool is about 20Tb and there is a lot of overlap - the > storage pool usage on the offsite will be close to 40Tb, rather than 25Tb > that it would have been if dedup worked properly > > On Tue, Sep 18, 2018 at 9:37 AM Zoltan Forray wrote: > > > We are investigating using CONTAINER pools for our offsite replica > > server vs the current FILE method which is killing us with the > > constant dedup, reclaims, etc. > > > > So, what are the "gotchas' ? We are still at V7.1.7.400 so I figure we > > will have to do without any new features added in the V8 branch. But > > is it problematic enough at V7 to avoid it? > > > > Your thoughts? Experiences? > > > > -- > > *Zoltan Forray* > > Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator Xymon > > Monitor Administrator VMware Administrator Virginia Commonwealth > > University UCC/Office of Technology Services www.ucc.vcu.edu > > zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and > > other reputable organizations will never use email to request that you > > reply with your password, social security number or confidential > > personal information. For more details visit http://phishing.vcu.edu/ > > > > > > -- > Mikhail Golbin > bus (908)635-5705 > cell (908)210-3393 > RMD IT Client Services > > *** > > This email and any files transmitted with it are confidential > and intended solely for the use of the individual or entity > to whom they are addressed. If you have received this > email in error please notify the sender by replying to this > email and then delete it from your system. > > No reliance may be placed upon this email without written > confirmation of its contents and any liability arising from > such reliance without written confirmation is hereby > excluded. > > JRI America > > *** > > > For information, services and offers, please visit our web site: > http://www.klm.com. This e-mail and any attachment may contain > confidential and privileged material intended for the addressee only. If > you are not the addressee, you are notified that no part of the e-mail or > any attachment may be disclosed, copied or distributed, and that any other > action related to this e-mail or attachment is strictly prohibited, and may > be unlawful. If you have received this e-mail by error, please notify the > sender immediately by return e-mail, and delete this message. > > Koninklijke Luchtvaart Maatschappij NV (KLM), its subsidiaries and/or its > employees shall not be liable for the incorrect or incomplete transmission > of this e-mail or any attachments, nor responsible for any delay in receipt. > Koninklijke Luchtvaart Maatschappij N.V. (also known as KLM Royal Dutch > Airlines) is registered in Amstelveen, The Netherlands, with registered > number 33014286 > > -- *Zoltan Forray* Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator Xymon Monitor Administrator VMware Administrator Virginia Commonwealth University UCC/Office of Technology Services www.ucc.vcu.edu zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security
Re: CONTAINER pool experiences
Thanks for the tip. Should not be an issue for us since this will be on the Replication Target server only - for now. On Tue, Sep 18, 2018 at 10:14 AM Solomon Miler wrote: > Dedup containers do not support 'migrate / export / move node '.The > only way to get rid of data : expire / delete node. > > We are on 8.1.1.0 > > > Solomon Miler > Senior Data Protection Engineer, VP > -- > Desk: 201.577.313 > Cell : 917.287.2332 > smi...@jri-america.com > > > > > > -Original Message- > From: ADSM: Dist Stor Manager On Behalf Of Golbin, > Mikhail > Sent: Tuesday, September 18, 2018 9:50 AM > To: ADSM-L@VM.MARIST.EDU > Subject: [External] Re: [ADSM-L] CONTAINER pool experiences > > Container pools work but you don't have defrag functionality until 8.1.4 - > which means it does not release the space it no longer uses. > Also you don't get much if any benefit from dedup if you commingle 2 or > more container pools into one on the replica. > For example you have 2 servers doing backups, storing data in container > pools and both replicating to one offsite server. > Each container pool is about 20Tb and there is a lot of overlap - the > storage pool usage on the offsite will be close to 40Tb, rather than 25Tb > that it would have been if dedup worked properly > > On Tue, Sep 18, 2018 at 9:37 AM Zoltan Forray wrote: > > > We are investigating using CONTAINER pools for our offsite replica > > server vs the current FILE method which is killing us with the > > constant dedup, reclaims, etc. > > > > So, what are the "gotchas' ? We are still at V7.1.7.400 so I figure we > > will have to do without any new features added in the V8 branch. But > > is it problematic enough at V7 to avoid it? > > > > Your thoughts? Experiences? > > > > -- > > *Zoltan Forray* > > Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator Xymon > > Monitor Administrator VMware Administrator Virginia Commonwealth > > University UCC/Office of Technology Services www.ucc.vcu.edu > > zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and > > other reputable organizations will never use email to request that you > > reply with your password, social security number or confidential > > personal information. For more details visit http://phishing.vcu.edu/ > > > > > > -- > Mikhail Golbin > bus (908)635-5705 > cell (908)210-3393 > RMD IT Client Services > > *** > > This email and any files transmitted with it are confidential > and intended solely for the use of the individual or entity > to whom they are addressed. If you have received this > email in error please notify the sender by replying to this > email and then delete it from your system. > > No reliance may be placed upon this email without written > confirmation of its contents and any liability arising from > such reliance without written confirmation is hereby > excluded. > > JRI America > > *** > > -- *Zoltan Forray* Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator Xymon Monitor Administrator VMware Administrator Virginia Commonwealth University UCC/Office of Technology Services www.ucc.vcu.edu zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://phishing.vcu.edu/
Re: CONTAINER pool experiences
Don't forget backupsets, you will lose them too with containerpools. Kind regards, Eric van Loon Air France/KLM Storage Engineering -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Solomon Miler Sent: dinsdag 18 september 2018 16:11 To: ADSM-L@VM.MARIST.EDU Subject: Re: CONTAINER pool experiences Dedup containers do not support 'migrate / export / move node '.The only way to get rid of data : expire / delete node. We are on 8.1.1.0 Solomon Miler Senior Data Protection Engineer, VP -- Desk: 201.577.313 Cell : 917.287.2332 smi...@jri-america.com -Original Message- From: ADSM: Dist Stor Manager On Behalf Of Golbin, Mikhail Sent: Tuesday, September 18, 2018 9:50 AM To: ADSM-L@VM.MARIST.EDU Subject: [External] Re: [ADSM-L] CONTAINER pool experiences Container pools work but you don't have defrag functionality until 8.1.4 - which means it does not release the space it no longer uses. Also you don't get much if any benefit from dedup if you commingle 2 or more container pools into one on the replica. For example you have 2 servers doing backups, storing data in container pools and both replicating to one offsite server. Each container pool is about 20Tb and there is a lot of overlap - the storage pool usage on the offsite will be close to 40Tb, rather than 25Tb that it would have been if dedup worked properly On Tue, Sep 18, 2018 at 9:37 AM Zoltan Forray wrote: > We are investigating using CONTAINER pools for our offsite replica > server vs the current FILE method which is killing us with the > constant dedup, reclaims, etc. > > So, what are the "gotchas' ? We are still at V7.1.7.400 so I figure we > will have to do without any new features added in the V8 branch. But > is it problematic enough at V7 to avoid it? > > Your thoughts? Experiences? > > -- > *Zoltan Forray* > Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator Xymon > Monitor Administrator VMware Administrator Virginia Commonwealth > University UCC/Office of Technology Services www.ucc.vcu.edu > zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and > other reputable organizations will never use email to request that you > reply with your password, social security number or confidential > personal information. For more details visit http://phishing.vcu.edu/ > > -- Mikhail Golbin bus (908)635-5705 cell (908)210-3393 RMD IT Client Services *** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender by replying to this email and then delete it from your system. No reliance may be placed upon this email without written confirmation of its contents and any liability arising from such reliance without written confirmation is hereby excluded. JRI America *** For information, services and offers, please visit our web site: http://www.klm.com. This e-mail and any attachment may contain confidential and privileged material intended for the addressee only. If you are not the addressee, you are notified that no part of the e-mail or any attachment may be disclosed, copied or distributed, and that any other action related to this e-mail or attachment is strictly prohibited, and may be unlawful. If you have received this e-mail by error, please notify the sender immediately by return e-mail, and delete this message. Koninklijke Luchtvaart Maatschappij NV (KLM), its subsidiaries and/or its employees shall not be liable for the incorrect or incomplete transmission of this e-mail or any attachments, nor responsible for any delay in receipt. Koninklijke Luchtvaart Maatschappij N.V. (also known as KLM Royal Dutch Airlines) is registered in Amstelveen, The Netherlands, with registered number 33014286
Re: CONTAINER pool experiences
Dedup containers do not support 'migrate / export / move node '.The only way to get rid of data : expire / delete node. We are on 8.1.1.0 Solomon Miler Senior Data Protection Engineer, VP -- Desk: 201.577.313 Cell : 917.287.2332 smi...@jri-america.com -Original Message- From: ADSM: Dist Stor Manager On Behalf Of Golbin, Mikhail Sent: Tuesday, September 18, 2018 9:50 AM To: ADSM-L@VM.MARIST.EDU Subject: [External] Re: [ADSM-L] CONTAINER pool experiences Container pools work but you don't have defrag functionality until 8.1.4 - which means it does not release the space it no longer uses. Also you don't get much if any benefit from dedup if you commingle 2 or more container pools into one on the replica. For example you have 2 servers doing backups, storing data in container pools and both replicating to one offsite server. Each container pool is about 20Tb and there is a lot of overlap - the storage pool usage on the offsite will be close to 40Tb, rather than 25Tb that it would have been if dedup worked properly On Tue, Sep 18, 2018 at 9:37 AM Zoltan Forray wrote: > We are investigating using CONTAINER pools for our offsite replica > server vs the current FILE method which is killing us with the > constant dedup, reclaims, etc. > > So, what are the "gotchas' ? We are still at V7.1.7.400 so I figure we > will have to do without any new features added in the V8 branch. But > is it problematic enough at V7 to avoid it? > > Your thoughts? Experiences? > > -- > *Zoltan Forray* > Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator Xymon > Monitor Administrator VMware Administrator Virginia Commonwealth > University UCC/Office of Technology Services www.ucc.vcu.edu > zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and > other reputable organizations will never use email to request that you > reply with your password, social security number or confidential > personal information. For more details visit http://phishing.vcu.edu/ > > -- Mikhail Golbin bus (908)635-5705 cell (908)210-3393 RMD IT Client Services *** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender by replying to this email and then delete it from your system. No reliance may be placed upon this email without written confirmation of its contents and any liability arising from such reliance without written confirmation is hereby excluded. JRI America ***
Re: CONTAINER pool experiences
Container pools work but you don't have defrag functionality until 8.1.4 - which means it does not release the space it no longer uses. Also you don't get much if any benefit from dedup if you commingle 2 or more container pools into one on the replica. For example you have 2 servers doing backups, storing data in container pools and both replicating to one offsite server. Each container pool is about 20Tb and there is a lot of overlap - the storage pool usage on the offsite will be close to 40Tb, rather than 25Tb that it would have been if dedup worked properly On Tue, Sep 18, 2018 at 9:37 AM Zoltan Forray wrote: > We are investigating using CONTAINER pools for our offsite replica server > vs the current FILE method which is killing us with the constant dedup, > reclaims, etc. > > So, what are the "gotchas' ? We are still at V7.1.7.400 so I figure we > will have to do without any new features added in the V8 branch. But is it > problematic enough at V7 to avoid it? > > Your thoughts? Experiences? > > -- > *Zoltan Forray* > Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator > Xymon Monitor Administrator > VMware Administrator > Virginia Commonwealth University > UCC/Office of Technology Services > www.ucc.vcu.edu > zfor...@vcu.edu - 804-828-4807 > Don't be a phishing victim - VCU and other reputable organizations will > never use email to request that you reply with your password, social > security number or confidential personal information. For more details > visit http://phishing.vcu.edu/ > > -- Mikhail Golbin bus (908)635-5705 cell (908)210-3393 RMD IT Client Services
CONTAINER pool experiences
We are investigating using CONTAINER pools for our offsite replica server vs the current FILE method which is killing us with the constant dedup, reclaims, etc. So, what are the "gotchas' ? We are still at V7.1.7.400 so I figure we will have to do without any new features added in the V8 branch. But is it problematic enough at V7 to avoid it? Your thoughts? Experiences? -- *Zoltan Forray* Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator Xymon Monitor Administrator VMware Administrator Virginia Commonwealth University UCC/Office of Technology Services www.ucc.vcu.edu zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://phishing.vcu.edu/
Re: Netapp snapdiff issues having TSM client on a Linux machine, making use of NFS mounts
Hi Tommaso, The backup command I'm using (dsmc i /Airwarder -snapdiff -snapdiffhttps -diffsnapshotname="daily.*" -diffsnapshot=latest -useexistingbase -optfile=dsm_netapp.opt) includes the "useexistingbase" statement. Based on my understanding of the documentation, this means that the S.P. client will not trigger the creation of a new snapshot on the Netapp device, but instead, make use of a snapshot that had been created previously by some internal mechanism of the Netapp. Therefore, it seems very unlikely that any process still has a grip on any of the files being part of this snapshot ... My humble opinion only of course, I'm waiting on others fellow members of this list feedback ! In addition to this, I would like to avoid the use of any exclude statement during the backup : I doubt that any of my customers would be very happy to hear that I'm not able to restore some of his precious files because the Spectrum Protect client had limitations ... Such issues never aroused with NDMP-based backups ! Cheers. Arnaud -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Tommaso Bollini Sent: Tuesday, September 18, 2018 12:29 PM To: ADSM-L@VM.MARIST.EDU Subject: R: [ADSM-L] Netapp snapdiff issues having TSM client on a Linux machine, making use of NFS mounts Hello Arnaud, maybe it would be: The NetApp snapshot indicates which files are modified on the LUN (for which their backup is triggered); but the Backup-Archive client cannot "take" them because they are locked by the application. Perhaps you can solve by inserting the appropiate rules in incl.excl file to skip them. -Messaggio originale- Da: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] Per conto di PAC Brion Arnaud Inviato: martedì 18 settembre 2018 12:21 A: ADSM-L@VM.MARIST.EDU Oggetto: [ADSM-L] Netapp snapdiff issues having TSM client on a Linux machine, making use of NFS mounts Hi All, Following to IBM's decision to withdraw the web GUI in the latest versions of their clients (thus making NDMP hardly usable), as well as to the renewal of our NAS infrastructure (now using Netapp), I'm trying to implement netapp snapdiffs in our shop. So far we succeeded in defining necessary user and roles on the Netapp, as well as to setup the TSM client in order to interact with our filer, but I'm now facing an issue where some files cannot be backed up, apparently due to access rights. Here an extract of our backup log : IBM Spectrum Protect Command Line Backup-Archive Client Interface Client Version 8, Release 1, Level 4.0 Client date/time: 09/18/2018 10:26:28 (c) Copyright by IBM Corporation and other(s) 1990, 2017. All Rights Reserved. Node Name: NETAPP_CH1_NFS Session established with server XXX: Linux/ppc64le Server Version 8, Release 1, Level 4.000 Server date/time: 09/18/2018 10:26:28 Last access: 09/18/2018 10:00:37 Incremental by snapshot difference of volume '/Airwarder' Connected to NetApp Storage Virtual Machine Management Filer Host/IP Address : Filer Version Information: NetApp Release 9.3P3: Wed Apr 04 13:07:06 UTC 2018 Storage VM Name : xxx Storage VM Host/IP Address : XX Storage VM Volume Style : Flex Login User : tsm-backup-user Transport: HTTPS Performing a Full Incremental Backup of volume '/Airwarder' Using Base Snapshot 'vserverdr.0.7b5a59c4-656c-11e8-bb80-00a098d614c2.2018-09-18_102500' with timestamp 09/18/2018 10:25:02 ANS4007E Error processing '/Airwarder/.snapshot/vserverdr.0.7b5a59c4-656c-11e8-bb80-00a098d614c2.2018-09-18_102500/acrimport_ref/ch': access to the object is denied ANS4007E Error processing '/Airwarder/.snapshot/vserverdr.0.7b5a59c4-656c-11e8-bb80-00a098d614c2.2018-09-18_102500/acrimport_test/ch': access to the object is denied ANS1898I * Processed 500 files * Directory--> 4,096 /Airwarder/ [Sent] Directory--> 4,096 /Airwarder/.etc [Sent] (skipped some lines) ANS1228E Sending of object '/Airwarder/acrimport_ref/config/log4j.conf' failed. ANS4007E Error processing '/Airwarder/acrimport_ref/config/log4j.conf': access to the object is denied Normal File--> 309 /Airwarder/acrimport_ref/config/sapConnector.cfg ** Unsuccessful ** ANS1228E Sending of object '/Airwarder/acrimport_ref/config/sapConnector.cfg' failed. ANS4007E Error processing '/Airwarder/acrimport_ref/config/sapConnector.cfg': access to the object is denied Normal File--> 330 /Airwarder/acrimport_ref/config/sapConnector.cfg.bak ** Unsuccessful ** ANS1228E Sending of object '/Airwarder/acrimport_ref/config/sapConnector.cfg.bak' failed. ANS4007E Error processing '/Airwarder/acrimport_ref/config/sapConnector.cfg.bak': access to the object is denied (skipped some lines) ANS1802E Incremental backup of '/Airwarder' finished with 90
Re: Netapp snapdiff issues having TSM client on a Linux machine, making use of NFS mounts
Hi Del, Thanks for the information, which I got as well thru other channels (IBM support), but there's still the limitation that this GUI will be usable only once logged on the machine hosting the Spectrum Protect client. This means that I will be forced to grant some of my colleagues (which were previously doing the restores on their own) specific logging rights on that machine. Was not the case before ... Cheers. Arnaud -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Del Hoobler Sent: Tuesday, September 18, 2018 12:57 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: Netapp snapdiff issues having TSM client on a Linux machine, making use of NFS mounts Hi Arnaud, Not related to SnapDiff ... but just some info on NDMP and B/A Client... In Spectrum Protect BA client 8.1.6 that GAs this coming Friday (21 September) you will be able to use the native Java GUI to handle NDMP backups/restores. Del "ADSM: Dist Stor Manager" wrote on 09/18/2018 06:20:52 AM: > From: PAC Brion Arnaud > To: ADSM-L@VM.MARIST.EDU > Date: 09/18/2018 06:21 AM > Subject: Netapp snapdiff issues having TSM client on a Linux > machine, making use of NFS mounts > Sent by: "ADSM: Dist Stor Manager" > > Hi All, > > Following to IBM's decision to withdraw the web GUI in the latest > versions of their clients (thus making NDMP hardly usable), as well > as to the renewal of our NAS infrastructure (now using Netapp), I'm > trying to implement netapp snapdiffs in our shop. > > So far we succeeded in defining necessary user and roles on the > Netapp, as well as to setup the TSM client in order to interact with > our filer, but I'm now facing an issue where some files cannot be > backed up, apparently due to access rights. > > Here an extract of our backup log : > > IBM Spectrum Protect > Command Line Backup-Archive Client Interface > Client Version 8, Release 1, Level 4.0 > Client date/time: 09/18/2018 10:26:28 > (c) Copyright by IBM Corporation and other(s) 1990, 2017. All RightsReserved. > > Node Name: NETAPP_CH1_NFS > Session established with server XXX: Linux/ppc64le > Server Version 8, Release 1, Level 4.000 > Server date/time: 09/18/2018 10:26:28 Last access: 09/18/2018 10:00:37 > > > Incremental by snapshot difference of volume '/Airwarder' > > Connected to NetApp Storage Virtual Machine > Management Filer Host/IP Address : > Filer Version Information: NetApp Release 9.3P3: Wed Apr > 04 13:07:06 UTC 2018 > Storage VM Name : xxx > Storage VM Host/IP Address : XX > Storage VM Volume Style : Flex > Login User : tsm-backup-user > Transport: HTTPS > > Performing a Full Incremental Backup of volume '/Airwarder' > Using Base Snapshot 'vserverdr.0.7b5a59c4-656c-11e8- > bb80-00a098d614c2.2018-09-18_102500' with timestamp 09/18/2018 10:25:02 > ANS4007E Error processing '/Airwarder/.snapshot/vserverdr.0. > 7b5a59c4-656c-11e8-bb80-00a098d614c2.2018-09-18_102500/ > acrimport_ref/ch': access to the object is denied > ANS4007E Error processing '/Airwarder/.snapshot/vserverdr.0. > 7b5a59c4-656c-11e8-bb80-00a098d614c2.2018-09-18_102500/ > acrimport_test/ch': access to the object is denied > ANS1898I * Processed 500 files * > Directory--> 4,096 /Airwarder/ [Sent] > Directory--> 4,096 /Airwarder/.etc [Sent] > > (skipped some lines) > > ANS1228E Sending of object '/Airwarder/acrimport_ref/config/ > log4j.conf' failed. > ANS4007E Error processing '/Airwarder/acrimport_ref/config/ > log4j.conf': access to the object is denied > Normal File--> 309 /Airwarder/acrimport_ref/config/ > sapConnector.cfg ** Unsuccessful ** > ANS1228E Sending of object '/Airwarder/acrimport_ref/config/ > sapConnector.cfg' failed. > ANS4007E Error processing '/Airwarder/acrimport_ref/config/ > sapConnector.cfg': access to the object is denied > Normal File--> 330 /Airwarder/acrimport_ref/config/ > sapConnector.cfg.bak ** Unsuccessful ** > ANS1228E Sending of object '/Airwarder/acrimport_ref/config/ > sapConnector.cfg.bak' failed. > ANS4007E Error processing '/Airwarder/acrimport_ref/config/ > sapConnector.cfg.bak': access to the object is denied > > (skipped some lines) > > ANS1802E Incremental backup of '/Airwarder' finished with 90 failure(s) > > > Total number of objects inspected:5,881 > Total number of objects backed up:5,791 > Total number of objects updated: 0 > Total number of objects rebound: 0 > Total number of objects deleted: 0 > Total number of objects expired: 0 > Total number of objects failed: 90 > Total number of objects encrypted:0 > Total number of objects grew: 0 > Total number of retries:
Re: Netapp snapdiff issues having TSM client on a Linux machine, making use of NFS mounts
Hi Arnaud, Not related to SnapDiff ... but just some info on NDMP and B/A Client... In Spectrum Protect BA client 8.1.6 that GAs this coming Friday (21 September) you will be able to use the native Java GUI to handle NDMP backups/restores. Del "ADSM: Dist Stor Manager" wrote on 09/18/2018 06:20:52 AM: > From: PAC Brion Arnaud > To: ADSM-L@VM.MARIST.EDU > Date: 09/18/2018 06:21 AM > Subject: Netapp snapdiff issues having TSM client on a Linux > machine, making use of NFS mounts > Sent by: "ADSM: Dist Stor Manager" > > Hi All, > > Following to IBM's decision to withdraw the web GUI in the latest > versions of their clients (thus making NDMP hardly usable), as well > as to the renewal of our NAS infrastructure (now using Netapp), I'm > trying to implement netapp snapdiffs in our shop. > > So far we succeeded in defining necessary user and roles on the > Netapp, as well as to setup the TSM client in order to interact with > our filer, but I'm now facing an issue where some files cannot be > backed up, apparently due to access rights. > > Here an extract of our backup log : > > IBM Spectrum Protect > Command Line Backup-Archive Client Interface > Client Version 8, Release 1, Level 4.0 > Client date/time: 09/18/2018 10:26:28 > (c) Copyright by IBM Corporation and other(s) 1990, 2017. All RightsReserved. > > Node Name: NETAPP_CH1_NFS > Session established with server XXX: Linux/ppc64le > Server Version 8, Release 1, Level 4.000 > Server date/time: 09/18/2018 10:26:28 Last access: 09/18/2018 10:00:37 > > > Incremental by snapshot difference of volume '/Airwarder' > > Connected to NetApp Storage Virtual Machine > Management Filer Host/IP Address : > Filer Version Information: NetApp Release 9.3P3: Wed Apr > 04 13:07:06 UTC 2018 > Storage VM Name : xxx > Storage VM Host/IP Address : XX > Storage VM Volume Style : Flex > Login User : tsm-backup-user > Transport: HTTPS > > Performing a Full Incremental Backup of volume '/Airwarder' > Using Base Snapshot 'vserverdr.0.7b5a59c4-656c-11e8- > bb80-00a098d614c2.2018-09-18_102500' with timestamp 09/18/2018 10:25:02 > ANS4007E Error processing '/Airwarder/.snapshot/vserverdr.0. > 7b5a59c4-656c-11e8-bb80-00a098d614c2.2018-09-18_102500/ > acrimport_ref/ch': access to the object is denied > ANS4007E Error processing '/Airwarder/.snapshot/vserverdr.0. > 7b5a59c4-656c-11e8-bb80-00a098d614c2.2018-09-18_102500/ > acrimport_test/ch': access to the object is denied > ANS1898I * Processed 500 files * > Directory--> 4,096 /Airwarder/ [Sent] > Directory--> 4,096 /Airwarder/.etc [Sent] > > (skipped some lines) > > ANS1228E Sending of object '/Airwarder/acrimport_ref/config/ > log4j.conf' failed. > ANS4007E Error processing '/Airwarder/acrimport_ref/config/ > log4j.conf': access to the object is denied > Normal File--> 309 /Airwarder/acrimport_ref/config/ > sapConnector.cfg ** Unsuccessful ** > ANS1228E Sending of object '/Airwarder/acrimport_ref/config/ > sapConnector.cfg' failed. > ANS4007E Error processing '/Airwarder/acrimport_ref/config/ > sapConnector.cfg': access to the object is denied > Normal File--> 330 /Airwarder/acrimport_ref/config/ > sapConnector.cfg.bak ** Unsuccessful ** > ANS1228E Sending of object '/Airwarder/acrimport_ref/config/ > sapConnector.cfg.bak' failed. > ANS4007E Error processing '/Airwarder/acrimport_ref/config/ > sapConnector.cfg.bak': access to the object is denied > > (skipped some lines) > > ANS1802E Incremental backup of '/Airwarder' finished with 90 failure(s) > > > Total number of objects inspected:5,881 > Total number of objects backed up:5,791 > Total number of objects updated: 0 > Total number of objects rebound: 0 > Total number of objects deleted: 0 > Total number of objects expired: 0 > Total number of objects failed: 90 > Total number of objects encrypted:0 > Total number of objects grew: 0 > Total number of retries: 15 > Total number of bytes inspected: 1.27 GB > Total number of bytes transferred: 1.37 GB > Data transfer time: 18.61 sec > Network data transfer rate: 77,367.92 KB/sec > Aggregate data transfer rate: 36,807.03 KB/sec > Objects compressed by:0% > Total data reduction ratio:0.00% > Elapsed processing time: 00:00:39 > > > Here, a closer look at some of the files making problems : > > root@xx:~ # ls -al /Airwarder/acrimport_ref/config/sapConnector.cfg.bak > -rw-r- 1 root root 330 May 6 2009 /Airwarder/acrimport_ref/ > config/sapConnector.cfg.bak > > > root@xx:~ # ls -la
R: [ADSM-L] Netapp snapdiff issues having TSM client on a Linux machine, making use of NFS mounts
Hello Arnaud, maybe it would be: The NetApp snapshot indicates which files are modified on the LUN (for which their backup is triggered); but the Backup-Archive client cannot "take" them because they are locked by the application. Perhaps you can solve by inserting the appropiate rules in incl.excl file to skip them. -Messaggio originale- Da: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] Per conto di PAC Brion Arnaud Inviato: martedì 18 settembre 2018 12:21 A: ADSM-L@VM.MARIST.EDU Oggetto: [ADSM-L] Netapp snapdiff issues having TSM client on a Linux machine, making use of NFS mounts Hi All, Following to IBM's decision to withdraw the web GUI in the latest versions of their clients (thus making NDMP hardly usable), as well as to the renewal of our NAS infrastructure (now using Netapp), I'm trying to implement netapp snapdiffs in our shop. So far we succeeded in defining necessary user and roles on the Netapp, as well as to setup the TSM client in order to interact with our filer, but I'm now facing an issue where some files cannot be backed up, apparently due to access rights. Here an extract of our backup log : IBM Spectrum Protect Command Line Backup-Archive Client Interface Client Version 8, Release 1, Level 4.0 Client date/time: 09/18/2018 10:26:28 (c) Copyright by IBM Corporation and other(s) 1990, 2017. All Rights Reserved. Node Name: NETAPP_CH1_NFS Session established with server XXX: Linux/ppc64le Server Version 8, Release 1, Level 4.000 Server date/time: 09/18/2018 10:26:28 Last access: 09/18/2018 10:00:37 Incremental by snapshot difference of volume '/Airwarder' Connected to NetApp Storage Virtual Machine Management Filer Host/IP Address : Filer Version Information: NetApp Release 9.3P3: Wed Apr 04 13:07:06 UTC 2018 Storage VM Name : xxx Storage VM Host/IP Address : XX Storage VM Volume Style : Flex Login User : tsm-backup-user Transport: HTTPS Performing a Full Incremental Backup of volume '/Airwarder' Using Base Snapshot 'vserverdr.0.7b5a59c4-656c-11e8-bb80-00a098d614c2.2018-09-18_102500' with timestamp 09/18/2018 10:25:02 ANS4007E Error processing '/Airwarder/.snapshot/vserverdr.0.7b5a59c4-656c-11e8-bb80-00a098d614c2.2018-09-18_102500/acrimport_ref/ch': access to the object is denied ANS4007E Error processing '/Airwarder/.snapshot/vserverdr.0.7b5a59c4-656c-11e8-bb80-00a098d614c2.2018-09-18_102500/acrimport_test/ch': access to the object is denied ANS1898I * Processed 500 files * Directory--> 4,096 /Airwarder/ [Sent] Directory--> 4,096 /Airwarder/.etc [Sent] (skipped some lines) ANS1228E Sending of object '/Airwarder/acrimport_ref/config/log4j.conf' failed. ANS4007E Error processing '/Airwarder/acrimport_ref/config/log4j.conf': access to the object is denied Normal File--> 309 /Airwarder/acrimport_ref/config/sapConnector.cfg ** Unsuccessful ** ANS1228E Sending of object '/Airwarder/acrimport_ref/config/sapConnector.cfg' failed. ANS4007E Error processing '/Airwarder/acrimport_ref/config/sapConnector.cfg': access to the object is denied Normal File--> 330 /Airwarder/acrimport_ref/config/sapConnector.cfg.bak ** Unsuccessful ** ANS1228E Sending of object '/Airwarder/acrimport_ref/config/sapConnector.cfg.bak' failed. ANS4007E Error processing '/Airwarder/acrimport_ref/config/sapConnector.cfg.bak': access to the object is denied (skipped some lines) ANS1802E Incremental backup of '/Airwarder' finished with 90 failure(s) Total number of objects inspected:5,881 Total number of objects backed up:5,791 Total number of objects updated: 0 Total number of objects rebound: 0 Total number of objects deleted: 0 Total number of objects expired: 0 Total number of objects failed: 90 Total number of objects encrypted:0 Total number of objects grew: 0 Total number of retries: 15 Total number of bytes inspected: 1.27 GB Total number of bytes transferred: 1.37 GB Data transfer time: 18.61 sec Network data transfer rate: 77,367.92 KB/sec Aggregate data transfer rate: 36,807.03 KB/sec Objects compressed by:0% Total data reduction ratio:0.00% Elapsed processing time: 00:00:39 Here, a closer look at some of the files making problems : root@xx:~ # ls -al /Airwarder/acrimport_ref/config/sapConnector.cfg.bak -rw-r- 1 root root 330 May 6 2009 /Airwarder/acrimport_ref/config/sapConnector.cfg.bak root@xx:~ # ls -la /Airwarder/.snapshot/vserverdr.0.7b5a59c4-656c-11e8-bb80-00a098d614c2.2018-09-18_121000/acrimport_ref/ch ls: cannot open directory
Netapp snapdiff issues having TSM client on a Linux machine, making use of NFS mounts
Hi All, Following to IBM's decision to withdraw the web GUI in the latest versions of their clients (thus making NDMP hardly usable), as well as to the renewal of our NAS infrastructure (now using Netapp), I'm trying to implement netapp snapdiffs in our shop. So far we succeeded in defining necessary user and roles on the Netapp, as well as to setup the TSM client in order to interact with our filer, but I'm now facing an issue where some files cannot be backed up, apparently due to access rights. Here an extract of our backup log : IBM Spectrum Protect Command Line Backup-Archive Client Interface Client Version 8, Release 1, Level 4.0 Client date/time: 09/18/2018 10:26:28 (c) Copyright by IBM Corporation and other(s) 1990, 2017. All Rights Reserved. Node Name: NETAPP_CH1_NFS Session established with server XXX: Linux/ppc64le Server Version 8, Release 1, Level 4.000 Server date/time: 09/18/2018 10:26:28 Last access: 09/18/2018 10:00:37 Incremental by snapshot difference of volume '/Airwarder' Connected to NetApp Storage Virtual Machine Management Filer Host/IP Address : Filer Version Information: NetApp Release 9.3P3: Wed Apr 04 13:07:06 UTC 2018 Storage VM Name : xxx Storage VM Host/IP Address : XX Storage VM Volume Style : Flex Login User : tsm-backup-user Transport: HTTPS Performing a Full Incremental Backup of volume '/Airwarder' Using Base Snapshot 'vserverdr.0.7b5a59c4-656c-11e8-bb80-00a098d614c2.2018-09-18_102500' with timestamp 09/18/2018 10:25:02 ANS4007E Error processing '/Airwarder/.snapshot/vserverdr.0.7b5a59c4-656c-11e8-bb80-00a098d614c2.2018-09-18_102500/acrimport_ref/ch': access to the object is denied ANS4007E Error processing '/Airwarder/.snapshot/vserverdr.0.7b5a59c4-656c-11e8-bb80-00a098d614c2.2018-09-18_102500/acrimport_test/ch': access to the object is denied ANS1898I * Processed 500 files * Directory--> 4,096 /Airwarder/ [Sent] Directory--> 4,096 /Airwarder/.etc [Sent] (skipped some lines) ANS1228E Sending of object '/Airwarder/acrimport_ref/config/log4j.conf' failed. ANS4007E Error processing '/Airwarder/acrimport_ref/config/log4j.conf': access to the object is denied Normal File--> 309 /Airwarder/acrimport_ref/config/sapConnector.cfg ** Unsuccessful ** ANS1228E Sending of object '/Airwarder/acrimport_ref/config/sapConnector.cfg' failed. ANS4007E Error processing '/Airwarder/acrimport_ref/config/sapConnector.cfg': access to the object is denied Normal File--> 330 /Airwarder/acrimport_ref/config/sapConnector.cfg.bak ** Unsuccessful ** ANS1228E Sending of object '/Airwarder/acrimport_ref/config/sapConnector.cfg.bak' failed. ANS4007E Error processing '/Airwarder/acrimport_ref/config/sapConnector.cfg.bak': access to the object is denied (skipped some lines) ANS1802E Incremental backup of '/Airwarder' finished with 90 failure(s) Total number of objects inspected:5,881 Total number of objects backed up:5,791 Total number of objects updated: 0 Total number of objects rebound: 0 Total number of objects deleted: 0 Total number of objects expired: 0 Total number of objects failed: 90 Total number of objects encrypted:0 Total number of objects grew: 0 Total number of retries: 15 Total number of bytes inspected: 1.27 GB Total number of bytes transferred: 1.37 GB Data transfer time: 18.61 sec Network data transfer rate: 77,367.92 KB/sec Aggregate data transfer rate: 36,807.03 KB/sec Objects compressed by:0% Total data reduction ratio:0.00% Elapsed processing time: 00:00:39 Here, a closer look at some of the files making problems : root@xx:~ # ls -al /Airwarder/acrimport_ref/config/sapConnector.cfg.bak -rw-r- 1 root root 330 May 6 2009 /Airwarder/acrimport_ref/config/sapConnector.cfg.bak root@xx:~ # ls -la /Airwarder/.snapshot/vserverdr.0.7b5a59c4-656c-11e8-bb80-00a098d614c2.2018-09-18_121000/acrimport_ref/ch ls: cannot open directory /Airwarder/.snapshot/vserverdr.0.7b5a59c4-656c-11e8-bb80-00a098d614c2.2018-09-18_121000/acrimport_ref/ch: Permission denied And who I am: root@xx:~ # id uid=0(root) gid=0(root) groups=0(root) Any idea on how to solve such issues ? Cheers. Arnaud Backup and Recovery Systems Administrator Panalpina Management Ltd., Basle, Switzerland, CIT Department Viadukstrasse 42, P.O. Box 4002 Basel/CH Phone: +41 (61) 226 11 11, FAX: +41 (61) 226 17 01 Direct: +41 (61) 226 19 78 e-mail:
