Re: No space available in storage pool failure but there is plenty of space
I agree. I thought it should have gone straight to tape, too. They are 3592-E06 drives in a TS3500 library. Zoltan Forray Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator VMware Administrator Xymon Administrator VCU Computer Center zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://infosecurity.vcu.edu/phishing.html On Jul 18, 2017 4:56 PM, "Sasa Drnjevic" wrote: > On 2017-07-18 22:01, Zoltan Forray wrote: > > Finally got some feedback from the node server owner and it explains what > > is going on. This is his comment but I am about to tell him he is wrong > > since the current active session has only backed up 30GB. > > > > *Looks like a single 8.1 TB file caused an error. I started a manual > backup > > of that file and its been running all day.* > > > > Of course, how does he backup such a file is the TSM server disk LZ is > > 8.8TB total with 95% used? > > I'd say that huge file should have mounted the tape from the NEXTpool? > > It happens here from time to time when a sparse file appears. Last one > had 15 TB > > Which tapes are you using? > > We are equiped with LTO7. > > > > Regards > > -- > Sasa > > > > > > > > > > On Tue, Jul 18, 2017 at 8:56 AM, Sasa Drnjevic > > wrote: > > > >> Could be a huge sparse file if you have Maximum Size Threshold set for > >> the pool? > >> > >> Regards, > >> > >> -- > >> Sasa Drnjevic > >> www.srce.unizg.hr > >> > >> > >> > >> > >> On 18.7.2017. 14:48, Zoltan Forray wrote: > >>> TSM Linux server 7.1.6.3. Client is Linux 7.1.6.4. > >>> > >>> This morning at 6am is the second time I have had this "failure" when > it > >>> isn't true. > >>> > >>> ANR0522W Transaction failed for session 19482 for node > >> VCU-GS1.CHPC.VCU.EDU > >>> (Linux x86-64) - no space available in storage pool BACKUPPOOL and all > >>> successor pools. > >>> > >>> But it isn't true. The BACKUPPOOL pool is only 92% used (of 9TB) and > the > >>> hi/low triggers are 95/90. I checked activity logs and there haven't > >> been > >>> any recent migrations. > >>> > >>> The NEXTPOOL is tape and all 9-drives are free and the MAXSCRATCH count > >>> hasn't been hit. > >>> > >>> The backup only transferred 60GB (of 108TB examined) before dying due > to > >>> this erroneous error. > >>> > >>> No other errors in the activity log. So, what gives? > >>> > >>> -- > >>> *Zoltan Forray* > >>> Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator > >>> Xymon Monitor Administrator > >>> VMware Administrator > >>> Virginia Commonwealth University > >>> UCC/Office of Technology Services > >>> www.ucc.vcu.edu > >>> zfor...@vcu.edu - 804-828-4807 > >>> Don't be a phishing victim - VCU and other reputable organizations will > >>> never use email to request that you reply with your password, social > >>> security number or confidential personal information. For more details > >>> visit http://infosecurity.vcu.edu/phishing.html > >>> > >> > > > > > > > > -- > > *Zoltan Forray* > > Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator > > Xymon Monitor Administrator > > VMware Administrator > > Virginia Commonwealth University > > UCC/Office of Technology Services > > www.ucc.vcu.edu > > zfor...@vcu.edu - 804-828-4807 > > Don't be a phishing victim - VCU and other reputable organizations will > > never use email to request that you reply with your password, social > > security number or confidential personal information. For more details > > visit http://infosecurity.vcu.edu/phishing.html > > >
Re: No space available in storage pool failure but there is plenty of space
No, it does not. All volumes are good. Zoltan Forray Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator VMware Administrator Xymon Administrator VCU Computer Center zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://infosecurity.vcu.edu/phishing.html On Jul 18, 2017 4:14 PM, "Giacomo Testa" wrote: > Hi, > > Could it maybe be that some disk volumes are unavailable? > > Does any volume show up launching these two commands? > > q v * stg=BACKUPPOOL access=readonly,unavailable,offsite,destroyed > > q v * stg=BACKUPPOOL status=offline,empty,pending,filling,full > > > > Giacomo Testa > Mobile +39 342 847 2983 > www.linkedin.com/in/giacomotesta > > -Original Message- > From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of > Zoltan Forray > Sent: Tuesday, July 18, 2017 18:08 > To: ADSM-L@VM.MARIST.EDU > Subject: Re: [ADSM-L] No space available in storage pool failure but there > is plenty of space > > Yes - the default/1. It has been backing up in the past - over 500TB. > > On Tue, Jul 18, 2017 at 11:43 AM, Richard Cowen > wrote: > > > Node has mount points? > > > > -Original Message- > > From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf > > Of Zoltan Forray > > Sent: Tuesday, July 18, 2017 11:40 AM > > To: ADSM-L@VM.MARIST.EDU > > Subject: Re: [ADSM-L] No space available in storage pool failure but > > there is plenty of space > > > > Yep - 100+ scratch tapes in both tape libraries. As I mentioned, > > there is no sign of any attempt to mount a tape and all drives were > > available at that time. > > > > On Tue, Jul 18, 2017 at 11:29 AM, Richard Cowen > > > > wrote: > > > > > Do you have lib volumes available (scratch/empty)? > > > > > > -Original Message- > > > From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On > > > Behalf Of Zoltan Forray > > > Sent: Tuesday, July 18, 2017 11:24 AM > > > To: ADSM-L@VM.MARIST.EDU > > > Subject: Re: [ADSM-L] No space available in storage pool failure but > > > there is plenty of space > > > > > > I already considered that. The tape pool is defined at 1500-scratch > > > and only 920-are used: > > > > > > 11:22:33 AM PROCESSOR : show sspool > > > -> Pool ARCHIVEPOOL(2): Strategy=10, ClassId=0, ClassName=DISK, > > > Next=6, ReclaimPool=0, HighMig=90, LowMig=70, MigProcess=1, > > > Access=0, > > > MaxSize=0, Cache=0, Collocate=0, Reclaim=60, MaxScratch=0, > > > ReuseDelay=0, crcData=False, verifyData=True, > > > ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, > ReclamationType=0 > > > Index=0, OpenCount=0, CreatePending=False, DeletePending=False > > > CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes > > > deduplicate=False, identifyProcess=1 > > > Shreddable=False, shredCount=0 > > > AutoCopy=Client, Encrypted=0, Compression=0 > > > DS Extension: VolListSize=16, VolCount=1, VolLast=0 > > > -> Pool BACKUPPOOL(1): Strategy=10, ClassId=0, ClassName=DISK, > > > Next=6, ReclaimPool=0, HighMig=95, LowMig=90, MigProcess=2, > > > Access=0, > > > MaxSize=0, Cache=0, Collocate=0, Reclaim=60, MaxScratch=0, > > > ReuseDelay=0, crcData=False, verifyData=True, > > > ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, > ReclamationType=0 > > > Index=1, OpenCount=0, CreatePending=False, DeletePending=False > > > CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes > > > deduplicate=False, identifyProcess=1 > > > Shreddable=False, shredCount=0 > > > AutoCopy=Client, Encrypted=0, Compression=0 > > > DS Extension: VolListSize=24, VolCount=18, VolLast=2 > > > -> Pool COPYPOOL-OFFSITE(-2): Strategy=30, ClassId=4, > > > ClassName=IBM3494-SUN, > > > Next=0, ReclaimPool=0, HighMig=90, LowMig=70, MigProcess=1, > > > Access=0, > > > MaxSize=0, Cache=0, Collocate=0, Reclaim=66, MaxScratch=1500, > > > ReuseDelay=0, crcData=False, verifyData=True, > > > ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, > ReclamationType=0 > > > Index=2, OpenCount=0, CreatePending=False, DeletePending=False > > > CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes > > > deduplicate=False, identifyProcess=0 > > > Shreddable=False, shredCount=0 > > > AutoCopy=Client, Encrypted=0, Compression=0 > > > AS Extension: NumDefVols=770, NumEmptyVols=0, > > > NumScratchVols=770, NumRsvdScratch=0 > > > -> Pool PRIMARY-ONSITE(6): Strategy=30, ClassId=3, ClassName=IBM3494, > > > Next=0, ReclaimPool=0, HighMig=90, LowMig=70, MigProcess=1, > > > Access=0, > > > MaxSize=0, Cache=0, Collocate=0, Reclaim=63, MaxScratch=1500, > > > ReuseDelay=0, crcData=False, verifyData=True, > > >
Re: No space available in storage pool failure but there is plenty of space
On 2017-07-18 22:01, Zoltan Forray wrote: > Finally got some feedback from the node server owner and it explains what > is going on. This is his comment but I am about to tell him he is wrong > since the current active session has only backed up 30GB. > > *Looks like a single 8.1 TB file caused an error. I started a manual backup > of that file and its been running all day.* > > Of course, how does he backup such a file is the TSM server disk LZ is > 8.8TB total with 95% used? I'd say that huge file should have mounted the tape from the NEXTpool? It happens here from time to time when a sparse file appears. Last one had 15 TB Which tapes are you using? We are equiped with LTO7. Regards -- Sasa > > > On Tue, Jul 18, 2017 at 8:56 AM, Sasa Drnjevic > wrote: > >> Could be a huge sparse file if you have Maximum Size Threshold set for >> the pool? >> >> Regards, >> >> -- >> Sasa Drnjevic >> www.srce.unizg.hr >> >> >> >> >> On 18.7.2017. 14:48, Zoltan Forray wrote: >>> TSM Linux server 7.1.6.3. Client is Linux 7.1.6.4. >>> >>> This morning at 6am is the second time I have had this "failure" when it >>> isn't true. >>> >>> ANR0522W Transaction failed for session 19482 for node >> VCU-GS1.CHPC.VCU.EDU >>> (Linux x86-64) - no space available in storage pool BACKUPPOOL and all >>> successor pools. >>> >>> But it isn't true. The BACKUPPOOL pool is only 92% used (of 9TB) and the >>> hi/low triggers are 95/90. I checked activity logs and there haven't >> been >>> any recent migrations. >>> >>> The NEXTPOOL is tape and all 9-drives are free and the MAXSCRATCH count >>> hasn't been hit. >>> >>> The backup only transferred 60GB (of 108TB examined) before dying due to >>> this erroneous error. >>> >>> No other errors in the activity log. So, what gives? >>> >>> -- >>> *Zoltan Forray* >>> Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator >>> Xymon Monitor Administrator >>> VMware Administrator >>> Virginia Commonwealth University >>> UCC/Office of Technology Services >>> www.ucc.vcu.edu >>> zfor...@vcu.edu - 804-828-4807 >>> Don't be a phishing victim - VCU and other reputable organizations will >>> never use email to request that you reply with your password, social >>> security number or confidential personal information. For more details >>> visit http://infosecurity.vcu.edu/phishing.html >>> >> > > > > -- > *Zoltan Forray* > Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator > Xymon Monitor Administrator > VMware Administrator > Virginia Commonwealth University > UCC/Office of Technology Services > www.ucc.vcu.edu > zfor...@vcu.edu - 804-828-4807 > Don't be a phishing victim - VCU and other reputable organizations will > never use email to request that you reply with your password, social > security number or confidential personal information. For more details > visit http://infosecurity.vcu.edu/phishing.html >
Re: No space available in storage pool failure but there is plenty of space
On 2017-07-18 22:08, Zoltan Forray wrote: > I just got another comment from the server owner that I thought you would > enjoy: > > > > > *I've stopped the backup. I looked at the file, its a zillion lines > of:Reply (O)verwrite (A)ppend, or (Q)uit [O/A/Q]:* > > Endless loop😱 Well, we do experience all sorts of (useless) things ;-) Cheers ;-) > > On Tue, Jul 18, 2017 at 8:56 AM, Sasa Drnjevic > wrote: > >> Could be a huge sparse file if you have Maximum Size Threshold set for >> the pool? >> >> Regards, >> >> -- >> Sasa Drnjevic >> www.srce.unizg.hr >> >> >> >> >> On 18.7.2017. 14:48, Zoltan Forray wrote: >>> TSM Linux server 7.1.6.3. Client is Linux 7.1.6.4. >>> >>> This morning at 6am is the second time I have had this "failure" when it >>> isn't true. >>> >>> ANR0522W Transaction failed for session 19482 for node >> VCU-GS1.CHPC.VCU.EDU >>> (Linux x86-64) - no space available in storage pool BACKUPPOOL and all >>> successor pools. >>> >>> But it isn't true. The BACKUPPOOL pool is only 92% used (of 9TB) and the >>> hi/low triggers are 95/90. I checked activity logs and there haven't >> been >>> any recent migrations. >>> >>> The NEXTPOOL is tape and all 9-drives are free and the MAXSCRATCH count >>> hasn't been hit. >>> >>> The backup only transferred 60GB (of 108TB examined) before dying due to >>> this erroneous error. >>> >>> No other errors in the activity log. So, what gives? >>> >>> -- >>> *Zoltan Forray* >>> Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator >>> Xymon Monitor Administrator >>> VMware Administrator >>> Virginia Commonwealth University >>> UCC/Office of Technology Services >>> www.ucc.vcu.edu >>> zfor...@vcu.edu - 804-828-4807 >>> Don't be a phishing victim - VCU and other reputable organizations will >>> never use email to request that you reply with your password, social >>> security number or confidential personal information. For more details >>> visit http://infosecurity.vcu.edu/phishing.html >>> >> > > >
Re: No space available in storage pool failure but there is plenty of space
Hi, Could it maybe be that some disk volumes are unavailable? Does any volume show up launching these two commands? q v * stg=BACKUPPOOL access=readonly,unavailable,offsite,destroyed q v * stg=BACKUPPOOL status=offline,empty,pending,filling,full Giacomo Testa Mobile +39 342 847 2983 www.linkedin.com/in/giacomotesta -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Zoltan Forray Sent: Tuesday, July 18, 2017 18:08 To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] No space available in storage pool failure but there is plenty of space Yes - the default/1. It has been backing up in the past - over 500TB. On Tue, Jul 18, 2017 at 11:43 AM, Richard Cowen wrote: > Node has mount points? > > -Original Message- > From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf > Of Zoltan Forray > Sent: Tuesday, July 18, 2017 11:40 AM > To: ADSM-L@VM.MARIST.EDU > Subject: Re: [ADSM-L] No space available in storage pool failure but > there is plenty of space > > Yep - 100+ scratch tapes in both tape libraries. As I mentioned, > there is no sign of any attempt to mount a tape and all drives were > available at that time. > > On Tue, Jul 18, 2017 at 11:29 AM, Richard Cowen > > wrote: > > > Do you have lib volumes available (scratch/empty)? > > > > -Original Message- > > From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On > > Behalf Of Zoltan Forray > > Sent: Tuesday, July 18, 2017 11:24 AM > > To: ADSM-L@VM.MARIST.EDU > > Subject: Re: [ADSM-L] No space available in storage pool failure but > > there is plenty of space > > > > I already considered that. The tape pool is defined at 1500-scratch > > and only 920-are used: > > > > 11:22:33 AM PROCESSOR : show sspool > > -> Pool ARCHIVEPOOL(2): Strategy=10, ClassId=0, ClassName=DISK, > > Next=6, ReclaimPool=0, HighMig=90, LowMig=70, MigProcess=1, > > Access=0, > > MaxSize=0, Cache=0, Collocate=0, Reclaim=60, MaxScratch=0, > > ReuseDelay=0, crcData=False, verifyData=True, > > ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, ReclamationType=0 > > Index=0, OpenCount=0, CreatePending=False, DeletePending=False > > CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes > > deduplicate=False, identifyProcess=1 > > Shreddable=False, shredCount=0 > > AutoCopy=Client, Encrypted=0, Compression=0 > > DS Extension: VolListSize=16, VolCount=1, VolLast=0 > > -> Pool BACKUPPOOL(1): Strategy=10, ClassId=0, ClassName=DISK, > > Next=6, ReclaimPool=0, HighMig=95, LowMig=90, MigProcess=2, > > Access=0, > > MaxSize=0, Cache=0, Collocate=0, Reclaim=60, MaxScratch=0, > > ReuseDelay=0, crcData=False, verifyData=True, > > ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, ReclamationType=0 > > Index=1, OpenCount=0, CreatePending=False, DeletePending=False > > CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes > > deduplicate=False, identifyProcess=1 > > Shreddable=False, shredCount=0 > > AutoCopy=Client, Encrypted=0, Compression=0 > > DS Extension: VolListSize=24, VolCount=18, VolLast=2 > > -> Pool COPYPOOL-OFFSITE(-2): Strategy=30, ClassId=4, > > ClassName=IBM3494-SUN, > > Next=0, ReclaimPool=0, HighMig=90, LowMig=70, MigProcess=1, > > Access=0, > > MaxSize=0, Cache=0, Collocate=0, Reclaim=66, MaxScratch=1500, > > ReuseDelay=0, crcData=False, verifyData=True, > > ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, ReclamationType=0 > > Index=2, OpenCount=0, CreatePending=False, DeletePending=False > > CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes > > deduplicate=False, identifyProcess=0 > > Shreddable=False, shredCount=0 > > AutoCopy=Client, Encrypted=0, Compression=0 > > AS Extension: NumDefVols=770, NumEmptyVols=0, > > NumScratchVols=770, NumRsvdScratch=0 > > -> Pool PRIMARY-ONSITE(6): Strategy=30, ClassId=3, ClassName=IBM3494, > > Next=0, ReclaimPool=0, HighMig=90, LowMig=70, MigProcess=1, > > Access=0, > > MaxSize=0, Cache=0, Collocate=0, Reclaim=63, MaxScratch=1500, > > ReuseDelay=0, crcData=False, verifyData=True, > > ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, ReclamationType=0 > > Index=3, OpenCount=0, CreatePending=False, DeletePending=False > > CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes > > deduplicate=False, identifyProcess=1 > > Shreddable=False, shredCount=0 > > AutoCopy=Client, Encrypted=0, Compression=0 > > AS Extension: NumDefVols=920, NumEmptyVols=0, > > NumScratchVols=920, NumRsvdScratch=0 > > > > > > On Tue, Jul 18, 2017 at 11:11 AM, Loon, Eric van (ITOPT3) - KLM < > > eric-van.l...@klm.com> wrote: > > > > > Hi Zoltan! > > > Try this one: issue a "show sspool" command. If the sum of > > > NumScratchVols and NumRsvdScratch equals
Re: No space available in storage pool failure but there is plenty of space
I just got another comment from the server owner that I thought you would enjoy: *I've stopped the backup. I looked at the file, its a zillion lines of:Reply (O)verwrite (A)ppend, or (Q)uit [O/A/Q]:* Endless loop😱 On Tue, Jul 18, 2017 at 8:56 AM, Sasa Drnjevic wrote: > Could be a huge sparse file if you have Maximum Size Threshold set for > the pool? > > Regards, > > -- > Sasa Drnjevic > www.srce.unizg.hr > > > > > On 18.7.2017. 14:48, Zoltan Forray wrote: > > TSM Linux server 7.1.6.3. Client is Linux 7.1.6.4. > > > > This morning at 6am is the second time I have had this "failure" when it > > isn't true. > > > > ANR0522W Transaction failed for session 19482 for node > VCU-GS1.CHPC.VCU.EDU > > (Linux x86-64) - no space available in storage pool BACKUPPOOL and all > > successor pools. > > > > But it isn't true. The BACKUPPOOL pool is only 92% used (of 9TB) and the > > hi/low triggers are 95/90. I checked activity logs and there haven't > been > > any recent migrations. > > > > The NEXTPOOL is tape and all 9-drives are free and the MAXSCRATCH count > > hasn't been hit. > > > > The backup only transferred 60GB (of 108TB examined) before dying due to > > this erroneous error. > > > > No other errors in the activity log. So, what gives? > > > > -- > > *Zoltan Forray* > > Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator > > Xymon Monitor Administrator > > VMware Administrator > > Virginia Commonwealth University > > UCC/Office of Technology Services > > www.ucc.vcu.edu > > zfor...@vcu.edu - 804-828-4807 > > Don't be a phishing victim - VCU and other reputable organizations will > > never use email to request that you reply with your password, social > > security number or confidential personal information. For more details > > visit http://infosecurity.vcu.edu/phishing.html > > > -- *Zoltan Forray* Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator Xymon Monitor Administrator VMware Administrator Virginia Commonwealth University UCC/Office of Technology Services www.ucc.vcu.edu zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://infosecurity.vcu.edu/phishing.html
Re: No space available in storage pool failure but there is plenty of space
Finally got some feedback from the node server owner and it explains what is going on. This is his comment but I am about to tell him he is wrong since the current active session has only backed up 30GB. *Looks like a single 8.1 TB file caused an error. I started a manual backup of that file and its been running all day.* Of course, how does he backup such a file is the TSM server disk LZ is 8.8TB total with 95% used? On Tue, Jul 18, 2017 at 8:56 AM, Sasa Drnjevic wrote: > Could be a huge sparse file if you have Maximum Size Threshold set for > the pool? > > Regards, > > -- > Sasa Drnjevic > www.srce.unizg.hr > > > > > On 18.7.2017. 14:48, Zoltan Forray wrote: > > TSM Linux server 7.1.6.3. Client is Linux 7.1.6.4. > > > > This morning at 6am is the second time I have had this "failure" when it > > isn't true. > > > > ANR0522W Transaction failed for session 19482 for node > VCU-GS1.CHPC.VCU.EDU > > (Linux x86-64) - no space available in storage pool BACKUPPOOL and all > > successor pools. > > > > But it isn't true. The BACKUPPOOL pool is only 92% used (of 9TB) and the > > hi/low triggers are 95/90. I checked activity logs and there haven't > been > > any recent migrations. > > > > The NEXTPOOL is tape and all 9-drives are free and the MAXSCRATCH count > > hasn't been hit. > > > > The backup only transferred 60GB (of 108TB examined) before dying due to > > this erroneous error. > > > > No other errors in the activity log. So, what gives? > > > > -- > > *Zoltan Forray* > > Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator > > Xymon Monitor Administrator > > VMware Administrator > > Virginia Commonwealth University > > UCC/Office of Technology Services > > www.ucc.vcu.edu > > zfor...@vcu.edu - 804-828-4807 > > Don't be a phishing victim - VCU and other reputable organizations will > > never use email to request that you reply with your password, social > > security number or confidential personal information. For more details > > visit http://infosecurity.vcu.edu/phishing.html > > > -- *Zoltan Forray* Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator Xymon Monitor Administrator VMware Administrator Virginia Commonwealth University UCC/Office of Technology Services www.ucc.vcu.edu zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://infosecurity.vcu.edu/phishing.html
Re: No space available in storage pool failure but there is plenty of space
Yes - the default/1. It has been backing up in the past - over 500TB. On Tue, Jul 18, 2017 at 11:43 AM, Richard Cowen wrote: > Node has mount points? > > -Original Message- > From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of > Zoltan Forray > Sent: Tuesday, July 18, 2017 11:40 AM > To: ADSM-L@VM.MARIST.EDU > Subject: Re: [ADSM-L] No space available in storage pool failure but there > is plenty of space > > Yep - 100+ scratch tapes in both tape libraries. As I mentioned, there is > no sign of any attempt to mount a tape and all drives were available at > that time. > > On Tue, Jul 18, 2017 at 11:29 AM, Richard Cowen > wrote: > > > Do you have lib volumes available (scratch/empty)? > > > > -Original Message- > > From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf > > Of Zoltan Forray > > Sent: Tuesday, July 18, 2017 11:24 AM > > To: ADSM-L@VM.MARIST.EDU > > Subject: Re: [ADSM-L] No space available in storage pool failure but > > there is plenty of space > > > > I already considered that. The tape pool is defined at 1500-scratch > > and only 920-are used: > > > > 11:22:33 AM PROCESSOR : show sspool > > -> Pool ARCHIVEPOOL(2): Strategy=10, ClassId=0, ClassName=DISK, > > Next=6, ReclaimPool=0, HighMig=90, LowMig=70, MigProcess=1, > > Access=0, > > MaxSize=0, Cache=0, Collocate=0, Reclaim=60, MaxScratch=0, > > ReuseDelay=0, crcData=False, verifyData=True, > > ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, ReclamationType=0 > > Index=0, OpenCount=0, CreatePending=False, DeletePending=False > > CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes > > deduplicate=False, identifyProcess=1 > > Shreddable=False, shredCount=0 > > AutoCopy=Client, Encrypted=0, Compression=0 > > DS Extension: VolListSize=16, VolCount=1, VolLast=0 > > -> Pool BACKUPPOOL(1): Strategy=10, ClassId=0, ClassName=DISK, > > Next=6, ReclaimPool=0, HighMig=95, LowMig=90, MigProcess=2, > > Access=0, > > MaxSize=0, Cache=0, Collocate=0, Reclaim=60, MaxScratch=0, > > ReuseDelay=0, crcData=False, verifyData=True, > > ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, ReclamationType=0 > > Index=1, OpenCount=0, CreatePending=False, DeletePending=False > > CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes > > deduplicate=False, identifyProcess=1 > > Shreddable=False, shredCount=0 > > AutoCopy=Client, Encrypted=0, Compression=0 > > DS Extension: VolListSize=24, VolCount=18, VolLast=2 > > -> Pool COPYPOOL-OFFSITE(-2): Strategy=30, ClassId=4, > > ClassName=IBM3494-SUN, > > Next=0, ReclaimPool=0, HighMig=90, LowMig=70, MigProcess=1, > > Access=0, > > MaxSize=0, Cache=0, Collocate=0, Reclaim=66, MaxScratch=1500, > > ReuseDelay=0, crcData=False, verifyData=True, > > ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, ReclamationType=0 > > Index=2, OpenCount=0, CreatePending=False, DeletePending=False > > CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes > > deduplicate=False, identifyProcess=0 > > Shreddable=False, shredCount=0 > > AutoCopy=Client, Encrypted=0, Compression=0 > > AS Extension: NumDefVols=770, NumEmptyVols=0, > > NumScratchVols=770, NumRsvdScratch=0 > > -> Pool PRIMARY-ONSITE(6): Strategy=30, ClassId=3, ClassName=IBM3494, > > Next=0, ReclaimPool=0, HighMig=90, LowMig=70, MigProcess=1, > > Access=0, > > MaxSize=0, Cache=0, Collocate=0, Reclaim=63, MaxScratch=1500, > > ReuseDelay=0, crcData=False, verifyData=True, > > ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, ReclamationType=0 > > Index=3, OpenCount=0, CreatePending=False, DeletePending=False > > CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes > > deduplicate=False, identifyProcess=1 > > Shreddable=False, shredCount=0 > > AutoCopy=Client, Encrypted=0, Compression=0 > > AS Extension: NumDefVols=920, NumEmptyVols=0, > > NumScratchVols=920, NumRsvdScratch=0 > > > > > > On Tue, Jul 18, 2017 at 11:11 AM, Loon, Eric van (ITOPT3) - KLM < > > eric-van.l...@klm.com> wrote: > > > > > Hi Zoltan! > > > Try this one: issue a "show sspool" command. If the sum of > > > NumScratchVols and NumRsvdScratch equals your total amount of > > > scratch tapes, you're probably hit by this APAR: > > > http://www-01.ibm.com/support/ > > > docview.wss?uid=swg1IC77685 > > > I have bine there, either raise your maxscratch value or bounce the > > > server to reset the NumRsvdScratch value. Although the APAR is old > > > and states it's fixed in 6.2, I still get hit by it on my 6.3 > > > servers. I raised the maxscratch to 100,000 to get rid of it. These > > > reserved scratches are (in my > > > case) mainly caused by failed storage agent scratch mounts. > > > Kind regards, > > > Eric van Loon > > > Air France/KLM Storage Engine
Re: No space available in storage pool failure but there is plenty of space
Node has mount points? -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Zoltan Forray Sent: Tuesday, July 18, 2017 11:40 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] No space available in storage pool failure but there is plenty of space Yep - 100+ scratch tapes in both tape libraries. As I mentioned, there is no sign of any attempt to mount a tape and all drives were available at that time. On Tue, Jul 18, 2017 at 11:29 AM, Richard Cowen wrote: > Do you have lib volumes available (scratch/empty)? > > -Original Message- > From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf > Of Zoltan Forray > Sent: Tuesday, July 18, 2017 11:24 AM > To: ADSM-L@VM.MARIST.EDU > Subject: Re: [ADSM-L] No space available in storage pool failure but > there is plenty of space > > I already considered that. The tape pool is defined at 1500-scratch > and only 920-are used: > > 11:22:33 AM PROCESSOR : show sspool > -> Pool ARCHIVEPOOL(2): Strategy=10, ClassId=0, ClassName=DISK, > Next=6, ReclaimPool=0, HighMig=90, LowMig=70, MigProcess=1, > Access=0, > MaxSize=0, Cache=0, Collocate=0, Reclaim=60, MaxScratch=0, > ReuseDelay=0, crcData=False, verifyData=True, > ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, ReclamationType=0 > Index=0, OpenCount=0, CreatePending=False, DeletePending=False > CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes > deduplicate=False, identifyProcess=1 > Shreddable=False, shredCount=0 > AutoCopy=Client, Encrypted=0, Compression=0 > DS Extension: VolListSize=16, VolCount=1, VolLast=0 > -> Pool BACKUPPOOL(1): Strategy=10, ClassId=0, ClassName=DISK, > Next=6, ReclaimPool=0, HighMig=95, LowMig=90, MigProcess=2, > Access=0, > MaxSize=0, Cache=0, Collocate=0, Reclaim=60, MaxScratch=0, > ReuseDelay=0, crcData=False, verifyData=True, > ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, ReclamationType=0 > Index=1, OpenCount=0, CreatePending=False, DeletePending=False > CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes > deduplicate=False, identifyProcess=1 > Shreddable=False, shredCount=0 > AutoCopy=Client, Encrypted=0, Compression=0 > DS Extension: VolListSize=24, VolCount=18, VolLast=2 > -> Pool COPYPOOL-OFFSITE(-2): Strategy=30, ClassId=4, > ClassName=IBM3494-SUN, > Next=0, ReclaimPool=0, HighMig=90, LowMig=70, MigProcess=1, > Access=0, > MaxSize=0, Cache=0, Collocate=0, Reclaim=66, MaxScratch=1500, > ReuseDelay=0, crcData=False, verifyData=True, > ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, ReclamationType=0 > Index=2, OpenCount=0, CreatePending=False, DeletePending=False > CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes > deduplicate=False, identifyProcess=0 > Shreddable=False, shredCount=0 > AutoCopy=Client, Encrypted=0, Compression=0 > AS Extension: NumDefVols=770, NumEmptyVols=0, > NumScratchVols=770, NumRsvdScratch=0 > -> Pool PRIMARY-ONSITE(6): Strategy=30, ClassId=3, ClassName=IBM3494, > Next=0, ReclaimPool=0, HighMig=90, LowMig=70, MigProcess=1, > Access=0, > MaxSize=0, Cache=0, Collocate=0, Reclaim=63, MaxScratch=1500, > ReuseDelay=0, crcData=False, verifyData=True, > ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, ReclamationType=0 > Index=3, OpenCount=0, CreatePending=False, DeletePending=False > CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes > deduplicate=False, identifyProcess=1 > Shreddable=False, shredCount=0 > AutoCopy=Client, Encrypted=0, Compression=0 > AS Extension: NumDefVols=920, NumEmptyVols=0, > NumScratchVols=920, NumRsvdScratch=0 > > > On Tue, Jul 18, 2017 at 11:11 AM, Loon, Eric van (ITOPT3) - KLM < > eric-van.l...@klm.com> wrote: > > > Hi Zoltan! > > Try this one: issue a "show sspool" command. If the sum of > > NumScratchVols and NumRsvdScratch equals your total amount of > > scratch tapes, you're probably hit by this APAR: > > http://www-01.ibm.com/support/ > > docview.wss?uid=swg1IC77685 > > I have bine there, either raise your maxscratch value or bounce the > > server to reset the NumRsvdScratch value. Although the APAR is old > > and states it's fixed in 6.2, I still get hit by it on my 6.3 > > servers. I raised the maxscratch to 100,000 to get rid of it. These > > reserved scratches are (in my > > case) mainly caused by failed storage agent scratch mounts. > > Kind regards, > > Eric van Loon > > Air France/KLM Storage Engineering > > > > > > -Original Message- > > From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On > > Behalf Of Zoltan Forray > > Sent: dinsdag 18 juli 2017 14:49 > > To: ADSM-L@VM.MARIST.EDU > > Subject: No space available in storage pool failure but there is > > plenty of space > > > > TSM L
Re: No space available in storage pool failure but there is plenty of space
Yep - 100+ scratch tapes in both tape libraries. As I mentioned, there is no sign of any attempt to mount a tape and all drives were available at that time. On Tue, Jul 18, 2017 at 11:29 AM, Richard Cowen wrote: > Do you have lib volumes available (scratch/empty)? > > -Original Message- > From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of > Zoltan Forray > Sent: Tuesday, July 18, 2017 11:24 AM > To: ADSM-L@VM.MARIST.EDU > Subject: Re: [ADSM-L] No space available in storage pool failure but there > is plenty of space > > I already considered that. The tape pool is defined at 1500-scratch and > only 920-are used: > > 11:22:33 AM PROCESSOR : show sspool > -> Pool ARCHIVEPOOL(2): Strategy=10, ClassId=0, ClassName=DISK, > Next=6, ReclaimPool=0, HighMig=90, LowMig=70, MigProcess=1, > Access=0, > MaxSize=0, Cache=0, Collocate=0, Reclaim=60, MaxScratch=0, > ReuseDelay=0, crcData=False, verifyData=True, > ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, ReclamationType=0 > Index=0, OpenCount=0, CreatePending=False, DeletePending=False > CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes > deduplicate=False, identifyProcess=1 > Shreddable=False, shredCount=0 > AutoCopy=Client, Encrypted=0, Compression=0 > DS Extension: VolListSize=16, VolCount=1, VolLast=0 > -> Pool BACKUPPOOL(1): Strategy=10, ClassId=0, ClassName=DISK, > Next=6, ReclaimPool=0, HighMig=95, LowMig=90, MigProcess=2, > Access=0, > MaxSize=0, Cache=0, Collocate=0, Reclaim=60, MaxScratch=0, > ReuseDelay=0, crcData=False, verifyData=True, > ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, ReclamationType=0 > Index=1, OpenCount=0, CreatePending=False, DeletePending=False > CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes > deduplicate=False, identifyProcess=1 > Shreddable=False, shredCount=0 > AutoCopy=Client, Encrypted=0, Compression=0 > DS Extension: VolListSize=24, VolCount=18, VolLast=2 > -> Pool COPYPOOL-OFFSITE(-2): Strategy=30, ClassId=4, > ClassName=IBM3494-SUN, > Next=0, ReclaimPool=0, HighMig=90, LowMig=70, MigProcess=1, > Access=0, > MaxSize=0, Cache=0, Collocate=0, Reclaim=66, MaxScratch=1500, > ReuseDelay=0, crcData=False, verifyData=True, > ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, ReclamationType=0 > Index=2, OpenCount=0, CreatePending=False, DeletePending=False > CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes > deduplicate=False, identifyProcess=0 > Shreddable=False, shredCount=0 > AutoCopy=Client, Encrypted=0, Compression=0 > AS Extension: NumDefVols=770, NumEmptyVols=0, > NumScratchVols=770, NumRsvdScratch=0 > -> Pool PRIMARY-ONSITE(6): Strategy=30, ClassId=3, ClassName=IBM3494, > Next=0, ReclaimPool=0, HighMig=90, LowMig=70, MigProcess=1, > Access=0, > MaxSize=0, Cache=0, Collocate=0, Reclaim=63, MaxScratch=1500, > ReuseDelay=0, crcData=False, verifyData=True, > ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, ReclamationType=0 > Index=3, OpenCount=0, CreatePending=False, DeletePending=False > CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes > deduplicate=False, identifyProcess=1 > Shreddable=False, shredCount=0 > AutoCopy=Client, Encrypted=0, Compression=0 > AS Extension: NumDefVols=920, NumEmptyVols=0, > NumScratchVols=920, NumRsvdScratch=0 > > > On Tue, Jul 18, 2017 at 11:11 AM, Loon, Eric van (ITOPT3) - KLM < > eric-van.l...@klm.com> wrote: > > > Hi Zoltan! > > Try this one: issue a "show sspool" command. If the sum of > > NumScratchVols and NumRsvdScratch equals your total amount of scratch > > tapes, you're probably hit by this APAR: > > http://www-01.ibm.com/support/ > > docview.wss?uid=swg1IC77685 > > I have bine there, either raise your maxscratch value or bounce the > > server to reset the NumRsvdScratch value. Although the APAR is old and > > states it's fixed in 6.2, I still get hit by it on my 6.3 servers. I > > raised the maxscratch to 100,000 to get rid of it. These reserved > > scratches are (in my > > case) mainly caused by failed storage agent scratch mounts. > > Kind regards, > > Eric van Loon > > Air France/KLM Storage Engineering > > > > > > -Original Message- > > From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf > > Of Zoltan Forray > > Sent: dinsdag 18 juli 2017 14:49 > > To: ADSM-L@VM.MARIST.EDU > > Subject: No space available in storage pool failure but there is > > plenty of space > > > > TSM Linux server 7.1.6.3. Client is Linux 7.1.6.4. > > > > This morning at 6am is the second time I have had this "failure" when > > it isn't true. > > > > ANR0522W Transaction failed for session 19482 for node > > VCU-GS1.CHPC.VCU.EDU (Linux x86-64) - no space available in storage > > pool BACKUPPOOL and all successor
Re: No space available in storage pool failure but there is plenty of space
Do you have lib volumes available (scratch/empty)? -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Zoltan Forray Sent: Tuesday, July 18, 2017 11:24 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] No space available in storage pool failure but there is plenty of space I already considered that. The tape pool is defined at 1500-scratch and only 920-are used: 11:22:33 AM PROCESSOR : show sspool -> Pool ARCHIVEPOOL(2): Strategy=10, ClassId=0, ClassName=DISK, Next=6, ReclaimPool=0, HighMig=90, LowMig=70, MigProcess=1, Access=0, MaxSize=0, Cache=0, Collocate=0, Reclaim=60, MaxScratch=0, ReuseDelay=0, crcData=False, verifyData=True, ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, ReclamationType=0 Index=0, OpenCount=0, CreatePending=False, DeletePending=False CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes deduplicate=False, identifyProcess=1 Shreddable=False, shredCount=0 AutoCopy=Client, Encrypted=0, Compression=0 DS Extension: VolListSize=16, VolCount=1, VolLast=0 -> Pool BACKUPPOOL(1): Strategy=10, ClassId=0, ClassName=DISK, Next=6, ReclaimPool=0, HighMig=95, LowMig=90, MigProcess=2, Access=0, MaxSize=0, Cache=0, Collocate=0, Reclaim=60, MaxScratch=0, ReuseDelay=0, crcData=False, verifyData=True, ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, ReclamationType=0 Index=1, OpenCount=0, CreatePending=False, DeletePending=False CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes deduplicate=False, identifyProcess=1 Shreddable=False, shredCount=0 AutoCopy=Client, Encrypted=0, Compression=0 DS Extension: VolListSize=24, VolCount=18, VolLast=2 -> Pool COPYPOOL-OFFSITE(-2): Strategy=30, ClassId=4, ClassName=IBM3494-SUN, Next=0, ReclaimPool=0, HighMig=90, LowMig=70, MigProcess=1, Access=0, MaxSize=0, Cache=0, Collocate=0, Reclaim=66, MaxScratch=1500, ReuseDelay=0, crcData=False, verifyData=True, ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, ReclamationType=0 Index=2, OpenCount=0, CreatePending=False, DeletePending=False CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes deduplicate=False, identifyProcess=0 Shreddable=False, shredCount=0 AutoCopy=Client, Encrypted=0, Compression=0 AS Extension: NumDefVols=770, NumEmptyVols=0, NumScratchVols=770, NumRsvdScratch=0 -> Pool PRIMARY-ONSITE(6): Strategy=30, ClassId=3, ClassName=IBM3494, Next=0, ReclaimPool=0, HighMig=90, LowMig=70, MigProcess=1, Access=0, MaxSize=0, Cache=0, Collocate=0, Reclaim=63, MaxScratch=1500, ReuseDelay=0, crcData=False, verifyData=True, ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, ReclamationType=0 Index=3, OpenCount=0, CreatePending=False, DeletePending=False CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes deduplicate=False, identifyProcess=1 Shreddable=False, shredCount=0 AutoCopy=Client, Encrypted=0, Compression=0 AS Extension: NumDefVols=920, NumEmptyVols=0, NumScratchVols=920, NumRsvdScratch=0 On Tue, Jul 18, 2017 at 11:11 AM, Loon, Eric van (ITOPT3) - KLM < eric-van.l...@klm.com> wrote: > Hi Zoltan! > Try this one: issue a "show sspool" command. If the sum of > NumScratchVols and NumRsvdScratch equals your total amount of scratch > tapes, you're probably hit by this APAR: > http://www-01.ibm.com/support/ > docview.wss?uid=swg1IC77685 > I have bine there, either raise your maxscratch value or bounce the > server to reset the NumRsvdScratch value. Although the APAR is old and > states it's fixed in 6.2, I still get hit by it on my 6.3 servers. I > raised the maxscratch to 100,000 to get rid of it. These reserved > scratches are (in my > case) mainly caused by failed storage agent scratch mounts. > Kind regards, > Eric van Loon > Air France/KLM Storage Engineering > > > -Original Message- > From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf > Of Zoltan Forray > Sent: dinsdag 18 juli 2017 14:49 > To: ADSM-L@VM.MARIST.EDU > Subject: No space available in storage pool failure but there is > plenty of space > > TSM Linux server 7.1.6.3. Client is Linux 7.1.6.4. > > This morning at 6am is the second time I have had this "failure" when > it isn't true. > > ANR0522W Transaction failed for session 19482 for node > VCU-GS1.CHPC.VCU.EDU (Linux x86-64) - no space available in storage > pool BACKUPPOOL and all successor pools. > > But it isn't true. The BACKUPPOOL pool is only 92% used (of 9TB) and > the hi/low triggers are 95/90. I checked activity logs and there > haven't been any recent migrations. > > The NEXTPOOL is tape and all 9-drives are free and the MAXSCRATCH > count hasn't been hit. > > The backup only transferred 60GB (of 108TB examined) before dying due > to this erroneous error. > > No other
Re: No space available in storage pool failure but there is plenty of space
No way of knowing. This server is backed-up "every so often" by the owner and then usually multiple terabytes over several days. On Tue, Jul 18, 2017 at 9:39 AM, Rick Adamson wrote: > Zoltan, > > Could it be that the amount of data that the backup is attempting to store > exceeds the amount of available storage space in the pool? > > Recall that before sending the data the backup validates with the server > that there is sufficient space to store the data. If I recall correctly > that number is before compression. > > > > Also noted this in your storage pool details below? > > Pct Logical: 99.9 > > > > -Rick Adamson > > > > > > -Original Message- > > From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of > Zoltan Forray > > Sent: Tuesday, July 18, 2017 9:13 AM > > To: ADSM-L@VM.MARIST.EDU > > Subject: Re: [ADSM-L] No space available in storage pool failure but there > is plenty of space > > > > I should have mentioned that no, I do not set file size limits: > > > > 9:12:03 AM PROCESSOR : q stg backuppool f=d > > Storage Pool Name: BACKUPPOOL > > Storage Pool Type: Primary > > Device Class Name: DISK > > Storage Type: DEVCLASS > >Cloud Type: > > Cloud URL: > >Cloud Identity: > >Cloud Location: > >Estimated Capacity: 8,800 G > >Space Trigger Util: 92.7 > > Pct Util: 92.7 > > Pct Migr: 92.7 > > Pct Logical: 99.9 > > High Mig Pct: 95 > > Low Mig Pct: 90 > > Migration Delay: 0 > >Migration Continue: Yes > > Migration Processes: 2 > > Reclamation Processes: > > Next Storage Pool: PRIMARY-ONSITE > > Reclaim Storage Pool: > > * Maximum Size Threshold: No Limit* > >Access: Read/Write > > Description: > > Overflow Location: > > Cache Migrated Files?: No > >Collocate?: > > Reclamation Threshold: > > Offsite Reclamation Limit: > > Maximum Scratch Volumes Allowed: > >Number of Scratch Volumes Used: > > Delay Period for Volume Reuse: > >Migration in Progress?: No > > Amount Migrated (MB): 0.00 > > Elapsed Migration Time (seconds): 0 > > Reclamation in Progress?: > >Last Update by (administrator): ZFORRAY > > Last Update Date/Time: 07/08/2017 09:55:26 > > Storage Pool Data Format: Native > > Copy Storage Pool(s): > > Active Data Pool(s): > > Continue Copy on Error?: Yes > > CRC Data: No > > Reclamation Type: > > Overwrite Data when Deleted: > > Deduplicate Data?: No Processes For Identifying > Duplicates: > >Compressed: > > Deduplication Savings: > > Compression Savings: > > Total Space Saved: > >Auto-copy Mode: Client Contains Data Deduplicated > by Client?: No > > Maximum Simultaneous Writers: > > Protection Storage Pool: > > Date of Last Protection: > > Deduplicate Requires Backup?: > > Encrypted: > > Space Utilized (MB): > > > > > > On Tue, Jul 18, 2017 at 8:56 AM, Sasa Drnjevic > > wrote: > > > > > Could be a huge sparse file if you have Maximum Size Threshold set for > > > the pool? > > > > > > Regards, > > > > > > -- > > > Sasa Drnjevic > > > www.srce.unizg.hr > > > > > > > > > > > > > > > On 18.7.2017. 14:48, Zoltan Forray wrote: > > > > TSM Linux server 7.1.6.3. Client is Linux 7.1.6.4. > > > > > > > > This morning at 6am is the second time I have had this "failure" > > > > when it isn't true. > > > > > > > > ANR0522W Transaction failed for session 19482 for node > > > VCU-GS1.CHPC.VCU.EDU > > > > (Linux x86-64) - no space available in storage pool BACKUPPOOL and > > > > all successor pools. > > > > > > > > But it isn't true. The BACKUPPOOL pool is only 92% used (of 9TB) > > > > and the hi/low triggers are 95/90. I checked activity logs and > > > > there haven't > > > been > > > > any recent migrations. > > > > > > > > The NEXTPOOL is tape and all 9-drives are free and the MAXSCRATCH > > > > count hasn't been hit. > > > > > > > > The backup only transferred 60GB (of 108TB examined) before dying > > > > due to this erroneous error. > > > > > > > > No other errors in the activity log. So, what gives? > > > > > > > > -- >
Re: No space available in storage pool failure but there is plenty of space
I already considered that. The tape pool is defined at 1500-scratch and only 920-are used: 11:22:33 AM PROCESSOR : show sspool -> Pool ARCHIVEPOOL(2): Strategy=10, ClassId=0, ClassName=DISK, Next=6, ReclaimPool=0, HighMig=90, LowMig=70, MigProcess=1, Access=0, MaxSize=0, Cache=0, Collocate=0, Reclaim=60, MaxScratch=0, ReuseDelay=0, crcData=False, verifyData=True, ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, ReclamationType=0 Index=0, OpenCount=0, CreatePending=False, DeletePending=False CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes deduplicate=False, identifyProcess=1 Shreddable=False, shredCount=0 AutoCopy=Client, Encrypted=0, Compression=0 DS Extension: VolListSize=16, VolCount=1, VolLast=0 -> Pool BACKUPPOOL(1): Strategy=10, ClassId=0, ClassName=DISK, Next=6, ReclaimPool=0, HighMig=95, LowMig=90, MigProcess=2, Access=0, MaxSize=0, Cache=0, Collocate=0, Reclaim=60, MaxScratch=0, ReuseDelay=0, crcData=False, verifyData=True, ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, ReclamationType=0 Index=1, OpenCount=0, CreatePending=False, DeletePending=False CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes deduplicate=False, identifyProcess=1 Shreddable=False, shredCount=0 AutoCopy=Client, Encrypted=0, Compression=0 DS Extension: VolListSize=24, VolCount=18, VolLast=2 -> Pool COPYPOOL-OFFSITE(-2): Strategy=30, ClassId=4, ClassName=IBM3494-SUN, Next=0, ReclaimPool=0, HighMig=90, LowMig=70, MigProcess=1, Access=0, MaxSize=0, Cache=0, Collocate=0, Reclaim=66, MaxScratch=1500, ReuseDelay=0, crcData=False, verifyData=True, ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, ReclamationType=0 Index=2, OpenCount=0, CreatePending=False, DeletePending=False CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes deduplicate=False, identifyProcess=0 Shreddable=False, shredCount=0 AutoCopy=Client, Encrypted=0, Compression=0 AS Extension: NumDefVols=770, NumEmptyVols=0, NumScratchVols=770, NumRsvdScratch=0 -> Pool PRIMARY-ONSITE(6): Strategy=30, ClassId=3, ClassName=IBM3494, Next=0, ReclaimPool=0, HighMig=90, LowMig=70, MigProcess=1, Access=0, MaxSize=0, Cache=0, Collocate=0, Reclaim=63, MaxScratch=1500, ReuseDelay=0, crcData=False, verifyData=True, ReclaimProcess=1, OffsiteReclaimLimit=NoLimit, ReclamationType=0 Index=3, OpenCount=0, CreatePending=False, DeletePending=False CopyPoolCount=0, CopyPoolIdList=, CopyContinue=Yes deduplicate=False, identifyProcess=1 Shreddable=False, shredCount=0 AutoCopy=Client, Encrypted=0, Compression=0 AS Extension: NumDefVols=920, NumEmptyVols=0, NumScratchVols=920, NumRsvdScratch=0 On Tue, Jul 18, 2017 at 11:11 AM, Loon, Eric van (ITOPT3) - KLM < eric-van.l...@klm.com> wrote: > Hi Zoltan! > Try this one: issue a "show sspool" command. If the sum of NumScratchVols > and NumRsvdScratch equals your total amount of scratch tapes, you're > probably hit by this APAR: http://www-01.ibm.com/support/ > docview.wss?uid=swg1IC77685 > I have bine there, either raise your maxscratch value or bounce the server > to reset the NumRsvdScratch value. Although the APAR is old and states it's > fixed in 6.2, I still get hit by it on my 6.3 servers. I raised the > maxscratch to 100,000 to get rid of it. These reserved scratches are (in my > case) mainly caused by failed storage agent scratch mounts. > Kind regards, > Eric van Loon > Air France/KLM Storage Engineering > > > -Original Message- > From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of > Zoltan Forray > Sent: dinsdag 18 juli 2017 14:49 > To: ADSM-L@VM.MARIST.EDU > Subject: No space available in storage pool failure but there is plenty of > space > > TSM Linux server 7.1.6.3. Client is Linux 7.1.6.4. > > This morning at 6am is the second time I have had this "failure" when it > isn't true. > > ANR0522W Transaction failed for session 19482 for node > VCU-GS1.CHPC.VCU.EDU (Linux x86-64) - no space available in storage pool > BACKUPPOOL and all successor pools. > > But it isn't true. The BACKUPPOOL pool is only 92% used (of 9TB) and the > hi/low triggers are 95/90. I checked activity logs and there haven't been > any recent migrations. > > The NEXTPOOL is tape and all 9-drives are free and the MAXSCRATCH count > hasn't been hit. > > The backup only transferred 60GB (of 108TB examined) before dying due to > this erroneous error. > > No other errors in the activity log. So, what gives? > > -- > *Zoltan Forray* > Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator Xymon > Monitor Administrator VMware Administrator Virginia Commonwealth University > UCC/Office of Technology Services www.ucc.vcu.edu zfor...@vcu.edu - > 804-828-4807 Don't be a phishing victim - VCU and other
Re: No space available in storage pool failure but there is plenty of space
Hi Zoltan! Try this one: issue a "show sspool" command. If the sum of NumScratchVols and NumRsvdScratch equals your total amount of scratch tapes, you're probably hit by this APAR: http://www-01.ibm.com/support/docview.wss?uid=swg1IC77685 I have bine there, either raise your maxscratch value or bounce the server to reset the NumRsvdScratch value. Although the APAR is old and states it's fixed in 6.2, I still get hit by it on my 6.3 servers. I raised the maxscratch to 100,000 to get rid of it. These reserved scratches are (in my case) mainly caused by failed storage agent scratch mounts. Kind regards, Eric van Loon Air France/KLM Storage Engineering -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Zoltan Forray Sent: dinsdag 18 juli 2017 14:49 To: ADSM-L@VM.MARIST.EDU Subject: No space available in storage pool failure but there is plenty of space TSM Linux server 7.1.6.3. Client is Linux 7.1.6.4. This morning at 6am is the second time I have had this "failure" when it isn't true. ANR0522W Transaction failed for session 19482 for node VCU-GS1.CHPC.VCU.EDU (Linux x86-64) - no space available in storage pool BACKUPPOOL and all successor pools. But it isn't true. The BACKUPPOOL pool is only 92% used (of 9TB) and the hi/low triggers are 95/90. I checked activity logs and there haven't been any recent migrations. The NEXTPOOL is tape and all 9-drives are free and the MAXSCRATCH count hasn't been hit. The backup only transferred 60GB (of 108TB examined) before dying due to this erroneous error. No other errors in the activity log. So, what gives? -- *Zoltan Forray* Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator Xymon Monitor Administrator VMware Administrator Virginia Commonwealth University UCC/Office of Technology Services www.ucc.vcu.edu zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://infosecurity.vcu.edu/phishing.html For information, services and offers, please visit our web site: http://www.klm.com. This e-mail and any attachment may contain confidential and privileged material intended for the addressee only. If you are not the addressee, you are notified that no part of the e-mail or any attachment may be disclosed, copied or distributed, and that any other action related to this e-mail or attachment is strictly prohibited, and may be unlawful. If you have received this e-mail by error, please notify the sender immediately by return e-mail, and delete this message. Koninklijke Luchtvaart Maatschappij NV (KLM), its subsidiaries and/or its employees shall not be liable for the incorrect or incomplete transmission of this e-mail or any attachments, nor responsible for any delay in receipt. Koninklijke Luchtvaart Maatschappij N.V. (also known as KLM Royal Dutch Airlines) is registered in Amstelveen, The Netherlands, with registered number 33014286
Re: No space available in storage pool failure but there is plenty of space
Zoltan, Could it be that the amount of data that the backup is attempting to store exceeds the amount of available storage space in the pool? Recall that before sending the data the backup validates with the server that there is sufficient space to store the data. If I recall correctly that number is before compression. Also noted this in your storage pool details below? Pct Logical: 99.9 -Rick Adamson -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Zoltan Forray Sent: Tuesday, July 18, 2017 9:13 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] No space available in storage pool failure but there is plenty of space I should have mentioned that no, I do not set file size limits: 9:12:03 AM PROCESSOR : q stg backuppool f=d Storage Pool Name: BACKUPPOOL Storage Pool Type: Primary Device Class Name: DISK Storage Type: DEVCLASS Cloud Type: Cloud URL: Cloud Identity: Cloud Location: Estimated Capacity: 8,800 G Space Trigger Util: 92.7 Pct Util: 92.7 Pct Migr: 92.7 Pct Logical: 99.9 High Mig Pct: 95 Low Mig Pct: 90 Migration Delay: 0 Migration Continue: Yes Migration Processes: 2 Reclamation Processes: Next Storage Pool: PRIMARY-ONSITE Reclaim Storage Pool: * Maximum Size Threshold: No Limit* Access: Read/Write Description: Overflow Location: Cache Migrated Files?: No Collocate?: Reclamation Threshold: Offsite Reclamation Limit: Maximum Scratch Volumes Allowed: Number of Scratch Volumes Used: Delay Period for Volume Reuse: Migration in Progress?: No Amount Migrated (MB): 0.00 Elapsed Migration Time (seconds): 0 Reclamation in Progress?: Last Update by (administrator): ZFORRAY Last Update Date/Time: 07/08/2017 09:55:26 Storage Pool Data Format: Native Copy Storage Pool(s): Active Data Pool(s): Continue Copy on Error?: Yes CRC Data: No Reclamation Type: Overwrite Data when Deleted: Deduplicate Data?: No Processes For Identifying Duplicates: Compressed: Deduplication Savings: Compression Savings: Total Space Saved: Auto-copy Mode: Client Contains Data Deduplicated by Client?: No Maximum Simultaneous Writers: Protection Storage Pool: Date of Last Protection: Deduplicate Requires Backup?: Encrypted: Space Utilized (MB): On Tue, Jul 18, 2017 at 8:56 AM, Sasa Drnjevic wrote: > Could be a huge sparse file if you have Maximum Size Threshold set for > the pool? > > Regards, > > -- > Sasa Drnjevic > www.srce.unizg.hr > > > > > On 18.7.2017. 14:48, Zoltan Forray wrote: > > TSM Linux server 7.1.6.3. Client is Linux 7.1.6.4. > > > > This morning at 6am is the second time I have had this "failure" > > when it isn't true. > > > > ANR0522W Transaction failed for session 19482 for node > VCU-GS1.CHPC.VCU.EDU > > (Linux x86-64) - no space available in storage pool BACKUPPOOL and > > all successor pools. > > > > But it isn't true. The BACKUPPOOL pool is only 92% used (of 9TB) > > and the hi/low triggers are 95/90. I checked activity logs and > > there haven't > been > > any recent migrations. > > > > The NEXTPOOL is tape and all 9-drives are free and the MAXSCRATCH > > count hasn't been hit. > > > > The backup only transferred 60GB (of 108TB examined) before dying > > due to this erroneous error. > > > > No other errors in the activity log. So, what gives? > > > > -- > > *Zoltan Forray* > > Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator > > Xymon Monitor Administrator VMware Administrator Virginia > > Commonwealth University UCC/Office of Technology Services > > www.ucc.vcu.edu zfor...@vcu.edu - 804-828-4807 Don't be a phishing > > victim - VCU and other reputable organizations will never use email > > to request that you reply with your password, social security number > > or confidential personal information. For more details visit > > https://urldefense.proofpoint.com/v2/url?u=http-3A__infosecurity.vcu.edu_phishing.html&d=DwIGaQ&c=AzgFQeXLLKhxSQaoFCm29A&r=uJG3UnPaeoz9naeIzbwWFddVED
Re: No space available in storage pool failure but there is plenty of space
Long shot...Maybe this could help: http://www-01.ibm.com/support/docview.wss?uid=swg21684682 ... This problem is seen for an almost full (sequential) storage pool as well as for a pool that has enough space available. If the storage pool gets full while a backup/archive operation is running, it will fail with the same error, even if there is a next pool with sufficient space available. ... I understand that your pool is not sequential but random disk, but examine the support link it may be the problem even with random device class... Regards, -- Sasa Drnjevic www.srce.unizg.hr On 18.7.2017. 15:15, Zoltan Forray wrote: > No, the pool wasn't full before it started and it still isn't full. > > All tape drives are available for the NEXTPOOL and were available when this > error occurred at 6am today. > > This pool uses fixed DISK volumes, not FILEDEV class. > > On Tue, Jul 18, 2017 at 9:12 AM, Efim wrote: > >> Hi, >> You can get this error if the storage pool gets full during backup (no >> scratch tapes, mount points). >> If this pool is full before backup starts - it will go to the next storage >> pool. >> Mark this pool as readonly and start backup. it will switch to the tape >> (next storage pool). >> Efim >> >> >>> 18 июля 2017 г., в 15:48, Zoltan Forray написал(а): >>> >>> TSM Linux server 7.1.6.3. Client is Linux 7.1.6.4. >>> >>> This morning at 6am is the second time I have had this "failure" when it >>> isn't true. >>> >>> ANR0522W Transaction failed for session 19482 for node >> VCU-GS1.CHPC.VCU.EDU >>> (Linux x86-64) - no space available in storage pool BACKUPPOOL and all >>> successor pools. >>> >>> But it isn't true. The BACKUPPOOL pool is only 92% used (of 9TB) and the >>> hi/low triggers are 95/90. I checked activity logs and there haven't >> been >>> any recent migrations. >>> >>> The NEXTPOOL is tape and all 9-drives are free and the MAXSCRATCH count >>> hasn't been hit. >>> >>> The backup only transferred 60GB (of 108TB examined) before dying due to >>> this erroneous error. >>> >>> No other errors in the activity log. So, what gives? >>> >>> -- >>> *Zoltan Forray* >>> Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator >>> Xymon Monitor Administrator >>> VMware Administrator >>> Virginia Commonwealth University >>> UCC/Office of Technology Services >>> www.ucc.vcu.edu >>> zfor...@vcu.edu - 804-828-4807 >>> Don't be a phishing victim - VCU and other reputable organizations will >>> never use email to request that you reply with your password, social >>> security number or confidential personal information. For more details >>> visit http://infosecurity.vcu.edu/phishing.html >> > > >
Re: No space available in storage pool failure but there is plenty of space
No, the pool wasn't full before it started and it still isn't full. All tape drives are available for the NEXTPOOL and were available when this error occurred at 6am today. This pool uses fixed DISK volumes, not FILEDEV class. On Tue, Jul 18, 2017 at 9:12 AM, Efim wrote: > Hi, > You can get this error if the storage pool gets full during backup (no > scratch tapes, mount points). > If this pool is full before backup starts - it will go to the next storage > pool. > Mark this pool as readonly and start backup. it will switch to the tape > (next storage pool). > Efim > > > > 18 июля 2017 г., в 15:48, Zoltan Forray написал(а): > > > > TSM Linux server 7.1.6.3. Client is Linux 7.1.6.4. > > > > This morning at 6am is the second time I have had this "failure" when it > > isn't true. > > > > ANR0522W Transaction failed for session 19482 for node > VCU-GS1.CHPC.VCU.EDU > > (Linux x86-64) - no space available in storage pool BACKUPPOOL and all > > successor pools. > > > > But it isn't true. The BACKUPPOOL pool is only 92% used (of 9TB) and the > > hi/low triggers are 95/90. I checked activity logs and there haven't > been > > any recent migrations. > > > > The NEXTPOOL is tape and all 9-drives are free and the MAXSCRATCH count > > hasn't been hit. > > > > The backup only transferred 60GB (of 108TB examined) before dying due to > > this erroneous error. > > > > No other errors in the activity log. So, what gives? > > > > -- > > *Zoltan Forray* > > Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator > > Xymon Monitor Administrator > > VMware Administrator > > Virginia Commonwealth University > > UCC/Office of Technology Services > > www.ucc.vcu.edu > > zfor...@vcu.edu - 804-828-4807 > > Don't be a phishing victim - VCU and other reputable organizations will > > never use email to request that you reply with your password, social > > security number or confidential personal information. For more details > > visit http://infosecurity.vcu.edu/phishing.html > -- *Zoltan Forray* Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator Xymon Monitor Administrator VMware Administrator Virginia Commonwealth University UCC/Office of Technology Services www.ucc.vcu.edu zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://infosecurity.vcu.edu/phishing.html
Re: No space available in storage pool failure but there is plenty of space
I should have mentioned that no, I do not set file size limits: 9:12:03 AM PROCESSOR : q stg backuppool f=d Storage Pool Name: BACKUPPOOL Storage Pool Type: Primary Device Class Name: DISK Storage Type: DEVCLASS Cloud Type: Cloud URL: Cloud Identity: Cloud Location: Estimated Capacity: 8,800 G Space Trigger Util: 92.7 Pct Util: 92.7 Pct Migr: 92.7 Pct Logical: 99.9 High Mig Pct: 95 Low Mig Pct: 90 Migration Delay: 0 Migration Continue: Yes Migration Processes: 2 Reclamation Processes: Next Storage Pool: PRIMARY-ONSITE Reclaim Storage Pool: * Maximum Size Threshold: No Limit* Access: Read/Write Description: Overflow Location: Cache Migrated Files?: No Collocate?: Reclamation Threshold: Offsite Reclamation Limit: Maximum Scratch Volumes Allowed: Number of Scratch Volumes Used: Delay Period for Volume Reuse: Migration in Progress?: No Amount Migrated (MB): 0.00 Elapsed Migration Time (seconds): 0 Reclamation in Progress?: Last Update by (administrator): ZFORRAY Last Update Date/Time: 07/08/2017 09:55:26 Storage Pool Data Format: Native Copy Storage Pool(s): Active Data Pool(s): Continue Copy on Error?: Yes CRC Data: No Reclamation Type: Overwrite Data when Deleted: Deduplicate Data?: No Processes For Identifying Duplicates: Compressed: Deduplication Savings: Compression Savings: Total Space Saved: Auto-copy Mode: Client Contains Data Deduplicated by Client?: No Maximum Simultaneous Writers: Protection Storage Pool: Date of Last Protection: Deduplicate Requires Backup?: Encrypted: Space Utilized (MB): On Tue, Jul 18, 2017 at 8:56 AM, Sasa Drnjevic wrote: > Could be a huge sparse file if you have Maximum Size Threshold set for > the pool? > > Regards, > > -- > Sasa Drnjevic > www.srce.unizg.hr > > > > > On 18.7.2017. 14:48, Zoltan Forray wrote: > > TSM Linux server 7.1.6.3. Client is Linux 7.1.6.4. > > > > This morning at 6am is the second time I have had this "failure" when it > > isn't true. > > > > ANR0522W Transaction failed for session 19482 for node > VCU-GS1.CHPC.VCU.EDU > > (Linux x86-64) - no space available in storage pool BACKUPPOOL and all > > successor pools. > > > > But it isn't true. The BACKUPPOOL pool is only 92% used (of 9TB) and the > > hi/low triggers are 95/90. I checked activity logs and there haven't > been > > any recent migrations. > > > > The NEXTPOOL is tape and all 9-drives are free and the MAXSCRATCH count > > hasn't been hit. > > > > The backup only transferred 60GB (of 108TB examined) before dying due to > > this erroneous error. > > > > No other errors in the activity log. So, what gives? > > > > -- > > *Zoltan Forray* > > Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator > > Xymon Monitor Administrator > > VMware Administrator > > Virginia Commonwealth University > > UCC/Office of Technology Services > > www.ucc.vcu.edu > > zfor...@vcu.edu - 804-828-4807 > > Don't be a phishing victim - VCU and other reputable organizations will > > never use email to request that you reply with your password, social > > security number or confidential personal information. For more details > > visit http://infosecurity.vcu.edu/phishing.html > > > -- *Zoltan Forray* Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator Xymon Monitor Administrator VMware Administrator Virginia Commonwealth University UCC/Office of Technology Services www.ucc.vcu.edu zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://infosecurity.vcu.edu/phishing.html
Re: No space available in storage pool failure but there is plenty of space
Hi, You can get this error if the storage pool gets full during backup (no scratch tapes, mount points). If this pool is full before backup starts - it will go to the next storage pool. Mark this pool as readonly and start backup. it will switch to the tape (next storage pool). Efim > 18 июля 2017 г., в 15:48, Zoltan Forray написал(а): > > TSM Linux server 7.1.6.3. Client is Linux 7.1.6.4. > > This morning at 6am is the second time I have had this "failure" when it > isn't true. > > ANR0522W Transaction failed for session 19482 for node VCU-GS1.CHPC.VCU.EDU > (Linux x86-64) - no space available in storage pool BACKUPPOOL and all > successor pools. > > But it isn't true. The BACKUPPOOL pool is only 92% used (of 9TB) and the > hi/low triggers are 95/90. I checked activity logs and there haven't been > any recent migrations. > > The NEXTPOOL is tape and all 9-drives are free and the MAXSCRATCH count > hasn't been hit. > > The backup only transferred 60GB (of 108TB examined) before dying due to > this erroneous error. > > No other errors in the activity log. So, what gives? > > -- > *Zoltan Forray* > Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator > Xymon Monitor Administrator > VMware Administrator > Virginia Commonwealth University > UCC/Office of Technology Services > www.ucc.vcu.edu > zfor...@vcu.edu - 804-828-4807 > Don't be a phishing victim - VCU and other reputable organizations will > never use email to request that you reply with your password, social > security number or confidential personal information. For more details > visit http://infosecurity.vcu.edu/phishing.html
Re: No space available in storage pool failure but there is plenty of space
Could be a huge sparse file if you have Maximum Size Threshold set for the pool? Regards, -- Sasa Drnjevic www.srce.unizg.hr On 18.7.2017. 14:48, Zoltan Forray wrote: > TSM Linux server 7.1.6.3. Client is Linux 7.1.6.4. > > This morning at 6am is the second time I have had this "failure" when it > isn't true. > > ANR0522W Transaction failed for session 19482 for node VCU-GS1.CHPC.VCU.EDU > (Linux x86-64) - no space available in storage pool BACKUPPOOL and all > successor pools. > > But it isn't true. The BACKUPPOOL pool is only 92% used (of 9TB) and the > hi/low triggers are 95/90. I checked activity logs and there haven't been > any recent migrations. > > The NEXTPOOL is tape and all 9-drives are free and the MAXSCRATCH count > hasn't been hit. > > The backup only transferred 60GB (of 108TB examined) before dying due to > this erroneous error. > > No other errors in the activity log. So, what gives? > > -- > *Zoltan Forray* > Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator > Xymon Monitor Administrator > VMware Administrator > Virginia Commonwealth University > UCC/Office of Technology Services > www.ucc.vcu.edu > zfor...@vcu.edu - 804-828-4807 > Don't be a phishing victim - VCU and other reputable organizations will > never use email to request that you reply with your password, social > security number or confidential personal information. For more details > visit http://infosecurity.vcu.edu/phishing.html >
No space available in storage pool failure but there is plenty of space
TSM Linux server 7.1.6.3. Client is Linux 7.1.6.4. This morning at 6am is the second time I have had this "failure" when it isn't true. ANR0522W Transaction failed for session 19482 for node VCU-GS1.CHPC.VCU.EDU (Linux x86-64) - no space available in storage pool BACKUPPOOL and all successor pools. But it isn't true. The BACKUPPOOL pool is only 92% used (of 9TB) and the hi/low triggers are 95/90. I checked activity logs and there haven't been any recent migrations. The NEXTPOOL is tape and all 9-drives are free and the MAXSCRATCH count hasn't been hit. The backup only transferred 60GB (of 108TB examined) before dying due to this erroneous error. No other errors in the activity log. So, what gives? -- *Zoltan Forray* Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator Xymon Monitor Administrator VMware Administrator Virginia Commonwealth University UCC/Office of Technology Services www.ucc.vcu.edu zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://infosecurity.vcu.edu/phishing.html
Re: Dynamically increasing size of tsmarchlog filesystem
Thanks for the verification. We have successfully increased tsmarchlog. On Sat, Jul 15, 2017 at 3:57 AM, Giacomo Testa wrote: > Hi, > > There shouldn't be any issues extending the logical volume using lvextend, > and extending the filesystem on this logical volume, using the appropriate > filesystem command. > > See also: > http://www.mail-archive.com/adsm-l@vm.marist.edu/msg98836.html > http://www.mail-archive.com/adsm-l@vm.marist.edu/msg99103.html > > Giacomo Testa > > -Original Message- > From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of > Zoltan Forray > Sent: Friday, July 14, 2017 18:21 > To: ADSM-L@VM.MARIST.EDU > Subject: [ADSM-L] Dynamically increasing size of tsmarchlog filesystem > > My /tsmarchlog filesystem is constantly filling up. Are there any issues > with using lvextend to resize it, after doing a full DBBackup and then > shutting down the TSM server, of course. Tried compressing archlog but > that seems to add lots of CPU overhead. > > This is a 7.1.6.3 Linux TSM server on RHEL7 > > -- > *Zoltan Forray* > Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator Xymon > Monitor Administrator VMware Administrator Virginia Commonwealth University > UCC/Office of Technology Services www.ucc.vcu.edu zfor...@vcu.edu - > 804-828-4807 Don't be a phishing victim - VCU and other reputable > organizations will never use email to request that you reply with your > password, social security number or confidential personal information. For > more details visit http://infosecurity.vcu.edu/phishing.html > -- *Zoltan Forray* Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator Xymon Monitor Administrator VMware Administrator Virginia Commonwealth University UCC/Office of Technology Services www.ucc.vcu.edu zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://infosecurity.vcu.edu/phishing.html
Script help
Hi to all
Need a little help with this script below , need to get the summary amount
backup result for the node .
Now I got a lot of entries from this script as:
Protect: POSTBACK>run q_obj_0 IHPPROD_ORA
Nodename Date (D/M/Y) Begin timeEnd time
Elapsed time in Minutes Num Obj Num Obj Failed Bytes
- - - -
--- --- ---
IHPPROD_ORA 2017-07-1810.00.20 10.04.21 4
1 0 5 Gb
IHPPROD_ORA 2017-07-1810.00.23 10.05.14 4
1 0 6 Gb
IHPPROD_ORA 2017-07-1810.05.23 10.06.22 0
1 0 822 Mb
IHPPROD_ORA 2017-07-1810.00.22 10.07.00 6
1 0 10 Gb
IHPPROD_ORA 2017-07-1810.07.06 10.08.59 1
1 0 3 Gb
IHPPROD_ORA 2017-07-1810.06.29 10.09.26 2
1 0 4 Gb
IHPPROD_ORA 2017-07-1810.00.19 10.11.17 10
1 0 17 Gb
IHPPROD_ORA 2017-07-1810.04.29 10.11.23 6
1 0 9 Gb
IHPPROD_ORA 2017-07-1810.09.10 10.12.01 2
1 0 4 Gb
IHPPROD_ORA 2017-07-1810.09.36 10.12.33 2
1 0 4 Gb
IHPPROD_ORA 2017-07-1810.11.21 10.13.47 2
1 0 4 Gb
Want to get:
Nodename Date (D/M/Y) Begin timeEnd time
Elapsed time in Minutes Num Obj Num Obj Failed Bytes
- --
- ---
--- ---
IHPPROD_ORA 2017-07-1810.00.20 10.13.47
39 11
0 66.8 Gb
The script is:
set sqlmathmode round
set sqldatetimeformat eur
select cast(entity as varchar(16)) as "Nodename", -
cast(date(start_time) as varchar(12)) as "Date (D/M/Y)", -
cast(time(start_time) as varchar(12)) as "Begin time", -
cast(time(end_time) as varchar(12)) as "End time", -
cast(timestampdiff(4,char(end_time-start_time)) as varchar(16)) as "Elapsed
time in Minutes" , -
cast(sum(affected) as varchar(10)) as "Num Obj", -
cast(sum(failed) as varchar(10)) as "Num Obj Failed", -
case -
when sum(bytes)>1073741824 then cast(sum(bytes)/1073741824 as varchar(10))
|| ' Gb' -
when sum(bytes)>1048576 then cast(sum(bytes)/1048576 as varchar(10)) || '
Mb' -
when sum(bytes)>1024 then cast(sum(bytes)/1024 as varchar(10)) || ' Kb' -
else cast(sum(bytes) as varchar(10)) -
end as "Bytes" -
from summary -
where (activity='BACKUP' or activity='ARCHIVE') and -
start_time>=timestamp(current_date,'07:00:00') and -
start_time<=timestamp(current_date,'23:59:00') and -
successful='YES' -
and entity like upper('%%$1%%') -
group by entity,start_time,end_time
T.I.A Best Regards
Robert
