Re: Real Storage Allocation

2016-02-16 Thread phil yogendran
Thank you all for your replies. My immediate concern was whether there were
any issues/problems with over-allocating storage and with your responses, I
am confident I can plough ahead. Thanks also for all the tips on how to
debug and what to analyze. That's a step for later. Your time
and assistance are much appreciated.

Regards,

Phil


On Mon, Feb 15, 2016 at 9:22 AM, John Abell <
john.ab...@intnlsoftwareproducts.com> wrote:

> As long as your z/OS isn't running under, z/VM like may smaller ISVs,
> where LFAREA is not yet supported.
>
> John T. Abell
> Tel:800-295-7608Option 4
> President
> International:  1-416-593-5578  Option 4
> E-mail:  john.ab...@intnlsoftwareproducts.com
> Fax:800-295-7609
>
> International:  1-416-593-5579
>
>
> International Software Products
> www.ispinfo.com
>
> This email may contain confidential and privileged material for the sole
> use of the intended recipient(s). Any review, use, retention, distribution
> or disclosure by others is strictly prohibited. If you are not the intended
> recipient (or authorized to receive on behalf of the named recipient),
> please contact the sender by reply email and delete all copies of this
> message. Also,email is susceptible to data corruption, interception,
> tampering, unauthorized amendment and viruses. We only send and receive
> emails on the basis that we are not liable for any such corruption,
> interception, tampering, amendment or viruses or any consequence thereof.
>
>
> -Original Message-
> From: IBM Mainframe Discussion List [mailto:IBM-MAIN@LISTSERV.UA.EDU] On
> Behalf Of Ed Jaffe
> Sent: Sunday, February 14, 2016 5:05 PM
> To: IBM-MAIN@LISTSERV.UA.EDU
> Subject: Re: Real Storage Allocation
>
> On 2/14/2016 11:19 AM, Graham Harris wrote:
> > Ed Jaffe wrote:
> >
> >
> >> The nice thing about an overabundance of real storage is the ability
> >> to
> > create a very large LFAREA with plenty of room for 1MB >pageable pages
> > and
> > -- if you have software that can truly benefit from it (which we
> > don't) -- 2G fixed pages.
> >
> >
> > LFAREA does of course only generally hold fixed large pages, although
> > it does also handle overflow of PLAREA when that becomes full, which
> > maybe what you were thinking.
>
> LFAREA (Large Frame Area) provides frame space for both fixed and pageable
> large pages. We specify:
>
> LFAREA=7782M,  Large frame area
>
> which is more than enough for our needs. Right after IPL I see some fairly
> small numbers:
>
> D VS,LFAREA
> IAR019I  13.56.52 DISPLAY VIRTSTOR 507
>   SOURCE =  20
>   TOTAL LFAREA = 7782M , 0G
>   LFAREA AVAILABLE = 7257M , 0G
>   LFAREA ALLOCATED (1M) = 0M
>   LFAREA ALLOCATED (4K) = 311M
>   MAX LFAREA ALLOCATED (1M) = 0M
>   MAX LFAREA ALLOCATED (4K) = 311M
>   LFAREA ALLOCATED (PAGEABLE1M) = 214M
>   MAX LFAREA ALLOCATED (PAGEABLE1M) = 214M
>   LFAREA ALLOCATED NUMBER OF 2G PAGES = 0
>   MAX LFAREA ALLOCATED NUMBER OF 2G PAGES = 0
>
> Of course, these numbers grow over time...
>
> --
> Edward E Jaffe
> Phoenix Software International, Inc
> 831 Parkview Drive North
> El Segundo, CA 90245
> http://www.phoenixsoftware.com/
>
> --
> For IBM-MAIN subscribe / signoff / archive access instructions, send email
> to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
>
>
> ---
> This email has been checked for viruses by Avast antivirus software.
> https://www.avast.com/antivirus
>
> --
> For IBM-MAIN subscribe / signoff / archive access instructions,
> send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
>

--
For IBM-MAIN subscribe / signoff / archive access instructions,
send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN


Re: Real Storage Allocation

2016-02-15 Thread John Abell
As long as your z/OS isn't running under, z/VM like may smaller ISVs, where 
LFAREA is not yet supported.

John T. Abell
Tel:800-295-7608Option 4
President
International:  1-416-593-5578  Option 4
E-mail:  john.ab...@intnlsoftwareproducts.com
Fax:800-295-7609

International:  1-416-593-5579


International Software Products
www.ispinfo.com

This email may contain confidential and privileged material for the sole use of 
the intended recipient(s). Any review, use, retention, distribution or 
disclosure by others is strictly prohibited. If you are not the intended
recipient (or authorized to receive on behalf of the named recipient), please 
contact the sender by reply email and delete all copies of this message. 
Also,email is susceptible to data corruption, interception,
tampering, unauthorized amendment and viruses. We only send and receive emails 
on the basis that we are not liable for any such corruption, interception, 
tampering, amendment or viruses or any consequence thereof.


-Original Message-
From: IBM Mainframe Discussion List [mailto:IBM-MAIN@LISTSERV.UA.EDU] On Behalf 
Of Ed Jaffe
Sent: Sunday, February 14, 2016 5:05 PM
To: IBM-MAIN@LISTSERV.UA.EDU
Subject: Re: Real Storage Allocation

On 2/14/2016 11:19 AM, Graham Harris wrote:
> Ed Jaffe wrote:
>
>
>> The nice thing about an overabundance of real storage is the ability
>> to
> create a very large LFAREA with plenty of room for 1MB >pageable pages
> and
> -- if you have software that can truly benefit from it (which we
> don't) -- 2G fixed pages.
>
>
> LFAREA does of course only generally hold fixed large pages, although
> it does also handle overflow of PLAREA when that becomes full, which
> maybe what you were thinking.

LFAREA (Large Frame Area) provides frame space for both fixed and pageable 
large pages. We specify:

LFAREA=7782M,  Large frame area

which is more than enough for our needs. Right after IPL I see some fairly 
small numbers:

D VS,LFAREA
IAR019I  13.56.52 DISPLAY VIRTSTOR 507
  SOURCE =  20
  TOTAL LFAREA = 7782M , 0G
  LFAREA AVAILABLE = 7257M , 0G
  LFAREA ALLOCATED (1M) = 0M
  LFAREA ALLOCATED (4K) = 311M
  MAX LFAREA ALLOCATED (1M) = 0M
  MAX LFAREA ALLOCATED (4K) = 311M
  LFAREA ALLOCATED (PAGEABLE1M) = 214M
  MAX LFAREA ALLOCATED (PAGEABLE1M) = 214M
  LFAREA ALLOCATED NUMBER OF 2G PAGES = 0
  MAX LFAREA ALLOCATED NUMBER OF 2G PAGES = 0

Of course, these numbers grow over time...

--
Edward E Jaffe
Phoenix Software International, Inc
831 Parkview Drive North
El Segundo, CA 90245
http://www.phoenixsoftware.com/

--
For IBM-MAIN subscribe / signoff / archive access instructions, send email to 
lists...@listserv.ua.edu with the message: INFO IBM-MAIN


---
This email has been checked for viruses by Avast antivirus software.
https://www.avast.com/antivirus

--
For IBM-MAIN subscribe / signoff / archive access instructions,
send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN


Re: Real Storage Allocation

2016-02-14 Thread Ed Jaffe

On 2/14/2016 11:19 AM, Graham Harris wrote:

Ed Jaffe wrote:



The nice thing about an overabundance of real storage is the ability to

create a very large LFAREA with plenty of room for 1MB >pageable pages and
-- if you have software that can truly benefit from it (which we don't) --
2G fixed pages.


LFAREA does of course only generally hold fixed large pages, although it
does also handle overflow of PLAREA when that becomes full, which maybe
what you were thinking.


LFAREA (Large Frame Area) provides frame space for both fixed and 
pageable large pages. We specify:


LFAREA=7782M,  Large frame area

which is more than enough for our needs. Right after IPL I see some 
fairly small numbers:


D VS,LFAREA
IAR019I  13.56.52 DISPLAY VIRTSTOR 507
 SOURCE =  20
 TOTAL LFAREA = 7782M , 0G
 LFAREA AVAILABLE = 7257M , 0G
 LFAREA ALLOCATED (1M) = 0M
 LFAREA ALLOCATED (4K) = 311M
 MAX LFAREA ALLOCATED (1M) = 0M
 MAX LFAREA ALLOCATED (4K) = 311M
 LFAREA ALLOCATED (PAGEABLE1M) = 214M
 MAX LFAREA ALLOCATED (PAGEABLE1M) = 214M
 LFAREA ALLOCATED NUMBER OF 2G PAGES = 0
 MAX LFAREA ALLOCATED NUMBER OF 2G PAGES = 0

Of course, these numbers grow over time...

--
Edward E Jaffe
Phoenix Software International, Inc
831 Parkview Drive North
El Segundo, CA 90245
http://www.phoenixsoftware.com/

--
For IBM-MAIN subscribe / signoff / archive access instructions,
send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN


Re: Real Storage Allocation

2016-02-14 Thread Graham Harris
Ed Jaffe wrote:


>The nice thing about an overabundance of real storage is the ability to
create a very large LFAREA with plenty of room for 1MB >pageable pages and
-- if you have software that can truly benefit from it (which we don't) --
2G fixed pages.


LFAREA does of course only generally hold fixed large pages, although it
does also handle overflow of PLAREA when that becomes full, which maybe
what you were thinking.

I use SMF71s extensively to trend long term REAL memory use by LPAR, and
augment that with LFAREA info from D VS,LFAREA commands (RMF still doesnt
provide an equivalent for all the metrics displayed, last time i looked),
and PLAREA from a rexx I acquired from the RSM guys (RMF provides little
info on that currently).

Joining everything together can be quite revealing, especially whats
happening inside PLAREA, which is generally hidden from view at the moment,
with the current lack of RMF instrumentation, although i am sure will be
forthcoming at some point in the future.


On 13 February 2016 at 08:30, Martin Packer 
wrote:

> As for monitoring use SMF 71 (RMF Paging Activity) data, most especially
> MINIMUM as well as AVERAGE Available Frame Count. Study how they both
> behave with time and how the Minimum deviates from the Average.
>
> That's what Dave Betten and I do in every engagement. And Dave probably
> has some choice words on how to manage DFSORT use of memory - which often
> accounts for the difference.
>
> One thing I would say is: Understand how your choices help or hinder your
> ability to add memory to LPARs - whether the one it's allocated to or a
> different one that subsequently needs it. This, to me, is still not an
> exact science. I would argue the instrumentation (again SMF 71) could be
> better in this area.
>
> Cheers, Martin
>
> Martin Packer,
> zChampion, Principal Systems Investigator,
> Worldwide Cloud & Systems Performance, IBM
>
> +44-7802-245-584
>
> email: martin_pac...@uk.ibm.com
>
> Twitter / Facebook IDs: MartinPacker
> Blog:
> https://www.ibm.com/developerworks/mydeveloperworks/blogs/MartinPacker
>
>
>
> From:   "Rugen, Len" 
> To: IBM-MAIN@LISTSERV.UA.EDU
> Date:   12/02/2016 22:40
> Subject:Re: Real Storage Allocation
> Sent by:IBM Mainframe Discussion List 
>
>
>
> I'd say it depends on your workload :-)
>
> If you are doing I/O that could be avoided with more buffers, it would be
> used.  Sort might be able to use it, if you sort much.
>
> I once did amazing things increasing CICS temp storage buffers :-)
>
> Len Rugen
>
> University of Missouri
> Division of Information Technology
> Systems & Operations - Metrics & Automation Team
>
> ____
> From: IBM Mainframe Discussion List [IBM-MAIN@LISTSERV.UA.EDU] on behalf
> of phil yogendran [philyo...@gmail.com]
> Sent: Friday, February 12, 2016 4:07 PM
> To: IBM-MAIN@LISTSERV.UA.EDU
> Subject: Real Storage Allocation
>
> Hello,
>
> Is there a downside to over-allocating real storage on an LPAR?
>
> We will be upgrading current processors which are tired and soon to be out
> of service to z13's which will have 4 times the storage we have at
> present.
>
> We don't have any issues with paging or UIC etc. but I feel that on the
> new
> processors, I need to make use of most if not all that available storage.
>
> Some of my thoughts are;
>
> - Will the additional storage be used on an LPAR which already has enough
> to do it's work.
> - Is there a way to monitor for 'unused' storage?
> - If the storage is not used, is there a loss of cycles in an 'overhead'
> to
> managing this unused storage?
> - etc.
>
> Your comments will be appreciated.
>
> --
> For IBM-MAIN subscribe / signoff / archive access instructions,
> send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
>
> --
> For IBM-MAIN subscribe / signoff / archive access instructions,
> send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
>
>
>
> Unless stated otherwise above:
> IBM United Kingdom Limited - Registered in England and Wales with number
> 741598.
> Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU
>
> --
> For IBM-MAIN subscribe / signoff / archive access instructions,
> send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
>

--
For IBM-MAIN subscribe / signoff / archive access instructions,
send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN


Re: Real Storage Allocation

2016-02-13 Thread Martin Packer
As for monitoring use SMF 71 (RMF Paging Activity) data, most especially 
MINIMUM as well as AVERAGE Available Frame Count. Study how they both 
behave with time and how the Minimum deviates from the Average.

That's what Dave Betten and I do in every engagement. And Dave probably 
has some choice words on how to manage DFSORT use of memory - which often 
accounts for the difference.

One thing I would say is: Understand how your choices help or hinder your 
ability to add memory to LPARs - whether the one it's allocated to or a 
different one that subsequently needs it. This, to me, is still not an 
exact science. I would argue the instrumentation (again SMF 71) could be 
better in this area.

Cheers, Martin

Martin Packer,
zChampion, Principal Systems Investigator,
Worldwide Cloud & Systems Performance, IBM

+44-7802-245-584

email: martin_pac...@uk.ibm.com

Twitter / Facebook IDs: MartinPacker
Blog: 
https://www.ibm.com/developerworks/mydeveloperworks/blogs/MartinPacker



From:   "Rugen, Len" 
To: IBM-MAIN@LISTSERV.UA.EDU
Date:   12/02/2016 22:40
Subject:    Re: Real Storage Allocation
Sent by:IBM Mainframe Discussion List 



I'd say it depends on your workload :-) 

If you are doing I/O that could be avoided with more buffers, it would be 
used.  Sort might be able to use it, if you sort much. 

I once did amazing things increasing CICS temp storage buffers :-)

Len Rugen

University of Missouri
Division of Information Technology
Systems & Operations - Metrics & Automation Team


From: IBM Mainframe Discussion List [IBM-MAIN@LISTSERV.UA.EDU] on behalf 
of phil yogendran [philyo...@gmail.com]
Sent: Friday, February 12, 2016 4:07 PM
To: IBM-MAIN@LISTSERV.UA.EDU
Subject: Real Storage Allocation

Hello,

Is there a downside to over-allocating real storage on an LPAR?

We will be upgrading current processors which are tired and soon to be out
of service to z13's which will have 4 times the storage we have at 
present.

We don't have any issues with paging or UIC etc. but I feel that on the 
new
processors, I need to make use of most if not all that available storage.

Some of my thoughts are;

- Will the additional storage be used on an LPAR which already has enough
to do it's work.
- Is there a way to monitor for 'unused' storage?
- If the storage is not used, is there a loss of cycles in an 'overhead' 
to
managing this unused storage?
- etc.

Your comments will be appreciated.

--
For IBM-MAIN subscribe / signoff / archive access instructions,
send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN

--
For IBM-MAIN subscribe / signoff / archive access instructions,
send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN



Unless stated otherwise above:
IBM United Kingdom Limited - Registered in England and Wales with number 
741598. 
Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

--
For IBM-MAIN subscribe / signoff / archive access instructions,
send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN


Re: Real Storage Allocation

2016-02-12 Thread Jim Mulder
> > Is there a downside to over-allocating real storage on an LPAR?
> 
> Slower stand-alone dump? Seriously, that's the only "downside" I know 
> of, but I'm not really a performance guy...

  And larger stand-alone dumps.  So remember to review the sizes of 
your stand-alone dump output data sets.

Jim Mulder   z/OS System Test   IBM Corp.  Poughkeepsie,  NY


--
For IBM-MAIN subscribe / signoff / archive access instructions,
send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN


Re: Real Storage Allocation

2016-02-12 Thread Ed Jaffe

On 2/12/2016 2:07 PM, phil yogendran wrote:

Hello,

Is there a downside to over-allocating real storage on an LPAR?


Slower stand-alone dump? Seriously, that's the only "downside" I know 
of, but I'm not really a performance guy...



We will be upgrading current processors which are tired and soon to be out
of service to z13's which will have 4 times the storage we have at present.

We don't have any issues with paging or UIC etc. but I feel that on the new
processors, I need to make use of most if not all that available storage.


We took exactly the same approach on our z13. It's been great!

The nice thing about an overabundance of real storage is the ability to 
create a very large LFAREA with plenty of room for 1MB pageable pages 
and -- if you have software that can truly benefit from it (which we 
don't) -- 2G fixed pages.


--
Edward E Jaffe
Phoenix Software International, Inc
831 Parkview Drive North
El Segundo, CA 90245
http://www.phoenixsoftware.com/

--
For IBM-MAIN subscribe / signoff / archive access instructions,
send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN


Re: Real Storage Allocation

2016-02-12 Thread Rugen, Len
I'd say it depends on your workload :-)  

If you are doing I/O that could be avoided with more buffers, it would be used. 
 Sort might be able to use it, if you sort much.  

I once did amazing things increasing CICS temp storage buffers :-)

Len Rugen

University of Missouri
Division of Information Technology
Systems & Operations - Metrics & Automation Team


From: IBM Mainframe Discussion List [IBM-MAIN@LISTSERV.UA.EDU] on behalf of 
phil yogendran [philyo...@gmail.com]
Sent: Friday, February 12, 2016 4:07 PM
To: IBM-MAIN@LISTSERV.UA.EDU
Subject: Real Storage Allocation

Hello,

Is there a downside to over-allocating real storage on an LPAR?

We will be upgrading current processors which are tired and soon to be out
of service to z13's which will have 4 times the storage we have at present.

We don't have any issues with paging or UIC etc. but I feel that on the new
processors, I need to make use of most if not all that available storage.

Some of my thoughts are;

- Will the additional storage be used on an LPAR which already has enough
to do it's work.
- Is there a way to monitor for 'unused' storage?
- If the storage is not used, is there a loss of cycles in an 'overhead' to
managing this unused storage?
- etc.

Your comments will be appreciated.

--
For IBM-MAIN subscribe / signoff / archive access instructions,
send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN

--
For IBM-MAIN subscribe / signoff / archive access instructions,
send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN


Real Storage Allocation

2016-02-12 Thread phil yogendran
Hello,

Is there a downside to over-allocating real storage on an LPAR?

We will be upgrading current processors which are tired and soon to be out
of service to z13's which will have 4 times the storage we have at present.

We don't have any issues with paging or UIC etc. but I feel that on the new
processors, I need to make use of most if not all that available storage.

Some of my thoughts are;

- Will the additional storage be used on an LPAR which already has enough
to do it's work.
- Is there a way to monitor for 'unused' storage?
- If the storage is not used, is there a loss of cycles in an 'overhead' to
managing this unused storage?
- etc.

Your comments will be appreciated.

--
For IBM-MAIN subscribe / signoff / archive access instructions,
send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN