Re: Anyone exploiting ZEDC?

2024-04-29 Thread Andrew Rowley
On 19/04/2024 9:35 pm, Scott Chapman wrote: Agreed, it's been many years since I ran similar test with our software and don't remember the exact details, but my recollection is that I saw no noticeable change in CPU consumption. Which I remember being particularly interested in because I'd

Re: Anyone exploiting ZEDC?

2024-04-27 Thread Ed Jaffe
On 4/16/2024 9:16 AM, Jousma, David wrote: Is anyone exploiting ZEDC data compression accelerator in your environments? We zEDC compress and encrypt our zFS file systems and SVC dumps. We zEDC compress our HSM backups on both DASD and TAPE and other large data sets such as the *huge* PDSEs

Re: Anyone exploiting ZEDC?

2024-04-26 Thread Russell Witt
The new release (over a year old, so not so new) of CA 1 Flexible Storage has an option to exploit z/EDC when writing to tape or to exploit z/EDC and ACS256 encryption when writing to tape. In both cases, we have an option to do those both in a zIIP engine if available. On the z16 systems, it

Re: Anyone exploiting ZEDC?

2024-04-20 Thread Steve Estle
David, We are using it - biggest benefit so far has been with our backups in converting DFSMSDSS (ADRDSSU) backups using "ZPREF" option. It reduced runtime on backups significantly (50%+) with also some reduction in CPU cycles. We also are using it in other scenarios. You do need to test

Re: Anyone exploiting ZEDC?

2024-04-19 Thread Scott Chapman
Agreed, it's been many years since I ran similar test with our software and don't remember the exact details, but my recollection is that I saw no noticeable change in CPU consumption. Which I remember being particularly interested in because I'd heard of issues reading that compressed data.

Re: Anyone exploiting ZEDC?

2024-04-18 Thread Radoslaw Skorupka
W dniu 16.04.2024 o 18:28, rpinion865 pisze: At a prior life, we got the zEDC cards on a z15, and turned that on for PS datasets. [...] No cards for z15. It has zEDC module in processor. z14 and older had zEDC cards, defined in HCD as a function. HW: Cards were paid feature, zEDC in z15 is

Re: Anyone exploiting ZEDC?

2024-04-18 Thread Radoslaw Skorupka
W dniu 16.04.2024 o 18:16, Jousma, David pisze: Is anyone exploiting ZEDC data compression accelerator in your environments? We recently licensed the enablement and are working through the issues in our DEV environment. We initially enabled Extended Format/COMPACT ZP, for all DSORG PS

Re: Anyone exploiting ZEDC?

2024-04-17 Thread Prashant Joshi
tasks like HSM, CICS, DB2 etc Thank you, Prashant -Original Message- From: IBM Mainframe Discussion List On Behalf Of Glenn Wilcock Sent: Thursday, April 18, 2024 2:34 AM To: IBM-MAIN@LISTSERV.UA.EDU Subject: [EXTERNAL] Re: Anyone exploiting ZEDC? DFSMShsm is an excellent use case for zEDC

Re: Anyone exploiting ZEDC?

2024-04-17 Thread Andrew Rowley
On 18/04/2024 12:04 am, Michael Oujesky wrote: Just a thought, but anyone processing internally compressed CICS or DB2 data on a non-z/OS platform (Windows/Unix) might see substantial CPU usage from RLE decompression. If the compression is lightweight, decompression should be too. I can't

Re: Anyone exploiting ZEDC?

2024-04-17 Thread Michael Oujesky
Unless the file is already compressed. For those they just get passed to ML2 or BACKUP as-is. Michael At 04:04 PM 4/17/2024, Glenn Wilcock wrote: DFSMShsm is an excellent use case for zEDC and is our number one best practice for HSM. When enabled, DSS zEDC compresses all blocks of data

Re: Anyone exploiting ZEDC?

2024-04-17 Thread Glenn Wilcock
DFSMShsm is an excellent use case for zEDC and is our number one best practice for HSM. When enabled, DSS zEDC compresses all blocks of data passed to HSM during Migration and Backup. Because HSM is processing fewer data blocks, both cpu and elapsed time are reduced. When going to ML1, the

Re: Anyone exploiting ZEDC?

2024-04-17 Thread Michael Oujesky
| Director, Technology Engineering From: IBM Mainframe Discussion List on behalf of Michael Oujesky Date: Tuesday, April 16, 2024 at 3:24 PM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: Anyone exploiting ZEDC? Food for thought. zEDC is block oriented rather than record oriented (i. e. reads

Re: Anyone exploiting ZEDC?

2024-04-17 Thread Michael Oujesky
Just a thought, but anyone processing internally compressed CICS or DB2 data on a non-z/OS platform (Windows/Unix) might see substantial CPU usage from RLE decompression. Michael At 07:02 AM 4/17/2024, Scott Chapman wrote: My recommendation has always been to leave Db2/CICS's RLE compression

Re: Anyone exploiting ZEDC?

2024-04-17 Thread Michael Oujesky
Mainframe Discussion List IBM-MAIN@LISTSERV.UA.EDU on behalf of rpinion865 042a019916dd-dmarc-requ...@listserv.ua.edu > > Date: Tuesday, April 16, 2024 at 3:41 PM > To: IBM-MAIN@LISTSERV.UA.EDU IBM-MAIN@LISTSERV.UA.EDU > > Subject: Re: Anyone exploiting ZEDC? > FWIW, here i

Re: Anyone exploiting ZEDC?

2024-04-17 Thread Timothy Sipples
rpinion865 wrote: >Is it not true that even though you get the zEDC engines on the z15 and z16, >you still have to pay for the exploitation by enabling Featurename('ZEDC') in >parmlib's IFAPRDxx? David Jousma

Re: Anyone exploiting ZEDC?

2024-04-17 Thread rpinion865
TSERV.UA.EDU IBM-MAIN@LISTSERV.UA.EDU > > Subject: Re: Anyone exploiting ZEDC? > FWIW, here is a snippet of the SMS ACS DC code that we were using for zEDC. > /* DEFINE extra data sets to receive zEDC compression / > /

Re: Anyone exploiting ZEDC?

2024-04-17 Thread Jousma, David
Discussion List on behalf of rpinion865 <042a019916dd-dmarc-requ...@listserv.ua.edu> Date: Tuesday, April 16, 2024 at 3:41 PM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: Anyone exploiting ZEDC? FWIW, here is a snippet of the SMS ACS DC code that we were using for zEDC. /* DEFINE extra dat

Re: Anyone exploiting ZEDC?

2024-04-17 Thread Scott Chapman
My recommendation has always been to leave Db2/CICS's RLE compression of SMF data enabled even with zEDC compression of the data. 1) Less data will be sent to the zEDC compression engine, which will then process faster. I believe at one point I had an IBM chart that showed this. 2) The data

Re: Anyone exploiting ZEDC?

2024-04-17 Thread rpinion865
Is it not true that even though you get the zEDC engines on the z15 and z16, you still have to pay for the exploitation by enabling Featurename('ZEDC') in parmlib's IFAPRDxx? Sent with Proton Mail secure email. On Wednesday, April 17th, 2024 at 4:44 AM, Timothy Sipples wrote: >

Re: Anyone exploiting ZEDC?

2024-04-17 Thread Timothy Sipples
rpinion865 wrote: > At a prior life, we got the zEDC cards on a z15, and turned that on >for PS datasets. Just to clarify, every IBM z15, LinuxONE III, and higher model machine has on-chip zEDC (compression). It’s formally called the “Integrated Accelerator for zEDC,” and you can expand the

Re: Anyone exploiting ZEDC?

2024-04-17 Thread Andrew Rowley
On 17/04/2024 12:09 pm, Michael Oujesky wrote: Yes and zEDC poorly compresses internally RLE compressed records. I was surprised how well zEDC compressed the already compressed records. Using my data: zEDC alone : 52000 tracks CICS compression + zEDC : 22000 tracks zEDC seems to be biased

Re: Anyone exploiting ZEDC?

2024-04-16 Thread kekronbekron
Turning off s/w compression in CICS & Db2 doesn't always work as advertised (meaning, it's not always better to turn off s/w compr and let h/w handle it). Uncompressed = more I/O for SMF processor tooling to handle. With either way of compressing, bytes stored will be around the same but the

Re: Anyone exploiting ZEDC?

2024-04-16 Thread Michael Oujesky
Yes and zEDC poorly compresses internally RLE compressed records. Plus CSRCESRV uses GP engine cycles, whereas zEDC offloads the processing and reduces CICS and DB2 address space CPU time, By the time LOGGER writes the data to the logstream, it is already compressed and is smaller than the

Re: Anyone exploiting ZEDC?

2024-04-16 Thread Andrew Rowley
On 17/04/2024 7:52 am, Michael Oujesky wrote: My  current recommendation is to remove internal compression from CICS CMF (110/112) and DB2 (100-102) records, Zedc compress the SMF logstreams, then compress the logstream offloads via SMS zEDC compression. Have you compared compressed size

Re: Anyone exploiting ZEDC?

2024-04-16 Thread Mark Jacobs
And SMF data in logstreams too. Mark Jacobs Sent from ProtonMail, Swiss-based encrypted email. GPG Public Key - https://api.protonmail.ch/pks/lookup?op=get=markjac...@protonmail.com On Tuesday, April 16th, 2024 at 6:32 PM, Mark Jacobs <0224d287a4b1-dmarc-requ...@listserv.ua.edu> wrote:

Auto: Re: Anyone exploiting ZEDC?

2024-04-16 Thread Frederic Mancini
Je suis absent le 17 avril 2024. -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN

Re: Anyone exploiting ZEDC?

2024-04-16 Thread Mark Jacobs
Our storage team would know more about what they've done with zEDC, but I'm using it for compression of zFS file systems and JES2 Sysout written to spool. Mark Jacobs Sent from ProtonMail, Swiss-based encrypted email. GPG Public Key -

Re: Anyone exploiting ZEDC?

2024-04-16 Thread Michael Oujesky
Have you considered using zEDC on your SMF logstreams? My current recommendation is to remove internal compression from CICS CMF (110/112) and DB2 (100-102) records, Zedc compress the SMF logstreams, then compress the logstream offloads via SMS zEDC compression. Note that DFHSM archives

Re: Anyone exploiting ZEDC?

2024-04-16 Thread Michael Oujesky
ril 16, 2024 at 2:25 PM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: Anyone exploiting ZEDC? At my previous life, we were using BMC's IAM VSAM interface. I think IAM could use zEDC. But I was told by then IDP support, that IAM's internal compression was Moe (as in Moe Howard) better than eve

Re: Anyone exploiting ZEDC?

2024-04-16 Thread Michael Oujesky
sion List IBM-MAIN@LISTSERV.UA.EDU on behalf of rpinion865 042a019916dd-dmarc-requ...@listserv.ua.edu > > Date: Tuesday, April 16, 2024 at 2:25 PM > To: IBM-MAIN@LISTSERV.UA.EDU IBM-MAIN@LISTSERV.UA.EDU > > Subject: Re: Anyone exploiting ZEDC? > At my previous life, we wer

Re: Anyone exploiting ZEDC?

2024-04-16 Thread rpinion865
resident | Director, Technology Engineering > > > > > > From: IBM Mainframe Discussion List IBM-MAIN@LISTSERV.UA.EDU on behalf of > rpinion865 042a019916dd-dmarc-requ...@listserv.ua.edu > > Date: Tuesday, April 16, 2024 at 3:27 PM > To: IBM-MAIN@LISTSERV.UA.EDU IBM

Re: Anyone exploiting ZEDC?

2024-04-16 Thread Jousma, David
: Anyone exploiting ZEDC? Food for thought. zEDC is block oriented rather than record oriented (i. e. reads/writes full track blocks on DASD and BLKSIZE become logical (i. e. the size of the buffer used to exchange data with the application)), so any processing that expects Food for thought. zEDC

Re: Anyone exploiting ZEDC?

2024-04-16 Thread Jousma, David
; Date: Tuesday, April 16, 2024 at 3:27 PM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: Anyone exploiting ZEDC? Curious, do you use IAM for Hogan applications? My previous life did, and the applications group was very satisfied with the IAM performance vs. native VSAM. However, we had to impress o

Re: Anyone exploiting ZEDC?

2024-04-16 Thread rpinion865
equ...@listserv.ua.edu > > Date: Tuesday, April 16, 2024 at 2:25 PM > To: IBM-MAIN@LISTSERV.UA.EDU IBM-MAIN@LISTSERV.UA.EDU > > Subject: Re: Anyone exploiting ZEDC? > At my previous life, we were using BMC's IAM VSAM interface. I think IAM > could use zEDC. But I was told by th

Re: Anyone exploiting ZEDC?

2024-04-16 Thread Michael Oujesky
Food for thought. zEDC is block oriented rather than record oriented (i.e. reads/writes full track blocks on DASD and BLKSIZE become logical (i.e. the size of the buffer used to exchange data with the application)), so any processing that expects to make use of BLKSIZE to perform physical I/O

Re: Anyone exploiting ZEDC?

2024-04-16 Thread Jousma, David
From: IBM Mainframe Discussion List on behalf of rpinion865 <042a019916dd-dmarc-requ...@listserv.ua.edu> Date: Tuesday, April 16, 2024 at 2:25 PM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: Anyone exploiting ZEDC? At my previous life, we were using BMC's IAM VSAM interface. I think IAM

Re: Anyone exploiting ZEDC?

2024-04-16 Thread rpinion865
dmarc-requ...@listserv.ua.EDUmailto:031df298a9da-dmarc-requ...@listserv.ua.edu> > > > Date: Tuesday, April 16, 2024 at 1:10 PM > > To: ibm-m...@listserv.ua.EDUmailto:IBM-MAIN@LISTSERV.UA.EDU > mailto:IBM-MAIN@LISTSERV.UA.EDU> > > > Subject: Re: Anyone exploiting ZED

Re: Anyone exploiting ZEDC?

2024-04-16 Thread Sri Hari Kolusu
>> We initially enabled Extended Format/COMPACT ZP, for all DSORG PS datasets, >> but are quickly finding that DFSORT, SAS, ISPF recovery datasets all have >> issues. Dave, Can you elaborate more on the issue that you have with DFSORT as ZEDC is supported by DFSORT. You can send an offline

Re: Anyone exploiting ZEDC?

2024-04-16 Thread Farley, Peter
ous internal communications I have seen. I just do not know the exact details. Peter From: IBM Mainframe Discussion List On Behalf Of Jousma, David Sent: Tuesday, April 16, 2024 1:13 PM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: Anyone exploiting ZEDC? Peter, Interesting. IBM says VSAM d

Re: Anyone exploiting ZEDC?

2024-04-16 Thread Jousma, David
Mainframe Discussion List on behalf of Farley, Peter <031df298a9da-dmarc-requ...@listserv.ua.edu> Date: Tuesday, April 16, 2024 at 1:10 PM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: Anyone exploiting ZEDC? I do not know what criteria the sysprogs here set things up. But we are successfully usin

Re: Anyone exploiting ZEDC?

2024-04-16 Thread Farley, Peter
and bureaucracy that I have no business reason to cover. From: IBM Mainframe Discussion List On Behalf Of Jousma, David Sent: Tuesday, April 16, 2024 12:39 PM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: Anyone exploiting ZEDC? Thank-you for this feedback. I’m starting to feel like this is a half-baked

Re: Anyone exploiting ZEDC?

2024-04-16 Thread Jousma, David
of rpinion865 <042a019916dd-dmarc-requ...@listserv.ua.edu> Date: Tuesday, April 16, 2024 at 12:29 PM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: Anyone exploiting ZEDC? At a prior life, we got the zEDC cards on a z15, and turned that on for PS datasets. But like you, we quickly learned that PS da

Re: Anyone exploiting ZEDC?

2024-04-16 Thread rpinion865
At a prior life, we got the zEDC cards on a z15, and turned that on for PS datasets. But like you, we quickly learned that PS datasets opened for in/out processing (update in place) did not work. As a compromise, we narrowed down to new PS GDG datasets. Also we looked at new PS GDG datasets