Re: SELECTING SMF RECORDS FOR 1 DAY
Control statements look good to me. Change the BLKSIZE on OUTDD1 to 27998 i.e. ...DCB=(recfm=vbs,lrecl=32760,blksize=27998) Increase the space allocation. There are an awful lot of type14/15 records cut. Michael Cleary's DAF (CBT FILE 094) will be helpful here to decode the records. Don't forget to adjust the blksize in STEP2. HTH, Al Staller | Z Systems Programmer | KBM Group | (Tel) 972 664 3565 | allan.stal...@kbmg.com I am following up on a problem regarding the corruption of a dsn. I have the SMF records for the day, however since the daily tapes are merged into a weekly tape I am having a problem (space issues) trying to extract only the type 14 & 15 records for that particular date. I looked at - OSMVS System Management Facilities - the doc for an example but I didn't find any. Can someone suggest what I can try. Below is my job which I am trying to run. //STEP1 EXEC PGM=IFASMFDP //INDD1 DD DSN=SYS2.SMFDATA.WEEK.G1584V00,DISP=SHR //OUTDD1 DD DSN=&&SM11, // DISP=(,PASS),UNIT=SYSDA,SPACE=(CYL,(150,150),RLSE), // DCB=(RECFM=VBS,LRECL=32760,BLKSIZE=4096) //SYSPRINT DD SYSOUT=* //SYSIN DD * INDD(INDD1,OPTIONS(DUMP)) OUTDD(OUTDD1,TYPE(14:15)) /* //STEP2 EXEC PGM=IDCAMS,TIME=1440 //DD1 DD DSN=&&SM11, // DISP=(OLD,DELETE), // DCB=(RECFM=VBS,LRECL=32760,BLKSIZE=4096) //SYSOUT DD SYSOUT=* //SYSPRINT DD SYSOUT=* //SYSIN DD * PRINT INFILE(DD1) DUMP /* // -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: INFO IBM-MAIN
Re: SELECTING SMF RECORDS FOR 1 DAY
I like the program DAF on CBTTAPE.ORG. It can select records by data set name and date. -Original Message- From: IBM Mainframe Discussion List [mailto:IBM-MAIN@bama.ua.edu] On Behalf Of John Dawes Sent: Friday, May 04, 2012 6:13 AM To: IBM-MAIN@bama.ua.edu Subject: SELECTING SMF RECORDS FOR 1 DAY G'Day, I am following up on a problem regarding the corruption of a dsn. I have the SMF records for the day, however since the daily tapes are merged into a weekly tape I am having a problem (space issues) trying to extract only the type 14 & 15 records for that particular date. I looked at - OSMVS System Management Facilities - the doc for an example but I didn't find any. Can someone suggest what I can try. Below is my job which I am trying to run. //STEP1 EXEC PGM=IFASMFDP //INDD1 DD DSN=SYS2.SMFDATA.WEEK.G1584V00,DISP=SHR //OUTDD1 DD DSN=&&SM11, // DISP=(,PASS),UNIT=SYSDA,SPACE=(CYL,(150,150),RLSE), // DCB=(RECFM=VBS,LRECL=32760,BLKSIZE=4096) //SYSPRINT DD SYSOUT=* //SYSIN DD * INDD(INDD1,OPTIONS(DUMP)) OUTDD(OUTDD1,TYPE(14:15)) /* //STEP2 EXEC PGM=IDCAMS,TIME=1440 //DD1 DD DSN=&&SM11, // DISP=(OLD,DELETE), // DCB=(RECFM=VBS,LRECL=32760,BLKSIZE=4096) //SYSOUT DD SYSOUT=* //SYSPRINT DD SYSOUT=* //SYSIN DD * PRINT INFILE(DD1) DUMP /* // -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: INFO IBM-MAIN -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: INFO IBM-MAIN
Re: SELECTING SMF RECORDS FOR 1 DAY
David, I am trying out the suggestions made by you and Mary Anne . Thanks. From: David Betten To: IBM-MAIN@bama.ua.edu Sent: Friday, 4 May 2012 7:42 AM Subject: Re: SELECTING SMF RECORDS FOR 1 DAY Try this in your SYSIN //SYSIN DD * INDD(INDD1,OPTIONS(DUMP)) OUTDD(OUTDD1,TYPE(14:15)) DATE(2012125,2012125) /* In my example, the job would select only records from today. Change the 125 to the day you need to select. Have a nice day, Dave Betten DFSORT Development, Performance Lead IBM Corporation email: bet...@us.ibm.com 1-301-240-3809 DFSORT/MVSontheweb at http://www.ibm.com/storage/dfsort/ IBM Mainframe Discussion List wrote on 05/04/2012 07:13:28 AM: > From: John Dawes > To: IBM-MAIN@bama.ua.edu, > Date: 05/04/2012 07:13 AM > Subject: SELECTING SMF RECORDS FOR 1 DAY > Sent by: IBM Mainframe Discussion List > > G'Day, > > I am following up on a problem regarding the corruption of a dsn. I > have the SMF records for the day, however since the daily tapes are > merged into a weekly tape I am having a problem (space issues) > trying to extract only the type 14 & 15 records for that particular > date. I looked at - OSMVS System Management Facilities - the doc > for an example but I didn't find any. Can someone suggest what I > can try. Below is my job which I am trying to run. > //STEP1 EXEC PGM=IFASMFDP > //INDD1 DD DSN=SYS2.SMFDATA.WEEK.G1584V00,DISP=SHR > //OUTDD1 DD DSN=&&SM11, > // DISP=(,PASS),UNIT=SYSDA,SPACE=(CYL,(150,150),RLSE), > // DCB=(RECFM=VBS,LRECL=32760,BLKSIZE=4096) > //SYSPRINT DD SYSOUT=* > //SYSIN DD * > INDD(INDD1,OPTIONS(DUMP)) > OUTDD(OUTDD1,TYPE(14:15)) > /* > //STEP2 EXEC PGM=IDCAMS,TIME=1440 > //DD1 DD DSN=&&SM11, > // DISP=(OLD,DELETE), > // DCB=(RECFM=VBS,LRECL=32760,BLKSIZE=4096) > //SYSOUT DD SYSOUT=* > //SYSPRINT DD SYSOUT=* > //SYSIN DD * > PRINT INFILE(DD1) DUMP > /* > // > > -- > For IBM-MAIN subscribe / signoff / archive access instructions, > send email to lists...@bama.ua.edu with the message: INFO IBM-MAIN > -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: INFO IBM-MAIN -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: INFO IBM-MAIN
Re: SELECTING SMF RECORDS FOR 1 DAY
John, try something like: INDD(IN,OPTIONS(DUMP)) DATE(2012108,2012108) OUTDD(OUT,TYPE(70:78)) The date parm is what you need. Mary Anne -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: INFO IBM-MAIN
Re: SELECTING SMF RECORDS FOR 1 DAY
Try this in your SYSIN //SYSIN DD * INDD(INDD1,OPTIONS(DUMP)) OUTDD(OUTDD1,TYPE(14:15)) DATE(2012125,2012125) /* In my example, the job would select only records from today. Change the 125 to the day you need to select. Have a nice day, Dave Betten DFSORT Development, Performance Lead IBM Corporation email: bet...@us.ibm.com 1-301-240-3809 DFSORT/MVSontheweb at http://www.ibm.com/storage/dfsort/ IBM Mainframe Discussion List wrote on 05/04/2012 07:13:28 AM: > From: John Dawes > To: IBM-MAIN@bama.ua.edu, > Date: 05/04/2012 07:13 AM > Subject: SELECTING SMF RECORDS FOR 1 DAY > Sent by: IBM Mainframe Discussion List > > G'Day, > > I am following up on a problem regarding the corruption of a dsn. I > have the SMF records for the day, however since the daily tapes are > merged into a weekly tape I am having a problem (space issues) > trying to extract only the type 14 & 15 records for that particular > date. I looked at - OSMVS System Management Facilities - the doc > for an example but I didn't find any. Can someone suggest what I > can try. Below is my job which I am trying to run. > //STEP1 EXEC PGM=IFASMFDP > //INDD1 DD DSN=SYS2.SMFDATA.WEEK.G1584V00,DISP=SHR > //OUTDD1 DD DSN=&&SM11, > // DISP=(,PASS),UNIT=SYSDA,SPACE=(CYL,(150,150),RLSE), > // DCB=(RECFM=VBS,LRECL=32760,BLKSIZE=4096) > //SYSPRINT DD SYSOUT=* > //SYSIN DD * > INDD(INDD1,OPTIONS(DUMP)) > OUTDD(OUTDD1,TYPE(14:15)) > /* > //STEP2 EXEC PGM=IDCAMS,TIME=1440 > //DD1 DD DSN=&&SM11, > // DISP=(OLD,DELETE), > // DCB=(RECFM=VBS,LRECL=32760,BLKSIZE=4096) > //SYSOUT DD SYSOUT=* > //SYSPRINT DD SYSOUT=* > //SYSIN DD * > PRINT INFILE(DD1) DUMP > /* > // > > -- > For IBM-MAIN subscribe / signoff / archive access instructions, > send email to lists...@bama.ua.edu with the message: INFO IBM-MAIN > -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: INFO IBM-MAIN
SELECTING SMF RECORDS FOR 1 DAY
G'Day, I am following up on a problem regarding the corruption of a dsn. I have the SMF records for the day, however since the daily tapes are merged into a weekly tape I am having a problem (space issues) trying to extract only the type 14 & 15 records for that particular date. I looked at - OSMVS System Management Facilities - the doc for an example but I didn't find any. Can someone suggest what I can try. Below is my job which I am trying to run. //STEP1 EXEC PGM=IFASMFDP //INDD1 DD DSN=SYS2.SMFDATA.WEEK.G1584V00,DISP=SHR //OUTDD1 DD DSN=&&SM11, // DISP=(,PASS),UNIT=SYSDA,SPACE=(CYL,(150,150),RLSE), // DCB=(RECFM=VBS,LRECL=32760,BLKSIZE=4096) //SYSPRINT DD SYSOUT=* //SYSIN DD * INDD(INDD1,OPTIONS(DUMP)) OUTDD(OUTDD1,TYPE(14:15)) /* //STEP2 EXEC PGM=IDCAMS,TIME=1440 //DD1 DD DSN=&&SM11, // DISP=(OLD,DELETE), // DCB=(RECFM=VBS,LRECL=32760,BLKSIZE=4096) //SYSOUT DD SYSOUT=* //SYSPRINT DD SYSOUT=* //SYSIN DD * PRINT INFILE(DD1) DUMP /* // -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: INFO IBM-MAIN
Re: SMF Records
If you have SAS, there is a very powerful but also trivial technique to read any file and only keep the records with a desired string of text, // EXEC SAS //SMF DD //SMFOUT DD DATA _NULL_; INFILE SMF; INPUT @; IF INDEX(_INFILE_,'LOOKFOR') GT 0 THEN DO; FILE SMFOUT DCB=SMF; PUT _INFILE_; FILE LOG; END; Will write to SMFOUT only records containing "LOOKFOR" text string. For MXG users, the (new) SMFSRCH program in 29.07 enhances this technique to select records, by then reading those selected records to create all possible MXG datasets from those SMF records, but then goes further to filter and keep only the individual observations that have that text string in a variable in a created dataset. Why? Consider an SMF 30 step termination record that contains that string. MXG creates multiple datasets, in particular, TYPE30_D that has an observation for each DD segment. But if the LOOKFOR string was a USERID, TYPE30DD doesn't have the userid field, so those observations can never have the "LOOKFOR" text and thus the TYPE30_Deated from thosd selected records are NOT kept, but the TYPE30_4 dataset with step term info will be kept if they have that USERID name. Barry Merrill -Original Message- From: IBM Mainframe Discussion List [mailto:IBM-MAIN@bama.ua.edu] On Behalf Of Ravi Gaur Sent: Tuesday, November 29, 2011 11:37 PM To: IBM-MAIN@bama.ua.edu Subject: SMF Records Does anybody give me idea how can i copy only the smf records from given dataset which does contain a particular string(dataset name) ..well while dumping using ifasmfdp i used (0:255) now need to figure out the dataset name I am looking is associated with which smf records..since as i thought it may be 14/15 it does however want to know what other records are associated with it.. -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: SMF Records
Ravi Gaur wrote: >Does anybody give me idea how can i copy only the smf records from given >dataset which does contain a particular string(dataset name) ..well while >dumping using ifasmfdp i used (0:255) now need to figure out the dataset name >I am looking is associated with which smf records..since as i thought it may >be 14/15 it does however want to know what other records are associated with >it.. There are many ways to do it, provided you collected the records (14/15/17/18, 30, catalogs records, RACF records, DB2 records, etc) in the first place. Perhaps you need to find what usage you want to investigate? Read? update? delete? Temp against permanent? Wrong usage in a production run? If you just want to do a little browsing, do a DFSORT using INCLUDE COND=(1,,SS,EQ,C'') to SYSOUT. Use DAF. Lizette already kindly gave you the source of that. Use RACF reporting of SMF records. Use IRRADU00, then use that output with something like ICETOOL. There are many reporting utilities you can use just for that. Other list members can give details. HTH! Groete / Greetings Elardus Engelbrecht -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: SMF Records
Of course you can filter with DFSORT regarding that "particular string". But I think it is better to first make up mind which SMF records are expected. Some examples: 14/15 sounds good, may be 17 and the range around 60? Would you expect the data set name to appear in records of type 100 and above? Well, if you have a DB2 resource with same name as that data set...sounds weired but why not? This leads to the question what are you looking for. May be you are interested in "who is using my data set". Then, you might want to consider auditing RACF profiles. Cheers Michael Von:Ravi Gaur An: IBM-MAIN@bama.ua.edu Datum: 2011-11-30 06:52 Betreff:SMF Records Gesendet von: IBM Mainframe Discussion List Does anybody give me idea how can i copy only the smf records from given dataset which does contain a particular string(dataset name) ..well while dumping using ifasmfdp i used (0:255) now need to figure out the dataset name I am looking is associated with which smf records..since as i thought it may be 14/15 it does however want to know what other records are associated with it.. -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: SMF Records
> > Does anybody give me idea how can i copy only the smf records from given dataset > which does contain a particular string(dataset name) ..well while dumping using > ifasmfdp i used (0:255) now need to figure out the dataset name I am looking is > associated with which smf records..since as i thought it may be 14/15 it does however > want to know what other records are associated with it.. > Go to www.cbttape.org and find the DAF utility. It will do this. Lizette -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
SMF Records
Does anybody give me idea how can i copy only the smf records from given dataset which does contain a particular string(dataset name) ..well while dumping using ifasmfdp i used (0:255) now need to figure out the dataset name I am looking is associated with which smf records..since as i thought it may be 14/15 it does however want to know what other records are associated with it.. -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: DB2 SMF Records
In my second job as a capacity/performance, MICS wasn't ready for DB2. So, I took the manual and coded a SAS programme to parse the SMF records produced. The documentation didn't have offsets -- just type & length. There were a lot of typo and offset errors before I got clean code. Also, the meanings of a lot of fields were not clear -- not to mention recording bugs! This was the first release of DB2; I can't recall if it was V1.0 or V1.1 -- I don't remember how IBM numbered them, circa 1983-84. I did the coding because we needed the information, and we were one of the first sites in Ontario (or Canada), and possibly the first in Toronto; we didn't have many contacts to ask for help. Even IBM wasn't sure of a lot, back then; we ended up as a guinea pig a few times. These days, I recomend not developing the code, yourself! Sent wirelessly from my BlackBerry device on the Bell network. Envoyé sans fil par mon terminal mobile BlackBerry sur le réseau de Bell. -Original Message- From: Charles Mills Sender: IBM Mainframe Discussion List Date: Wed, 13 Apr 2011 15:48:44 To: Reply-To: IBM Mainframe Discussion List Subject: Re: DB2 SMF Records Oh boy, do you have some fun cut out for you! //SYSLIB DD DISP=SHR,DSN=DB2.DSN710.ADSNMACS //SYSINDD * * See DB2 Performance and Tuning Section 5.4.1.1 * *** DSNDQWST DSECT=YES,SUBTYPE=ALLType 100 DSNDQWAS DSECT=YES,SUBTYPE=ALLType 101 * *** DSNDQWSP DSECT=YES,SUBTYPE=ALLType 102 END /* Good luck! Charles -Original Message- From: IBM Mainframe Discussion List [mailto:IBM-MAIN@bama.ua.edu] On Behalf Of Hal Merritt Sent: Tuesday, April 12, 2011 1:10 PM To: IBM-MAIN@bama.ua.edu Subject: DB2 SMF Records Anyone know I could find the layouts (DSECTs) of DB2 SMF records? Specifically Type 100, 101, & 102 ? -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: DB2 SMF Records
Oh boy, do you have some fun cut out for you! //SYSLIB DD DISP=SHR,DSN=DB2.DSN710.ADSNMACS //SYSINDD * * See DB2 Performance and Tuning Section 5.4.1.1 * *** DSNDQWST DSECT=YES,SUBTYPE=ALLType 100 DSNDQWAS DSECT=YES,SUBTYPE=ALLType 101 * *** DSNDQWSP DSECT=YES,SUBTYPE=ALLType 102 END /* Good luck! Charles -Original Message- From: IBM Mainframe Discussion List [mailto:IBM-MAIN@bama.ua.edu] On Behalf Of Hal Merritt Sent: Tuesday, April 12, 2011 1:10 PM To: IBM-MAIN@bama.ua.edu Subject: DB2 SMF Records Anyone know I could find the layouts (DSECTs) of DB2 SMF records? Specifically Type 100, 101, & 102 ? -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: DB2 SMF Records
They're not the easiest records to parse, BTW. But then again they're not the hardest. :-) Martin Martin Packer, Mainframe Performance Consultant, zChampion Worldwide Banking Center of Excellence, IBM +44-7802-245-584 email: martin_pac...@uk.ibm.com Twitter / Facebook IDs: MartinPacker Blog: https://www.ibm.com/developerworks/mydeveloperworks/blogs/MartinPacker IBM Mainframe Discussion List wrote on 12/04/2011 21:28:57: > From: > > Matthew Stitt > > To: > > IBM-MAIN@bama.ua.edu > > Date: > > 12/04/2011 21:30 > > Subject: > > Re: DB2 SMF Records > > Sent by: > > IBM Mainframe Discussion List > > Try looking in SDSNMACS, members starting with DSNDQW.. > > I remember looking at these records several years ago and almost throwing up > my hands due to the layouts. > > On Tue, 12 Apr 2011 15:09:43 -0500, Hal Merritt > wrote: > > >Anyone know I could find the layouts (DSECTs) of DB2 SMF records? > Specifically Type 100, 101, & 102 ? > > > >Thanks!! > > > > -- > For IBM-MAIN subscribe / signoff / archive access instructions, > send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO > Search the archives at http://bama.ua.edu/archives/ibm-main.html Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: DB2 SMF Records
On Tue, 12 Apr 2011 15:28:57 -0500, Matthew Stitt wrote: >Try looking in SDSNMACS, members starting with DSNDQW.. > >I remember looking at these records several years ago and almost throwing up >my hands due to the layouts. > >On Tue, 12 Apr 2011 15:09:43 -0500, Hal Merritt wrote: > >>Anyone know I could find the layouts (DSECTs) of DB2 SMF records? >Specifically Type 100, 101, & 102 ? >> >>Thanks!! >> Took some digging, but in the DB2 Performance and Tuning Guide they seem to somewhat lay it out, on page 572. http://publib.boulder.ibm.com/epubs/pdf/dsnpfk19.pdf I agree with Matt, good luck! HTH! -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: DB2 SMF Records
Try looking in SDSNMACS, members starting with DSNDQW.. I remember looking at these records several years ago and almost throwing up my hands due to the layouts. On Tue, 12 Apr 2011 15:09:43 -0500, Hal Merritt wrote: >Anyone know I could find the layouts (DSECTs) of DB2 SMF records? Specifically Type 100, 101, & 102 ? > >Thanks!! > -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
DB2 SMF Records
Anyone know I could find the layouts (DSECTs) of DB2 SMF records? Specifically Type 100, 101, & 102 ? Thanks!! NOTICE: This electronic mail message and any files transmitted with it are intended exclusively for the individual or entity to which it is addressed. The message, together with any attachment, may contain confidential and/or privileged information. Any unauthorized review, use, printing, saving, copying, disclosure or distribution is strictly prohibited. If you have received this message in error, please immediately advise the sender by reply email and delete all copies. -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Processing Compressed SMF Records with MXG
I changed the subject from the How Log For SMF to Switch to answer the question posed in that thread with regard to MXG and it's handling of compressed SMF records from CICS and (new in V10) DB2: For sites executing on z/OS, MXG 28.07 provides the ASM code in member EXITCICS to create a SAS "Infile" Exit that decompresses the SMF 110-1 CICS records and the SMF 100,101, and 102 DB2 records, transparently, once the load module is created and stored in a STEPLIB, and MXG is informed the exit exists with //SYSIN DD * %LET SMFEXIT=CICS; to enable MXG to use that decompression infile exit. In addition, if the infile exit is not installed on z/OS, or if MXG is executed on ASCII SAS (which does not provide "Infile Exits"), the compressed records are transparently processed using an internal SAS code algorithm, which, unfortunately is VERY CPU EXPENSIVE on z/OS. (So expensive MXG prints ERROR messages when the internal algorithm is used on z/OS where the EXITCICS algorithm should be used.) On z/OS, for CICS, the IBM utility DFH$MOLS will decompress the SMF 110 subtype 1 records, but there is (at present) no IBM utility that decompresses the DB2 V10 SMF records. The below note from the NEXT MXG NEWSLETTER www.mxg.com/newsltrs compares processing of compressed CICS SMF records. Barry Merrill Herbert W. Barry Merrill, PhD President-Programmer Merrill Consultants MXG Software 10717 Cromwell Drive Dallas, TX 75229 ba...@mxg.com http://www.mxg.com admin questions: ad...@mxg.com technical questions: supp...@mxg.com tel: 214 351 1966 fax: 214 350 3694 1. Processing Compressed CICS data on z/OS and on Windows. An SMF file of 125,712 ID=110 records that created 267,899 CICSTRAN transactions was 212 MB when IBM Compression was enabled, and was 970 MB when uncompressed by the IBM utility DFH$MOLS. The example JCL for CICS decompression is in new DFH$MOLS member in MXG 28.06. On z/OS, three alternatives exist to process compressed CICS data: a. Use DFH$MOLS first to uncompress the file and read UNCOMPRESSED. b. Use EXITCICS (SAS Infile Exit) to read COMPRESSED WITH EXIT. c. Use MXG's internal SAS code to read COMPRESSED WITH INTERNAL. Average 7 runs:ElapsedTCBSRB EXCP Connect Size (min)(min) (min) (sec) a. DFH$MOLS.8 .07.00 53158 11.2 212/970 UNCOMPRESSED 2.0 .62.01 47934 11.3 970 MB total 2.8 .69.01 101092 22.5 b. COMP WITH EXIT 2.3 .70.00 145495.7 212 MB c. INTERNAL SAS 22.4 9.88.00 145545.7 212 MB As previously reported, the INTERNAL SAS algorithm on z/OS is VERY CPU intensive (and it takes a long time, too!). DFH$MOLS and read UNCOMPRESSED is only slightly slower than reading COMPRESSED+EXIT, but the uncompressed file needs nearly 5 times the disk space for the (temporary) uncompressed file, and I/O activity with DFH$MOLS (read compressed, write uncompressed, then read uncompressed) took six times the EXCPs and four times the IOTM (Connect Time), so the reading of the compressed file with the EXITCICS exit is best. On Windows/ascii platforms, SAS Infile Exits do not exist (and, if they existed, the ASM code in EXITCICS couldn't execute on ASCII), so if the SMF data file is downloaded and then processed, there are only two ways to process compressed CICS data: a. Use DFH$MOLS first to uncompress the file and read UNCOMPRESSED. c. Use MXG's internal SAS algorithm to read COMPRESSED NO EXIT. Elapsed User SYSSize a. DFH$MOLS.4 .07.00 212/970 ftp download 2.0 .04.00970 MB UNCOMPRESSED.4 .23.05970 MB total2.8 .34.05 c. ftp download 2.0 .04.00212 MB INTERNAL SAS 3.8 2.71.05212 MB total5.8 2.75.05 The internal algorithm on Windows is only ten times as CPU intensive reading the compressed file, compared to reading uncompressed, but a lot more disk space is needed for the uncompressed file. Unfortunately, at this test site, we were not able to use the SAS ftp access method on ASCII to read the uncompressed and compressed files directly from z/OS, without download, for that comparison, but prior tests using the access method to directly read z/OS files have always been cheaper and faster than reading the downloaded files, so I would expect that if you can tolerate the temporary disk space on z/OS for the uncompressed file, using DFH$MOLS first would be best. ---
Re: eliminate the duplicate SMF records
>From my class notes: What Causes Duplicate SMF Data? Must have a software/hardware failure followed by human error. When IEAFSMDP program fails, you must determine where it failed a. First phase, copies (dumps) data from VSAM to BSAM file. Must delete the BSAM output from failed run if IFASMFDP fails in this First phase. Then rerun IEASMFDP. b. Second phase, writes EOF in each VSAM block Dumped data is good if IFASMFDP fails in this Second phase. Rerun IEASMFDP with only CLEAR option (to write EOFs). c. How to tell where failure occurred, first or second phase? If the last physical record on output BSAM is ID=3 (Trailer) then First phase completed successfully, ELSE NOT. MXG Users can give this program to tell Operations in which Phase the IFASMSDP program failed: %INCLUDE SOURCLIB(VMACSMF); DATA; _SMF IF ENDOFSMF AND ID=3 THEN PUT 'FAILED IN 2ND PHASE'; ELSE IF ENDOFSMF AND ID NE 3 THEN PUT 'FAILED IN 1ST PHASE'; d. MXG prints each Header (02) and Trailer (03) SMF time on log Plus time of first and last record in each "Chunk". Can see how the SMF dump tape was created. Barry Merrill -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: eliminate the duplicate SMF records
On 10/17/2010 10:28 AM, john gilmore wrote: Flippancies aside, Mr Engleberger's suggestion that duplicate sort records can be eliminated in a DFSORT E35 routine--One can be written in assembly language, in C, in PL/I, or even in, say, COBOL--is an entirely viable and appropriate one. I continue, however, to be puzzled by the notion of duplicate SMF records. Record types that contain some of the same information in a succession of records written are clearly possible, even frequent; but identical SMF timestamps are outside my experience (except for the rare STCK cases that the STCKE programmable field now addresses and eliminates,. which could be but have never in my own experience been records of the same SMF type). In any case 'duplicates', however Mr Tsui wishes to define them, can be eliminated readily in an E35 routine, which can and should report on its actions, outputting a multinomial EFD of the numbers of duplicate records it encounters and eliminates (so many pairs, so many triples, etc., and a total). John Gilmore Ashland, MA 01721-1817 USA ... The first two ways that come to mind for aggregating a days' worth of SMF records are (1) to save all the original SMF offload files for the day and then merge a variable number of offload files in a daily run after midnight, or (2) start with an empty daily accumulation file and "mod" each SMF offload file onto the end of that file. Approach (2) has the advantage of simplicity and requiring the minimal amount of processing time and DASD to keep all data on DASD. But, as the volume of data grows with time it also it also has a nasty failure mode of running out of DASD extents in the middle of the night in the middle of processing the last SMF offload file of the day. To recover from such a failure requires reallocating and copying almost a full day's worth of data from the old aggregation file and then reprocessing the SMF offload file causing the failure, but any records successfully processed from that last offload file before the failure will be duplicated unless you somehow eliminate them. I would suspect something like this may be the source of the duplicates in question not the original SMF data. We started with approach (1), but after about ten years on MVS space failures started occurring at least once a month and each time recovery took over an hour waiting for recovery jobs to complete. I used the time waiting on those recovery jobs to design and implement a variation of approach (1) which in most cases can use what I call a "windowed merge/copy" to put the data in sorted order in a single pass despite the jitter in SMF time stamps. -- Joel C. Ewing, Fort Smith, ARjcew...@acm.org -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: eliminate the duplicate SMF records
John Gilmore wrote on IBM-MAIN (Original thread was on Assembler-L): >Flippancies aside, Mr Engleberger's My surname is Engelbrecht. G ;-D > suggestion that duplicate sort records can be eliminated in a DFSORT E35 routine--One can be written in assembly language, in C, in PL/I, or even in, say, COBOL--is an entirely viable and appropriate one. I assumed that the original poster already wrote/use something to post process those SMF records and thus discovered these duplicates. You can write RYO programs to handle SMF records in any language. For myself, I find DFSORT exit handling very convenient to handle SMF records. One good reason is that DFSORT preserves the original sequence of SMF records (if same of course) upon sorting and you can then decide what to do with the records as passed by DFSORT. For example, you can keep only the last/first record, move any extra records to other output, do summaries on duplicates, etc. (exactly what you suggested indeed.) >I continue, however, to be puzzled by the notion of duplicate SMF records. Record types that contain some of the same information in a succession of records written are clearly possible, even frequent; Indeed, this is why I asked on Assembler-L *why* and how it is an issue. > but identical SMF timestamps are outside my experience (except for the rare STCK cases that the STCKE programmable field now addresses and eliminates,. which could be but have never in my own experience been records of the same SMF type). AFAIK, identical SMF timestamps have been discussed on IBM-MAIN and Assembler-L. >In any case 'duplicates', however Mr Tsui wishes to define them, can be eliminated readily in an E35 routine, which can and should report on its actions, outputting a multinomial EFD of the numbers of duplicate records it encounters and eliminates (so many pairs, so many triples, etc., and a total). Agreed. See also Paul's reply too. IMHO, we should continue on Assembler-L this discussion if you wish. Thanks for your kind answer and have a very nice day. Groete / Greetings Elardus Engelbrecht -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: eliminate the duplicate SMF records
Flippancies aside, Mr Engleberger's suggestion that duplicate sort records can be eliminated in a DFSORT E35 routine--One can be written in assembly language, in C, in PL/I, or even in, say, COBOL--is an entirely viable and appropriate one. I continue, however, to be puzzled by the notion of duplicate SMF records. Record types that contain some of the same information in a succession of records written are clearly possible, even frequent; but identical SMF timestamps are outside my experience (except for the rare STCK cases that the STCKE programmable field now addresses and eliminates,. which could be but have never in my own experience been records of the same SMF type). In any case 'duplicates', however Mr Tsui wishes to define them, can be eliminated readily in an E35 routine, which can and should report on its actions, outputting a multinomial EFD of the numbers of duplicate records it encounters and eliminates (so many pairs, so many triples, etc., and a total). John Gilmore Ashland, MA 01721-1817 USA -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: SMF records for data set open/close
On 3 Aug 2010 13:22:07 -0700, in bit.listserv.ibm-main you wrote: >I'm also curious as to why you would want to filter out the recording of >SMF records for certain datasets. SMF records are useful for a variety >of analysis tasks, not the least of which would be an audit trail in >case something happened to the dataset, or someone who shouldn't >accesses it. Working for a bank I can just hear the auditor's and >security folks screaming right now. Wouldn't the RACF/ACF/Top Secret logging be enough for audit purposes? The records for the selected data sets and started tasks may be redundant and useless information. Clark Morris > >Tom Kelman > >-Original Message- >From: IBM Mainframe Discussion List [mailto:ibm-m...@bama.ua.edu] On >Behalf Of Rick Fochtman >Sent: Tuesday, August 03, 2010 12:46 PM >To: IBM-MAIN@bama.ua.edu >Subject: Re: SMF records for data set open/close > >-- > >In addition to the dataset name, would I also be able to filter on the >STC name as well? Thanks to all who've helped answer this question for >me. > > >The IEFU83/84/85 exits get to examine every SMF record before they are >written. You can examine any field in the record to make your decision. > >Curious: why? > >Rick > -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: SMF records for data set open/close
--- I'm also curious as to why you would want to filter out the recording of SMF records for certain datasets. SMF records are useful for a variety of analysis tasks, not the least of which would be an audit trail in case something happened to the dataset, or someone who shouldn't accesses it. Working for a bank I can just hear the auditor's and security folks screaming right now. - You are hearing "The Sounds of Silence"; your auditors and security people are lying on the floor in a dead faint condition. Deleting or suppressing a single SMF record will give an auditor the heebie-jeebies. Just the thought makes him wonder how much is being hidden and thus untrackable. Rick -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: SMF records for data set open/close
Sure, and if he is trying to exlude records for temporary datasets, there a parameter in SMFPRMxx for it. Kees. "Kelman, Tom" wrote in message news:... > I'm also curious as to why you would want to filter out the recording of > SMF records for certain datasets. SMF records are useful for a variety > of analysis tasks, not the least of which would be an audit trail in > case something happened to the dataset, or someone who shouldn't > accesses it. Working for a bank I can just hear the auditor's and > security folks screaming right now. > > Tom Kelman > > -Original Message- > From: IBM Mainframe Discussion List [mailto:ibm-m...@bama.ua.edu] On > Behalf Of Rick Fochtman > Sent: Tuesday, August 03, 2010 12:46 PM > To: IBM-MAIN@bama.ua.edu > Subject: Re: SMF records for data set open/close > > -- > > In addition to the dataset name, would I also be able to filter on the > STC name as well? Thanks to all who've helped answer this question for > me. > > > The IEFU83/84/85 exits get to examine every SMF record before they are > written. You can examine any field in the record to make your decision. > > Curious: why? > > Rick > > -- > For IBM-MAIN subscribe / signoff / archive access instructions, > send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO > Search the archives at http://bama.ua.edu/archives/ibm-main.html > > > * > If you wish to communicate securely with Commerce Bank and its > affiliates, you must log into your account under Online Services at > http://www.commercebank.com or use the Commerce Bank Secure > Email Message Center at https://securemail.commercebank.com > > NOTICE: This electronic mail message and any attached files are > confidential. The information is exclusively for the use of the > individual or entity intended as the recipient. If you are not > the intended recipient, any use, copying, printing, reviewing, > retention, disclosure, distribution or forwarding of the message > or any attached file is not authorized and is strictly prohibited. > If you have received this electronic mail message in error, please > advise the sender by reply electronic mail immediately and > permanently delete the original transmission, any attachments > and any copies of this message from your computer system. > * > > -- > For IBM-MAIN subscribe / signoff / archive access instructions, > send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO > Search the archives at http://bama.ua.edu/archives/ibm-main.html For information, services and offers, please visit our web site: http://www.klm.com. This e-mail and any attachment may contain confidential and privileged material intended for the addressee only. If you are not the addressee, you are notified that no part of the e-mail or any attachment may be disclosed, copied or distributed, and that any other action related to this e-mail or attachment is strictly prohibited, and may be unlawful. If you have received this e-mail by error, please notify the sender immediately by return e-mail, and delete this message. Koninklijke Luchtvaart Maatschappij NV (KLM), its subsidiaries and/or its employees shall not be liable for the incorrect or incomplete transmission of this e-mail or any attachments, nor responsible for any delay in receipt. Koninklijke Luchtvaart Maatschappij N.V. (also known as KLM Royal Dutch Airlines) is registered in Amstelveen, The Netherlands, with registered number 33014286 -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: SMF records for data set open/close
W dniu 2010-08-03 16:28, Stan Weyman pisze: Does anyone know of a way to prevent the cutting of SMF records for certain dataset open/close activities. We don't want to recommend use of SMFPRMxx as they want to continue cutting SMF records for other dataset names but not some. Well. What is the real need? Why do you want it? I'm asking because instead of coding exits just to literally fulfill the requirements (which is time-consuming and costly), maybe - for example - it would be enough to use SMF80 (RACF) records for that. RACF can be used to audit all or some dataset activities. Very flexible options for choosing what datasets and what users and STCs. Worth to consider. -- Radoslaw Skorupka Lodz, Poland -- BRE Bank SA ul. Senatorska 18 00-950 Warszawa www.brebank.pl Sd Rejonowy dla m. st. Warszawy XII Wydzia Gospodarczy Krajowego Rejestru Sdowego, nr rejestru przedsibiorców KRS 025237 NIP: 526-021-50-88 Wedug stanu na dzie 01.01.2009 r. kapita zakadowy BRE Banku SA (w caoci wpacony) wynosi 118.763.528 zotych. W zwizku z realizacj warunkowego podwyszenia kapitau zakadowego, na podstawie uchway XXI WZ z dnia 16 marca 2008r., oraz uchway XVI NWZ z dnia 27 padziernika 2008r., moe ulec podwyszeniu do kwoty 123.763.528 z. Akcje w podwyszonym kapitale zakadowym BRE Banku SA bd w caoci opacone. -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: SMF records for data set open/close
I'm also curious as to why you would want to filter out the recording of SMF records for certain datasets. SMF records are useful for a variety of analysis tasks, not the least of which would be an audit trail in case something happened to the dataset, or someone who shouldn't accesses it. Working for a bank I can just hear the auditor's and security folks screaming right now. Tom Kelman -Original Message- From: IBM Mainframe Discussion List [mailto:ibm-m...@bama.ua.edu] On Behalf Of Rick Fochtman Sent: Tuesday, August 03, 2010 12:46 PM To: IBM-MAIN@bama.ua.edu Subject: Re: SMF records for data set open/close -- In addition to the dataset name, would I also be able to filter on the STC name as well? Thanks to all who've helped answer this question for me. The IEFU83/84/85 exits get to examine every SMF record before they are written. You can examine any field in the record to make your decision. Curious: why? Rick -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html * If you wish to communicate securely with Commerce Bank and its affiliates, you must log into your account under Online Services at http://www.commercebank.com or use the Commerce Bank Secure Email Message Center at https://securemail.commercebank.com NOTICE: This electronic mail message and any attached files are confidential. The information is exclusively for the use of the individual or entity intended as the recipient. If you are not the intended recipient, any use, copying, printing, reviewing, retention, disclosure, distribution or forwarding of the message or any attached file is not authorized and is strictly prohibited. If you have received this electronic mail message in error, please advise the sender by reply electronic mail immediately and permanently delete the original transmission, any attachments and any copies of this message from your computer system. * -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: SMF records for data set open/close
-- In addition to the dataset name, would I also be able to filter on the STC name as well? Thanks to all who've helped answer this question for me. The IEFU83/84/85 exits get to examine every SMF record before they are written. You can examine any field in the record to make your decision. Curious: why? Rick -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: SMF records for data set open/close
In addition to the dataset name, would I also be able to filter on the STC name as well? Thanks to all who've helped answer this question for me. -Original Message- From: IBM Mainframe Discussion List [mailto:ibm-m...@bama.ua.edu] On Behalf Of Rob Scott Sent: Tuesday, August 03, 2010 10:34 AM To: IBM-MAIN@bama.ua.edu Subject: Re: SMF records for data set open/close Stan, You need to code up IEFU83/4/5 exit to suppress the SMF records being written for subsets of dataset names. Rob Scott Lead Developer Rocket Software 275 Grove Street * Newton, MA 02466-2272 * USA Tel: +1.617.614.2305 Email: rsc...@rs.com Web: www.rocketsoftware.com -Original Message- From: IBM Mainframe Discussion List [mailto:ibm-m...@bama.ua.edu] On Behalf Of Stan Weyman Sent: 03 August 2010 16:28 To: IBM-MAIN@bama.ua.edu Subject: SMF records for data set open/close Does anyone know of a way to prevent the cutting of SMF records for certain dataset open/close activities. We don't want to recommend use of SMFPRMxx as they want to continue cutting SMF records for other dataset names but not some. Thanks ahead of time for the assistance Stan -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: SMF records for data set open/close
>Does anyone know of a way to prevent the cutting of SMF records for certain >dataset open/close activities. Exits, only. These days, it's not always a good thing. >We don't want to recommend use of SMFPRMxx as they want to continue cutting >SMF records for other dataset names but not some. What problem are they trying to solve? Why some, rather than all or nothing? - I'm a SuperHero with neither powers, nor motivation! Kimota! -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: SMF records for data set open/close
Stan, You need to code up IEFU83/4/5 exit to suppress the SMF records being written for subsets of dataset names. Rob Scott Lead Developer Rocket Software 275 Grove Street * Newton, MA 02466-2272 * USA Tel: +1.617.614.2305 Email: rsc...@rs.com Web: www.rocketsoftware.com -Original Message- From: IBM Mainframe Discussion List [mailto:ibm-m...@bama.ua.edu] On Behalf Of Stan Weyman Sent: 03 August 2010 16:28 To: IBM-MAIN@bama.ua.edu Subject: SMF records for data set open/close Does anyone know of a way to prevent the cutting of SMF records for certain dataset open/close activities. We don't want to recommend use of SMFPRMxx as they want to continue cutting SMF records for other dataset names but not some. Thanks ahead of time for the assistance Stan -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
SMF records for data set open/close
Does anyone know of a way to prevent the cutting of SMF records for certain dataset open/close activities. We don't want to recommend use of SMFPRMxx as they want to continue cutting SMF records for other dataset names but not some. Thanks ahead of time for the assistance Stan -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: SMF records correalte to JES2 JOBID
>$HASP250 INIT PURGED -- (JOB KEY WAS C63E10F9) That does not make it to any SMF record, as far as I know. That is an internal identifier. - I'm a SuperHero with neither powers, nor motivation! Kimota! -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: SMF records correalte to JES2 JOBID
Miklos Szigetvari wrote: >Not tools, just the poor SMF records. Ok. >For example select the 14 and 15 records for a given JOBNAME and JOBID JOBID is NOT in SMF record 14 (and 15). Other SMF records : SMF type 6 - SMF6JBN (Jobname) in Header. For SMF6JBID (Job id) you will need to calculate the Offsets programmatically. The same goes for other records for example SMF 30 as described by John. About '(JOB KEY WAS C63E10F9)' - I've just now looked in the SMF book. It is not recorded there AFAIK. Groete / Greetings Elardus Engelbrecht -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: SMF records correalte to JES2 JOBID
> -Original Message- > From: IBM Mainframe Discussion List > [mailto:ibm-m...@bama.ua.edu] On Behalf Of Miklos Szigetvari > Sent: Thursday, July 08, 2010 9:53 AM > To: IBM-MAIN@bama.ua.edu > Subject: Re: SMF records correalte to JES2 JOBID > > On 7/8/2010 4:43 PM, McKown, John wrote: > >> -Original Message- > >> From: IBM Mainframe Discussion List > >> [mailto:ibm-m...@bama.ua.edu] On Behalf Of Miklos Szigetvari > >> Sent: Thursday, July 08, 2010 9:40 AM > >> To: IBM-MAIN@bama.ua.edu > >> Subject: Re: SMF records correalte to JES2 JOBID > >> > >> Hi > >> > >> Thank you , that is it . > >> As we are a very small shop, hope in the uniqueness of the JOBID . > >> If we are here , what is in the JES JOB KEY field ? > >> > > what is the "JES JOB KEY" field? That does not ring any > bells with me. > > > $HASP250 INIT PURGED -- (JOB KEY WAS C63E10F9) Good question - I don't know. -- John McKown Systems Engineer IV IT Administrative Services Group HealthMarkets(r) 9151 Boulevard 26 * N. Richland Hills * TX 76010 (817) 255-3225 phone * (817)-961-6183 cell john.mck...@healthmarkets.com * www.HealthMarkets.com Confidentiality Notice: This e-mail message may contain confidential or proprietary information. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message. HealthMarkets(r) is the brand name for products underwritten and issued by the insurance subsidiaries of HealthMarkets, Inc. -The Chesapeake Life Insurance Company(r), Mid-West National Life Insurance Company of TennesseeSM and The MEGA Life and Health Insurance Company.SM -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: SMF records correalte to JES2 JOBID
On 7/8/2010 4:43 PM, McKown, John wrote: -Original Message- From: IBM Mainframe Discussion List [mailto:ibm-m...@bama.ua.edu] On Behalf Of Miklos Szigetvari Sent: Thursday, July 08, 2010 9:40 AM To: IBM-MAIN@bama.ua.edu Subject: Re: SMF records correalte to JES2 JOBID Hi Thank you , that is it . As we are a very small shop, hope in the uniqueness of the JOBID . If we are here , what is in the JES JOB KEY field ? what is the "JES JOB KEY" field? That does not ring any bells with me. $HASP250 INIT PURGED -- (JOB KEY WAS C63E10F9) -- John McKown Systems Engineer IV IT Administrative Services Group HealthMarkets(r) 9151 Boulevard 26 * N. Richland Hills * TX 76010 (817) 255-3225 phone * (817)-961-6183 cell john.mck...@healthmarkets.com * www.HealthMarkets.com Confidentiality Notice: This e-mail message may contain confidential or proprietary information. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message. HealthMarkets(r) is the brand name for products underwritten and issued by the insurance subsidiaries of HealthMarkets, Inc. -The Chesapeake Life Insurance Company(r), Mid-West National Life Insurance Company of TennesseeSM and The MEGA Life and Health Insurance Company.SM -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: SMF records correalte to JES2 JOBID
> -Original Message- > From: IBM Mainframe Discussion List > [mailto:ibm-m...@bama.ua.edu] On Behalf Of Miklos Szigetvari > Sent: Thursday, July 08, 2010 9:40 AM > To: IBM-MAIN@bama.ua.edu > Subject: Re: SMF records correalte to JES2 JOBID > > Hi > > Thank you , that is it . > As we are a very small shop, hope in the uniqueness of the JOBID . > If we are here , what is in the JES JOB KEY field ? what is the "JES JOB KEY" field? That does not ring any bells with me. -- John McKown Systems Engineer IV IT Administrative Services Group HealthMarkets(r) 9151 Boulevard 26 * N. Richland Hills * TX 76010 (817) 255-3225 phone * (817)-961-6183 cell john.mck...@healthmarkets.com * www.HealthMarkets.com Confidentiality Notice: This e-mail message may contain confidential or proprietary information. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message. HealthMarkets(r) is the brand name for products underwritten and issued by the insurance subsidiaries of HealthMarkets, Inc. -The Chesapeake Life Insurance Company(r), Mid-West National Life Insurance Company of TennesseeSM and The MEGA Life and Health Insurance Company.SM -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: SMF records correalte to JES2 JOBID
Hi Thank you , that is it . As we are a very small shop, hope in the uniqueness of the JOBID . If we are here , what is in the JES JOB KEY field ? On 7/8/2010 4:23 PM, McKown, John wrote: -Original Message- From: IBM Mainframe Discussion List [mailto:ibm-m...@bama.ua.edu] On Behalf Of Miklos Szigetvari Sent: Thursday, July 08, 2010 9:04 AM To: IBM-MAIN@bama.ua.edu Subject: SMF records correalte to JES2 JOBID Hi How to select SMF records for a given JOBNAME and JOBID ? With fear and trembling?? First off, there is no guaranteed "unique key" for a job. The closest is the jobname || reader start date || reader start time. But this is not guaranteed to be unique, though it usually is. Given that, you'd need to derive this "key" from the SMF record type 30, subtype 1. In the identification section, SMF30JNM has the jes job number, SMF30JBN is the job name, SMF30RST is the reader start time and SMF30RSD is the reader start date. Once you have these latter 3 values, scan the rest of the SMF records for them. -- John McKown Systems Engineer IV IT Administrative Services Group HealthMarkets(r) 9151 Boulevard 26 * N. Richland Hills * TX 76010 (817) 255-3225 phone * (817)-961-6183 cell john.mck...@healthmarkets.com * www.HealthMarkets.com Confidentiality Notice: This e-mail message may contain confidential or proprietary information. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message. HealthMarkets(r) is the brand name for products underwritten and issued by the insurance subsidiaries of HealthMarkets, Inc. -The Chesapeake Life Insurance Company(r), Mid-West National Life Insurance Company of TennesseeSM and The MEGA Life and Health Insurance Company.SM -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: SMF records correalte to JES2 JOBID
On 7/8/2010 4:23 PM, Elardus Engelbrecht wrote: Miklos Szigetvari wrote: How to select SMF records for a given JOBNAME and JOBID ? With what tool? What SMF records? Or if you could give us a hint what details from the selected records you want, perhaps someone can give you a good answer. Groete / Greetings Elardus Engelbrecht -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html Not tools, just the poor SMF records. For example select the 14 and 15 records for a given JOBNAME and JOBID -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: SMF records correalte to JES2 JOBID
> -Original Message- > From: IBM Mainframe Discussion List > [mailto:ibm-m...@bama.ua.edu] On Behalf Of Miklos Szigetvari > Sent: Thursday, July 08, 2010 9:04 AM > To: IBM-MAIN@bama.ua.edu > Subject: SMF records correalte to JES2 JOBID > > Hi > > How to select SMF records for a given JOBNAME and JOBID ? With fear and trembling?? First off, there is no guaranteed "unique key" for a job. The closest is the jobname || reader start date || reader start time. But this is not guaranteed to be unique, though it usually is. Given that, you'd need to derive this "key" from the SMF record type 30, subtype 1. In the identification section, SMF30JNM has the jes job number, SMF30JBN is the job name, SMF30RST is the reader start time and SMF30RSD is the reader start date. Once you have these latter 3 values, scan the rest of the SMF records for them. -- John McKown Systems Engineer IV IT Administrative Services Group HealthMarkets(r) 9151 Boulevard 26 * N. Richland Hills * TX 76010 (817) 255-3225 phone * (817)-961-6183 cell john.mck...@healthmarkets.com * www.HealthMarkets.com Confidentiality Notice: This e-mail message may contain confidential or proprietary information. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message. HealthMarkets(r) is the brand name for products underwritten and issued by the insurance subsidiaries of HealthMarkets, Inc. -The Chesapeake Life Insurance Company(r), Mid-West National Life Insurance Company of TennesseeSM and The MEGA Life and Health Insurance Company.SM -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: SMF records correalte to JES2 JOBID
Miklos Szigetvari wrote: >How to select SMF records for a given JOBNAME and JOBID ? With what tool? What SMF records? Or if you could give us a hint what details from the selected records you want, perhaps someone can give you a good answer. Groete / Greetings Elardus Engelbrecht -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
SMF records correalte to JES2 JOBID
Hi How to select SMF records for a given JOBNAME and JOBID ? -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: ICETOOL question: Two different SMF records
Binyamin Dissen on IBM Mainframe Discussion List wrote on 07/07/2010 10:51:12 AM: > I have an application which produces multiple SMF records. I have created an > ICETOOL job to format the detail records, but I would like to include the > header record. The header record is a different subtype with different data. I > would like the report to indicate there was a started record (perhaps put > *STARTED* in one of the detail columns) and the other detail columns to be > blank. > > Is this possible? The detail records contain numbers as well as text, if that > make a difference. I suspect you can do something with DFSORT IFTHEN clauses to reformat the various records the way you want them so ICETOOL can give you the report you want. Or you could use OUTFIL reporting directly rather than ICETOOL DISPLAY. But without knowing what your input records look like and what you expect for output, I can't suggest anything more specific. If you're using DFSORT and you want to send me more detailed information offline (yae...@us.ibm.com), I'd be happy to help you. I'd want to see the ICETOOL job you're currently using and an example of the input records and expected output. Frank Yaeger - DFSORT Development Team (IBM) - yae...@us.ibm.com Specialties: JOINKEYS, FINDREP, WHEN=GROUP, ICETOOL, Symbols, Migration => DFSORT/MVS is on the Web at http://www.ibm.com/storage/dfsort/ -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
ICETOOL question: Two different SMF records
I have an application which produces multiple SMF records. I have created an ICETOOL job to format the detail records, but I would like to include the header record. The header record is a different subtype with different data. I would like the report to indicate there was a started record (perhaps put *STARTED* in one of the detail columns) and the other detail columns to be blank. Is this possible? The detail records contain numbers as well as text, if that make a difference. -- Binyamin Dissen http://www.dissensoftware.com Director, Dissen Software, Bar & Grill - Israel Should you use the mailblocks package and expect a response from me, you should preauthorize the dissensoftware.com domain. I very rarely bother responding to challenge/response systems, especially those from irresponsible companies. -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Any IPv6 on the Mainframe Yet - Need IPv6 FTP SMF Records To Test DAF
Greetings, Any IPv6 on the Mainframe Yet - Need IPv6 FTP SMF Records To Test DAF These are SMF RT 119 and need to be activated in CS TCPIP via: For FTP Server records add to FTPD parms one of these: Add SMF STD TYPE119 (Both 118/119) Add SMF TYPE119 (Only 119) Add SMF STD (Only 118) Note: TYPE119 is new in z/OS 1.2 For FTP Client records add to TCPIP parms one of these: Add SMFCONFIG FTPCLIENT TYPE119 FTPCLIENT (Both 118/119) Add SMFCONFIG TYPE119 FTPCLIENT (Only 119) Add SMFCONFIG FTPCLIENT (Only 118) Note: TYPE119 FTPCLIENT is new in z/OS 1.2 I am looking for the newer SMF RT 119s, which replaced SMF RT 118s. Cheers, Michael === Instructions: 1) Creat the SMF file with IFASMFDP and XMIT the SMF file (JCL below) 2) do a binary transfer of the XMIT file to your PC 3) Zip the downloaded file 4) e-mail me the zipped file as an attachment Here is JCL to create the SMF file and XMIT it. //&SYSUID.SMF JOB (TECHY),'CLEARY',CLASS=U, // MSGCLASS=X,MSGLEVEL=(1,1),NOTIFY=&SYSUID. //DELETE EXEC PGM=IEFBR14 //DELETE1 DD DSN=ZTGP01.SMFTXXX,DISP=(MOD,DELETE,DELETE), // UNIT=SYSDA,SPACE=(CYL,(1,1)), // DCB=(RECFM=VBS,LRECL=32760,BLKSIZE=27998,BUFNO=64) //DELETE2 DD DSN=ZTGP01.SMFTXXX.XMI,DISP=(MOD,DELETE,DELETE), // UNIT=SYSDA,SPACE=(CYL,(1,1)), // DCB=(RECFM=VBS,LRECL=32760,BLKSIZE=27998,BUFNO=64) //IFASMFDP EXEC PGM=IFASMFDP //DUMPINDD DISP=SHR,DSN=DCTR.SMFDUMP.ACCUM.BBC1(+0), // DCB=(BUFNO=64) //DUMPOUT DD DSN=ZTGP01.SMFTXXX,DISP=(NEW,CATLG,CATLG), // UNIT=SYSDA,SPACE=(CYL,(100,50),RLSE), // DCB=(RECFM=VBS,LRECL=32760,BLKSIZE=27998,BUFNO=64) //SYSIN DD * INDD(DUMPIN,OPTIONS(DUMP)) OUTDD(DUMPOUT,TYPE(XXX)) //SYSPRINT DD SYSOUT=* //IKJEFT01 EXEC PGM=IKJEFT01 //SYSTSPRT DD SYSOUT=* //SYSPRINT DD SYSOUT=* //SYSTSIN DD * XMIT ANYNODE.ANYUSER + DATASET('ZTGP01.SMFTXXX') + OUTDATASET('ZTGP01.SMFTXXX.XMI') -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Reading SMF records using SAS - Date/Time format
On Thu, 26 Mar 2009 17:27:04 -0500, Santosh Kandi wrote: >Hello All, > >I am running SAS on MVS to read SMF30 records and want to the know the >easiest way to convert the Date/Time format >FROM: 15MAR09:00:05:19 >TO: YYMMDDHHMMSS > >When I read SMF records I use "SMFSTAMP8." for Input and then format it >with:FORMAT SMF30SIT DATETIME16. This gives me the format >15MAR09:00:05:19 > >But my requirement is to output the date/time as YYMMDDHHMMSS > >Thanks for your help. >Santosh > Recommend visiting the SAS support website http://support.sas.com/ and search for argument" PROC FORMAT datetime custom formats" argument, which are generated with the PICTURE statement. There are limits on formatting SAS 8601 style date and datetime values, as a general purpose, which can be handled with PROC FORMAT. Scott Barry SBBWorks, Inc. -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Reading SMF records using SAS - Date/Time format
Hello All, I am running SAS on MVS to read SMF30 records and want to the know the easiest way to convert the Date/Time format FROM: 15MAR09:00:05:19 TO: YYMMDDHHMMSS When I read SMF records I use "SMFSTAMP8." for Input and then format it with:FORMAT SMF30SIT DATETIME16. This gives me the format 15MAR09:00:05:19 But my requirement is to output the date/time as YYMMDDHHMMSS Thanks for your help. Santosh -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Copy SMF Records With Syncsort
You could also have corrected those records with just SAS, i.e., MXG not required: DATA _NULL_; INFILE SMF; INPUT @11 SYSTEM $EBCDIC4. @; IF SYSTEM='1234' THEN SYSTEM='5678'; ELSE ... change system to desired; FILE SMFOUT DCB=SMF; PUT _INFILE_ @11 SYSTEM $EBCDIC4. ; FILE LOG; -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Copy SMF Records With Syncsort
Yes you can, and I have done so when I knew the length of the records I was looking at weren't going to be an issue. But it isn't a viable option for making a copy of all your SMF data - even if you weren't modifying anything in it. Though the subject here was SCRT, which are SMF 89 records. Those should be okay. Mark -- Mark Zelden Sr. Software and Systems Architect - z/OS Team Lead Zurich North America / Farmers Insurance Group - ZFUS G-ITO mailto:mark.zel...@zurichna.com z/OS Systems Programming expert at http://expertanswercenter.techtarget.com/ Mark's MVS Utilities: http://home.flash.net/~mzelden/mvsutil.html On Thu, 5 Feb 2009 13:46:03 -0800, Natarajan Mohan wrote: >You could use IDCAMS to repro from a VBS to VB. Then REXX would be able to handle. > >Natarajan > Mark Zelden 2/5/2009 1:35 PM >>> >On Thu, 5 Feb 2009 12:59:07 -0600, John McKown wrote: > >>FileAid could do this sort of fix as well, if you have it. If you're really >>masochistic, you could even use REXX! >> > >Not really. REXX doesn't handle spanned records. > >Mark >-- >Mark Zelden >Sr. Software and Systems Architect - z/OS Team Lead >Zurich North America / Farmers Insurance Group - ZFUS G-ITO >mailto:mark.zel...@zurichna.com >z/OS Systems Programming expert at http://expertanswercenter.techtarget.com/ >Mark's MVS Utilities: http://home.flash.net/~mzelden/mvsutil.html -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Copy SMF Records With Syncsort
You could use IDCAMS to repro from a VBS to VB. Then REXX would be able to handle. Natarajan >>> Mark Zelden 2/5/2009 1:35 PM >>> On Thu, 5 Feb 2009 12:59:07 -0600, John McKown wrote: >FileAid could do this sort of fix as well, if you have it. If you're really >masochistic, you could even use REXX! > Not really. REXX doesn't handle spanned records. Mark -- Mark Zelden Sr. Software and Systems Architect - z/OS Team Lead Zurich North America / Farmers Insurance Group - ZFUS G-ITO mailto:mark.zel...@zurichna.com z/OS Systems Programming expert at http://expertanswercenter.techtarget.com/ Mark's MVS Utilities: http://home.flash.net/~mzelden/mvsutil.html -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html NOTICE OF CONFIDENTIALITY The information contained in this communication, including but not limited to any accompanying document(s) and/or attachment(s), is privileged and confidential and is intended solely for the above-named individual(s). If you are not the intended recipient, please be advised that any distribution, copying, disclosure, and/or use of the information contained herein is strictly prohibited. If you received this communication in error, please destroy all copies of the communication, whether in electronic or hard copy format, and immediately contact the Security Office at EDFUND at (916) 526-7539 or securityoff...@edfund.org. Thank you. -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Copy SMF Records With Syncsort
On Thu, 5 Feb 2009 12:59:07 -0600, John McKown wrote: >FileAid could do this sort of fix as well, if you have it. If you're really >masochistic, you could even use REXX! > Not really. REXX doesn't handle spanned records. Mark -- Mark Zelden Sr. Software and Systems Architect - z/OS Team Lead Zurich North America / Farmers Insurance Group - ZFUS G-ITO mailto:mark.zel...@zurichna.com z/OS Systems Programming expert at http://expertanswercenter.techtarget.com/ Mark's MVS Utilities: http://home.flash.net/~mzelden/mvsutil.html -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Copy SMF Records With Syncsort
Hi John, I just ran John Reda's sort and checked it out when I read your post. I hope you didn't spend a lot of time writing it. I don't think I'll try it right now, but I will keep a copy of it in case I have any more problems working with SMF records. SMF records ALWAYS give trouble sometimes. Thanks for your help. Eric -- Eric Bielefeld Systems Programmer Washington University St Louis, Missouri 314-935-3418 John McKown wrote: > the following COBOL program will do what you want. Well, in my minor test it > did. Compiled with Enterprise COBOL 3.4. > > 000100 PROCESS MAP,TRUNC(OPT),OPTIMIZE,VBREF,XREF,APOST,LIST > 000200 ID DIVISION. > 000300 PROGRAM-ID. SMFALTER. > 000400 AUTHOR. JOHN MCKOWN. > 000500 INSTALLATION. HEALTHMARKETS, INC. > 000600 DATE-WRITTEN. FEBRUARY 04, 2009. > 000700 DATE-COMPILED. > 000800 SECURITY. NONE. > 000900* > 001000 ENVIRONMENT DIVISION. > 001100 CONFIGURATION SECTION. > 001200 SOURCE-COMPUTER. IBM-370. > 001300 OBJECT-COMPUTER. IBM-370. > 001400 INPUT-OUTPUT SECTION. > 001500 FILE-CONTROL. > 001600 SELECT SMF-INPUT ASSIGN TO UT-S-SMFIN > 001700ORGANIZATION IS SEQUENTIAL > 001800ACCESS MODE IS SEQUENTIAL > 001900FILE STATUS IS SMFIN-FILE-STATUS. > 002000 SELECT SMF-OUTPUT ASSIGN TO UT-S-SMFOUT > 002100ORGANIZATION IS SEQUENTIAL > 002200ACCESS MODE IS SEQUENTIAL > 002300FILE STATUS IS SMFOUT-FILE-STATUS. > 002400 I-O-CONTROL. > 002500*APPLY WRITE-ONLY ON SMF-OUTPUT. > 002600* > 002700 DATA DIVISION. > 002800 FILE SECTION. > 002900 FD SMF-INPUT > 003000 BLOCK CONTAINS 0 RECORDS > 003100 LABEL RECORDS ARE STANDARD > 003200 RECORDING MODE IS S > 003300 RECORD IS VARYING IN SIZE FROM 1 TO 32763 CHARACTERS > 003400 DEPENDING ON WS-INPUT-RECORD-SIZE > 003500 . > 003600 01 SMF-INPUT-RECORD. > 003700 05 SMF-INPUT-DATA PIC X > 003800OCCURS 1 TO 32763 TIMES > 003900DEPENDING ON WS-INPUT-RECORD-SIZE > 004000. > 004100*01 LARGEST-INPUT-RECORD. > 004200*05 FILLER PIC X(32763). > 004300 01 SMF-COMMON-RECORD. > 004400 05 FILLERPIC X. > 004500 05 SMF-RECORD-TYPE PIC X. > 004600 88 SMF-RECORD-TYPE-30VALUE IS X'1E'. > 004700 05 SMF-TIME PIC S9(9) BINARY. > 004800 05 SMF-DATE PIC S9(7) PACKED-DECIMAL. > 004900 05 SMF-SYSTEM-ID PIC X(4). > 005000 05 SMF-SUBSYSTEM-ID PIC X(4). > 005100 05 SMF-RECORD-SUBTYPEPIC S9(4) BINARY. > 005200 88 SMF-RECORD-SUBTYPE-2 VALUE IS 2. > 005300 88 SMF-RECORD-SUBTYPE-3 VALUE IS 3. > 005400* > 005500 FD SMF-OUTPUT > 005600 BLOCK CONTAINS 0 RECORDS > 005700 LABEL RECORDS ARE STANDARD > 005800 RECORDING MODE IS S > 005900 RECORD IS VARYING IN SIZE FROM 1 TO 32763 CHARACTERS > 006000 DEPENDING ON WS-INPUT-RECORD-SIZE > 006100 . > 006200 01 SMF-OUTPUT-RECORD. > 006300 05 SMF-OUTPUT-BYTES PIC X > 006400 OCCURS 1 TO 32763 TIMES > 006500 DEPENDING ON WS-INPUT-RECORD-SIZE > 006600 . > 006700* > 006800 WORKING-STORAGE SECTION. > 006900 77 SMFIN-FILE-STATUS PIC XX. > 007000 77 SMFOUT-FILE-STATUSPIC XX. > 007100 77 EOF-ON-SMFIN-VALUEPIC X VALUE 'N'. > 007200 88 EOF-ON-SMFIN VALUE IS 'Y'. > 007300 77 TOTAL-RECORDS-READPIC S9(15) PACKED-DECIMAL > 007400 VALUE IS ZERO. > 007500 77 WS-INPUT-RECORD-SIZE PIC 9(9) BINARY. > 007600 77 TOTAL-RECORDS-WRITTEN PIC S9(15) PACKED-DECIMAL > 007700 VALUE IS ZERO. > 007800* > 007900*LINKAGE SECTION. > 008000* > 008100 PROCEDURE DIVISION. > 008200 START-UP. > 008300 OPEN INPUT SMF-INPUT > 008400 OUTPUT SMF-OUTPUT. > 008500 IF SMFIN-FILE-STATUS IS NOT EQUAL TO ZEROS THEN > 008600DISPLAY 'ERROR. INPUT FILE FAILED TO OPEN. STATUS=' > 008700SMFIN-FILE-STATUS UPON SYSOUT > 008800MOVE +8 TO RETURN-CODE > 008900END-IF. > 009000 IF SMFOUT-FILE-STATUS IS NOT EQUAL TO ZEROS THEN > 009100DISPLAY 'ERROR. OUTPUT FILE FAILED TO OPEN. STATUS=' > 009200SMFOUT-FILE-STATUS UPON SYSOUT > 009300MOVE +8 TO RETURN-CODE > 009400END-IF. > 009500 IF RETURN-CODE IS NOT EQUAL TO ZERO THEN > 009600GOBACK > 009700END-IF. > 009800 READ SMF-INPUT AT END SET EOF-ON-SMFIN TO TRUE. > 009900 PERFORM ALTER-INPU
Re: Copy SMF Records With Syncsort
John, Thanks. That worked very well, except I took the STOPAFT=50 off of the SORT statement. Thanks for taking time out of a busy day to help. But, then thats one of the reasons if anyone asks about Syncsort, I will recommend your product. Eric -- Eric Bielefeld Systems Programmer Washington University St Louis, Missouri 314-935-3418 "Reda wrote: > Eric, > > Sorry, it has been a real busy day. Try these control cards: > > ALTSEQ CODE=(C3C5,C4C6) > SORT FIELDS=COPY,STOPAFT=50 > OUTREC FIELDS=(1,4,5,10,15,1,TRAN=ALTSEQ,16) > > I believe they will produce the desired output with the release you are > running but please check the columns to make sure. Send me a private email > with the status. I will be able to get that even though I will be out of the > office. > > John Reda > Syncsort, Inc. -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Copy SMF Records With Syncsort
the following COBOL program will do what you want. Well, in my minor test it did. Compiled with Enterprise COBOL 3.4. 000100 PROCESS MAP,TRUNC(OPT),OPTIMIZE,VBREF,XREF,APOST,LIST 000200 ID DIVISION. 000300 PROGRAM-ID. SMFALTER. 000400 AUTHOR. JOHN MCKOWN. 000500 INSTALLATION. HEALTHMARKETS, INC. 000600 DATE-WRITTEN. FEBRUARY 04, 2009. 000700 DATE-COMPILED. 000800 SECURITY. NONE. 000900* 001000 ENVIRONMENT DIVISION. 001100 CONFIGURATION SECTION. 001200 SOURCE-COMPUTER. IBM-370. 001300 OBJECT-COMPUTER. IBM-370. 001400 INPUT-OUTPUT SECTION. 001500 FILE-CONTROL. 001600 SELECT SMF-INPUT ASSIGN TO UT-S-SMFIN 001700ORGANIZATION IS SEQUENTIAL 001800ACCESS MODE IS SEQUENTIAL 001900FILE STATUS IS SMFIN-FILE-STATUS. 002000 SELECT SMF-OUTPUT ASSIGN TO UT-S-SMFOUT 002100ORGANIZATION IS SEQUENTIAL 002200ACCESS MODE IS SEQUENTIAL 002300FILE STATUS IS SMFOUT-FILE-STATUS. 002400 I-O-CONTROL. 002500*APPLY WRITE-ONLY ON SMF-OUTPUT. 002600* 002700 DATA DIVISION. 002800 FILE SECTION. 002900 FD SMF-INPUT 003000 BLOCK CONTAINS 0 RECORDS 003100 LABEL RECORDS ARE STANDARD 003200 RECORDING MODE IS S 003300 RECORD IS VARYING IN SIZE FROM 1 TO 32763 CHARACTERS 003400 DEPENDING ON WS-INPUT-RECORD-SIZE 003500 . 003600 01 SMF-INPUT-RECORD. 003700 05 SMF-INPUT-DATA PIC X 003800OCCURS 1 TO 32763 TIMES 003900DEPENDING ON WS-INPUT-RECORD-SIZE 004000. 004100*01 LARGEST-INPUT-RECORD. 004200*05 FILLER PIC X(32763). 004300 01 SMF-COMMON-RECORD. 004400 05 FILLERPIC X. 004500 05 SMF-RECORD-TYPE PIC X. 004600 88 SMF-RECORD-TYPE-30VALUE IS X'1E'. 004700 05 SMF-TIME PIC S9(9) BINARY. 004800 05 SMF-DATE PIC S9(7) PACKED-DECIMAL. 004900 05 SMF-SYSTEM-ID PIC X(4). 005000 05 SMF-SUBSYSTEM-ID PIC X(4). 005100 05 SMF-RECORD-SUBTYPEPIC S9(4) BINARY. 005200 88 SMF-RECORD-SUBTYPE-2 VALUE IS 2. 005300 88 SMF-RECORD-SUBTYPE-3 VALUE IS 3. 005400* 005500 FD SMF-OUTPUT 005600 BLOCK CONTAINS 0 RECORDS 005700 LABEL RECORDS ARE STANDARD 005800 RECORDING MODE IS S 005900 RECORD IS VARYING IN SIZE FROM 1 TO 32763 CHARACTERS 006000 DEPENDING ON WS-INPUT-RECORD-SIZE 006100 . 006200 01 SMF-OUTPUT-RECORD. 006300 05 SMF-OUTPUT-BYTES PIC X 006400 OCCURS 1 TO 32763 TIMES 006500 DEPENDING ON WS-INPUT-RECORD-SIZE 006600 . 006700* 006800 WORKING-STORAGE SECTION. 006900 77 SMFIN-FILE-STATUS PIC XX. 007000 77 SMFOUT-FILE-STATUSPIC XX. 007100 77 EOF-ON-SMFIN-VALUEPIC X VALUE 'N'. 007200 88 EOF-ON-SMFIN VALUE IS 'Y'. 007300 77 TOTAL-RECORDS-READPIC S9(15) PACKED-DECIMAL 007400 VALUE IS ZERO. 007500 77 WS-INPUT-RECORD-SIZE PIC 9(9) BINARY. 007600 77 TOTAL-RECORDS-WRITTEN PIC S9(15) PACKED-DECIMAL 007700 VALUE IS ZERO. 007800* 007900*LINKAGE SECTION. 008000* 008100 PROCEDURE DIVISION. 008200 START-UP. 008300 OPEN INPUT SMF-INPUT 008400 OUTPUT SMF-OUTPUT. 008500 IF SMFIN-FILE-STATUS IS NOT EQUAL TO ZEROS THEN 008600DISPLAY 'ERROR. INPUT FILE FAILED TO OPEN. STATUS=' 008700SMFIN-FILE-STATUS UPON SYSOUT 008800MOVE +8 TO RETURN-CODE 008900END-IF. 009000 IF SMFOUT-FILE-STATUS IS NOT EQUAL TO ZEROS THEN 009100DISPLAY 'ERROR. OUTPUT FILE FAILED TO OPEN. STATUS=' 009200SMFOUT-FILE-STATUS UPON SYSOUT 009300MOVE +8 TO RETURN-CODE 009400END-IF. 009500 IF RETURN-CODE IS NOT EQUAL TO ZERO THEN 009600GOBACK 009700END-IF. 009800 READ SMF-INPUT AT END SET EOF-ON-SMFIN TO TRUE. 009900 PERFORM ALTER-INPUT 01 UNTIL EOF-ON-SMFIN 010100 ORSMFIN-FILE-STATUS IS NOT EQUAL TO ZERO 010200 ORSMFOUT-FILE-STATUS IS NOT EQUAL TO ZERO. 010300 CLOSE SMF-INPUT 010400 SMF-OUTPUT. 010500 DISPLAY 'TOTAL RECORDS READ =' TOTAL-RECORDS-READ 010600 UPON SYSOUT. 010700 DISPLAY 'TOTAL RECORDS WRITTEN =' TOTAL-RECORDS-WRITTEN 010800 UPON SYSOUT. 010900 IF SMFIN-FILE-STATUS IS NOT EQUAL TO ZERO THEN 011000DISPLAY 'READ ERROR. STATUS=' SMFIN-FILE-STATUS 011100UPON SYSOUT 011200MOVE +8 TO RETURN-CODE 011300 END-IF. 011400 IF SMFOUT-FILE-STATUS IS NOT EQUAL TO ZERO THEN 011500DISPLAY 'WRITE ERROR. STATUS=' SMFOUT-FILE-STATUS 011600UPON SYSOUT 011700MOVE +8 TO RETURN-CODE 011800 END-IF. 011900 GOBACK. 012000* 012100 ALTER-INPUT. 012200 ADD +1 TO TOTAL-RECORDS-READ. 012300 EVALUATE SMF-SYSTEM-ID 012400 WHEN 'CSYS' MOVE 'ESYS' TO SMF-SYSTEM-ID 012500 WHEN 'DSYS' MOVE
Re: Copy SMF Records With Syncsort
Unfortuneately, we don't have FileAid. I've used it in the past, and its a great product. I don't think I would even attempt to do this in Rexx. Maybe assembler! I used to do a lot of assembler 25 years ago. But, as my boss says, if it takes longer than 10 minutes, don't do it. Eric Bielefeld On Thu, 5 Feb 2009 12:59:07 -0600, John McKown wrote: >FileAid could do this sort of fix as well, if you have it. If you're really >masochistic, you could even use REXX! > >-- >John -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Copy SMF Records With Syncsort
Eric, Sorry, it has been a real busy day. Try these control cards: ALTSEQ CODE=(C3C5,C4C6) SORT FIELDS=COPY,STOPAFT=50 OUTREC FIELDS=(1,4,5,10,15,1,TRAN=ALTSEQ,16) I believe they will produce the desired output with the release you are running but please check the columns to make sure. Send me a private email with the status. I will be able to get that even though I will be out of the office. John Reda Syncsort, Inc. -Original Message- From: IBM Mainframe Discussion List [mailto:ibm-m...@bama.ua.edu] On Behalf Of Eric Bielefeld Sent: Thursday, February 05, 2009 1:01 PM To: IBM-MAIN@bama.ua.edu Subject: Re: Copy SMF Records With Syncsort I just thought I'd update this thread. I haven't found an answer yet. John Reda from Syncsort emailed me with a solution, except that our version of Syncsort is so old that the OVERLAY function is not included. He did say that there is a way to do what I need without using OVERLAY. I may get a solution from Syncsort today, although John was quite busy today. I am basically trying to correct the data on our test LPars for the SCRT report. I need to change the SMFID from the production Lpar names to the test lpar names. I manually looked at all of the records, and each record had what I was comparing for - either CSYS, DSYS, or FSYS. I did IPL both Lpars in the test sysplex this morning, so now I have the correct information being generated in my SMF records. If I don't get this fixed by tomorrow, we will just send in our report with an explanation. Thanks for all your help. Eric -- Eric Bielefeld Systems Programmer Washington University St Louis, Missouri 314-935-3418 Steve Comstock wrote: > Reda, John wrote: > > Steve/Eric, > > > > CHANGE has been around for a while but OVERLAY was introduced in release > > 1.3. Steve's control cards were real close, I think these will work for > > you: > > I kinda' thought you would have that; now it's just > a matter if Eric is current in his release of SyncSort > (despite his documentation which is "about 6 years old"). > > You guys make your docs available for free on the Internet, > like IBM, right? Maybe you can give Eric a pointer. > > -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Copy SMF Records With Syncsort
FileAid could do this sort of fix as well, if you have it. If you're really masochistic, you could even use REXX! -- John -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Copy SMF Records With Syncsort
I just thought I'd update this thread. I haven't found an answer yet. John Reda from Syncsort emailed me with a solution, except that our version of Syncsort is so old that the OVERLAY function is not included. He did say that there is a way to do what I need without using OVERLAY. I may get a solution from Syncsort today, although John was quite busy today. I am basically trying to correct the data on our test LPars for the SCRT report. I need to change the SMFID from the production Lpar names to the test lpar names. I manually looked at all of the records, and each record had what I was comparing for - either CSYS, DSYS, or FSYS. I did IPL both Lpars in the test sysplex this morning, so now I have the correct information being generated in my SMF records. If I don't get this fixed by tomorrow, we will just send in our report with an explanation. Thanks for all your help. Eric -- Eric Bielefeld Systems Programmer Washington University St Louis, Missouri 314-935-3418 Steve Comstock wrote: > Reda, John wrote: > > Steve/Eric, > > > > CHANGE has been around for a while but OVERLAY was introduced in release > > 1.3. Steve's control cards were real close, I think these will work for > > you: > > I kinda' thought you would have that; now it's just > a matter if Eric is current in his release of SyncSort > (despite his documentation which is "about 6 years old"). > > You guys make your docs available for free on the Internet, > like IBM, right? Maybe you can give Eric a pointer. > > -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Copy SMF Records With Syncsort
Reda, John wrote: Steve/Eric, CHANGE has been around for a while but OVERLAY was introduced in release 1.3. Steve's control cards were real close, I think these will work for you: I kinda' thought you would have that; now it's just a matter if Eric is current in his release of SyncSort (despite his documentation which is "about 6 years old"). You guys make your docs available for free on the Internet, like IBM, right? Maybe you can give Eric a pointer. SORT FIELDS=COPY OUTREC OVERLAY=(15:15,4, CHANGE=(4,C'CSYS',C'ESYS', C'DSYS',C'FSYS', C'FSYS',C'FSYS'),NOMATCH=(15,4)) The thing that was required was the column designation. Without it, the output of the CHANGE would be placed in the column 1. By putting in the "15:" you are directing the output to be put in column 15. This will leave the RDW alone. Whoa, you're right. I was too quick to just copy over Eric's job and change BUILD to OVERLAY. Good catch. You many also want to consider using the NOMATCH subparameter. This tells OUTREC what to do if column 15 is not either CSYS, DSYS or FSYS. If something other than these 3 values is found, the sort would end with RC=16. NOMATCH will let the execution continue leaving the original value in the field. SMF data is notoriously dirty so it would not surprise me for you to have an unexpected value in at least one of your fields. On the other hand, having NOMATCH would hide the fact there was something in error. Guess it comes down to his real needs here. *** NOTE *** Eric's original cards pointed to column 15 while Steve's used column 19. Please make sure you are using the correct column. I used 15 in my example to match Eric's. I wasn't sure, in the original post, if Eric had allowed for the RDW. In a later post he said he had, so 15 is the value to use. If this doesn't work, let me know and I will work with you. John Reda Syncsort, Inc. -Original Message- From: IBM Mainframe Discussion List [mailto:ibm-m...@bama.ua.edu] On Behalf Of Steve Comstock Sent: Wednesday, February 04, 2009 6:26 PM To: IBM-MAIN@bama.ua.edu Subject: Re: Copy SMF Records With Syncsort Eric Bielefeld wrote: I'm trying to fix some SMF records from our TEST Lpars that have the wrong SMFID in them. I'm pretty sure I can fix them with Syncsort using the OUTREC Change command, but I'm not sure how to do that. I haven't worked with Syncsort that much, and I've spent the last hour or so trying to figure out what I need. I figure there's someone out there that can do this off the top of their head quickly. This is what I have so far: OUTREC FIELDS=(15,4, CHANGE=(4,C'CSYS',C'ESYS', C'DSYS',C'FSYS', C'FSYS',C'FSYS')) SORT FIELDS=COPY I'm sure there is a few things missing. I get a message: WER108I SORTIN : RECFM=VBS ; LRECL= 32756; BLKSIZE= 27990 WER235A OUTREC RDW NOT INCLUDED I'd appreciate any help. Thanks. Eric -- Eric Bielefeld Systems Programmer Washington University St Louis, Missouri 314-935-3418 Eric, I've been spending a lot of time developing a DFSORT/ICETOOL class, which I hope to announce next week. Although DFSORT is not SyncSort, I imagine they are the same for this case. OUTREC FIELDS=(15,4, CHANGE=(4,C'CSYS',C'ESYS', C'DSYS',C'FSYS', C'FSYS',C'FSYS')) SORT FIELDS=COPY This will copy from your SORTIN data set; the output data set will just be the four bytes ESYS, or FSYS. You want to OVERLAY the field; since the input records are variable, you must also allow for a 4 byte RDW in your positioning. Try this: SORT FIELDS=COPY OUTREC OVERLAY=(19,4, CHANGE=(4,C'CSYS',C'ESYS', C'DSYS',C'FSYS', C'FSYS',C'FSYS')) Kind regards, -Steve Comstock The Trainer's Friend, Inc. 303-393-8716 http://www.trainersfriend.com z/OS Application development made easier * Our classes include + How things work + Programming examples with realistic applications + Starter / skeleton code + Complete working programs + Useful utilities and subroutines + Tips and techniques ==> Check out the Trainer's Friend Store to purchase z/OS <== ==> application developer toolkits. Sample code in four<== ==> programming languages, JCL to Assemble or compile, <== ==> bind and test. <== ==> http://www.trainersfriend.com/TTFStore/index.html<== -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Copy SMF Records With Syncsort
Steve/Eric, CHANGE has been around for a while but OVERLAY was introduced in release 1.3. Steve's control cards were real close, I think these will work for you: SORT FIELDS=COPY OUTREC OVERLAY=(15:15,4, CHANGE=(4,C'CSYS',C'ESYS', C'DSYS',C'FSYS', C'FSYS',C'FSYS'),NOMATCH=(15,4)) The thing that was required was the column designation. Without it, the output of the CHANGE would be placed in the column 1. By putting in the "15:" you are directing the output to be put in column 15. This will leave the RDW alone. You many also want to consider using the NOMATCH subparameter. This tells OUTREC what to do if column 15 is not either CSYS, DSYS or FSYS. If something other than these 3 values is found, the sort would end with RC=16. NOMATCH will let the execution continue leaving the original value in the field. SMF data is notoriously dirty so it would not surprise me for you to have an unexpected value in at least one of your fields. *** NOTE *** Eric's original cards pointed to column 15 while Steve's used column 19. Please make sure you are using the correct column. I used 15 in my example to match Eric's. If this doesn't work, let me know and I will work with you. John Reda Syncsort, Inc. -Original Message- From: IBM Mainframe Discussion List [mailto:ibm-m...@bama.ua.edu] On Behalf Of Steve Comstock Sent: Wednesday, February 04, 2009 6:26 PM To: IBM-MAIN@bama.ua.edu Subject: Re: Copy SMF Records With Syncsort Eric Bielefeld wrote: > I'm trying to fix some SMF records from our TEST Lpars that have the wrong > SMFID in them. I'm pretty sure I can fix them with Syncsort using the OUTREC > Change command, but I'm not sure how to do that. I haven't worked with > Syncsort that much, and I've spent the last hour or so trying to figure out > what I need. I figure there's someone out there that can do this off the top > of their head quickly. > > This is what I have so far: > > OUTREC FIELDS=(15,4, > CHANGE=(4,C'CSYS',C'ESYS', > C'DSYS',C'FSYS', > C'FSYS',C'FSYS')) > SORT FIELDS=COPY > > I'm sure there is a few things missing. I get a message: > > WER108I SORTIN : RECFM=VBS ; LRECL= 32756; BLKSIZE= 27990 > WER235A OUTREC RDW NOT INCLUDED > > I'd appreciate any help. Thanks. > > Eric > > -- > Eric Bielefeld > Systems Programmer > Washington University > St Louis, Missouri > 314-935-3418 Eric, I've been spending a lot of time developing a DFSORT/ICETOOL class, which I hope to announce next week. Although DFSORT is not SyncSort, I imagine they are the same for this case. OUTREC FIELDS=(15,4, CHANGE=(4,C'CSYS',C'ESYS', C'DSYS',C'FSYS', C'FSYS',C'FSYS')) SORT FIELDS=COPY This will copy from your SORTIN data set; the output data set will just be the four bytes ESYS, or FSYS. You want to OVERLAY the field; since the input records are variable, you must also allow for a 4 byte RDW in your positioning. Try this: SORT FIELDS=COPY OUTREC OVERLAY=(19,4, CHANGE=(4,C'CSYS',C'ESYS', C'DSYS',C'FSYS', C'FSYS',C'FSYS')) Kind regards, -Steve Comstock The Trainer's Friend, Inc. -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Copy SMF Records With Syncsort
On Wed, 4 Feb 2009 23:42:38 +, Eric Bielefeld wrote: >Steve, > >Apparently OVERLAY is not a Syncsort keyword. I did a search of the whole Syncsort reference manual, and it wasn't listed, although my book is about 6 years old. I did allow for the RDW in my displacement, I think. > >Eric > Eric, I just looked up OVERLAY in my SyncSort for z/OS 1.3 manuals: "The OVERLAY parameter has been added. OVERLAY enables reformatting of selected portions of records." Further: "OVERLAY Parameter (Optional) The OVERLAY parameter enables you to change particular columns and add fields to the end of a record without rebuilding the entire record. When using the OVERLAY parameter you only need to specify the columns you want to change. The rest of the input record remains unchanged. See OVERLAY Parameter (Optional) on page 2.162 for a complete description." Not sure what release of SyncSort you're using, but you might be able to get the same results with a more complicated OUTREC statement. The variable length nature of the records will be problematic. I'm not that talented with SyncSort or I'd try to work something up. Good Luck, Dave K. -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Copy SMF Records With Syncsort
I don't use SYSCSORT but I think you do have the displacement correct. My SMF manual shows the RDW at offset 0 and the system ID at 14. Since sort starts at 1, 15 should be correct. DFSORT and SYNCSORT manage to stay in step with each other regarding features. OVERLAY is not that new in DFSORT. Chances are that SYNCSORT uses a different name for it. If you really don't have an overlay capability, one possibility would be to break your output record into three sections: 1-14, 15-18, and 19-end. Just copy the first and third sections from the input and use whatever SYSNCSORT calls the change facility for the middle. -Original Message- From: Eric Bielefeld Sent: Wednesday, February 04, 2009 3:43 PM To: IBM-MAIN@bama.ua.edu Subject: Re: Copy SMF Records With Syncsort Steve, Apparently OVERLAY is not a Syncsort keyword. I did a search of the whole Syncsort reference manual, and it wasn't listed, although my book is about 6 years old. I did allow for the RDW in my displacement, I think. -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Copy SMF Records With Syncsort
Steve, Apparently OVERLAY is not a Syncsort keyword. I did a search of the whole Syncsort reference manual, and it wasn't listed, although my book is about 6 years old. I did allow for the RDW in my displacement, I think. Eric -- Eric Bielefeld Systems Programmer Washington University St Louis, Missouri 314-935-3418 Steve Comstock wrote: > > Eric, > > I've been spending a lot of time developing a DFSORT/ICETOOL > class, which I hope to announce next week. > > > Although DFSORT is not SyncSort, I imagine they are the same for this case. > > > OUTREC FIELDS=(15,4, >CHANGE=(4,C'CSYS',C'ESYS', > C'DSYS',C'FSYS', > C'FSYS',C'FSYS')) > SORT FIELDS=COPY > > This will copy from your SORTIN data set; the output > data set will just be the four bytes ESYS, or FSYS. > > You want to OVERLAY the field; since the input records > are variable, you must also allow for a 4 byte RDW in > your positioning. > > Try this: > > SORT FIELDS=COPY > OUTREC OVERLAY=(19,4, > CHANGE=(4,C'CSYS',C'ESYS', > C'DSYS',C'FSYS', > C'FSYS',C'FSYS')) > > > Kind regards, > > -Steve Comstock > The Trainer's Friend, Inc. > > 303-393-8716 > http://www.trainersfriend.com > >z/OS Application development made easier > * Our classes include > + How things work > + Programming examples with realistic applications > + Starter / skeleton code > + Complete working programs > + Useful utilities and subroutines > + Tips and techniques > > ==> Check out the Trainer's Friend Store to purchase z/OS <== > ==> application developer toolkits. Sample code in four<== > ==> programming languages, JCL to Assemble or compile, <== > ==> bind and test. <== > ==> http://www.trainersfriend.com/TTFStore/index.html<== > > -- > For IBM-MAIN subscribe / signoff / archive access instructions, > send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO > Search the archives at http://bama.ua.edu/archives/ibm-main.html -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Copy SMF Records With Syncsort
Eric Bielefeld wrote: I'm trying to fix some SMF records from our TEST Lpars that have the wrong SMFID in them. I'm pretty sure I can fix them with Syncsort using the OUTREC Change command, but I'm not sure how to do that. I haven't worked with Syncsort that much, and I've spent the last hour or so trying to figure out what I need. I figure there's someone out there that can do this off the top of their head quickly. This is what I have so far: OUTREC FIELDS=(15,4, CHANGE=(4,C'CSYS',C'ESYS', C'DSYS',C'FSYS', C'FSYS',C'FSYS')) SORT FIELDS=COPY I'm sure there is a few things missing. I get a message: WER108I SORTIN : RECFM=VBS ; LRECL= 32756; BLKSIZE= 27990 WER235A OUTREC RDW NOT INCLUDED I'd appreciate any help. Thanks. Eric -- Eric Bielefeld Systems Programmer Washington University St Louis, Missouri 314-935-3418 Eric, I've been spending a lot of time developing a DFSORT/ICETOOL class, which I hope to announce next week. Although DFSORT is not SyncSort, I imagine they are the same for this case. OUTREC FIELDS=(15,4, CHANGE=(4,C'CSYS',C'ESYS', C'DSYS',C'FSYS', C'FSYS',C'FSYS')) SORT FIELDS=COPY This will copy from your SORTIN data set; the output data set will just be the four bytes ESYS, or FSYS. You want to OVERLAY the field; since the input records are variable, you must also allow for a 4 byte RDW in your positioning. Try this: SORT FIELDS=COPY OUTREC OVERLAY=(19,4, CHANGE=(4,C'CSYS',C'ESYS', C'DSYS',C'FSYS', C'FSYS',C'FSYS')) Kind regards, -Steve Comstock The Trainer's Friend, Inc. 303-393-8716 http://www.trainersfriend.com z/OS Application development made easier * Our classes include + How things work + Programming examples with realistic applications + Starter / skeleton code + Complete working programs + Useful utilities and subroutines + Tips and techniques ==> Check out the Trainer's Friend Store to purchase z/OS <== ==> application developer toolkits. Sample code in four<== ==> programming languages, JCL to Assemble or compile, <== ==> bind and test. <== ==> http://www.trainersfriend.com/TTFStore/index.html<== -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Copy SMF Records With Syncsort
I'm trying to fix some SMF records from our TEST Lpars that have the wrong SMFID in them. I'm pretty sure I can fix them with Syncsort using the OUTREC Change command, but I'm not sure how to do that. I haven't worked with Syncsort that much, and I've spent the last hour or so trying to figure out what I need. I figure there's someone out there that can do this off the top of their head quickly. This is what I have so far: OUTREC FIELDS=(15,4, CHANGE=(4,C'CSYS',C'ESYS', C'DSYS',C'FSYS', C'FSYS',C'FSYS')) SORT FIELDS=COPY I'm sure there is a few things missing. I get a message: WER108I SORTIN : RECFM=VBS ; LRECL= 32756; BLKSIZE= 27990 WER235A OUTREC RDW NOT INCLUDED I'd appreciate any help. Thanks. Eric -- Eric Bielefeld Systems Programmer Washington University St Louis, Missouri 314-935-3418 -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@bama.ua.edu with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Realtime retrieval of SMF records
Greetings folks, I wrote an application some years ago to pull LPAR utilization data off the system in real time - using the CMS Pipelines STARMON stage, which connects to z/VM's *MONITOR service. The IFL this runs on is being shut down so the functionality needs to move to z/OS. I can see that I need SMF Type 70 records, however... I need to figure out how to pull the SMF data. Again, in real time. Can anyone direct me to a starting point? Thanks! Mark L. Wheeler IT Infrastructure, 3M Center B224-4N-20, St Paul MN 55144 Tel: (651) 733-4355, Fax: (651) 736-7689 mlwheeler at mmm.com -- "I have this theory that if one person can go out of their way to show compassion then it will start a chain reaction of the same. People will never know how far a little kindness can go." Rachel Joy Scott -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Flushing SMF Records from Buffer
I am not close to a manual ATM, but is there an exit that gets control for each record written? It is possible the original asker would want to utilize one if one were available. David Logan -Original Message- From: "McKown, John" <[EMAIL PROTECTED]> To: "IBM-MAIN@BAMA.UA.EDU" Sent: 12/21/07 7:51 AM Subject: Re: Flushing SMF Records from Buffer > -Original Message- > From: IBM Mainframe Discussion List > [mailto:[EMAIL PROTECTED] On Behalf Of Jason To > Sent: Thursday, December 20, 2007 9:15 PM > To: IBM-MAIN@BAMA.UA.EDU > Subject: Flushing SMF Records from Buffer > > > Is there a way to flush SMF records from buffer to immediately write > to DASD? Currently, we have to wait for 15-30 mins before we can > access the SMF records. I knew that we can access SMF type > 70-79 using > RMF JCL and produce reports from the bufferspace, however for > CICS and > DB2, we can't do that. We need this requirement to > immediately access > the SMF records for problem determination. > > Btw, can we use REXX to access the bufferspace? TIA. > > Regards, > Jason The only way that I am sure of is via the HALT EOD command. But it does many other "bad" things as well as flushing SMF data. -- John McKown Senior Systems Programmer HealthMarkets Keeping the Promise of Affordable Coverage Administrative Services Group Information Technology The information contained in this e-mail message may be privileged and/or confidential. It is for intended addressee(s) only. If you are not the intended recipient, you are hereby notified that any disclosure, reproduction, distribution or other use of this communication is strictly prohibited and could, in certain circumstances, be a criminal offense. If you have received this e-mail in error, please notify the sender by reply and delete this message without copying or disclosing it. -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html NOTICE: This E-mail may contain confidential information. If you are not the addressee or the intended recipient please do not read this E-mail and please immediately delete this e-mail message and any attachments from your workstation or network mail system. If you are the addressee or the intended recipient and you save or print a copy of this E-mail, please place it in an appropriate file, depending on whether confidential information is contained in the message. -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Flushing SMF Records from Buffer
Greetings, SMF records generally fall into two categories - event driven and time driven. This means that the creator of the SMF record does so either based on a specific event happening or by the passing of an interval of time that it has setup. Most SMF interval record creators have a way to customize the interval. That being said, you can't read an SMF record that hasn't been created yet. At a high level this is what happens. After the SMF record is created, it goes into the local storage of the SMF address space until it is written to the active SMF dataset/logstream (z/OS 1.9 +). On a somewhat active system with current DASD technologies, SMF records do not stay in the SMF address space local storage long. If they do, that is a symptom of a problem. Once the SMF record goes into the active SMF dataset, the SMF record is readable in the active SMF dataset. The most straight forward way to read the new SMF record is to do an "I SMF" and then read the offloaded SMF dataset that is created by the normal SMF offload process. If this is not fast enough, maybe the normal SMF offload process should be assessed and tuned. Can you provide more details about exactly what SMF records you are trying to process? Cheers... Michael On Thu, 20 Dec 2007 23:15:14 -0600, Jason To <[EMAIL PROTECTED]> wrote: >Hi Scott, > >Thanks for your prompt reply. Is this only available in z/OS 1.9? We >are currently in z/OS 1.7 and every time we switch SMF, we still can't >get the latest SMF data, still about 15 minutes delay. > >Regards, >Jason -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Flushing SMF Records from Buffer
> -Original Message- > From: IBM Mainframe Discussion List > [mailto:[EMAIL PROTECTED] On Behalf Of Jason To > Sent: Thursday, December 20, 2007 9:15 PM > To: IBM-MAIN@BAMA.UA.EDU > Subject: Flushing SMF Records from Buffer > > > Is there a way to flush SMF records from buffer to immediately write > to DASD? Currently, we have to wait for 15-30 mins before we can > access the SMF records. I knew that we can access SMF type > 70-79 using > RMF JCL and produce reports from the bufferspace, however for > CICS and > DB2, we can't do that. We need this requirement to > immediately access > the SMF records for problem determination. > > Btw, can we use REXX to access the bufferspace? TIA. > > Regards, > Jason The only way that I am sure of is via the HALT EOD command. But it does many other "bad" things as well as flushing SMF data. -- John McKown Senior Systems Programmer HealthMarkets Keeping the Promise of Affordable Coverage Administrative Services Group Information Technology The information contained in this e-mail message may be privileged and/or confidential. It is for intended addressee(s) only. If you are not the intended recipient, you are hereby notified that any disclosure, reproduction, distribution or other use of this communication is strictly prohibited and could, in certain circumstances, be a criminal offense. If you have received this e-mail in error, please notify the sender by reply and delete this message without copying or disclosing it. -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Flushing SMF Records from Buffer
"Scott Fagen" <[EMAIL PROTECTED]> wrote in message news:<[EMAIL PROTECTED]>... > Jason To wrote: > > >Is there a way to flush SMF records from buffer to immediately write > >to DASD? Currently, we have to wait for 15-30 mins before we can > >access the SMF records. I knew that we can access SMF type 70-79 using > >RMF JCL and produce reports from the bufferspace, however for CICS and > >DB2, we can't do that. We need this requirement to immediately access > >the SMF records for problem determination. > > If you 'switch' SMF over to using the System Logger for its recording medium > (z/OS 1.9), you can access the records almost immediately after they are written > into the logstream via the IFASMFDL program. > > Scott Fagen I am not sure if this fully solves the problem: AFAIK data is also written to the logstream in blocks when a block is full, not with every record. So there will still be a backlog of records in the buffer being built to write, possibly the same amount as now remains behind after an I SMF. Kees. ** For information, services and offers, please visit our web site: http://www.klm.com. This e-mail and any attachment may contain confidential and privileged material intended for the addressee only. If you are not the addressee, you are notified that no part of the e-mail or any attachment may be disclosed, copied or distributed, and that any other action related to this e-mail or attachment is strictly prohibited, and may be unlawful. If you have received this e-mail by error, please notify the sender immediately by return e-mail, and delete this message. Koninklijke Luchtvaart Maatschappij NV (KLM), its subsidiaries and/or its employees shall not be liable for the incorrect or incomplete transmission of this e-mail or any attachments, nor responsible for any delay in receipt. Koninklijke Luchtvaart Maatschappij N.V. (also known as KLM Royal Dutch Airlines) is registered in Amstelveen, The Netherlands, with registered number 33014286 ** -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Flushing SMF Records from Buffer
Hi Scott, Thanks for your prompt reply. Is this only available in z/OS 1.9? We are currently in z/OS 1.7 and every time we switch SMF, we still can't get the latest SMF data, still about 15 minutes delay. Regards, Jason Quoting Scott Fagen <[EMAIL PROTECTED]>: Jason To wrote: Is there a way to flush SMF records from buffer to immediately write to DASD? Currently, we have to wait for 15-30 mins before we can access the SMF records. I knew that we can access SMF type 70-79 using RMF JCL and produce reports from the bufferspace, however for CICS and DB2, we can't do that. We need this requirement to immediately access the SMF records for problem determination. If you 'switch' SMF over to using the System Logger for its recording medium (z/OS 1.9), you can access the records almost immediately after they are written into the logstream via the IFASMFDL program. Scott Fagen Enterprise Systems Management -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Flushing SMF Records from Buffer
Jason To wrote: >Is there a way to flush SMF records from buffer to immediately write >to DASD? Currently, we have to wait for 15-30 mins before we can >access the SMF records. I knew that we can access SMF type 70-79 using >RMF JCL and produce reports from the bufferspace, however for CICS and >DB2, we can't do that. We need this requirement to immediately access >the SMF records for problem determination. If you 'switch' SMF over to using the System Logger for its recording medium (z/OS 1.9), you can access the records almost immediately after they are written into the logstream via the IFASMFDL program. Scott Fagen Enterprise Systems Management -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Flushing SMF Records from Buffer
Is there a way to flush SMF records from buffer to immediately write to DASD? Currently, we have to wait for 15-30 mins before we can access the SMF records. I knew that we can access SMF type 70-79 using RMF JCL and produce reports from the bufferspace, however for CICS and DB2, we can't do that. We need this requirement to immediately access the SMF records for problem determination. Btw, can we use REXX to access the bufferspace? TIA. Regards, Jason -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Extracting SMF Records to find the userid who deleted a dataset
Thanks - Original Message - Thanks David and all who replied. Thanks - Original Message From: David Betten <[EMAIL PROTECTED]> To: IBM-MAIN@BAMA.UA.EDU Sent: Thursday, 13 December, 2007 11:15:18 PM Subject: Re: Extracting SMF Records to find the userid who deleted a dataset You can try this //SORT EXEC PGM=SORT,REGION=5000K //SYSPRINT DD SYSOUT=* //SYSOUT DD SYSOUT=* //SORTIN DD DISP=SHR,DSN=inputsmf //SORTOUT DD DISP=(NEW,PASS),DSN=&&TEMP, //SPACE=(CYL,(50,20),RLSE),DCB=*.SORTIN,UNIT=SYSLG //SYSINDD * SORT FIELDS=COPY INCLUDE COND=(6,1,BI,EQ,X'11',&, 45,44,CH,EQ, C'deleted.dsn') OPTION VLSHRT /* //PRINTEXEC PGM=IDCAMS //IN1 DD DISP=(OLD,PASS),DSN=&&TEMP //SYSPRINT DD SYSOUT=* //SYSINDD * PRINT INFILE(IN1) DUMP /* Type 17 is pretty easy becaue the dsn is part of the header so you know the offset in each record. Some other smf record types are not so simple because you need to use the triplet for the offset to the section that had the data. Also, I used a length of 44 for the dsn field. If your dsn is less tan 44, you can shorten the length and get rid of the trailing blanks. Have a nice day, Dave Betten DFSORT Development, Performance Lead IBM Corporation email: [EMAIL PROTECTED] DFSORT/MVSontheweb at http://www.ibm.com/storage/dfsort/ IBM Mainframe Discussion List wrote on 12/13/2007 11:51:04 AM: > On one of our account, a production dataset is deleted. We > Greetings, > > On one of our account, a production dataset is deleted. We have to > find the userid of the person who deleted that specific dataset. I > know that we can extract the SMF records with IFASMFDP and Sort the > record type 17 for it. However, I am not sure what would be the sort > JCL and sort control statements for it. > > Could you please guide me or provide a sample jcl which could > extract the SMF dataset and find the userid. > > Any help is greatly appreciated. > > Thanks > Vijay > > > 5, 50, 500, 5000 - Store N number of mails in your inbox. Go to > http://help.yahoo.com/l/in/yahoo/mail/yahoomail/tools/tools-08.html > > -- > For IBM-MAIN subscribe / signoff / archive access instructions, > send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO > Search the archives at http://bama.ua.edu/archives/ibm-main.html -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html Get the freedom to save as many mails as you wish. To know how, go to http://help.yahoo..com/l/in/yahoo/mail/yahoomail/tools/tools-08.html -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Extracting SMF Records to find the userid who deleted a dataset
--- On one of our account, a production dataset is deleted. We Greetings, On one of our account, a production dataset is deleted. We have to find the userid of the person who deleted that specific dataset. I know that we can extract the SMF records with IFASMFDP and Sort the record type 17 for it. However, I am not sure what would be the sort JCL and sort control statements for it. Could you please guide me or provide a sample jcl which could extract the SMF dataset and find the userid. Any help is greatly appreciated. You need the Dataset Monitor tool from the CBT tape (www.cbttape.org) . It processes SMF data to give you exactly what you're looking for. -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Extracting SMF Records to find the userid who deleted a dataset
Frank Yaeger just pointed out to me that the trailing blanks are not necessary since DFSORT will pad the constant on the right with blanks to the length of the field. So you can just code it like this //SORT EXEC PGM=SORT,REGION=5000K //SYSPRINT DD SYSOUT=* //SYSOUT DD SYSOUT=* //SORTIN DD DISP=SHR,DSN=inputsmf //SORTOUT DD DISP=(NEW,PASS),DSN=&&TEMP, // SPACE=(CYL,(50,20),RLSE),DCB=*.SORTIN,UNIT=SYSLG //SYSINDD * SORT FIELDS=COPY INCLUDE COND=(6,1,BI,EQ,X'11',&, 45,44,CH,EQ, C'deleted.dsn') OPTION VLSHRT /* //PRINTEXEC PGM=IDCAMS //IN1 DD DISP=(OLD,PASS),DSN=&&TEMP //SYSPRINT DD SYSOUT=* //SYSINDD * PRINT INFILE(IN1) DUMP /* Have a nice day, Dave Betten DFSORT Development, Performance Lead IBM Corporation email: [EMAIL PROTECTED] DFSORT/MVSontheweb at http://www.ibm.com/storage/dfsort/ IBM Mainframe Discussion List wrote on 12/13/2007 12:45:18 PM: > You can try this > > //SORT EXEC PGM=SORT,REGION=5000K > //SYSPRINT DD SYSOUT=* > //SYSOUT DD SYSOUT=* > //SORTIN DD DISP=SHR,DSN=inputsmf > //SORTOUT DD DISP=(NEW,PASS),DSN=&&TEMP, > // SPACE=(CYL,(50,20),RLSE),DCB=*.SORTIN,UNIT=SYSLG > //SYSINDD * >SORT FIELDS=COPY >INCLUDE COND=(6,1,BI,EQ,X'11',&, >45,44,CH,EQ, >C'deleted.dsn ') >OPTION VLSHRT > /* > //PRINTEXEC PGM=IDCAMS > //IN1 DD DISP=(OLD,PASS),DSN=&&TEMP > //SYSPRINT DD SYSOUT=* > //SYSINDD * > PRINT INFILE(IN1) DUMP > /* > > Type 17 is pretty easy becaue the dsn is part of the header so you know the > offset in each record. Some other smf record types are not so simple > because you need to use the triplet for the offset to the section that had > the data. Also, I used a length of 44 for the dsn field. If your dsn is > less tan 44, you can shorten the length and get rid of the trailing blanks. > > > Have a nice day, > Dave Betten > DFSORT Development, Performance Lead > IBM Corporation > email: [EMAIL PROTECTED] > DFSORT/MVSontheweb at http://www.ibm.com/storage/dfsort/ > > IBM Mainframe Discussion List wrote on 12/13/2007 > 11:51:04 AM: > > > On one of our account, a production dataset is deleted. We > > Greetings, > > > > On one of our account, a production dataset is deleted. We have to > > find the userid of the person who deleted that specific dataset. I > > know that we can extract the SMF records with IFASMFDP and Sort the > > record type 17 for it. However, I am not sure what would be the sort > > JCL and sort control statements for it. > > > > Could you please guide me or provide a sample jcl which could > > extract the SMF dataset and find the userid. > > > > Any help is greatly appreciated. > > > > Thanks > > Vijay > > > > > > 5, 50, 500, 5000 - Store N number of mails in your inbox. Go to > > http://help.yahoo.com/l/in/yahoo/mail/yahoomail/tools/tools-08.html > > > > -- > > For IBM-MAIN subscribe / signoff / archive access instructions, > > send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO > > Search the archives at http://bama.ua.edu/archives/ibm-main.html > -- > For IBM-MAIN subscribe / signoff / archive access instructions, > send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO > Search the archives at http://bama.ua.edu/archives/ibm-main.html -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Extracting SMF Records to find the userid who deleted a dataset
There is a freebe on the CBTTAPE.ORG called DAF... this will do everything you should need. Ed On Dec 13, 2007, at 10:51 AM, vijay raj wrote: On one of our account, a production dataset is deleted. We Greetings, On one of our account, a production dataset is deleted. We have to find the userid of the person who deleted that specific dataset. I know that we can extract the SMF records with IFASMFDP and Sort the record type 17 for it. However, I am not sure what would be the sort JCL and sort control statements for it. Could you please guide me or provide a sample jcl which could extract the SMF dataset and find the userid. Any help is greatly appreciated. Thanks Vijay 5, 50, 500, 5000 - Store N number of mails in your inbox. Go to http://help.yahoo.com/l/in/yahoo/mail/yahoomail/tools/tools-08.html -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Extracting SMF Records to find the userid who deleted a dataset
You can try this //SORT EXEC PGM=SORT,REGION=5000K //SYSPRINT DD SYSOUT=* //SYSOUT DD SYSOUT=* //SORTIN DD DISP=SHR,DSN=inputsmf //SORTOUT DD DISP=(NEW,PASS),DSN=&&TEMP, // SPACE=(CYL,(50,20),RLSE),DCB=*.SORTIN,UNIT=SYSLG //SYSINDD * SORT FIELDS=COPY INCLUDE COND=(6,1,BI,EQ,X'11',&, 45,44,CH,EQ, C'deleted.dsn ') OPTION VLSHRT /* //PRINTEXEC PGM=IDCAMS //IN1 DD DISP=(OLD,PASS),DSN=&&TEMP //SYSPRINT DD SYSOUT=* //SYSINDD * PRINT INFILE(IN1) DUMP /* Type 17 is pretty easy becaue the dsn is part of the header so you know the offset in each record. Some other smf record types are not so simple because you need to use the triplet for the offset to the section that had the data. Also, I used a length of 44 for the dsn field. If your dsn is less tan 44, you can shorten the length and get rid of the trailing blanks. Have a nice day, Dave Betten DFSORT Development, Performance Lead IBM Corporation email: [EMAIL PROTECTED] DFSORT/MVSontheweb at http://www.ibm.com/storage/dfsort/ IBM Mainframe Discussion List wrote on 12/13/2007 11:51:04 AM: > On one of our account, a production dataset is deleted. We > Greetings, > > On one of our account, a production dataset is deleted. We have to > find the userid of the person who deleted that specific dataset. I > know that we can extract the SMF records with IFASMFDP and Sort the > record type 17 for it. However, I am not sure what would be the sort > JCL and sort control statements for it. > > Could you please guide me or provide a sample jcl which could > extract the SMF dataset and find the userid. > > Any help is greatly appreciated. > > Thanks > Vijay > > > 5, 50, 500, 5000 - Store N number of mails in your inbox. Go to > http://help.yahoo.com/l/in/yahoo/mail/yahoomail/tools/tools-08.html > > -- > For IBM-MAIN subscribe / signoff / archive access instructions, > send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO > Search the archives at http://bama.ua.edu/archives/ibm-main.html -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Extracting SMF Records to find the userid who deleted a dataset
On one of our account, a production dataset is deleted A simple SAS routine will do the trick too. But i would also include SMF18, SMF65 and SMF66. In general i check SMF14,15,17,18,60-66 although the VSAM SMF6x aren't too useful. Jack Kelly 202-502-2390 (Office) -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Extracting SMF Records to find the userid who deleted a dataset
vijay raj wrote: > On one of our account, a production dataset is deleted. We > Greetings, > > On one of our account, a production dataset is deleted. We have to find the > userid of the person who deleted that specific dataset. I know that we can > extract the SMF records with IFASMFDP and Sort the record type 17 for it. > However, I am not sure what would be the sort JCL and sort control statements > for it. > > Could you please guide me or provide a sample jcl which could extract the SMF > dataset and find the userid. > > Any help is greatly appreciated. > > Thanks > Vijay > > > Go to www.cbttape.org and download File 094: DAF from Mike Cleary - Dataset Audit Facility -- Mark Jacobs Time Customer Service Tampa, FL -- The primary purpose of the DATA statement is to give names to constants; instead of referring to pi as 3.141592653589793 at every appearance, the variable PI can be given that value with a DATA statement and used instead of the longer form of the constant. This also simplifies modifying the program, should the value of pi change. - FORTRAN manual for Xerox computers -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Extracting SMF Records to find the userid who deleted a dataset
Vijay, I would use SMF DUMP (IFASMPDP) and just dump the SMF record I wanted. If you have sas you can then filter through the SMF record for that data set. The SMF Manual is very good to show you how to dump specific records. Or if you have DFSORT, I think there may be some control cards built for a DFSORT process to do this. Lizette -Original Message- >From: vijay raj <[EMAIL PROTECTED]> >Sent: Dec 13, 2007 11:51 AM >To: IBM-MAIN@BAMA.UA.EDU >Subject: Extracting SMF Records to find the userid who deleted a dataset > >On one of our account, a production dataset is deleted. We >Greetings, > >On one of our account, a production dataset is deleted. We have to find the >userid of the person who deleted that specific dataset. I know that we can >extract the SMF records with IFASMFDP and Sort the record type 17 for it. >However, I am not sure what would be the sort JCL and sort control statements >for it. > >Could you please guide me or provide a sample jcl which could extract the SMF >dataset and find the userid. > >Any help is greatly appreciated. > >Thanks >Vijay > > > 5, 50, 500, 5000 - Store N number of mails in your inbox. Go to > http://help.yahoo.com/l/in/yahoo/mail/yahoomail/tools/tools-08.html > >-- >For IBM-MAIN subscribe / signoff / archive access instructions, >send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO >Search the archives at http://bama.ua.edu/archives/ibm-main.html -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Extracting SMF Records to find the userid who deleted a dataset
On one of our account, a production dataset is deleted. We Greetings, On one of our account, a production dataset is deleted. We have to find the userid of the person who deleted that specific dataset. I know that we can extract the SMF records with IFASMFDP and Sort the record type 17 for it. However, I am not sure what would be the sort JCL and sort control statements for it. Could you please guide me or provide a sample jcl which could extract the SMF dataset and find the userid. Any help is greatly appreciated. Thanks Vijay 5, 50, 500, 5000 - Store N number of mails in your inbox. Go to http://help.yahoo.com/l/in/yahoo/mail/yahoomail/tools/tools-08.html -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Need TDMF SMF Records To Test DAF
Greetings, I am in need of Transparent Data Migration Facility (TDMF) SMF Records to test DAF. Cheers, Michael === Instructions: 1) Creat the SMF file with IFASMFDP and XMIT the SMF file (JCL below) 2) do a binary transfer of the XMIT file to your PC 3) Zip the downloaded file 4) e-mail me the zipped file as an attachment Here is JCL to create the SMF file and XMIT it. //&SYSUID.SMF JOB (TECHY),'CLEARY',CLASS=U, // MSGCLASS=X,MSGLEVEL=(1,1),NOTIFY=&SYSUID. //DELETE EXEC PGM=IEFBR14 //DELETE1 DD DSN=ZTGP01.SMFTXXX,DISP=(MOD,DELETE,DELETE), // UNIT=SYSDA,SPACE=(CYL,(1,1)), // DCB=(RECFM=VBS,LRECL=32760,BLKSIZE=27998,BUFNO=64) //DELETE2 DD DSN=ZTGP01.SMFTXXX.XMI,DISP=(MOD,DELETE,DELETE), // UNIT=SYSDA,SPACE=(CYL,(1,1)), // DCB=(RECFM=VBS,LRECL=32760,BLKSIZE=27998,BUFNO=64) //IFASMFDP EXEC PGM=IFASMFDP //DUMPINDD DISP=SHR,DSN=DCTR.SMFDUMP.ACCUM.BBC1(+0), // DCB=(BUFNO=64) //DUMPOUT DD DSN=ZTGP01.SMFTXXX,DISP=(NEW,CATLG,CATLG), // UNIT=SYSDA,SPACE=(CYL,(100,50),RLSE), // DCB=(RECFM=VBS,LRECL=32760,BLKSIZE=27998,BUFNO=64) //SYSIN DD * INDD(DUMPIN,OPTIONS(DUMP)) OUTDD(DUMPOUT,TYPE(XXX)) //SYSPRINT DD SYSOUT=* //IKJEFT01 EXEC PGM=IKJEFT01 //SYSTSPRT DD SYSOUT=* //SYSPRINT DD SYSOUT=* //SYSTSIN DD * XMIT ANYNODE.ANYUSER + DATASET('ZTGP01.SMFTXXX') + OUTDATASET('ZTGP01.SMFTXXX.XMI') TV dinner still cooling? Check out "Tonight's Picks" on Yahoo! TV. http://tv.yahoo.com/ -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Sorting SMF records
Scott, will give it a whirl tomorrow, appreciate the tip. Regards, John O n Wed, February 14, 2007 18:51, [EMAIL PROTECTED] wrote: > > The JCL below provides an example with SMF/LPAR selection. Refer to the > DFSORT documentation at the DFSORT home page link below for details. > > > > Sincerely, > > > Scott Barry > SBBWorks, Inc. > > > http://www-304.ibm.com/jct01004c/systems/support/storage/software/sort/mv > s/ > > //S1 EXEC PGM=SORT,PARM=ABEND > //SYSOUT DD SYSOUT=* > //SORTIN DD DSN=smf.input,... > //SORTOUT DD DSN=smf.output,... > //SYSINDD * > OPTION VLSHRT,VLSCMP > * COPY/SUBSET SMFJOB FILE FOR TYPE 30 > SORT FIELDS=(11,4,PD,A,7,4,BI,A) > * SELECT ONLY TYPE 30 and 26. > INCLUDE COND=((6,1,BI,EQ,30,OR,6,1,BI,EQ,26),AND, > (15,4,SS,EQ,C'SYSA,SYSB,SYSZ')) > /* > > > E-Mail: [EMAIL PROTECTED] http://www.JDCassidy.net -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Sorting SMF records
The JCL below provides an example with SMF/LPAR selection. Refer to the DFSORT documentation at the DFSORT home page link below for details. Sincerely, Scott Barry SBBWorks, Inc. http://www-304.ibm.com/jct01004c/systems/support/storage/software/sort/mvs/ //S1 EXEC PGM=SORT,PARM=ABEND //SYSOUT DD SYSOUT=* //SORTIN DD DSN=smf.input,... //SORTOUT DD DSN=smf.output,... //SYSINDD * OPTION VLSHRT,VLSCMP * COPY/SUBSET SMFJOB FILE FOR TYPE 30 SORT FIELDS=(11,4,PD,A,7,4,BI,A) * SELECT ONLY TYPE 30 and 26. INCLUDE COND=((6,1,BI,EQ,30,OR,6,1,BI,EQ,26),AND, (15,4,SS,EQ,C'SYSA,SYSB,SYSZ')) /* John Cassidy wrote: Hello all, need to sort a month of SMF data excluding specific LPAR's and one type of SMF record. With IFASMFDP I can filter out the SMF records, not however, the LPAR's I want excluded. Would anyone have any DFSORT / ICETOOL JCL handy? TIA and regards, J. John Cassidy (Dipl.-Ingr.) Berninastrasse 9 8057 Zuerich Europe -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Sorting SMF records
Hello all, need to sort a month of SMF data excluding specific LPAR's and one type of SMF record. With IFASMFDP I can filter out the SMF records, not however, the LPAR's I want excluded. Would anyone have any DFSORT / ICETOOL JCL handy? TIA and regards, J. John Cassidy (Dipl.-Ingr.) Berninastrasse 9 8057 Zuerich Europe John Cassidy (Dipl.-Ingr.) Berninastrasse 9 8057 Zuerich Europe Telephone: +41 (0) 43 300 4602 Mobile:+41 (0) 79 207 3268 E-Mail: [EMAIL PROTECTED] http://www.JDCassidy.net http://www.europeunited.org http://en.wikipedia.org/wiki/Europe_United -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Sorting SMF records
Look at the INCLUDE/OMIT control cards. You should be able to do it all in one pass of the data and skip the IFASMFDP process. Christopher Y. Blaicher BMC Software, Inc. Austin Development Labs (512) 340-6154 The comments made are my personal opinions. BMC Software, Inc. makes no representations or promises regarding the reliability, completeness, or accuracy of the information provided in this discussion; all readers agree not to rely on this information or take any action against BMC Software in response to this information. -Original Message- From: IBM Mainframe Discussion List [mailto:[EMAIL PROTECTED] On Behalf Of John Cassidy Sent: Wednesday, February 14, 2007 2:45 AM To: IBM-MAIN@BAMA.UA.EDU Subject: Sorting SMF records Hello all, need to sort a month of SMF data excluding specific LPAR's and one type of SMF record. With IFASMFDP I can filter out the SMF records, not however, the LPAR's I want excluded. Would anyone have any DFSORT / ICETOOL JCL handy? TIA and regards, J. John Cassidy (Dipl.-Ingr.) Berninastrasse 9 8057 Zuerich Europe -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Sorting SMF records
Hello all, need to sort a month of SMF data excluding specific LPAR's and one type of SMF record. With IFASMFDP I can filter out the SMF records, not however, the LPAR's I want excluded. Would anyone have any DFSORT / ICETOOL JCL handy? TIA and regards, J. John Cassidy (Dipl.-Ingr.) Berninastrasse 9 8057 Zuerich Europe -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Merge SMF records
Antonio Corrales wrote on 11/15/2006 08:40:57 AM: > My problem is not with the SORT function. Really is with the MERGE > function. I will try to explain it > > I have two SMF files, F1 and F2 > > a) If i merge F1 and F2 with IFASMFDP, it works correctly > > b) If i sort F1 with SPANINC=RC16 default, it works correctly > > c) If i sort F2 with SPANINC=RC16 default, it works correctly > > d) If i merge F1 and F2 with SPANINC=RC16 default, it shows ICE204A 2 > INCOMPLETE SPANNED RECORD DETECTED ON - > RC=16 > >Frank, i will send you the //SYSOUT messages if you want to see them) > Yes, please add the following to your jobs so I can see the diagnotic messages: //SORTDIAG DD DUMMY and send the //SYSOUT messages for b), c) and d) to me ([EMAIL PROTECTED]) so I can have a look. Frank Yaeger - DFSORT Team (IBM) - [EMAIL PROTECTED] Specialties: PARSE, JFY, SQZ, ICETOOL, IFTHEN, OVERLAY, Symbols, Migration => DFSORT/MVS is on the Web at http://www.ibm.com/storage/dfsort/ -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Merge SMF records
Antonio Corrales wrote: A last doubt for Radoslaw: When you says “Eliminate SMF record flood”. What do you mean? Really we want to merge F1 and F2 to have one SMF montly file to have some reports sorted in a especial sequence Antonio, It is general remark, not related to your problem. Sometimes people switch on some application (i.e DB2, CICS) knobs which causes a lot of records being created. In some cases they really requires those records, but sometimes it simply by mistake. In taht case it's very likely to get space abend during SMF offload. Such an abend is a reason for incomplete VBS records in SMF archive. BTW: Do you really need *all the records* from F1 and F2 files ? Maybe it's enough to filter some record types and then process them. Sometimes it's much easier, especially when you have to repeat the reporting job. Regards -- Radoslaw Skorupka Lodz, Poland -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Merge SMF records
First, thanks all the people that try to help me My problem is not with the SORT function. Really is with the MERGE function. I will try to explain it I have two SMF files, F1 and F2 a) If i merge F1 and F2 with IFASMFDP, it works correctly b) If i sort F1 with SPANINC=RC16 default, it works correctly c) If i sort F2 with SPANINC=RC16 default, it works correctly d) If i merge F1 and F2 with SPANINC=RC16 default, it shows ICE204A 2 INCOMPLETE SPANNED RECORD DETECTED ON - > RC=16 Frank, when you answer me about this Antonio wrote > Like we can see, in the place were in theory we must find the SYSIN > dd statement, we found spaces (Some idea about this???) Frank wrote >I don't understand what you mean by this. Please explain in more detail. I mean where SYSIN DD name must appear (see in the message), i receive spaces. I think are the same kind of invalid characters that Gary receive in his ICE output e) If i merge F1 and F2 with SPANINC=RC4 or RC0, it shows ICE141A 2 SPANNED RECORD ON COULD NOT BE ASSEMBLED ( are spaces) Like we can see, MERGE function detects some invalid records that SORT function doesn’t detects. Why? (Frank, i will send you the //SYSOUT messages if you want to see them) Nowadays we are using IFASMFDP to merge F1 and F2 without problems, but we need to merge it in a different sort sequence. I don’t still try the VBSFIX solution (thanks John), but i prefer to solve the problem with SORT vs MERGE with spanned records first, and if VBSFIX is unsupported, i don’t know if it will be the best way for the future... A last doubt for Radoslaw: When you says “Eliminate SMF record flood”. What do you mean? Really we want to merge F1 and F2 to have one SMF montly file to have some reports sorted in a especial sequence To sum up, somebody knows why MERGE fuction detects invalid records that SORT function? Thanks a lot Antonio -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Merge SMF records
From my experience IFASMFDP cannot handle incomplete VBS records. I case of such error it terminates with abend S002. Then I use ICEMAN with OPTION COPY,SPANINC=RC4 to eliminate the incomplete record(s). Works like a charm. The only thing I miss is the number of records incompleted and eliminated. So, I use DFSORT to fix problem which cannot be solved by IFASMFDP. Other shops I know also do that. BTW: In every case I know, the reason of incomplete SMF record is abend during appending SMF "archlog" file. Usually because lack of space. IMHO the best approach is to do the following: 1. Eliminate space constraints (make more space available) 2. Eliminate SMF record flood. 3. Divide large monthly or weekly file into smaller *separate* daily datasets. It takes the same amount of space, but the potential problem is easier to isolate/fix. It also save resources when doing some report for few days period. -- Radoslaw Skorupka Lodz, Poland -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Merge SMF records
Gary Diehl wrote on 11/10/2006 11:05:27 AM: > I honestly don't know what the problems were with the records that > caused ICETOOL to abend and IFASMFDP to work fine. A manual dump of > them to a readable file using SAS didn't show anything glaringly unusual > on eyeball-inspection. > > When I ran IFASMFDP to "clean up" this production abend, it came back > and reported 0 records in error. So why did ICE find a problem and > abend while IFA copied it fine and didn't report an error? Since you had SPANINC=RC16 and DFSORT terminated for an incomplete spanned record, I have no reason to doubt that there was an incomplete spanned record in the file. I don't know much about IFASMFDP. Maybe it's default is to handle incomplete spanned records automatically or maybe it doesn't detect them, in which case there could be incomplete spanned records in the file and you wouldn't know it. If you had used SPANINC=RC0 or SPANINC=RC0 with DFSORT, maybe DFSORT would have handled the incomplete spanned records as well and you wouldn't have noticed them. The fact that DFSORT reported a problem when you told it to report a problem (SPANINC=RC16) and that IFASMFDP didn't report a problem might just mean that IFASMFDP doesn't report such problems when it finds them or doesn't find them. Maybe somebody else who knows more about how IFASMFDP handles incomplete spanned records could shed some light on this. The fact is, since you were using SPANINC=RC16, you really don't know whether DFSORT would have handled the incomplete spanned records or not with SPANINC=RC0 or SPANINC=RC4. So we're comparing apples to oranges here. >I don't know, but I can tell you that it was a repeatable issue, and using IFA > to clean it up was a whole lot easier than trying to use SAS to isolate > and delete the record in error and try ICE again (and maybe have it > abend again and again, as each new "bad" record was found and had to be > manually worked around). But you told DFSORT to terminate with SPANINC=RC16. If you didn't want it to terminate, you should have used SPANINC=RC0 or SPANINC=RC4. But maybe you didn't know that SPANINC=RC16 was the default and could be changed? > I'm sure we must be running the default RC16 you mentioned. If it's > that noteworthy of pursuing, we could probably arrange a set of test > data to troubleshoot the nature of the failure. Well, it would be interesting to know if you still got a failure with SPANINC=RC0 or SPANINC=RC4. If so, then we'd know that IFASMFDP can handle or ignores bad spanned record situations that cause DFSORT to terminate. But we really don't know that based on what you were doing. Frank Yaeger - DFSORT Team (IBM) - [EMAIL PROTECTED] Specialties: PARSE, JFY, SQZ, ICETOOL, IFTHEN, OVERLAY, Symbols, Migration => DFSORT/MVS is on the Web at http://www.ibm.com/storage/dfsort/ -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Merge SMF records
Frank, I honestly don't know what the problems were with the records that caused ICETOOL to abend and IFASMFDP to work fine. A manual dump of them to a readable file using SAS didn't show anything glaringly unusual on eyeball-inspection. When I ran IFASMFDP to "clean up" this production abend, it came back and reported 0 records in error. So why did ICE find a problem and abend while IFA copied it fine and didn't report an error? I don't know, but I can tell you that it was a repeatable issue, and using IFA to clean it up was a whole lot easier than trying to use SAS to isolate and delete the record in error and try ICE again (and maybe have it abend again and again, as each new "bad" record was found and had to be manually worked around). I'm sure we must be running the default RC16 you mentioned. If it's that noteworthy of pursuing, we could probably arrange a set of test data to troubleshoot the nature of the failure. Thanks, Gary Diehl -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Merge SMF records
Gary Diehl wrote on 11/10/2006 09:30:44 AM: > We've had these issues in the recent past, and switched from using > ICETOOL to just plain IFASMFDP to copy or merge SMF records. Too many > production abends to mess around with trying to fix ICETOOL when > IFASMFDP does it seamlessly. > > And we saw the same thing you saw with the DD name containing invalid > characters in the ICE output: > > 2 INCOMPLETE SPANNED RECORD DETECTED ONq - RC=16 That message indicates that there's an incomplete spanned record in the file and that SPANINC=RC16 is in effect so DFSORT should terminate. If you have SPANINC=RC0 or SPANINC=RC4 in effect, DFSORT will attempt to eliminate incomplete spanned records and keep valid records. It's not clear if you tried SPANINC=RC0/RC4 or not. DFSORT's shipped installation default is SPANINC=RC16, but you can change that to RC0 or RC4 so it's used for all DFSORT and ICETOOL jobs. Or you can change it for a particular DFSORT or ICETOOL like this: //DFSPARM DD * OPTION SPANINC=RC4 /* > Why ICE won't but IFASMFDP will, is perhaps a better question for Frank > than I. Well, if you have SPANINC=RC16 in effect, you're telling DFSORT to terminate so that's what it does. If you have SPANINC=RC0/RC4 in effect, then I guess the question would be are there problem(s) with spanned records that IFASMFDP can fix, but DFSORT can't, and if so, what are those specific problem(s). Frank Yaeger - DFSORT Team (IBM) - [EMAIL PROTECTED] Specialties: PARSE, JFY, SQZ, ICETOOL, IFTHEN, OVERLAY, Symbols, Migration => DFSORT/MVS is on the Web at http://www.ibm.com/storage/dfsort/ -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Merge SMF records
Antonio, We've had these issues in the recent past, and switched from using ICETOOL to just plain IFASMFDP to copy or merge SMF records. Too many production abends to mess around with trying to fix ICETOOL when IFASMFDP does it seamlessly. And we saw the same thing you saw with the DD name containing invalid characters in the ICE output: 2 INCOMPLETE SPANNED RECORD DETECTED ONq - RC=16 Why ICE won't but IFASMFDP will, is perhaps a better question for Frank than I. Regards, Gary Diehl -Original Message- From: IBM Mainframe Discussion List [mailto:[EMAIL PROTECTED] On Behalf Of Frank Yaeger Sent: Friday, November 10, 2006 10:16 AM To: IBM-MAIN@BAMA.UA.EDU Subject: Re: Merge SMF records -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Merge SMF records
Antonio Corrales García wrote on 11/10/2006 04:35:48 AM: > We are fighting against a problem with SORT and SMF records. > > We are trying to merge two smf files obtaining this error message: > >ICE204A 2 INCOMPLETE SPANNED RECORD DETECTED ON - RC=16 > > When we try to use the SPANINC=RC0/RC4 option, we obtain this error message: > >ICE141A 2 SPANNED RECORD ON COULD NOT BE ASSEMBLED DFSORT's SPANINC option can "fix up" many types of incomplete spanned records, but not all types. The ICE141A message indicates there's a serious problem with the file that DFSORT can't fix. Here's a link to the online doc for ICE141A: http://publibz.boulder.ibm.com/cgi-bin/bookmgr_OS390/BOOKS/ICE1CM20/2.2.137?SHELF=&DT=20060721170811&CASE= > Like we can see, in the place were in theory we must find the SYSIN > dd statement, we found spaces (Some idea about this???) I don't understand what you mean by this. Please explain in more detail. >... > 2) If we use the COPY,SPANINC=RC0 option to eliminate the > incomplete or erroneus spanned records, no records are eliminated > and the merge results are the same Are you saying that when you use SPANINC=RC0 with a MERGE, you get ICE141A, but when you use SPANINC=RC0 with a COPY, you don't get ICE141A? If so, please send me ([EMAIL PROTECTED]) the //SYSOUT messages for both of those runs so I can see what's happening. > Anybody knows more possibilities to solve this problem The VBSFIX program might or might not help. I don't know if it handles any situations that DFSORT's SPANINC option doesn't handle. Frank Yaeger - DFSORT Team (IBM) - [EMAIL PROTECTED] Specialties: PARSE, JFY, SQZ, ICETOOL, IFTHEN, OVERLAY, Symbols, Migration => DFSORT/MVS is on the Web at http://www.ibm.com/storage/dfsort/ -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Merge SMF records
Corrales García, Antonio wrote: Hi all We are fighting against a problem with SORT and SMF records. We are trying to merge two smf files obtaining this error message: ICE204A 2 INCOMPLETE SPANNED RECORD DETECTED ON - RC=16 When we try to use the SPANINC=RC0/RC4 option, we obtain this error message: ICE141A 2 SPANNED RECORD ON COULD NOT BE ASSEMBLED Like we can see, in the place were in theory we must find the SYSIN dd statement, we found spaces (Some idea about this???) We're tried 2 more possible solutions but: 1) If we convert the SMF files from VBS to VB, the amount of disk space used by the new VB files makes it impossible to manage 2) If we use the COPY,SPANINC=RC0 option to eliminate the incomplete or erroneus spanned records, no records are eliminated and the merge results are the same Anybody knows more possibilities to solve this problem Show us your JOB. I suspect, you should first exclude incomplete records and then work on fixed SMF dataset. -- Radoslaw Skorupka Lodz, Poland -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Re: Merge SMF records
> -Original Message- > From: IBM Mainframe Discussion List On Behalf Of Corrales García, Antonio > > Hi all > > We are fighting against a problem with SORT and SMF records. > > We are trying to merge two smf files obtaining this error message: > > ICE204A 2 INCOMPLETE SPANNED RECORD DETECTED ON >- RC=16 > > When we try to use the SPANINC=RC0/RC4 option, we obtain this > error message: > > ICE141A 2 SPANNED RECORD ON COULD NOT BE > ASSEMBLED > > Like we can see, in the place were in theory we must find the > SYSIN dd statement, we found spaces (Some idea about this???) > > We're tried 2 more possible solutions but: > 1)If we convert the SMF files from VBS to VB, the amount > of disk space used by the new VB files makes it impossible to manage > 2)If we use the COPY,SPANINC=RC0 option to eliminate the > incomplete or erroneus spanned records, no records are > eliminated and the merge results are the same > > Anybody knows more possibilities to solve this problem Thanks > for any help Go to http://www.ibm.com and search for VBSFIX. It's an unsupported program written long ago by somebody in the Washington Systems Center to fix or skip "broken" spanned records. -jc- -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html
Merge SMF records
Hi all We are fighting against a problem with SORT and SMF records. We are trying to merge two smf files obtaining this error message: ICE204A 2 INCOMPLETE SPANNED RECORD DETECTED ON - RC=16 When we try to use the SPANINC=RC0/RC4 option, we obtain this error message: ICE141A 2 SPANNED RECORD ON COULD NOT BE ASSEMBLED Like we can see, in the place were in theory we must find the SYSIN dd statement, we found spaces (Some idea about this???) We're tried 2 more possible solutions but: 1) If we convert the SMF files from VBS to VB, the amount of disk space used by the new VB files makes it impossible to manage 2) If we use the COPY,SPANINC=RC0 option to eliminate the incomplete or erroneus spanned records, no records are eliminated and the merge results are the same Anybody knows more possibilities to solve this problem Thanks for any help Antonio Corrales García Técnico de Sistemas/Grupo de Sistemas Z/OS MAPFRE TECNOLOGÍAS DE LA INFORMACIÓN Ctra. De Pozuelo nº 52 28220 Majadahonda (Madrid) [EMAIL PROTECTED] -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO Search the archives at http://bama.ua.edu/archives/ibm-main.html