Re: Z900 (2064 - 216) Problem.
Yes we checked EREP but it doesn't show anything. We run the same job from other member of Sysplex and everything is OK. The DASD Is share and the job is a simple DUMP. From: Vernooij, CP - SPLXM kees.verno...@klm.com To: IBM-MAIN@LISTSERV.UA.EDU Sent: Thursday, August 16, 2012 2:12 PM Subject: Re: Z900 (2064 - 216) Problem. It sounds like a hardware problem. Did you check EREP? Of no of SIOs decrease, it is probably due to increased Dasd response times. Did you check this? What component of Resp time increases? Does the other LPAR use the same Dasd? What happens to that LPAR's response times? Kees. Mehrshad Manshadi m_mansh...@yahoo.com wrote in message news:1345106626.32723.yahoomail...@web125603.mail.ne1.yahoo.com... Hi all, We have a parallel Sysplex with 2 members.one of them is a CPU Z900 (2064 -1C5) with Z/OS 1.8 as operating system and the other is CPU Z900(2064-216) with the same operating system. We have a weird problem with CPU 2064-216 as follows: When we power on reset the CPU and IPL from that,It works OK. for about 12 hours and after that it degrades and the jobs take much more times to complete.(about 4 times).The major things is decreasing No. of SIO for the jobs.after that even REIPL is not resolve the problem and we have to POWER ON RESET the CPU and REIPL for the next 12 hours!!. We exchange the operating systems between two CPUs but the problem is exactly the same. Does anybody have the same experience ? Any help should by highly appreciated. Regards, Manshadi -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN For information, services and offers, please visit our web site: http://www.klm.com. This e-mail and any attachment may contain confidential and privileged material intended for the addressee only. If you are not the addressee, you are notified that no part of the e-mail or any attachment may be disclosed, copied or distributed, and that any other action related to this e-mail or attachment is strictly prohibited, and may be unlawful. If you have received this e-mail by error, please notify the sender immediately by return e-mail, and delete this message. Koninklijke Luchtvaart Maatschappij NV (KLM), its subsidiaries and/or its employees shall not be liable for the incorrect or incomplete transmission of this e-mail or any attachments, nor responsible for any delay in receipt. Koninklijke Luchtvaart Maatschappij N.V. (also known as KLM Royal Dutch Airlines) is registered in Amstelveen, The Netherlands, with registered number 33014286 -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: Z900 (2064 - 216) Problem.
Mehrshad Manshadi wrote: We have a parallel Sysplex with 2 members.one of them is a CPU Z900 (2064 -1C5) with Z/OS 1.8 as operating system and the other is CPU Z900(2064-216) with the same operating system. z/OS 1.8 is unsupported. When we power on reset the CPU and IPL from that,It works OK. for about 12 hours and after that it degrades and the jobs take much more times to complete.(about 4 times). What jobs? How many jobs on what LPARs? Are they sharing workload and middleware? How long does the degrading take places? Try moving you data to another volsers to see if the problem is with some disks or channels (ESCON or FICON). What type of workload do you have? What middleware do you have? Can you post any SYSLOG message(s)? What is RMF, GRS, WLM and SMF showing you? The major things is decreasing No. of SIO for the jobs.after that even REIPL is not resolve the problem and we have to POWER ON RESET the CPU and REIPL for the next 12 hours!!. POR is too much taken in account of design of hardware and z/OS. Open a ticket with IBM rep. Groete / Greetings Elardus Engelbrecht -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: Z900 (2064 - 216) Problem.
Mehrshad Manshadi wrote: No this happen for all the jobs.Like ( Reorg , load ) Re-org is sometimes heavy on resources, but managable. YMMV. We are using the simple dump just for test. Please describe your 'simple dump'. Memory dump? Dump of volsers? Is it dump by application or by DFDSS? There is no any user on the machine during these test. The CICS and DB2 were down. During or before degradation? You should really check your EREP again and make sure you get all your records from all LPARS. Oh, yes, check your Coupling Facility (with your IBM CE) if you have any problems. Kees asked you lots of other questions, could you perhaps post your replies here? Groete / Greetings Elardus Engelbrecht -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: Z900 (2064 - 216) Problem.
We have this degradation for all the jobs after 12 hours of POR and IPL. We are using Goal Mode. We are also change the volumes on other channels but the problem is same. For test, we are using a simple DUMP JOB with following result : Before Problem: NP JOBNAME StepName ProcStep JobID Owner C Pos DP Real Paging SIO BKDUMP ADRDSSU JOB02189 IBMUSER A IN C0 1421 0.00 8572.2 -STEPNAME PROCSTEP RC EXCP CONN TCB SRB CLOCK -ADRDSSU 00 302K 13318 .31 .00 .6 === After Problem : After 12 hours NP JOBNAME StepName ProcStep JobID Owner C Pos DP Real Paging SIO BKDUMP ADRDSSU JOB02100 IBMUSER A IN C0 1421 0.00 3200.2 -STEPNAME PROCSTEP RC EXCP CONN TCB SRB CLOCK -DELET1 00 11 3 .00 .00 .0 -ADRDSSU 00 302K 13059 1.56 .01 1.6 1 Best regards Manshadi From: Elardus Engelbrecht elardus.engelbre...@sita.co.za To: IBM-MAIN@LISTSERV.UA.EDU Sent: Thursday, August 16, 2012 2:50 PM Subject: Re: Z900 (2064 - 216) Problem. Mehrshad Manshadi wrote: We have a parallel Sysplex with 2 members.one of them is a CPU Z900 (2064 -1C5) with Z/OS 1.8 as operating system and the other is CPU Z900(2064-216) with the same operating system. z/OS 1.8 is unsupported. When we power on reset the CPU and IPL from that,It works OK. for about 12 hours and after that it degrades and the jobs take much more times to complete.(about 4 times). What jobs? How many jobs on what LPARs? Are they sharing workload and middleware? How long does the degrading take places? Try moving you data to another volsers to see if the problem is with some disks or channels (ESCON or FICON). What type of workload do you have? What middleware do you have? Can you post any SYSLOG message(s)? What is RMF, GRS, WLM and SMF showing you? The major things is decreasing No. of SIO for the jobs.after that even REIPL is not resolve the problem and we have to POWER ON RESET the CPU and REIPL for the next 12 hours!!. POR is too much taken in account of design of hardware and z/OS. Open a ticket with IBM rep. Groete / Greetings Elardus Engelbrecht -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: Z900 (2064 - 216) Problem.
The DUMP we are using is as follows : //BKDUMP JOB MSGCLASS=X NOTIFY=SYSUID,TYPRUN=HOLD /*JOBPARM SYSAFF=Z18B //DELET1 EXEC PGM=IEFBR14 //SYSPUNCH DD DSN=TEMPFI.Y2012.M0718, // UNIT=SYSDA,DISP=(MOD,DELETE,DELETE),SPACE=(TRK,1) //ADRDSSU EXEC PGM=ADRDSSU,REGION=0M //DD1 DD UNIT=SYSALLDA, // SPACE=(CYL,(3000,1000),RLSE), // VOL=SER=SZ8W01, // DISP=(,CATLG,DELETE), // DSN=TEMPFI.Y2012.M0718 //SYSPRINT DD SYSOUT=* DUMP DATASET(INCLUDE( - CV3FNS.FNETONL.LOAD - ) - ) - COMPRESS - TOL(ENQF) WAIT(0, 0) - OUTDD(DD1) //* During or before degradation? There is no user on the machine before and after degradation. Oh, yes, check your Coupling Facility (with your IBM CE) if you have any problems. Forgot the Coupling Facility, because we bring up the machine as a normal I mean outside of Sysplex but the problem is still there. You should really check your EREP again and make sure you get all your records from all LPARS. About EREP could you please which part or which type of parameter I should check and prepare a report. Best regards Manshadi From: Elardus Engelbrecht elardus.engelbre...@sita.co.za To: IBM-MAIN@LISTSERV.UA.EDU Sent: Thursday, August 16, 2012 3:23 PM Subject: Re: Z900 (2064 - 216) Problem. Mehrshad Manshadi wrote: No this happen for all the jobs.Like ( Reorg , load ) Re-org is sometimes heavy on resources, but managable. YMMV. We are using the simple dump just for test. Please describe your 'simple dump'. Memory dump? Dump of volsers? Is it dump by application or by DFDSS? There is no any user on the machine during these test. The CICS and DB2 were down. During or before degradation? You should really check your EREP again and make sure you get all your records from all LPARS. Oh, yes, check your Coupling Facility (with your IBM CE) if you have any problems. Kees asked you lots of other questions, could you perhaps post your replies here? Groete / Greetings Elardus Engelbrecht -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: Z900 (2064 - 216) Problem.
Hi Manshadi, You might check to see if you have Defined Capacity or Group Capacity setup on the HMC for the LPARs on this CEC. This would fit with the general symptom of IPL and then sometime later seeing a slowdown. You said 12 hours but I want to consider that might be subjective and not always exactly 12 hours. The RMF Monitor III screen CPC aka RMF V1R13 CPC Capacity shows if you have capped the LPARs. Best Regards, Sam Knutson, GEICO System z Team Leader mailto:sknut...@geico.com (office) 301.986.3574 (cell) 301.996.1318 Think big, act bold, start simple, grow fast... -Original Message- From: IBM Mainframe Discussion List [mailto:IBM-MAIN@LISTSERV.UA.EDU] On Behalf Of Mehrshad Manshadi Sent: Thursday, August 16, 2012 4:44 AM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Z900 (2064 - 216) Problem. Hi all, We have a parallel Sysplex with 2 members.one of them is a CPU Z900 (2064 -1C5) with Z/OS 1.8 as operating system and the other is CPU Z900(2064-216) with the same operating system. We have a weird problem with CPU 2064-216 as follows: When we power on reset the CPU and IPL from that,It works OK. for about 12 hours and after that it degrades and the jobs take much more times to complete.(about 4 times).The major things is decreasing No. of SIO for the jobs.after that even REIPL is not resolve the problem and we have to POWER ON RESET the CPU and REIPL for the next 12 hours!!. We exchange the operating systems between two CPUs but the problem is exactly the same. Does anybody have the same experience ? Any help should by highly appreciated. Regards, Manshadi -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN This email/fax message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution of this email/fax is prohibited. If you are not the intended recipient, please destroy all paper and electronic copies of the original message. -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: Z900 (2064 - 216) Problem.
Re: Z900 (2064 - 216) Problem. TO: 1 recipientShow Details Well this is interesting: Excp, Conn are the same!! Apparently there is no difference in the actual I/O. TCB and SIO are higher. What is SIO, where does this come from? What is the relationship between Excp and SIO? Do you use hardware compression, can this be switched off after 12 hours? Kees. Mehrshad Manshadi m_mansh...@yahoo.com wrote in message news:1345115098.18256.yahoomail...@web125603.mail.ne1.yahoo.com... We have this degradation for all the jobs after 12 hours of POR and IPL. We are using Goal Mode. We are also change the volumes on other channels but the problem is same. For test, we are using a simple DUMP JOB with following result : Before Problem: NP JOBNAME StepName ProcStep JobID Owner C Pos DP Real Paging SIO BKDUMP ADRDSSU JOB02189 IBMUSER A IN C0 1421 0.00 8572.2 -STEPNAME PROCSTEP RC EXCP CONN TCB SRB CLOCK -ADRDSSU 00 302K 13318 .31 .00 .6 === After Problem : After 12 hours NP JOBNAME StepName ProcStep JobID Owner C Pos DP Real Paging SIO BKDUMP ADRDSSU JOB02100 IBMUSER A IN C0 1421 0.00 3200.2 -STEPNAME PROCSTEP RC EXCP CONN TCB SRB CLOCK -DELET1 00 11 3 .00 .00 .0 -ADRDSSU 00 302K 13059 1.56 .01 1.6 1 Best regards Manshadi From: Elardus Engelbrecht elardus.engelbre...@sita.co.za To: IBM-MAIN@LISTSERV.UA.EDU Sent: Thursday, August 16, 2012 2:50 PM Subject: Re: Z900 (2064 - 216) Problem. Mehrshad Manshadi wrote: We have a parallel Sysplex with 2 members.one of them is a CPU Z900 (2064 -1C5) with Z/OS 1.8 as operating system and the other is CPU Z900(2064-216) with the same operating system. z/OS 1.8 is unsupported. When we power on reset the CPU and IPL from that,It works OK. for about 12 hours and after that it degrades and the jobs take much more times to complete.(about 4 times). What jobs? How many jobs on what LPARs? Are they sharing workload and middleware? How long does the degrading take places? Try moving you data to another volsers to see if the problem is with some disks or channels (ESCON or FICON). What type of workload do you have? What middleware do you have? Can you post any SYSLOG message(s)? What is RMF, GRS, WLM and SMF showing you? The major things is decreasing No. of SIO for the jobs.after that even REIPL is not resolve the problem and we have to POWER ON RESET the CPU and REIPL for the next 12 hours!!. POR is too much taken in account of design of hardware and z/OS. Open a ticket with IBM rep. Groete / Greetings Elardus Engelbrecht rom: Elardus Engelbrecht elardus.engelbre...@sita.co.za To: IBM-MAIN@LISTSERV.UA.EDU Sent: Thursday, August 16, 2012 3:23 PM Subject: Re: Z900 (2064 - 216) Problem. Mehrshad Manshadi wrote: No this happen for all the jobs.Like ( Reorg , load ) Re-org is sometimes heavy on resources, but managable. YMMV. We are using the simple dump just for test. Please describe your 'simple dump'. Memory dump? Dump of volsers? Is it dump by application or by DFDSS? There is no any user on the machine during these test. The CICS and DB2 were down. During or before degradation? You should really check your EREP again and make sure you get all your records from all LPARS. Oh, yes, check your Coupling Facility (with your IBM CE) if you have any problems. Kees asked you lots of other questions, could you perhaps post your replies here? Groete / Greetings Elardus Engelbrecht -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: Z900 (2064 - 216) Problem.
SIO means Start IO and it's came from SDSF panel during execution a job. About hardware compression I should investigate. From: Vernooij, CP - SPLXM kees.verno...@klm.com To: IBM-MAIN@LISTSERV.UA.EDU Sent: Thursday, August 16, 2012 4:01 PM Subject: Re: Z900 (2064 - 216) Problem. Well this is interesting: Excp, Conn are the same!! Apparently there is no difference in the actual I/O. TCB and SIO are higher. What is SIO, where does this come from? What is the relationship between Excp and SIO? Do you use hardware compression, can this be switched off after 12 hours? Kees. Mehrshad Manshadi m_mansh...@yahoo.com wrote in message news:1345115098.18256.yahoomail...@web125603.mail.ne1.yahoo.com... We have this degradation for all the jobs after 12 hours of POR and IPL. We are using Goal Mode. We are also change the volumes on other channels but the problem is same. For test, we are using a simple DUMP JOB with following result : Before Problem: NP JOBNAME StepName ProcStep JobID Owner C Pos DP Real Paging SIO BKDUMP ADRDSSU JOB02189 IBMUSER A IN C0 1421 0.00 8572.2 -STEPNAME PROCSTEP RC EXCP CONN TCB SRB CLOCK -ADRDSSU 00 302K 13318 .31 .00 .6 === After Problem : After 12 hours NP JOBNAME StepName ProcStep JobID Owner C Pos DP Real Paging SIO BKDUMP ADRDSSU JOB02100 IBMUSER A IN C0 1421 0.00 3200.2 -STEPNAME PROCSTEP RC EXCP CONN TCB SRB CLOCK -DELET1 00 11 3 .00 .00 .0 -ADRDSSU 00 302K 13059 1.56 .01 1.6 1 Best regards Manshadi From: Elardus Engelbrecht elardus.engelbre...@sita.co.za To: IBM-MAIN@LISTSERV.UA.EDU Sent: Thursday, August 16, 2012 2:50 PM Subject: Re: Z900 (2064 - 216) Problem. Mehrshad Manshadi wrote: We have a parallel Sysplex with 2 members.one of them is a CPU Z900 (2064 -1C5) with Z/OS 1.8 as operating system and the other is CPU Z900(2064-216) with the same operating system. z/OS 1.8 is unsupported. When we power on reset the CPU and IPL from that,It works OK. for about 12 hours and after that it degrades and the jobs take much more times to complete.(about 4 times). What jobs? How many jobs on what LPARs? Are they sharing workload and middleware? How long does the degrading take places? Try moving you data to another volsers to see if the problem is with some disks or channels (ESCON or FICON). What type of workload do you have? What middleware do you have? Can you post any SYSLOG message(s)? What is RMF, GRS, WLM and SMF showing you? The major things is decreasing No. of SIO for the jobs.after that even REIPL is not resolve the problem and we have to POWER ON RESET the CPU and REIPL for the next 12 hours!!. POR is too much taken in account of design of hardware and z/OS. Open a ticket with IBM rep. Groete / Greetings Elardus Engelbrecht -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN For information, services and offers, please visit our web site: http://www.klm.com. This e-mail and any attachment may contain confidential and privileged material intended for the addressee only. If you are not the addressee, you are notified that no part of the e-mail or any attachment may be disclosed, copied or distributed, and that any other action related to this e-mail or attachment is strictly prohibited, and may be unlawful. If you have received this e-mail by error, please notify the sender immediately by return e-mail, and delete this message. Koninklijke Luchtvaart Maatschappij NV (KLM), its subsidiaries and/or its employees shall not be liable for the incorrect or incomplete transmission of this e-mail or any attachments, nor responsible for any delay in receipt. Koninklijke Luchtvaart Maatschappij N.V. (also known as KLM Royal Dutch Airlines) is registered in Amstelveen, The Netherlands, with registered number 33014286
Re: Z900 (2064 - 216) Problem.
Is you z/OS V1.8 system have all maintenance available? There were some issues with SRM and some of the counters going negative. But I do not recall where that was. I would search IBM Link and see if there is any remaining maint you do not have on. Even though z/OS V1.8 is no longer supported, any maint that is available can be researched. IBM just cannot create new fixes for your level of software. Lizette -Original Message- From: IBM Mainframe Discussion List [mailto:IBM-MAIN@LISTSERV.UA.EDU] On Behalf Of Mehrshad Manshadi Sent: Thursday, August 16, 2012 1:44 AM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Z900 (2064 - 216) Problem. Hi all, We have a parallel Sysplex with 2 members.one of them is a CPU Z900 (2064 -1C5) with Z/OS 1.8 as operating system and the other is CPU Z900(2064-216) with the same operating system. We have a weird problem with CPU 2064-216 as follows: When we power on reset the CPU and IPL from that,It works OK. for about 12 hours and after that it degrades and the jobs take much more times to complete.(about 4 times).The major things is decreasing No. of SIO for the jobs.after that even REIPL is not resolve the problem and we have to POWER ON RESET the CPU and REIPL for the next 12 hours!!. We exchange the operating systems between two CPUs but the problem is exactly the same. Does anybody have the same experience ? Any help should by highly appreciated. Regards, Manshadi -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
Re: Z900 (2064 - 216) Problem.
Isn't capacity capping a 4 hour rolling average? So wouldn't it kick in before 4 hours? Unless the workload is slow for about 9 hours, then CPU utilization picks up. On Thu, Aug 16, 2012 at 6:34 AM, Knutson, Sam sknut...@geico.com wrote: Hi Manshadi, You might check to see if you have Defined Capacity or Group Capacity setup on the HMC for the LPARs on this CEC. This would fit with the general symptom of IPL and then sometime later seeing a slowdown. You said 12 hours but I want to consider that might be subjective and not always exactly 12 hours. The RMF Monitor III screen CPC aka RMF V1R13 CPC Capacity shows if you have capped the LPARs. Best Regards, Sam Knutson, GEICO System z Team Leader mailto:sknut...@geico.com (office) 301.986.3574 (cell) 301.996.1318 Think big, act bold, start simple, grow fast... -Original Message- From: IBM Mainframe Discussion List [mailto:IBM-MAIN@LISTSERV.UA.EDU] On Behalf Of Mehrshad Manshadi Sent: Thursday, August 16, 2012 4:44 AM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Z900 (2064 - 216) Problem. Hi all, We have a parallel Sysplex with 2 members.one of them is a CPU Z900 (2064 -1C5) with Z/OS 1.8 as operating system and the other is CPU Z900(2064-216) with the same operating system. We have a weird problem with CPU 2064-216 as follows: When we power on reset the CPU and IPL from that,It works OK. for about 12 hours and after that it degrades and the jobs take much more times to complete.(about 4 times).The major things is decreasing No. of SIO for the jobs.after that even REIPL is not resolve the problem and we have to POWER ON RESET the CPU and REIPL for the next 12 hours!!. We exchange the operating systems between two CPUs but the problem is exactly the same. Does anybody have the same experience ? Any help should by highly appreciated. Regards, Manshadi -- Mike A Schwab, Springfield IL USA Where do Forest Rangers go to get away from it all? -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN
