Re: Problem with z/Linux guest Ethernet frames (buffering ?)
Hello Marcy, Current PAGE space utilization is 12.3% utilized of 2 3390-3 DASD, highest page utilization of 28%. Utilization of below 50% should be alright to run with, correct? Around the time of the event the page space usage was around 12%. q alloc page EXTENT EXTENT TOTAL PAGES HIGH% VOLID RDEV STARTEND PAGES IN USE PAGE USED -- -- -- -- -- -- LEPG1A 5814 1 3338 600840 74453 166317 12% LEPG2A 5815 1 3338 600840 74948 166320 12% -- -- SUMMARY1174K 149401 12% USABLE 1174K 149401 12% Thank you, Ashwin -Original Message- From: The IBM z/VM Operating System [mailto:IBMVM@LISTSERV.UARK.EDU] On Behalf Of Marcy Cortes Sent: Friday, May 06, 2011 3:28 PM To: IBMVM@LISTSERV.UARK.EDU Subject: Re: Problem with z/Linux guest Ethernet frames (buffering ?) How full is your page space? (Q ALLOC PAGE). Marcy -Original Message- From: The IBM z/VM Operating System [mailto:IBMVM@LISTSERV.UARK.EDU] On Behalf Of Bhemidhi, Ashwin Sent: Friday, May 06, 2011 8:05 AM To: IBMVM@LISTSERV.UARK.EDU Subject: Re: [IBMVM] Problem with z/Linux guest Ethernet frames (buffering ?) I will build a rexx exec that will run the IND QUEUES Command. What command/facility do I use to schedule the exec to run every 10 secs, is there something in z/VM that is similar to SCHEDULE/CRON. I updated SRM buffer setting to allow for storage over commit. Since this is a production LPAR I am not comfortable changing SRM setting(to defaults) with out being absolutely sure of what it might affect. The guest ran well for more than 3 months with the current SRM setting before we started seeing the network issue. It appears that we are running pretty tight. This z/VM LPAR is pretty small has 768 MB central and 256 Xstor , 2 X 3390-3 PAGE DASD. It runs 9 Linux guest ( 8 Prod, 1 standby) of 80MB memory, 16 MB, 48 MB VDISKs and 128 MB DASD SWAP disks . The guest are paging a little bit. Our application is 99.9% network IO(protocol convertor). We will be adding some memory to this LPAR during our maintenance this month to ease up on resources. VM CPU utilization seems to be a MAX 4% of 2 ILFs. When the problem occurs, it only happens on one of 8 machines machine, even though all the machines are polled similarly. The machine that has problem keeps changing and it appears to be paused for around 25+ seconds as we do not drop any frames just that they are delayed. Thank you, Ashwin -Original Message- From: The IBM z/VM Operating System [mailto:IBMVM@LISTSERV.UARK.EDU] On Behalf Of Alan Altmark Sent: Thursday, May 05, 2011 5:07 PM To: IBMVM@LISTSERV.UARK.EDU Subject: Re: Problem with z/Linux guest Ethernet frames (buffering ?) On Thursday, 05/05/2011 at 03:22 EDT, Bhemidhi, Ashwin ashw...@ti.com wrote: Right now there is the eligible list is 0. I could not check the queues at the time of event, the 3 times it occurred was either during after business hours or over the weekends. By the time I was able to logon the eligible list was 0. You can write an exec that issues IND QUEUES every, say, 10 seconds. If the result shows no-zero eligible lists, record the results (with the time) in a file or on the (spooled) console. Start it when you leave for the day. I did change the SRM storbuff setting from the default to 300%, 300%, 200%. Why? If you put it back to the defaults, does the problem go away? Alan Altmark z/VM and Linux on System z Consultant IBM System Lab Services and Training ibm.com/systems/services/labservices office: 607.429.3323 mobile; 607.321.7556 alan_altm...@us.ibm.com IBM Endicott
Re: Using EMC Clariion SCSI disk with Linux
Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: multipart/alternative; boundary=_000_897C82FC69765D45A301AF8F5D1210CB09BF7F6COTB6MAIL01execu_ MIME-Version: 1.0 X-Sophos-ESA: [mx6.uark.edu] 3.6.9.0, Antispam-Engine: 2.7.2.1390750, Antispam-Data: 2011.5.9.145714 --_000_897C82FC69765D45A301AF8F5D1210CB09BF7F6COTB6MAIL01execu_ Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable 1.The cabling appears fine. 2. Our Ficon Express 8 is LX (long wave) and open system guy says s= witch is: Make: EMC (Brocade) Model: DS-5100 Firmware: 6.1.0c NPIV Enabled Port He says optics are short wave and there is no such thing as long wave? 3. He says there are not errors on switch that the port is not negoti= ating at all. 4. As he says above NPIV is enabled on switch. Fabric Login Status ha= s *** in all fields. So with that being said, it appears the optics are the problem? Do you agr= ee that there is no such thing as long wave on open system switches? Anne D. Crabtree System Programmer WV Office of Technology Data Center 1900 Kanawha Blvd East Charleston, WV 25305 (304)558-5914 ext 58292 (304)558-1441 fax From: The IBM z/VM Operating System [mailto:IBMVM@LISTSERV.UARK.EDU] On Beh= alf Of Raymond Higgs Sent: Friday, May 06, 2011 9:12 AM Subject: Re: Using EMC Clariion SCSI disk with Linux The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU wrote on 05/06/2011= 07:51:57 AM: From: Crabtree, Anne D anne.d.crabt...@wv.gov To: IBMVM@LISTSERV.UARK.EDU Date: 05/06/2011 07:53 AM Subject: Using EMC Clariion SCSI disk with Linux Sent by: The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU I posted this on IBM-MAIN with not much response so hoping someone on z/VM might be able to help. Opened a PMR with IBM software but they feel it is a hardware issue. Waiting for information on switch before contacting IBM hardware folks... We have a z10 in which I have defined 2 FCP chpids on our FICON Express8 cards. These chpids have NPIV enabled and I have provided the open system team with the WWPN's that were generated. The FCP chpids are dedicated to our 1 Linux IFL. We have connected the fiber, but the chpid, while staying ONLINE, gets a SEQUENCE TIME-OUT on the HMC. The light is on on the mainframe side, but not on the switch. The open system team tells me that there is nothing for them to do on their side until they can see the mainframe (light comes on?). In z/VM, the chips appear fine, defined as FCP with devices attached and FREE. I'm not sure what else I can do from the mainframe side to help the situation? I am not involved in the Linux portion but the Linux guy says he can't see the luns from Linux. Both sides appear to be waiting on me to fix things! The SCSI is a CLARiiON CX-700 with FLARE (operating system) version 26 revision 31 (02.26.700.5.031) which is the latest release for the CX-700 product line. Anne, The bad news is that we don't support EMC Clariion, but I have heard accoun= ts of it working just fine. Since you are having problems between the chan= nel and switch, you still will be able to get some IBM support. I'd check = these things: * Double check the cabling between the channel and the switch. Is the chan= nel really plugged into the switch port that you think it is? * Make sure that the optics in the switch, the optics in the channel, and t= he fibre are either all long wave or all short wave. No mixing. * Check the switch for bit errors. If the switch is seeing bit errors, it = may have disabled the port on you. Or even simpler, was the switch port ev= er online? * Is NPIV enabled on your switch? There is a panel on the SE called Fabric= Login Status that may have some clues... Use the HMC to do single object = operatings to your z10 CPC. Navigate to your channel. It doesn't matter i= f it is the chpid or pchid. Find channel operations in the menus (I'm us= ed to classic mode so I use those arrows to cycle through the right hand pa= nel. Use channel problem determination. You might have to select an lpa= r at this point. Then Fabric login Status This panel shows a bunch = of fibre channel info from the channel about how it is logged into your swi= tch fabric. There might be some error messages here. Regards, Ray Higgs System z FCP Firmware Development Bld. 706, B42 2455 South Road Poughkeepsie, NY 12601 (845) 435-8666, T/L 295-8666 rayhi...@us.ibm.com --_000_897C82FC69765D45A301AF8F5D1210CB09BF7F6COTB6MAIL01execu_ Content-Type: text/html; charset=us-ascii Content-Transfer-Encoding: quoted-printable html xmlns:v=3Durn:schemas-microsoft-com:vml xmlns:o=3Durn:schemas-micr= osoft-com:office:office xmlns:w=3Durn:schemas-microsoft-com:office:word = xmlns:x=3Durn:schemas-microsoft-com:office:excel xmlns:p=3Durn:schemas-m= icrosoft-com:office:powerpoint
Re: Using EMC Clarion SCSI disk with Linux
You probably saw other post, but our open system guy says there's no such thing as long wave on switches? Do you have an opinion on that? Anne D. Crabtree System Programmer WV Office of Technology Data Center 1900 Kanawha Blvd East Charleston, WV 25305 (304)558-5914 ext 58292 (304)558-1441 fax From: The IBM z/VM Operating System [mailto:IBMVM@LISTSERV.UARK.EDU] On Behalf Of Jerry Whitteridge Sent: Friday, May 06, 2011 2:03 PM To: IBMVM@LISTSERV.UARK.EDU Subject: Re: Using EMC Clarion SCSI disk with Linux We connected our z9 to a Clarion a couple of years ago for POC testing only. I seem to remember something that the Clarion needed the z9 to attempt the connect , then they could authorize it and finally we were able to connect. (But these are vague memories - but I so remember a multi-step procedure). The Clarion is now de-installed but I believe the FCP chipid's are still there if you need me to look at something. Jerry Whitteridge Design Engineer Safeway Inc. 925 951 4184 If you feel in control you just aren't going fast enough. From: The IBM z/VM Operating System [mailto:IBMVM@LISTSERV.UARK.EDU] On Behalf Of Raymond Higgs Sent: Friday, May 06, 2011 10:25 AM To: IBMVM@LISTSERV.UARK.EDU Subject: Re: Using EMC Clariion SCSI disk with Linux The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU wrote on 05/06/2011 12:58:23 PM: From: Crabtree, Anne D anne.d.crabt...@wv.gov To: IBMVM@LISTSERV.UARK.EDU Date: 05/06/2011 01:02 PM Subject: Re: Using EMC Clariion SCSI disk with Linux Sent by: The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU Thank you Ray. Will verify these things and get back to you (probably next week). Thank you Heiko. Will research these as well. Can you tell me where speed is defined? I appreciate the responses. From: The IBM z/VM Operating System [IBMVM@LISTSERV.UARK.EDU] On Behalf Of Raymond Higgs [rayhi...@us.ibm.com] Sent: Friday, May 06, 2011 9:11 AM Subject: Re: Using EMC Clariion SCSI disk with Linux The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU wrote on 05/ 06/2011 07:51:57 AM: From: Crabtree, Anne D anne.d.crabt...@wv.gov To: IBMVM@LISTSERV.UARK.EDU Date: 05/06/2011 07:53 AM Subject: Using EMC Clariion SCSI disk with Linux Sent by: The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU I posted this on IBM-MAIN with not much response so hoping someone on z/VM might be able to help. Opened a PMR with IBM software but they feel it is a hardware issue. Waiting for information on switch before contacting IBM hardware folks... We have a z10 in which I have defined 2 FCP chpids on our FICON Express8 cards. These chpids have NPIV enabled and I have provided the open system team with the WWPN's that were generated. The FCP chpids are dedicated to our 1 Linux IFL. We have connected the fiber, but the chpid, while staying ONLINE, gets a SEQUENCE TIME-OUT on the HMC. The light is on on the mainframe side, but not on the switch. The open system team tells me that there is nothing for them to do on their side until they can see the mainframe (light comes on?). In z/VM, the chips appear fine, defined as FCP with devices attached and FREE. I'm not sure what else I can do from the mainframe side to help the situation? I am not involved in the Linux portion but the Linux guy says he can't see the luns from Linux. Both sides appear to be waiting on me to fix things! The SCSI is a CLARiiON CX-700 with FLARE (operating system) version 26 revision 31 (02.26.700.5.031) which is the latest release for the CX-700 product line. Anne, The bad news is that we don't support EMC Clariion, but I have heard accounts of it working just fine. Since you are having problems between the channel and switch, you still will be able to get some IBM support. I'd check these things: * Double check the cabling between the channel and the switch. Is the channel really plugged into the switch port that you think it is? * Make sure that the optics in the switch, the optics in the channel, and the fibre are either all long wave or all short wave. No mixing. * Check the switch for bit errors. If the switch is seeing bit errors, it may have disabled the port on you. Or even simpler, was the switch port ever online? * Is NPIV enabled on your switch? There is a panel on the SE called Fabric Login Status that may have some clues... Use the HMC to do single object operatings to your z10 CPC. Navigate to your channel. It doesn't matter if it is the chpid or pchid. Find channel operations in the menus (I'm used to classic mode so I use those arrows to cycle through the right hand panel. Use channel problem determination. You might have to select an lpar at this point. Then Fabric login Status This panel shows a bunch of fibre channel info from the channel about how it is logged into your switch fabric. There might be some error messages here. Regards, Ray Higgs System z
Re: Using EMC Clarion SCSI disk with Linux
I seem to remember when hooking up our DS6800 6/7 years ago we had a problem with long/short wave connections. So I believe there are long wave signals. Mace
Re: Using EMC Clariion SCSI disk with Linux
So with that being said, it appears the optics are the problem? That's certainly the first problem to kill. Do you agr= ee that there is no such thing as long wave on open system switches? It's rare for open systems (mostly appears in geo-plex-like situations), but it certainly does exist. They probably have never ordered any for their switch, but Brocade certainly makes LW interfaces.
Re: Using EMC Clariion SCSI disk with Linux
Anne, Mixing long and short wave is definitely your problem. It makes sense that the switch isn't negotiating at all. When the optics/cables are mismatched, the ports can't get word sync and can't even start sending ordered sets to do speed negotiation. A quick google search says that long wave is supported by that switch: http://www.brocade.com/downloads/documents/data_sheets/product_data_sheets/5100-DS-04.pdf Media types 8 Gbps: Requires Brocade hot-pluggable SFP+, LC connector; 8 Gbps Short-Wavelength Laser (SWL); 8 Gbps Long-Wavelength Laser (LWL); distance depends on fiber-optic cable and port speed 4 Gbps: Requires Brocade hot-pluggable, Small Form-factor Pluggable (SFP), LC connector; 4 Gbps Short-Wavelength Laser (SWL); 4 Gbps Long-Wavelength Laser (LWL); 4 Gbps Extended Long-Wavelength Laser (ELWL); distance depends on fiber-optic cable and port speed I don't know why he would say that long wave doesn't exist. Maybe he really means that they don't have any long wave in that switch. Long wave optics are usually more expensive... Our Ficon Express 8 cards support both long and short wave. Maybe you have some other channels that are short wave that you could use instead. Regards, Ray Higgs System z FCP Firmware Development Bld. 706, B42 2455 South Road Poughkeepsie, NY 12601 (845) 435-8666, T/L 295-8666 rayhi...@us.ibm.com The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU wrote on 05/09/2011 11:20:16 AM: From: Crabtree, Anne D anne.d.crabt...@wv.gov To: IBMVM@LISTSERV.UARK.EDU Date: 05/09/2011 11:21 AM Subject: Re: Using EMC Clariion SCSI disk with Linux Sent by: The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: multipart/alternative; boundary=_000_897C82FC69765D45A301AF8F5D1210CB09BF7F6COTB6MAIL01execu_ MIME-Version: 1.0 X-Sophos-ESA: [mx6.uark.edu] 3.6.9.0, Antispam-Engine: 2.7.2. 1390750, Antispam-Data: 2011.5.9.145714 --_000_897C82FC69765D45A301AF8F5D1210CB09BF7F6COTB6MAIL01execu_ Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable 1.The cabling appears fine. 2. Our Ficon Express 8 is LX (long wave) and open system guy says s= witch is: Make: EMC (Brocade) Model: DS-5100 Firmware: 6.1.0c NPIV Enabled Port He says optics are short wave and there is no such thing as long wave? 3. He says there are not errors on switch that the port is not negoti= ating at all. 4. As he says above NPIV is enabled on switch. Fabric Login Status ha= s *** in all fields. So with that being said, it appears the optics are the problem? Do you agr= ee that there is no such thing as long wave on open system switches? Anne D. Crabtree System Programmer WV Office of Technology Data Center 1900 Kanawha Blvd East Charleston, WV 25305 (304)558-5914 ext 58292 (304)558-1441 fax From: The IBM z/VM Operating System [mailto:IBMVM@LISTSERV.UARK.EDU] On Beh= alf Of Raymond Higgs Sent: Friday, May 06, 2011 9:12 AM Subject: Re: Using EMC Clariion SCSI disk with Linux The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU wrote on 05/06/2011= 07:51:57 AM: From: Crabtree, Anne D anne.d.crabt...@wv.gov To: IBMVM@LISTSERV.UARK.EDU Date: 05/06/2011 07:53 AM Subject: Using EMC Clariion SCSI disk with Linux Sent by: The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU I posted this on IBM-MAIN with not much response so hoping someone on z/VM might be able to help. Opened a PMR with IBM software but they feel it is a hardware issue. Waiting for information on switch before contacting IBM hardware folks... We have a z10 in which I have defined 2 FCP chpids on our FICON Express8 cards. These chpids have NPIV enabled and I have provided the open system team with the WWPN's that were generated. The FCP chpids are dedicated to our 1 Linux IFL. We have connected the fiber, but the chpid, while staying ONLINE, gets a SEQUENCE TIME-OUT on the HMC. The light is on on the mainframe side, but not on the switch. The open system team tells me that there is nothing for them to do on their side until they can see the mainframe (light comes on?). In z/VM, the chips appear fine, defined as FCP with devices attached and FREE. I'm not sure what else I can do from the mainframe side to help the situation? I am not involved in the Linux portion but the Linux guy says he can't see the luns from Linux. Both sides appear to be waiting on me to fix things! The SCSI is a CLARiiON CX-700 with FLARE (operating system) version 26 revision 31 (02.26.700.5.031) which is the latest release for the CX-700 product line. Anne, The bad news is that we don't support EMC Clariion, but I have heard accoun= ts of it working just fine. Since you are having problems between the chan= nel and
Re: Using EMC Clarion SCSI disk with Linux
theres no such thing as long wave on switches? Do you have an opinion on that? I think there are sfp modules that could be used for this (lx(single mode) - sx (multi mode)).
Re: Using EMC Clariion SCSI disk with Linux
I think you need the 3326. FICON Express8 10KM LX (FC 3325) All the channels on a single FICON Express8 10KM LX feature are the same type, 10KM LX. FICON Express8 10KM LX utilizes a long wavelength (LX) laser as the optical transceiver and supports use of a 9 micron single mode fiber optic cable terminated with an LC duplex connector. FICON Express8 10KM LX supports unrepeated distances up to 10 km (6.2 miles). FICON Express8 10KM LX (CHPID type FC or FCP) can be defined as a spanned channel and can be shared among LPARs within and across LCSS. FICON Express8 SX (FC 3326) All the channels on a single FICON Express8 SX feature are the same type, SX. FICON Express8 SX utilizes a short wavelength (SX) laser as the optical transceiver and supports use of a 50 micron multimode fiber optic cable or a 62.5 micron multimode fiber optic cable terminated with an LC duplex connector. Note: You cannot mix 50 and 62.5 micron multimode fiber optic cabling in the same link. For details about the unrepeated distances for FICON Express8 SX, refer to IBM System z Planning for Fiber Optic Links. Marcy From: The IBM z/VM Operating System [mailto:IBMVM@LISTSERV.UARK.EDU] On Behalf Of Crabtree, Anne D Sent: Monday, May 09, 2011 8:53 AM To: IBMVM@LISTSERV.UARK.EDU Subject: Re: [IBMVM] Using EMC Clariion SCSI disk with Linux Our Ficon Express 8 is 3325 type 10KM LX 4 ports. It is the only type we have. I'm assuming it is only capable of long wave. Is that correct? Anne D. Crabtree System Programmer WV Office of Technology Data Center 1900 Kanawha Blvd East Charleston, WV 25305 (304)558-5914 ext 58292 (304)558-1441 fax From: The IBM z/VM Operating System [mailto:IBMVM@LISTSERV.UARK.EDU] On Behalf Of Raymond Higgs Sent: Monday, May 09, 2011 11:49 AM To: IBMVM@LISTSERV.UARK.EDU Subject: Re: Using EMC Clariion SCSI disk with Linux Anne, Mixing long and short wave is definitely your problem. It makes sense that the switch isn't negotiating at all. When the optics/cables are mismatched, the ports can't get word sync and can't even start sending ordered sets to do speed negotiation. A quick google search says that long wave is supported by that switch: http://www.brocade.com/downloads/documents/data_sheets/product_data_sheets/5100-DS-04.pdf Media types 8 Gbps: Requires Brocade hot-pluggable SFP+, LC connector; 8 Gbps Short-Wavelength Laser (SWL); 8 Gbps Long-Wavelength Laser (LWL); distance depends on fiber-optic cable and port speed 4 Gbps: Requires Brocade hot-pluggable, Small Form-factor Pluggable (SFP), LC connector; 4 Gbps Short-Wavelength Laser (SWL); 4 Gbps Long-Wavelength Laser (LWL); 4 Gbps Extended Long-Wavelength Laser (ELWL); distance depends on fiber-optic cable and port speed I don't know why he would say that long wave doesn't exist. Maybe he really means that they don't have any long wave in that switch. Long wave optics are usually more expensive... Our Ficon Express 8 cards support both long and short wave. Maybe you have some other channels that are short wave that you could use instead. Regards, Ray Higgs System z FCP Firmware Development Bld. 706, B42 2455 South Road Poughkeepsie, NY 12601 (845) 435-8666, T/L 295-8666 rayhi...@us.ibm.com F6COTB6MAIL01execu_--
Re: Using EMC Clariion SCSI disk with Linux
Thank you everyone for all the help! At least we know where to start... Anne D. Crabtree System Programmer WV Office of Technology Data Center 1900 Kanawha Blvd East Charleston, WV 25305 (304)558-5914 ext 58292 (304)558-1441 fax From: The IBM z/VM Operating System [mailto:IBMVM@LISTSERV.UARK.EDU] On Behalf Of Marcy Cortes Sent: Monday, May 09, 2011 12:17 PM To: IBMVM@LISTSERV.UARK.EDU Subject: Re: Using EMC Clariion SCSI disk with Linux I think you need the 3326. FICON Express8 10KM LX (FC 3325) All the channels on a single FICON Express8 10KM LX feature are the same type, 10KM LX. FICON Express8 10KM LX utilizes a long wavelength (LX) laser as the optical transceiver and supports use of a 9 micron single mode fiber optic cable terminated with an LC duplex connector. FICON Express8 10KM LX supports unrepeated distances up to 10 km (6.2 miles). FICON Express8 10KM LX (CHPID type FC or FCP) can be defined as a spanned channel and can be shared among LPARs within and across LCSS. FICON Express8 SX (FC 3326) All the channels on a single FICON Express8 SX feature are the same type, SX. FICON Express8 SX utilizes a short wavelength (SX) laser as the optical transceiver and supports use of a 50 micron multimode fiber optic cable or a 62.5 micron multimode fiber optic cable terminated with an LC duplex connector. Note: You cannot mix 50 and 62.5 micron multimode fiber optic cabling in the same link. For details about the unrepeated distances for FICON Express8 SX, refer to IBM System z Planning for Fiber Optic Links. Marcy From: The IBM z/VM Operating System [mailto:IBMVM@LISTSERV.UARK.EDU] On Behalf Of Crabtree, Anne D Sent: Monday, May 09, 2011 8:53 AM To: IBMVM@LISTSERV.UARK.EDU Subject: Re: [IBMVM] Using EMC Clariion SCSI disk with Linux Our Ficon Express 8 is 3325 type 10KM LX 4 ports. It is the only type we have. I'm assuming it is only capable of long wave. Is that correct? Anne D. Crabtree System Programmer WV Office of Technology Data Center 1900 Kanawha Blvd East Charleston, WV 25305 (304)558-5914 ext 58292 (304)558-1441 fax From: The IBM z/VM Operating System [mailto:IBMVM@LISTSERV.UARK.EDU] On Behalf Of Raymond Higgs Sent: Monday, May 09, 2011 11:49 AM To: IBMVM@LISTSERV.UARK.EDU Subject: Re: Using EMC Clariion SCSI disk with Linux Anne, Mixing long and short wave is definitely your problem. It makes sense that the switch isn't negotiating at all. When the optics/cables are mismatched, the ports can't get word sync and can't even start sending ordered sets to do speed negotiation. A quick google search says that long wave is supported by that switch: http://www.brocade.com/downloads/documents/data_sheets/product_data_sheets/5100-DS-04.pdf Media types 8 Gbps: Requires Brocade hot-pluggable SFP+, LC connector; 8 Gbps Short-Wavelength Laser (SWL); 8 Gbps Long-Wavelength Laser (LWL); distance depends on fiber-optic cable and port speed 4 Gbps: Requires Brocade hot-pluggable, Small Form-factor Pluggable (SFP), LC connector; 4 Gbps Short-Wavelength Laser (SWL); 4 Gbps Long-Wavelength Laser (LWL); 4 Gbps Extended Long-Wavelength Laser (ELWL); distance depends on fiber-optic cable and port speed I don't know why he would say that long wave doesn't exist. Maybe he really means that they don't have any long wave in that switch. Long wave optics are usually more expensive... Our Ficon Express 8 cards support both long and short wave. Maybe you have some other channels that are short wave that you could use instead. Regards, Ray Higgs System z FCP Firmware Development Bld. 706, B42 2455 South Road Poughkeepsie, NY 12601 (845) 435-8666, T/L 295-8666 rayhi...@us.ibm.com F6COTB6MAIL01execu_--
Re: Using EMC Clarion SCSI disk with Linux
Yes - we had to change a couple of optics in the switch so we went longwave from the mainframe to the switch and shortwave from the switch to the clarion. Our switches were able to handle it (Brocade 6140's I believe) Jerry Whitteridge Design Engineer Safeway Inc. 925 951 4184 If you feel in control you just aren't going fast enough. From: The IBM z/VM Operating System [mailto:IBMVM@LISTSERV.UARK.EDU] On Behalf Of Crabtree, Anne D Sent: Monday, May 09, 2011 8:22 AM To: IBMVM@LISTSERV.UARK.EDU Subject: Re: Using EMC Clarion SCSI disk with Linux You probably saw other post, but our open system guy says there's no such thing as long wave on switches? Do you have an opinion on that? Anne D. Crabtree System Programmer WV Office of Technology Data Center 1900 Kanawha Blvd East Charleston, WV 25305 (304)558-5914 ext 58292 (304)558-1441 fax From: The IBM z/VM Operating System [mailto:IBMVM@LISTSERV.UARK.EDU] On Behalf Of Jerry Whitteridge Sent: Friday, May 06, 2011 2:03 PM To: IBMVM@LISTSERV.UARK.EDU Subject: Re: Using EMC Clarion SCSI disk with Linux We connected our z9 to a Clarion a couple of years ago for POC testing only. I seem to remember something that the Clarion needed the z9 to attempt the connect , then they could authorize it and finally we were able to connect. (But these are vague memories - but I so remember a multi-step procedure). The Clarion is now de-installed but I believe the FCP chipid's are still there if you need me to look at something. Jerry Whitteridge Design Engineer Safeway Inc. 925 951 4184 If you feel in control you just aren't going fast enough. From: The IBM z/VM Operating System [mailto:IBMVM@LISTSERV.UARK.EDU] On Behalf Of Raymond Higgs Sent: Friday, May 06, 2011 10:25 AM To: IBMVM@LISTSERV.UARK.EDU Subject: Re: Using EMC Clariion SCSI disk with Linux The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU wrote on 05/06/2011 12:58:23 PM: From: Crabtree, Anne D anne.d.crabt...@wv.gov To: IBMVM@LISTSERV.UARK.EDU Date: 05/06/2011 01:02 PM Subject: Re: Using EMC Clariion SCSI disk with Linux Sent by: The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU Thank you Ray. Will verify these things and get back to you (probably next week). Thank you Heiko. Will research these as well. Can you tell me where speed is defined? I appreciate the responses. From: The IBM z/VM Operating System [IBMVM@LISTSERV.UARK.EDU] On Behalf Of Raymond Higgs [rayhi...@us.ibm.com] Sent: Friday, May 06, 2011 9:11 AM Subject: Re: Using EMC Clariion SCSI disk with Linux The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU wrote on 05/ 06/2011 07:51:57 AM: From: Crabtree, Anne D anne.d.crabt...@wv.gov To: IBMVM@LISTSERV.UARK.EDU Date: 05/06/2011 07:53 AM Subject: Using EMC Clariion SCSI disk with Linux Sent by: The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU I posted this on IBM-MAIN with not much response so hoping someone on z/VM might be able to help. Opened a PMR with IBM software but they feel it is a hardware issue. Waiting for information on switch before contacting IBM hardware folks... We have a z10 in which I have defined 2 FCP chpids on our FICON Express8 cards. These chpids have NPIV enabled and I have provided the open system team with the WWPN's that were generated. The FCP chpids are dedicated to our 1 Linux IFL. We have connected the fiber, but the chpid, while staying ONLINE, gets a SEQUENCE TIME-OUT on the HMC. The light is on on the mainframe side, but not on the switch. The open system team tells me that there is nothing for them to do on their side until they can see the mainframe (light comes on?). In z/VM, the chips appear fine, defined as FCP with devices attached and FREE. I'm not sure what else I can do from the mainframe side to help the situation? I am not involved in the Linux portion but the Linux guy says he can't see the luns from Linux. Both sides appear to be waiting on me to fix things! The SCSI is a CLARiiON CX-700 with FLARE (operating system) version 26 revision 31 (02.26.700.5.031) which is the latest release for the CX-700 product line. Anne, The bad news is that we don't support EMC Clariion, but I have heard accounts of it working just fine. Since you are having problems between the channel and switch, you still will be able to get some IBM support. I'd check these things: * Double check the cabling between the channel and the switch. Is the channel really plugged into the switch port that you think it is? * Make sure that the optics in the switch, the optics in the channel, and the fibre are either all long wave or all short wave. No mixing. * Check the switch for bit errors. If the switch is seeing bit errors, it may have disabled the port on you. Or even simpler, was the switch port ever online? * Is NPIV enabled on your switch? There is a panel on the SE called Fabric Login Status that may have some clues... Use the
Re: Using EMC Clariion SCSI disk with Linux
If you have spare ports in your mainframe switches (Longwave) you should be able to pop them out and put them in the opensystems switch to test. Check with the switch manufacturer to make sure but that's what we did. Jerry Whitteridge Design Engineer Safeway Inc. 925 951 4184 If you feel in control you just aren't going fast enough. From: The IBM z/VM Operating System [mailto:IBMVM@LISTSERV.UARK.EDU] On Behalf Of Crabtree, Anne D Sent: Monday, May 09, 2011 9:35 AM To: IBMVM@LISTSERV.UARK.EDU Subject: Re: Using EMC Clariion SCSI disk with Linux Thank you everyone for all the help! At least we know where to start... Anne D. Crabtree System Programmer WV Office of Technology Data Center 1900 Kanawha Blvd East Charleston, WV 25305 (304)558-5914 ext 58292 (304)558-1441 fax From: The IBM z/VM Operating System [mailto:IBMVM@LISTSERV.UARK.EDU] On Behalf Of Marcy Cortes Sent: Monday, May 09, 2011 12:17 PM To: IBMVM@LISTSERV.UARK.EDU Subject: Re: Using EMC Clariion SCSI disk with Linux I think you need the 3326. FICON Express8 10KM LX (FC 3325) All the channels on a single FICON Express8 10KM LX feature are the same type, 10KM LX. FICON Express8 10KM LX utilizes a long wavelength (LX) laser as the optical transceiver and supports use of a 9 micron single mode fiber optic cable terminated with an LC duplex connector. FICON Express8 10KM LX supports unrepeated distances up to 10 km (6.2 miles). FICON Express8 10KM LX (CHPID type FC or FCP) can be defined as a spanned channel and can be shared among LPARs within and across LCSS. FICON Express8 SX (FC 3326) All the channels on a single FICON Express8 SX feature are the same type, SX. FICON Express8 SX utilizes a short wavelength (SX) laser as the optical transceiver and supports use of a 50 micron multimode fiber optic cable or a 62.5 micron multimode fiber optic cable terminated with an LC duplex connector. Note: You cannot mix 50 and 62.5 micron multimode fiber optic cabling in the same link. For details about the unrepeated distances for FICON Express8 SX, refer to IBM System z Planning for Fiber Optic Links. Marcy From: The IBM z/VM Operating System [mailto:IBMVM@LISTSERV.UARK.EDU] On Behalf Of Crabtree, Anne D Sent: Monday, May 09, 2011 8:53 AM To: IBMVM@LISTSERV.UARK.EDU Subject: Re: [IBMVM] Using EMC Clariion SCSI disk with Linux Our Ficon Express 8 is 3325 type 10KM LX 4 ports. It is the only type we have. I'm assuming it is only capable of long wave. Is that correct? Anne D. Crabtree System Programmer WV Office of Technology Data Center 1900 Kanawha Blvd East Charleston, WV 25305 (304)558-5914 ext 58292 (304)558-1441 fax From: The IBM z/VM Operating System [mailto:IBMVM@LISTSERV.UARK.EDU] On Behalf Of Raymond Higgs Sent: Monday, May 09, 2011 11:49 AM To: IBMVM@LISTSERV.UARK.EDU Subject: Re: Using EMC Clariion SCSI disk with Linux Anne, Mixing long and short wave is definitely your problem. It makes sense that the switch isn't negotiating at all. When the optics/cables are mismatched, the ports can't get word sync and can't even start sending ordered sets to do speed negotiation. A quick google search says that long wave is supported by that switch: http://www.brocade.com/downloads/documents/data_sheets/product_data_sheets/5100-DS-04.pdf Media types 8 Gbps: Requires Brocade hot-pluggable SFP+, LC connector; 8 Gbps Short-Wavelength Laser (SWL); 8 Gbps Long-Wavelength Laser (LWL); distance depends on fiber-optic cable and port speed 4 Gbps: Requires Brocade hot-pluggable, Small Form-factor Pluggable (SFP), LC connector; 4 Gbps Short-Wavelength Laser (SWL); 4 Gbps Long-Wavelength Laser (LWL); 4 Gbps Extended Long-Wavelength Laser (ELWL); distance depends on fiber-optic cable and port speed I don't know why he would say that long wave doesn't exist. Maybe he really means that they don't have any long wave in that switch. Long wave optics are usually more expensive... Our Ficon Express 8 cards support both long and short wave. Maybe you have some other channels that are short wave that you could use instead. Regards, Ray Higgs System z FCP Firmware Development Bld. 706, B42 2455 South Road Poughkeepsie, NY 12601 (845) 435-8666, T/L 295-8666 rayhi...@us.ibm.com F6COTB6MAIL01execu_-- Email Firewall made the following annotations. -- Warning: All e-mail sent to this address will be received by the corporate e-mail system, and is subject to archival and review by someone other than the recipient. This e-mail may contain proprietary information and is intended only for the use of the intended recipient(s). If the reader of this message is not the intended recipient(s), you are notified that you have received this message in error and that any review, dissemination, distribution or copying of this message is strictly prohibited. If you have received this message in error, please notify the sender immediately.
