Re: z/VM not seeing storage from SAN
May or may not be relevant to you Daniel, but our problem was RSCN Suppression. It apparently needs to be OFF when talking to Linux on z (or perhaps System z NPIV). Marcy -Original Message- From: Cortes, Marcy D. Sent: Tuesday, April 20, 2010 9:58 AM To: 'The IBM z/VM Operating System' Subject: RE: [IBMVM] z/VM not seeing storage from SAN It looks like you are not getting logged into the fabric (which you should be able to check from the SE Fabric Login Status page) (see page 19 http://www.redbooks.ibm.com/redpapers/pdfs/redp4125.pdf ) If you aren't, switch log reviews may be the next step. FWIW, i have the exact same messages after weekend fabric work here and we are failing to login. VM Support has said the -62 is outside of vm. The last time we struggled here it was the domain in the switch.We have the added wrinkle of having channel extension equip in the middle now. Marcy This message may contain confidential and/or privileged information. If you are not the addressee or authorized to receive this for the addressee, you must not use, copy, disclose, or take any action based on this message or any information herein. If you have received this message in error, please advise the sender immediately by reply e-mail and delete this message. Thank you for your cooperation. From: The IBM z/VM Operating System [mailto:ib...@listserv.uark.edu] On Behalf Of Richard Troth Sent: Tuesday, April 20, 2010 9:25 AM To: IBMVM@LISTSERV.UARK.EDU Subject: Re: [IBMVM] z/VM not seeing storage from SAN I am a little confused about what WWPN goes where in your case. Based on prior email, C05076FAE3000400 is the WWPN of your virtual FCP adapter (because NPIV is in place). It starts with a C. But 50060E80042CC20C looks to me more like a storage side WWPN. What is the real WWPN of your FCP adapter 5000? Might start with 5005, though a 5006 prefix is certainly also possible. (Someone who knows FCP better than I might know vendor prefixes and things like that.) When you had Linux up (instead of CMS), what did you find in these pseudo files? /sys/bus/ccw/devices/0.0.5000/physical_wwpn /sys/bus/ccw/devices/0.0.5000/wwpn The latter should be 0xc05076fae3000400. What is the other? (If you did not have NPIV in effect, then the two would match or one be zeros.) Since you said that you have it working on one or two other systems, how to they look by comparison? For zoning and masking and all that, it is not clear to me that you need to specify the real WWPN (of the HBA, of the FCP adapter) when NPIV is in play. Eric? What do you say about that? You certainly DO need to zone and mask the storage and the fabric to the virtual WWPN (the one with the C050 prefix). -- Rick; On Tue, Apr 20, 2010 at 09:13, Daniel Tate daniel.t...@gmail.com wrote: To answer someone's earlier question, yes, we've seen every redbook imaginable related to this, tried to do a direct zfcp attach, set edev. I can't give too much info away about our organization but we are using cisco san switches, if that makes a difference. Both the perm and the virtual WWPNs are in our zone. Port security has been toggled off then on, the entire CHPID has been toggled as well. NPIV is on everywhere, NPV is off. Another earlier question was were we doing a lot of attaches/detaches, and the answer is yes. unfortunately its not easy to read this debug information - at times i've had to go to the source code of the zfcp driver to make an educated guess at what the perr and ferr codes were with codes 0x0d and 0x05 (thanks to the person who clarified those). This is the output from SCSIDISC DEBUG. We are currently trying to find out what THINOP()=-62 and GETLUN()=-112 indicate. EXCEPTION::Logfile SCSIDISC LOG A already exists. Delete? (Y/N): y INFO::START @ 20 Apr 2010 07:00:58 INFO::No of attached FCP Channels found=1 PLEASE CHOOSE A NO CORRESPONDING TO A FCP DEVICE OR 'QUIT' 0) All DEVs 1) 5000 0 INFO::Choosen FCP Sub-Channel Device(s)=ALL DEVICES INFO::FCP SUB-CHANNEL 5000 Initialized INFO::For Sub Channel 5000 No of WWPNs found=2 FOR FCP SUBCHANNEL 5000 PLEASE CHOOSE A NO CORRESPONDING TO A WWPN OR 'QUIT' 0) All WWPNs1) C05076FAE3000400 2) 50060E80042CC20C 0 INFO::For 5000 Choosen WWPN(s)=ALL WWPNs INFO::FCP SUB-CHANNEL 5000 Re-Initialized WARNING::WWPN C05076FAE3000400 Could Not be Opened DEBUG::ERROR RC:C05076FAE3000400 THINOP()=-62 DEBUG::ERROR Open FCP port has failed WARNING::WWPN C05076FAE3000400 ignored DEBUG::ERROR RC:C05076FAE3000400 GETLUN()=-112 INFO::FCP SUB-CHANNEL 5000 Re-Initialized WARNING::WWPN
Re: z/VM not seeing storage from SAN
Oops. Said that backwards. It needs to be ON . -Original Message- From: The IBM z/VM Operating System [mailto:ib...@listserv.uark.edu] On Behalf Of Marcy Cortes Sent: Wednesday, April 21, 2010 9:16 AM To: IBMVM@LISTSERV.UARK.EDU Subject: Re: [IBMVM] z/VM not seeing storage from SAN May or may not be relevant to you Daniel, but our problem was RSCN Suppression. It apparently needs to be OFF when talking to Linux on z (or perhaps System z NPIV). Marcy -Original Message- From: Cortes, Marcy D. Sent: Tuesday, April 20, 2010 9:58 AM To: 'The IBM z/VM Operating System' Subject: RE: [IBMVM] z/VM not seeing storage from SAN It looks like you are not getting logged into the fabric (which you should be able to check from the SE Fabric Login Status page) (see page 19 http://www.redbooks.ibm.com/redpapers/pdfs/redp4125.pdf ) If you aren't, switch log reviews may be the next step. FWIW, i have the exact same messages after weekend fabric work here and we are failing to login. VM Support has said the -62 is outside of vm. The last time we struggled here it was the domain in the switch.We have the added wrinkle of having channel extension equip in the middle now. Marcy This message may contain confidential and/or privileged information. If you are not the addressee or authorized to receive this for the addressee, you must not use, copy, disclose, or take any action based on this message or any information herein. If you have received this message in error, please advise the sender immediately by reply e-mail and delete this message. Thank you for your cooperation. From: The IBM z/VM Operating System [mailto:ib...@listserv.uark.edu] On Behalf Of Richard Troth Sent: Tuesday, April 20, 2010 9:25 AM To: IBMVM@LISTSERV.UARK.EDU Subject: Re: [IBMVM] z/VM not seeing storage from SAN I am a little confused about what WWPN goes where in your case. Based on prior email, C05076FAE3000400 is the WWPN of your virtual FCP adapter (because NPIV is in place). It starts with a C. But 50060E80042CC20C looks to me more like a storage side WWPN. What is the real WWPN of your FCP adapter 5000? Might start with 5005, though a 5006 prefix is certainly also possible. (Someone who knows FCP better than I might know vendor prefixes and things like that.) When you had Linux up (instead of CMS), what did you find in these pseudo files? /sys/bus/ccw/devices/0.0.5000/physical_wwpn /sys/bus/ccw/devices/0.0.5000/wwpn The latter should be 0xc05076fae3000400. What is the other? (If you did not have NPIV in effect, then the two would match or one be zeros.) Since you said that you have it working on one or two other systems, how to they look by comparison? For zoning and masking and all that, it is not clear to me that you need to specify the real WWPN (of the HBA, of the FCP adapter) when NPIV is in play. Eric? What do you say about that? You certainly DO need to zone and mask the storage and the fabric to the virtual WWPN (the one with the C050 prefix). -- Rick; On Tue, Apr 20, 2010 at 09:13, Daniel Tate daniel.t...@gmail.com wrote: To answer someone's earlier question, yes, we've seen every redbook imaginable related to this, tried to do a direct zfcp attach, set edev. I can't give too much info away about our organization but we are using cisco san switches, if that makes a difference. Both the perm and the virtual WWPNs are in our zone. Port security has been toggled off then on, the entire CHPID has been toggled as well. NPIV is on everywhere, NPV is off. Another earlier question was were we doing a lot of attaches/detaches, and the answer is yes. unfortunately its not easy to read this debug information - at times i've had to go to the source code of the zfcp driver to make an educated guess at what the perr and ferr codes were with codes 0x0d and 0x05 (thanks to the person who clarified those). This is the output from SCSIDISC DEBUG. We are currently trying to find out what THINOP()=-62 and GETLUN()=-112 indicate. EXCEPTION::Logfile SCSIDISC LOG A already exists. Delete? (Y/N): y INFO::START @ 20 Apr 2010 07:00:58 INFO::No of attached FCP Channels found=1 PLEASE CHOOSE A NO CORRESPONDING TO A FCP DEVICE OR 'QUIT' 0) All DEVs 1) 5000 0 INFO::Choosen FCP Sub-Channel Device(s)=ALL DEVICES INFO::FCP SUB-CHANNEL 5000 Initialized INFO::For Sub Channel 5000 No of WWPNs found=2 FOR FCP SUBCHANNEL 5000 PLEASE CHOOSE A NO CORRESPONDING TO A WWPN OR 'QUIT' 0) All WWPNs1) C05076FAE3000400 2) 50060E80042CC20C 0 INFO::For 5000 Choosen WWPN(s)=ALL WWPNs INFO::FCP SUB-CHANNEL 5000 Re-Initialized WARNING::WWPN C05076FAE3000400 Could
Re: z/VM not seeing storage from SAN
To answer someone's earlier question, yes, we've seen every redbook imaginable related to this, tried to do a direct zfcp attach, set edev. I can't give too much info away about our organization but we are using cisco san switches, if that makes a difference. Both the perm and the virtual WWPNs are in our zone. Port security has been toggled off then on, the entire CHPID has been toggled as well. NPIV is on everywhere, NPV is off. Another earlier question was were we doing a lot of attaches/detaches, and the answer is yes. unfortunately its not easy to read this debug information - at times i've had to go to the source code of the zfcp driver to make an educated guess at what the perr and ferr codes were with codes 0x0d and 0x05 (thanks to the person who clarified those). This is the output from SCSIDISC DEBUG. We are currently trying to find out what THINOP()=-62 and GETLUN()=-112 indicate. EXCEPTION::Logfile SCSIDISC LOG A already exists. Delete? (Y/N): y INFO::START @ 20 Apr 2010 07:00:58 INFO::No of attached FCP Channels found=1 PLEASE CHOOSE A NO CORRESPONDING TO A FCP DEVICE OR 'QUIT' 0) All DEVs 1) 5000 0 INFO::Choosen FCP Sub-Channel Device(s)=ALL DEVICES INFO::FCP SUB-CHANNEL 5000 Initialized INFO::For Sub Channel 5000 No of WWPNs found=2 FOR FCP SUBCHANNEL 5000 PLEASE CHOOSE A NO CORRESPONDING TO A WWPN OR 'QUIT' 0) All WWPNs1) C05076FAE3000400 2) 50060E80042CC20C 0 INFO::For 5000 Choosen WWPN(s)=ALL WWPNs INFO::FCP SUB-CHANNEL 5000 Re-Initialized WARNING::WWPN C05076FAE3000400 Could Not be Opened DEBUG::ERROR RC:C05076FAE3000400 THINOP()=-62 DEBUG::ERROR Open FCP port has failed WARNING::WWPN C05076FAE3000400 ignored DEBUG::ERROR RC:C05076FAE3000400 GETLUN()=-112 INFO::FCP SUB-CHANNEL 5000 Re-Initialized WARNING::WWPN 50060E80042CC20C Could Not be Opened DEBUG::ERROR RC:50060E80042CC20C THINOP()=-62 DEBUG::ERROR Open FCP port has failed WARNING::WWPN 50060E80042CC20C ignored DEBUG::ERROR RC:50060E80042CC20C GETLUN()=-112 INFO::FCP SUB-CHANNEL 5000 RESET RC=0 INFO::END @ 20 Apr 2010 07:01:11 PROGRAM EXIT Ready; T=6.10/6.11 07:01:11 On Fri, Apr 16, 2010 at 5:00 AM, Eric R Farman far...@us.ibm.com wrote: Daniel, SCSIDISC retrieves all registered WWPNs from the switch connected to the selected FCP subchannel(s). If it only reports the one you had attached, it doesn't sound like the switch zones are setup properly to let the LPAR see the DASD subsystems. Has the SAN admin registered the physical WWPN of the card with the switch zone, or the NPIV WWPNs (displayed on Q FCP output)? The latter is necessary in NPIV environment. Regards, Eric Eric Farman z/VM I/O Development IBM Endicott, NY From: Daniel Tate daniel.t...@gmail.com To: IBMVM@LISTSERV.UARK.EDU Date: 04/15/2010 10:50 AM Subject: Re: z/VM not seeing storage from SAN Sent by: The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU -- scsidisc only reports those i've attached. That particular output was from a different device (i.e. 5001).. my terminology is a little off. Our SAN admin swears it's configured correctly on the switch. On Thu, Apr 15, 2010 at 9:38 AM, Eric R Farman *far...@us.ibm.com*far...@us.ibm.com wrote: Hi Daniel, The WWPN listed in your Q FCP outputs and that from the SCSIDISC tool are similar enough that I suspect they are different subchannels on the same FCP card, and not of your target DASD subsystem. Are there other WWPNs listed in the SCSIDISC output beyond what you have sent? If so, what does SCSIDISC see with them? If not, has the switch been told about the NPIV WWPNs that the VM LPAR will be using (that is, those listed in Q FCP)? What specific messages do you get when varying on the EDEV? One other thing... the FCP subchannel (5000 in your example below) shouldn't be attached to a particular user if it is going to be used as part of an EDEV. It should be free so that VM can attach it to the SYSTEM itself at the time the EDEV is varied online. (The FCP can be used for multiple paths/LUNs at once, so in reality the FCP should be either free or attached to SYSTEM.) The ATTACH 5000 TO * command would be used for a guest to use, such as for SCSIDISC or Linux itself configuring SCSI. Regards, Eric Eric Farman z/VM I/O Development IBM Endicott, NY From: Daniel Tate *daniel.t...@gmail.com* daniel.t...@gmail.com To: *ib...@listserv.uark.edu* IBMVM@LISTSERV.UARK.EDU Date: 04/14/2010 02:40 PM Subject: z/VM not seeing storage from SAN Sent by: The IBM z/VM Operating System *ib...@listserv.uark.edu* IBMVM@LISTSERV.UARK.EDU -- Disclaimer: I am a UNIX admin, working with z/VM for the first time. I only know basic commands and concepts, but really need to get this working. Our san is connected, and other LPARs can see the storage. the CHPID is online
Re: z/VM not seeing storage from SAN
On 4/20/10 13:13 Daniel Tate said: This is the output from SCSIDISC DEBUG. INFO::Choosen FCP Sub-Channel Device(s)=ALL DEVICES ... from all the available chooses ... :-) INFO::For 5000 Choosen WWPN(s)=ALL WWPNs At least it's consistent... :-/ -Chip-
Re: z/VM not seeing storage from SAN
I am a little confused about what WWPN goes where in your case. Based on prior email, C05076FAE3000400 is the WWPN of your virtual FCP adapter (because NPIV is in place). It starts with a C. But 50060E80042CC20C looks to me more like a storage side WWPN. What is the real WWPN of your FCP adapter 5000? Might start with 5005, though a 5006 prefix is certainly also possible. (Someone who knows FCP better than I might know vendor prefixes and things like that.) When you had Linux up (instead of CMS), what did you find in these pseudo files? /sys/bus/ccw/devices/0.0.5000/physical_wwpn /sys/bus/ccw/devices/0.0.5000/wwpn The latter should be 0xc05076fae3000400. What is the other? (If you did not have NPIV in effect, then the two would match or one be zeros.) Since you said that you have it working on one or two other systems, how to they look by comparison? For zoning and masking and all that, it is not clear to me that you need to specify the real WWPN (of the HBA, of the FCP adapter) when NPIV is in play. Eric? What do you say about that? You certainly DO need to zone and mask the storage and the fabric to the virtual WWPN (the one with the C050 prefix). -- Rick; On Tue, Apr 20, 2010 at 09:13, Daniel Tate daniel.t...@gmail.com wrote: To answer someone's earlier question, yes, we've seen every redbook imaginable related to this, tried to do a direct zfcp attach, set edev. I can't give too much info away about our organization but we are using cisco san switches, if that makes a difference. Both the perm and the virtual WWPNs are in our zone. Port security has been toggled off then on, the entire CHPID has been toggled as well. NPIV is on everywhere, NPV is off. Another earlier question was were we doing a lot of attaches/detaches, and the answer is yes. unfortunately its not easy to read this debug information - at times i've had to go to the source code of the zfcp driver to make an educated guess at what the perr and ferr codes were with codes 0x0d and 0x05 (thanks to the person who clarified those). This is the output from SCSIDISC DEBUG. We are currently trying to find out what THINOP()=-62 and GETLUN()=-112 indicate. EXCEPTION::Logfile SCSIDISC LOG A already exists. Delete? (Y/N): y INFO::START @ 20 Apr 2010 07:00:58 INFO::No of attached FCP Channels found=1 PLEASE CHOOSE A NO CORRESPONDING TO A FCP DEVICE OR 'QUIT' 0) All DEVs 1) 5000 0 INFO::Choosen FCP Sub-Channel Device(s)=ALL DEVICES INFO::FCP SUB-CHANNEL 5000 Initialized INFO::For Sub Channel 5000 No of WWPNs found=2 FOR FCP SUBCHANNEL 5000 PLEASE CHOOSE A NO CORRESPONDING TO A WWPN OR 'QUIT' 0) All WWPNs1) C05076FAE3000400 2) 50060E80042CC20C 0 INFO::For 5000 Choosen WWPN(s)=ALL WWPNs INFO::FCP SUB-CHANNEL 5000 Re-Initialized WARNING::WWPN C05076FAE3000400 Could Not be Opened DEBUG::ERROR RC:C05076FAE3000400 THINOP()=-62 DEBUG::ERROR Open FCP port has failed WARNING::WWPN C05076FAE3000400 ignored DEBUG::ERROR RC:C05076FAE3000400 GETLUN()=-112 INFO::FCP SUB-CHANNEL 5000 Re-Initialized WARNING::WWPN 50060E80042CC20C Could Not be Opened DEBUG::ERROR RC:50060E80042CC20C THINOP()=-62 DEBUG::ERROR Open FCP port has failed WARNING::WWPN 50060E80042CC20C ignored DEBUG::ERROR RC:50060E80042CC20C GETLUN()=-112 INFO::FCP SUB-CHANNEL 5000 RESET RC=0 INFO::END @ 20 Apr 2010 07:01:11 PROGRAM EXIT Ready; T=6.10/6.11 07:01:11 On Fri, Apr 16, 2010 at 5:00 AM, Eric R Farman far...@us.ibm.com wrote: Daniel, SCSIDISC retrieves all registered WWPNs from the switch connected to the selected FCP subchannel(s). If it only reports the one you had attached, it doesn't sound like the switch zones are setup properly to let the LPAR see the DASD subsystems. Has the SAN admin registered the physical WWPN of the card with the switch zone, or the NPIV WWPNs (displayed on Q FCP output)? The latter is necessary in NPIV environment. Regards, Eric Eric Farman z/VM I/O Development IBM Endicott, NY From: Daniel Tate daniel.t...@gmail.com To: IBMVM@LISTSERV.UARK.EDU Date: 04/15/2010 10:50 AM Subject: Re: z/VM not seeing storage from SAN Sent by: The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU -- scsidisc only reports those i've attached. That particular output was from a different device (i.e. 5001).. my terminology is a little off. Our SAN admin swears it's configured correctly on the switch. On Thu, Apr 15, 2010 at 9:38 AM, Eric R Farman *far...@us.ibm.com*far...@us.ibm.com wrote: Hi Daniel, The WWPN listed in your Q FCP outputs and that from the SCSIDISC tool are similar enough that I suspect they are different subchannels on the same FCP card, and not of your target DASD subsystem. Are there other WWPNs listed in the SCSIDISC output beyond what you have sent? If so, what does SCSIDISC see with them
Re: z/VM not seeing storage from SAN
It looks like you are not getting logged into the fabric (which you should be able to check from the SE Fabric Login Status page) (see page 19 http://www.redbooks.ibm.com/redpapers/pdfs/redp4125.pdf ) If you aren't, switch log reviews may be the next step. FWIW, i have the exact same messages after weekend fabric work here and we are failing to login. VM Support has said the -62 is outside of vm. The last time we struggled here it was the domain in the switch.We have the added wrinkle of having channel extension equip in the middle now. Marcy This message may contain confidential and/or privileged information. If you are not the addressee or authorized to receive this for the addressee, you must not use, copy, disclose, or take any action based on this message or any information herein. If you have received this message in error, please advise the sender immediately by reply e-mail and delete this message. Thank you for your cooperation. From: The IBM z/VM Operating System [mailto:ib...@listserv.uark.edu] On Behalf Of Richard Troth Sent: Tuesday, April 20, 2010 9:25 AM To: IBMVM@LISTSERV.UARK.EDU Subject: Re: [IBMVM] z/VM not seeing storage from SAN I am a little confused about what WWPN goes where in your case. Based on prior email, C05076FAE3000400 is the WWPN of your virtual FCP adapter (because NPIV is in place). It starts with a C. But 50060E80042CC20C looks to me more like a storage side WWPN. What is the real WWPN of your FCP adapter 5000? Might start with 5005, though a 5006 prefix is certainly also possible. (Someone who knows FCP better than I might know vendor prefixes and things like that.) When you had Linux up (instead of CMS), what did you find in these pseudo files? /sys/bus/ccw/devices/0.0.5000/physical_wwpn /sys/bus/ccw/devices/0.0.5000/wwpn The latter should be 0xc05076fae3000400. What is the other? (If you did not have NPIV in effect, then the two would match or one be zeros.) Since you said that you have it working on one or two other systems, how to they look by comparison? For zoning and masking and all that, it is not clear to me that you need to specify the real WWPN (of the HBA, of the FCP adapter) when NPIV is in play. Eric? What do you say about that? You certainly DO need to zone and mask the storage and the fabric to the virtual WWPN (the one with the C050 prefix). -- Rick; On Tue, Apr 20, 2010 at 09:13, Daniel Tate daniel.t...@gmail.com wrote: To answer someone's earlier question, yes, we've seen every redbook imaginable related to this, tried to do a direct zfcp attach, set edev. I can't give too much info away about our organization but we are using cisco san switches, if that makes a difference. Both the perm and the virtual WWPNs are in our zone. Port security has been toggled off then on, the entire CHPID has been toggled as well. NPIV is on everywhere, NPV is off. Another earlier question was were we doing a lot of attaches/detaches, and the answer is yes. unfortunately its not easy to read this debug information - at times i've had to go to the source code of the zfcp driver to make an educated guess at what the perr and ferr codes were with codes 0x0d and 0x05 (thanks to the person who clarified those). This is the output from SCSIDISC DEBUG. We are currently trying to find out what THINOP()=-62 and GETLUN()=-112 indicate. EXCEPTION::Logfile SCSIDISC LOG A already exists. Delete? (Y/N): y INFO::START @ 20 Apr 2010 07:00:58 INFO::No of attached FCP Channels found=1 PLEASE CHOOSE A NO CORRESPONDING TO A FCP DEVICE OR 'QUIT' 0) All DEVs 1) 5000 0 INFO::Choosen FCP Sub-Channel Device(s)=ALL DEVICES INFO::FCP SUB-CHANNEL 5000 Initialized INFO::For Sub Channel 5000 No of WWPNs found=2 FOR FCP SUBCHANNEL 5000 PLEASE CHOOSE A NO CORRESPONDING TO A WWPN OR 'QUIT' 0) All WWPNs1) C05076FAE3000400 2) 50060E80042CC20C 0 INFO::For 5000 Choosen WWPN(s)=ALL WWPNs INFO::FCP SUB-CHANNEL 5000 Re-Initialized WARNING::WWPN C05076FAE3000400 Could Not be Opened DEBUG::ERROR RC:C05076FAE3000400 THINOP()=-62 DEBUG::ERROR Open FCP port has failed WARNING::WWPN C05076FAE3000400 ignored DEBUG::ERROR RC:C05076FAE3000400 GETLUN()=-112 INFO::FCP SUB-CHANNEL 5000 Re-Initialized WARNING::WWPN 50060E80042CC20C Could Not be Opened DEBUG::ERROR RC:50060E80042CC20C THINOP()=-62 DEBUG::ERROR Open FCP port has failed WARNING::WWPN 50060E80042CC20C ignored DEBUG::ERROR RC:50060E80042CC20C GETLUN()=-112 INFO::FCP SUB-CHANNEL 5000 RESET RC=0 INFO::END @ 20 Apr 2010 07:01:11 PROGRAM EXIT Ready; T
Re: z/VM not seeing storage from SAN
No such file exists.. this is the structure of that directory [root] zvmtestd:/sys/bus/ccw/devices/0.0.5000# ls availability devtype host37 online port_remove uevent card_version driverin_recovery peer_d_id port_rescan cmb_enablefailedlic_version peer_wwnn status cutypehardware_version modalias peer_wwpn subsystem On Tue, Apr 20, 2010 at 11:24 AM, Richard Troth vmcow...@gmail.com wrote: I am a little confused about what WWPN goes where in your case. Based on prior email, C05076FAE3000400 is the WWPN of your virtual FCP adapter (because NPIV is in place). It starts with a C. But 50060E80042CC20C looks to me more like a storage side WWPN. What is the real WWPN of your FCP adapter 5000? Might start with 5005, though a 5006 prefix is certainly also possible. (Someone who knows FCP better than I might know vendor prefixes and things like that.) When you had Linux up (instead of CMS), what did you find in these pseudo files? /sys/bus/ccw/devices/0.0.5000/physical_wwpn /sys/bus/ccw/devices/0.0.5000/wwpn The latter should be 0xc05076fae3000400. What is the other? (If you did not have NPIV in effect, then the two would match or one be zeros.) Since you said that you have it working on one or two other systems, how to they look by comparison? For zoning and masking and all that, it is not clear to me that you need to specify the real WWPN (of the HBA, of the FCP adapter) when NPIV is in play. Eric? What do you say about that? You certainly DO need to zone and mask the storage and the fabric to the virtual WWPN (the one with the C050 prefix). -- Rick; On Tue, Apr 20, 2010 at 09:13, Daniel Tate daniel.t...@gmail.com wrote: To answer someone's earlier question, yes, we've seen every redbook imaginable related to this, tried to do a direct zfcp attach, set edev. I can't give too much info away about our organization but we are using cisco san switches, if that makes a difference. Both the perm and the virtual WWPNs are in our zone. Port security has been toggled off then on, the entire CHPID has been toggled as well. NPIV is on everywhere, NPV is off. Another earlier question was were we doing a lot of attaches/detaches, and the answer is yes. unfortunately its not easy to read this debug information - at times i've had to go to the source code of the zfcp driver to make an educated guess at what the perr and ferr codes were with codes 0x0d and 0x05 (thanks to the person who clarified those). This is the output from SCSIDISC DEBUG. We are currently trying to find out what THINOP()=-62 and GETLUN()=-112 indicate. EXCEPTION::Logfile SCSIDISC LOG A already exists. Delete? (Y/N): y INFO::START @ 20 Apr 2010 07:00:58 INFO::No of attached FCP Channels found=1 PLEASE CHOOSE A NO CORRESPONDING TO A FCP DEVICE OR 'QUIT' 0) All DEVs 1) 5000 0 INFO::Choosen FCP Sub-Channel Device(s)=ALL DEVICES INFO::FCP SUB-CHANNEL 5000 Initialized INFO::For Sub Channel 5000 No of WWPNs found=2 FOR FCP SUBCHANNEL 5000 PLEASE CHOOSE A NO CORRESPONDING TO A WWPN OR 'QUIT' 0) All WWPNs1) C05076FAE3000400 2) 50060E80042CC20C 0 INFO::For 5000 Choosen WWPN(s)=ALL WWPNs INFO::FCP SUB-CHANNEL 5000 Re-Initialized WARNING::WWPN C05076FAE3000400 Could Not be Opened DEBUG::ERROR RC:C05076FAE3000400 THINOP()=-62 DEBUG::ERROR Open FCP port has failed WARNING::WWPN C05076FAE3000400 ignored DEBUG::ERROR RC:C05076FAE3000400 GETLUN()=-112 INFO::FCP SUB-CHANNEL 5000 Re-Initialized WARNING::WWPN 50060E80042CC20C Could Not be Opened DEBUG::ERROR RC:50060E80042CC20C THINOP()=-62 DEBUG::ERROR Open FCP port has failed WARNING::WWPN 50060E80042CC20C ignored DEBUG::ERROR RC:50060E80042CC20C GETLUN()=-112 INFO::FCP SUB-CHANNEL 5000 RESET RC=0 INFO::END @ 20 Apr 2010 07:01:11 PROGRAM EXIT Ready; T=6.10/6.11 07:01:11 On Fri, Apr 16, 2010 at 5:00 AM, Eric R Farman far...@us.ibm.com wrote: Daniel, SCSIDISC retrieves all registered WWPNs from the switch connected to the selected FCP subchannel(s). If it only reports the one you had attached, it doesn't sound like the switch zones are setup properly to let the LPAR see the DASD subsystems. Has the SAN admin registered the physical WWPN of the card with the switch zone, or the NPIV WWPNs (displayed on Q FCP output)? The latter is necessary in NPIV environment. Regards, Eric Eric Farman z/VM I/O Development IBM Endicott, NY From: Daniel Tate daniel.t...@gmail.com To: IBMVM@LISTSERV.UARK.EDU Date: 04/15/2010 10:50 AM Subject: Re: z/VM not seeing storage from SAN Sent by: The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU -- scsidisc only reports those i've attached. That particular output was from a different device (i.e. 5001).. my terminology is a little off. Our SAN
Re: z/VM not seeing storage from SAN
Daniel, It's much easier to get info about an FCP channel with lszfcp. You don't have to remember those damn sysfs paths that seem to change with each new kernel :) To figure out a subchannel's wwpn do something like this: r...@m12-205:lszfcp -a -b 0.0.7800 0.0.7800 host64 Bus = ccw availability= good card_version= 0x0006 cmb_enable = 0 cutype = 1731/03 devtype = 1732/03 failed = 0 hardware_version= 0x in_recovery = 0 lic_version = 0xbd23 modalias= ccw:t1731m03dt1732dm03 online = 1 peer_d_id = 0x00 peer_wwnn = 0x peer_wwpn = 0x status = 0x542a uevent = DRIVER=zfcp Class = fc_host maxframe_size = 2112 bytes node_name = 0x5005076400c0b742 permanent_port_name = 0x500507601d80074f here port_id = 0xe35c00 port_name = 0xc05076001b21 here port_state = Online port_type = NPort (fabric via point-to-point) serial_number = IBM02B742 speed = 8 Gbit supported_classes = Class 2, Class 3 supported_speeds= 2 Gbit, 4 Gbit tgtid_bind_type = wwpn (World Wide Port Name) Class = scsi_host active_mode = Initiator can_queue = 4096 cmd_per_lun = 1 host_busy = 0 megabytes = 0 0 proc_name = zfcp prot_capabilities = 0 prot_guard_type = 0 queue_full = 0 11029 requests= 0 0 0 seconds_active = 13 sg_tablesize= 538 state = running supported_mode = Initiator unchecked_isa_dma = 0 unique_id = 30720 utilization = 0 0 0 50060E80042CC20C is definitely your storage array. 50060 is Hitachi. For your channel, you'll either find 50050 or c0507 at the beginning of the wwpns. The first is NPIV off. The second is NPIV on. Anyway, that scsidisc output tells me that zoning is ok. The name server in your switch wouldn't have returned 50060E80042CC20C if zoning was wrong. I don't know what those scsidisc error codes are either, but maybe this helps... I wouldn't worry about these error messages: WARNING::WWPN C05076FAE3000400 Could Not be Opened DEBUG::ERROR RC:C05076FAE3000400 THINOP()=-62 DEBUG::ERROR Open FCP port has failed WARNING::WWPN C05076FAE3000400 ignored DEBUG::ERROR RC:C05076FAE3000400 GETLUN()=-112 C05076FAE3000400 is your channel. It's an initiator. It doesn't typically accept logins, and certainly won't know what to do with a report_luns scsi command. The other error messages: WARNING::WWPN 50060E80042CC20C Could Not be Opened DEBUG::ERROR RC:50060E80042CC20C THINOP()=-62 DEBUG::ERROR Open FCP port has failed WARNING::WWPN 50060E80042CC20C ignored DEBUG::ERROR RC:50060E80042CC20C GETLUN()=-112 should cause an entry in the analyze serial link status panel on the SE. It's in the same menu as the fabric login status panel. This should tell us if the fibre channel login (PLOGI) or the scsi login (PRLI) failed. Maybe the hitachi port isn't configured as fcp? Maybe it is configured as ficon? I wish I could offer more advice about configuring your hitachi storage, but I'm not very familiar with hitachi, and the person who does the set up here is on vacation. Also, when you are configuring this stuff under linux, how are you doing it? Are you using the wizard in yast? zfcp_host_configure/zfcp_disk_configure? echo commands into /sys? Yast is the most user friendly. Regards, Ray Higgs System z FCP Development Bld. 706, B24 2455 South Road Poughkeepsie, NY 12601 (845) 435-8666, T/L 295-8666 rayhi...@us.ibm.com Daniel Tate daniel.t...@gmail.com Sent by: The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU 04/20/2010 02:14 PM Please respond to The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU To IBMVM@LISTSERV.UARK.EDU cc Subject Re: z/VM not seeing storage from SAN No such file exists.. this is the structure of that directory [root] zvmtestd:/sys/bus/ccw/devices/0.0.5000# ls availability devtype host37 online port_remove uevent card_version driverin_recovery peer_d_id port_rescan cmb_enablefailedlic_version peer_wwnn status cutypehardware_version modalias peer_wwpn subsystem On Tue, Apr 20, 2010 at 11:24 AM, Richard Troth vmcow...@gmail.com wrote: I am a little confused about what WWPN goes where in your case. Based on prior email, C05076FAE3000400 is the WWPN of your virtual FCP adapter (because NPIV is in place). It starts with a C. But 50060E80042CC20C looks to me more like a storage side WWPN. What is the real WWPN of your FCP adapter 5000? Might start
Re: z/VM not seeing storage from SAN
Daniel, What happened with your VM problems? Which config failed? The one that you got working, or the new one when you tried to replicate? Which version of linux are you using? From this linux log, I only see one thing that is interesting fsf_prot_status 0x0080. This is connection initializing. There are 3 ways to get this: 1. The fibre channel link is not up. If you look at the SE, you should see online operating when the link is up. Did someone unplug the fibre from the channel? Are the optics in your channel, the switch, and the fibre consistent? Either all short wave, or all long wave. Is the switch trying to run at a speed that the channel doesn't support? 2. Are you issuing lots of chccwdev --online, chccwdev --offline, chccwdev --online, We'll send this status up if the QDIO and FSF parts of the channel get out of sync. QDIO quickly initializes. FSF doesn't because it has to communicate with the switch, and this status is a way to tell the operating system to be patient. 3. Very similar to 2... We're waiting on FDISC reply from the switch. Are there any clues on the fabric login status panel on the SE? Have you seen this redpaper? http://www.redbooks.ibm.com/redpapers/pdfs/redp4125.pdf It has some details about the SE panels. I hope this helps. Ray Higgs System z FCP Development Bld. 706, B24 2455 South Road Poughkeepsie, NY 12601 (845) 435-8666, T/L 295-8666 rayhi...@us.ibm.com Daniel Tate daniel.t...@gmail.com Sent by: The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU 04/19/2010 12:20 PM Please respond to The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU To IBMVM@LISTSERV.UARK.EDU cc Subject Re: z/VM not seeing storage from SAN OK, we *briefly* got the SAN to show a disk, i was able to format, everything.. we attempted to replicate with the exact same config, and it failed. Port security has been toggled, WWPNs have been added and removed from the zone. This is becoming incredibly frustrating. If anyone can provide any answers.. The documentation (as far as i have found) is so sparse that i had to look at the source code to identify what the hex codes mean This is the output of sys/kernel/debug/s390dbf/zfcp0.0.5000_hba: timestamp 01271692944:913553125 cpu 00 tag stat tag2dism failed 0x00 status_type 0x status_subtype 0x queue_designator payload timestamp 01271692949:933377062 cpu 01 tag resp tag2perr fsf_command 0x000d fsf_reqid 0x1c985000 fsf_seqno 0x fsf_issued 01271692949:933235988 fsf_prot_status 0x0080 fsf_status 0x fsf_prot_status_qual fsf_status_qual fsf_req_status 0x0010 sbal_first 0x00 sbal_last 0x00 sbal_response 0x00 pool0x01 2807adda 0001 001f 0002 1abea440 fd0006a0 e000 2808bad6 f2318ac4 1abea440 0100 2000 280b01b1 f2318ace 1abea440 0080 01 timestamp 01271692950:951330062 cpu 00 tag resp tag2ferr fsf_command 0x0005 On Fri, Apr 16, 2010 at 5:00 AM, Eric R Farman far...@us.ibm.com wrote: Daniel, SCSIDISC retrieves all registered WWPNs from the switch connected to the selected FCP subchannel(s). If it only reports the one you had attached, it doesn't sound like the switch zones are setup properly to let the LPAR see the DASD subsystems. Has the SAN admin registered the physical WWPN of the card with the switch zone, or the NPIV WWPNs (displayed on Q FCP output)? The latter is necessary in NPIV environment. Regards, Eric Eric Farman z/VM I/O Development IBM Endicott, NY From: Daniel Tate daniel.t...@gmail.com To: IBMVM@LISTSERV.UARK.EDU Date: 04/15/2010 10:50 AM Subject: Re: z/VM not seeing storage from SAN Sent by: The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU scsidisc only reports those i've attached. That particular output was from a different device (i.e. 5001).. my terminology is a little off. Our SAN admin swears it's configured correctly on the switch. On Thu, Apr 15, 2010 at 9:38 AM, Eric R Farman far...@us.ibm.com wrote: Hi Daniel, The WWPN listed in your Q FCP outputs and that from the SCSIDISC tool are similar enough that I suspect they are different subchannels on the same FCP card, and not of your target DASD subsystem. Are there other WWPNs listed in the SCSIDISC output beyond what you have
Re: z/VM not seeing storage from SAN
1) The VM Problems may still be there 2) When we tried to replicate 3) SLES 11 On Mon, Apr 19, 2010 at 1:40 PM, Raymond Higgs rayhi...@us.ibm.com wrote: Daniel, What happened with your VM problems? Which config failed? The one that you got working, or the new one when you tried to replicate? Which version of linux are you using? From this linux log, I only see one thing that is interesting fsf_prot_status 0x0080. This is connection initializing. There are 3 ways to get this: 1. The fibre channel link is not up. If you look at the SE, you should see online operating when the link is up. Did someone unplug the fibre from the channel? Are the optics in your channel, the switch, and the fibre consistent? Either all short wave, or all long wave. Is the switch trying to run at a speed that the channel doesn't support? 2. Are you issuing lots of chccwdev --online, chccwdev --offline, chccwdev --online, We'll send this status up if the QDIO and FSF parts of the channel get out of sync. QDIO quickly initializes. FSF doesn't because it has to communicate with the switch, and this status is a way to tell the operating system to be patient. 3. Very similar to 2... We're waiting on FDISC reply from the switch. Are there any clues on the fabric login status panel on the SE? Have you seen this redpaper? http://www.redbooks.ibm.com/redpapers/pdfs/redp4125.pdf It has some details about the SE panels. I hope this helps. Ray Higgs System z FCP Development Bld. 706, B24 2455 South Road Poughkeepsie, NY 12601 (845) 435-8666, T/L 295-8666 rayhi...@us.ibm.com *Daniel Tate daniel.t...@gmail.com* Sent by: The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU 04/19/2010 12:20 PM Please respond to The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU To IBMVM@LISTSERV.UARK.EDU cc Subject Re: z/VM not seeing storage from SAN OK, we *briefly* got the SAN to show a disk, i was able to format, everything.. we attempted to replicate with the exact same config, and it failed. Port security has been toggled, WWPNs have been added and removed from the zone. This is becoming incredibly frustrating. If anyone can provide any answers.. The documentation (as far as i have found) is so sparse that i had to look at the source code to identify what the hex codes mean This is the output of sys/kernel/debug/s390dbf/zfcp0.0.5000_hba: timestamp 01271692944:913553125 cpu 00 tag stat tag2dism failed 0x00 status_type 0x status_subtype 0x queue_designator payload timestamp 01271692949:933377062 cpu 01 tag resp tag2perr fsf_command 0x000d fsf_reqid 0x1c985000 fsf_seqno 0x fsf_issued 01271692949:933235988 fsf_prot_status 0x0080 fsf_status 0x fsf_prot_status_qual fsf_status_qual fsf_req_status 0x0010 sbal_first 0x00 sbal_last 0x00 sbal_response 0x00 pool0x01 2807adda 0001 001f 0002 1abea440 fd0006a0 e000 2808bad6 f2318ac4 1abea440 0100 2000 280b01b1 f2318ace 1abea440 0080 01 timestamp 01271692950:951330062 cpu 00 tag resp tag2ferr fsf_command 0x0005 On Fri, Apr 16, 2010 at 5:00 AM, Eric R Farman *far...@us.ibm.com*far...@us.ibm.com wrote: Daniel, SCSIDISC retrieves all registered WWPNs from the switch connected to the selected FCP subchannel(s). If it only reports the one you had attached, it doesn't sound like the switch zones are setup properly to let the LPAR see the DASD subsystems. Has the SAN admin registered the physical WWPN of the card with the switch zone, or the NPIV WWPNs (displayed on Q FCP output)? The latter is necessary in NPIV environment. Regards, Eric Eric Farman z/VM I/O Development IBM Endicott, NY From: Daniel Tate *daniel.t...@gmail.com* daniel.t...@gmail.com To: *ib...@listserv.uark.edu* IBMVM@LISTSERV.UARK.EDU Date: 04/15/2010 10:50 AM Subject: Re: z/VM not seeing storage from SAN Sent by: The IBM z/VM Operating System *ib...@listserv.uark.edu* IBMVM@LISTSERV.UARK.EDU -- scsidisc only reports those i've attached. That particular output was from a different device (i.e. 5001).. my terminology is a little off. Our SAN admin swears it's configured correctly on the switch. On Thu, Apr 15
Re: z/VM not seeing storage from SAN
Daniel, SCSIDISC retrieves all registered WWPNs from the switch connected to the selected FCP subchannel(s). If it only reports the one you had attached, it doesn't sound like the switch zones are setup properly to let the LPAR see the DASD subsystems. Has the SAN admin registered the physical WWPN of the card with the switch zone, or the NPIV WWPNs (displayed on Q FCP output)? The latter is necessary in NPIV environment. Regards, Eric Eric Farman z/VM I/O Development IBM Endicott, NY From: Daniel Tate daniel.t...@gmail.com To: IBMVM@LISTSERV.UARK.EDU Date: 04/15/2010 10:50 AM Subject: Re: z/VM not seeing storage from SAN Sent by: The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU scsidisc only reports those i've attached. That particular output was from a different device (i.e. 5001).. my terminology is a little off. Our SAN admin swears it's configured correctly on the switch. On Thu, Apr 15, 2010 at 9:38 AM, Eric R Farman far...@us.ibm.com wrote: Hi Daniel, The WWPN listed in your Q FCP outputs and that from the SCSIDISC tool are similar enough that I suspect they are different subchannels on the same FCP card, and not of your target DASD subsystem. Are there other WWPNs listed in the SCSIDISC output beyond what you have sent? If so, what does SCSIDISC see with them? If not, has the switch been told about the NPIV WWPNs that the VM LPAR will be using (that is, those listed in Q FCP)? What specific messages do you get when varying on the EDEV? One other thing... the FCP subchannel (5000 in your example below) shouldn't be attached to a particular user if it is going to be used as part of an EDEV. It should be free so that VM can attach it to the SYSTEM itself at the time the EDEV is varied online. (The FCP can be used for multiple paths/LUNs at once, so in reality the FCP should be either free or attached to SYSTEM.) The ATTACH 5000 TO * command would be used for a guest to use, such as for SCSIDISC or Linux itself configuring SCSI. Regards, Eric Eric Farman z/VM I/O Development IBM Endicott, NY From: Daniel Tate daniel.t...@gmail.com To: IBMVM@LISTSERV.UARK.EDU Date: 04/14/2010 02:40 PM Subject: z/VM not seeing storage from SAN Sent by: The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU Disclaimer: I am a UNIX admin, working with z/VM for the first time. I only know basic commands and concepts, but really need to get this working. Our san is connected, and other LPARs can see the storage. the CHPID is online. I can attach the storage (ATTACH 5000 to *) and SET EDEV blahblahbah.. but when i try to vary on the storage,i get a NO PATH TO DEVICE error. Anyone have any ideas? SCSIDISC Reports: WARNING::WWPN C05076FAE3000408 Could Not be Opened WARNING::WWPN C05076FAE3000408 ignored Here’s the output from q fcp: q fcp 07:05:04 FCP 5000 ATTACHED TO MAINT5000 CHPID 46 07:05:04 WWPN C05076FAE3000400 q v fcp 08:27:31 FCP 5000 ON FCP 5000 CHPID 46 SUBCHANNEL = 011D 08:27:31 5000 DEVTYPE FCP CHPID 46 FCP 08:27:31 5000 QDIO-ELIGIBLE QIOASSIST-ELIGIBLE 08:27:31 WWPN C05076FAE3000400 Ready; T=0.01/0.01 08:27:31
Re: z/VM not seeing storage from SAN
scsidisc only reports those i've attached. That particular output was from a different device (i.e. 5001).. my terminology is a little off. Our SAN admin swears it's configured correctly on the switch. On Thu, Apr 15, 2010 at 9:38 AM, Eric R Farman far...@us.ibm.com wrote: Hi Daniel, The WWPN listed in your Q FCP outputs and that from the SCSIDISC tool are similar enough that I suspect they are different subchannels on the same FCP card, and not of your target DASD subsystem. Are there other WWPNs listed in the SCSIDISC output beyond what you have sent? If so, what does SCSIDISC see with them? If not, has the switch been told about the NPIV WWPNs that the VM LPAR will be using (that is, those listed in Q FCP)? What specific messages do you get when varying on the EDEV? One other thing... the FCP subchannel (5000 in your example below) shouldn't be attached to a particular user if it is going to be used as part of an EDEV. It should be free so that VM can attach it to the SYSTEM itself at the time the EDEV is varied online. (The FCP can be used for multiple paths/LUNs at once, so in reality the FCP should be either free or attached to SYSTEM.) The ATTACH 5000 TO * command would be used for a guest to use, such as for SCSIDISC or Linux itself configuring SCSI. Regards, Eric Eric Farman z/VM I/O Development IBM Endicott, NY From: Daniel Tate daniel.t...@gmail.com To: IBMVM@LISTSERV.UARK.EDU Date: 04/14/2010 02:40 PM Subject: z/VM not seeing storage from SAN Sent by: The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU -- Disclaimer: I am a UNIX admin, working with z/VM for the first time. I only know basic commands and concepts, but really need to get this working. Our san is connected, and other LPARs can see the storage. the CHPID is online. I can attach the storage (ATTACH 5000 to *) and SET EDEV blahblahbah.. but when i try to vary on the storage,i get a NO PATH TO DEVICE error. Anyone have any ideas? SCSIDISC Reports: WARNING::WWPN C05076FAE3000408 Could Not be Opened WARNING::WWPN C05076FAE3000408 ignored Here’s the output from q fcp: q fcp 07:05:04 FCP 5000 ATTACHED TO MAINT5000 CHPID 46 07:05:04 WWPN C05076FAE3000400 q v fcp 08:27:31 FCP 5000 ON FCP 5000 CHPID 46 SUBCHANNEL = 011D 08:27:31 5000 DEVTYPE FCP CHPID 46 FCP 08:27:31 5000 QDIO-ELIGIBLE QIOASSIST-ELIGIBLE 08:27:31 WWPN C05076FAE3000400 Ready; T=0.01/0.01 08:27:31
Re: z/VM not seeing storage from SAN
What is the back-end storage?If DS have the appropriate Hostconnect been created? On Thu, Apr 15, 2010 at 10:19 AM, Daniel Tate daniel.t...@gmail.com wrote: scsidisc only reports those i've attached. That particular output was from a different device (i.e. 5001).. my terminology is a little off. Our SAN admin swears it's configured correctly on the switch. On Thu, Apr 15, 2010 at 9:38 AM, Eric R Farman far...@us.ibm.com wrote: Hi Daniel, The WWPN listed in your Q FCP outputs and that from the SCSIDISC tool are similar enough that I suspect they are different subchannels on the same FCP card, and not of your target DASD subsystem. Are there other WWPNs listed in the SCSIDISC output beyond what you have sent? If so, what does SCSIDISC see with them? If not, has the switch been told about the NPIV WWPNs that the VM LPAR will be using (that is, those listed in Q FCP)? What specific messages do you get when varying on the EDEV? One other thing... the FCP subchannel (5000 in your example below) shouldn't be attached to a particular user if it is going to be used as part of an EDEV. It should be free so that VM can attach it to the SYSTEM itself at the time the EDEV is varied online. (The FCP can be used for multiple paths/LUNs at once, so in reality the FCP should be either free or attached to SYSTEM.) The ATTACH 5000 TO * command would be used for a guest to use, such as for SCSIDISC or Linux itself configuring SCSI. Regards, Eric Eric Farman z/VM I/O Development IBM Endicott, NY From: Daniel Tate daniel.t...@gmail.com To: IBMVM@LISTSERV.UARK.EDU Date: 04/14/2010 02:40 PM Subject: z/VM not seeing storage from SAN Sent by: The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU -- Disclaimer: I am a UNIX admin, working with z/VM for the first time. I only know basic commands and concepts, but really need to get this working. Our san is connected, and other LPARs can see the storage. the CHPID is online. I can attach the storage (ATTACH 5000 to *) and SET EDEV blahblahbah.. but when i try to vary on the storage,i get a NO PATH TO DEVICE error. Anyone have any ideas? SCSIDISC Reports: WARNING::WWPN C05076FAE3000408 Could Not be Opened WARNING::WWPN C05076FAE3000408 ignored Here’s the output from q fcp: q fcp 07:05:04 FCP 5000 ATTACHED TO MAINT5000 CHPID 46 07:05:04 WWPN C05076FAE3000400 q v fcp 08:27:31 FCP 5000 ON FCP 5000 CHPID 46 SUBCHANNEL = 011D 08:27:31 5000 DEVTYPE FCP CHPID 46 FCP 08:27:31 5000 QDIO-ELIGIBLE QIOASSIST-ELIGIBLE 08:27:31 WWPN C05076FAE3000400 Ready; T=0.01/0.01 08:27:31 -- Mark Pace Mainline Information Systems 1700 Summit Lake Drive Tallahassee, FL. 32317
Re: z/VM not seeing storage from SAN
It's an Hitachi SAN through a Cisco fibre switch. NPIV is on on all. NPV, however, is not On Thu, Apr 15, 2010 at 8:53 PM, Mark Pace mpac...@gmail.com wrote: What is the back-end storage?If DS have the appropriate Hostconnect been created? On Thu, Apr 15, 2010 at 10:19 AM, Daniel Tate daniel.t...@gmail.comwrote: scsidisc only reports those i've attached. That particular output was from a different device (i.e. 5001).. my terminology is a little off. Our SAN admin swears it's configured correctly on the switch. On Thu, Apr 15, 2010 at 9:38 AM, Eric R Farman far...@us.ibm.com wrote: Hi Daniel, The WWPN listed in your Q FCP outputs and that from the SCSIDISC tool are similar enough that I suspect they are different subchannels on the same FCP card, and not of your target DASD subsystem. Are there other WWPNs listed in the SCSIDISC output beyond what you have sent? If so, what does SCSIDISC see with them? If not, has the switch been told about the NPIV WWPNs that the VM LPAR will be using (that is, those listed in Q FCP)? What specific messages do you get when varying on the EDEV? One other thing... the FCP subchannel (5000 in your example below) shouldn't be attached to a particular user if it is going to be used as part of an EDEV. It should be free so that VM can attach it to the SYSTEM itself at the time the EDEV is varied online. (The FCP can be used for multiple paths/LUNs at once, so in reality the FCP should be either free or attached to SYSTEM.) The ATTACH 5000 TO * command would be used for a guest to use, such as for SCSIDISC or Linux itself configuring SCSI. Regards, Eric Eric Farman z/VM I/O Development IBM Endicott, NY From: Daniel Tate daniel.t...@gmail.com To: IBMVM@LISTSERV.UARK.EDU Date: 04/14/2010 02:40 PM Subject: z/VM not seeing storage from SAN Sent by: The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU -- Disclaimer: I am a UNIX admin, working with z/VM for the first time. I only know basic commands and concepts, but really need to get this working. Our san is connected, and other LPARs can see the storage. the CHPID is online. I can attach the storage (ATTACH 5000 to *) and SET EDEV blahblahbah.. but when i try to vary on the storage,i get a NO PATH TO DEVICE error. Anyone have any ideas? SCSIDISC Reports: WARNING::WWPN C05076FAE3000408 Could Not be Opened WARNING::WWPN C05076FAE3000408 ignored Here’s the output from q fcp: q fcp 07:05:04 FCP 5000 ATTACHED TO MAINT5000 CHPID 46 07:05:04 WWPN C05076FAE3000400 q v fcp 08:27:31 FCP 5000 ON FCP 5000 CHPID 46 SUBCHANNEL = 011D 08:27:31 5000 DEVTYPE FCP CHPID 46 FCP 08:27:31 5000 QDIO-ELIGIBLE QIOASSIST-ELIGIBLE 08:27:31 WWPN C05076FAE3000400 Ready; T=0.01/0.01 08:27:31 -- Mark Pace Mainline Information Systems 1700 Summit Lake Drive Tallahassee, FL. 32317
Re: z/VM not seeing storage from SAN
Hi Daniel, The WWPN listed in your Q FCP outputs and that from the SCSIDISC tool are similar enough that I suspect they are different subchannels on the same FCP card, and not of your target DASD subsystem. Are there other WWPNs listed in the SCSIDISC output beyond what you have sent? If so, what does SCSIDISC see with them? If not, has the switch been told about the NPIV WWPNs that the VM LPAR will be using (that is, those listed in Q FCP)? What specific messages do you get when varying on the EDEV? One other thing... the FCP subchannel (5000 in your example below) shouldn't be attached to a particular user if it is going to be used as part of an EDEV. It should be free so that VM can attach it to the SYSTEM itself at the time the EDEV is varied online. (The FCP can be used for multiple paths/LUNs at once, so in reality the FCP should be either free or attached to SYSTEM.) The ATTACH 5000 TO * command would be used for a guest to use, such as for SCSIDISC or Linux itself configuring SCSI. Regards, Eric Eric Farman z/VM I/O Development IBM Endicott, NY From: Daniel Tate daniel.t...@gmail.com To: IBMVM@LISTSERV.UARK.EDU Date: 04/14/2010 02:40 PM Subject: z/VM not seeing storage from SAN Sent by: The IBM z/VM Operating System IBMVM@LISTSERV.UARK.EDU Disclaimer: I am a UNIX admin, working with z/VM for the first time. I only know basic commands and concepts, but really need to get this working. Our san is connected, and other LPARs can see the storage. the CHPID is online. I can attach the storage (ATTACH 5000 to *) and SET EDEV blahblahbah.. but when i try to vary on the storage,i get a NO PATH TO DEVICE error. Anyone have any ideas? SCSIDISC Reports: WARNING::WWPN C05076FAE3000408 Could Not be Opened WARNING::WWPN C05076FAE3000408 ignored Here’s the output from q fcp: q fcp 07:05:04 FCP 5000 ATTACHED TO MAINT5000 CHPID 46 07:05:04 WWPN C05076FAE3000400 q v fcp 08:27:31 FCP 5000 ON FCP 5000 CHPID 46 SUBCHANNEL = 011D 08:27:31 5000 DEVTYPE FCP CHPID 46 FCP 08:27:31 5000 QDIO-ELIGIBLE QIOASSIST-ELIGIBLE 08:27:31 WWPN C05076FAE3000400 Ready; T=0.01/0.01 08:27:31
