Ray,
The following displays are for the 2nd RedHat guest that is brought
up. It fails.
kernel: zfcp: The adapter 0.0.2107 reported the following
characteristics:
tdcrac02 kernel: WWNN 0x5005076400cb90c4, WWPN 0x500507640162c859, S_ID
0x00014c00,
tdcrac02 kernel: adapter version 0x4, LIC version 0xb02, FC link speed
4 Gb/s
tdcrac02 kernel: zfcp: Switched fabric fibrechannel network detected at
adapter 0.0.2107.
tdcrac02 kernel: zfcp: unit erp failed on unit 0x4011402600000000 on
port 0x50050763030384ac on adapter 0.0.2107
tdcrac02 kernel: zfcp: unit erp failed on unit 0x4011402600000000 on
port 0x500507630308c4ac on adapter 0.0.2107
[r...@tdcrac02 log]# lscss | grep 2107
0.0.2107 0.0.0008 1732/03 1731/03 yes 80 80 ff 50000000 00000000
[r...@tdcrac02 ~]# lszfcp -D
Error: No fcp devices found.
[r...@tdcrac02 ~]# lszfcp -a -b 0.0.2107
0.0.2107 host0
Bus = "ccw"
availability = "good"
card_version = "0x0004"
cmb_enable = "0"
cutype = "1731/03"
devtype = "1732/03"
failed = "0"
hardware_version = "0x00000000"
in_recovery = "0"
lic_version = "0x00000b02"
modalias = "ccw:t1731m03dt1732dm03"
online = "1"
peer_d_id = "0x000000"
peer_wwnn = "0x0000000000000000"
peer_wwpn = "0x0000000000000000"
status = "0x5400082e"
Class = "fc_host"
maxframe_size = "2112 bytes"
node_name = "0x5005076400cb90c4"
permanent_port_name = "0x500507640162c859"
port_id = "0x014c00"
port_name = "0x500507640162c859"
port_type = "NPort (fabric via point-to-point)"
serial_number = "IBM020000000B90C4"
speed = "4 Gbit"
supported_classes = "Class 2, Class 3"
supported_speeds = "4 Gbit"
tgtid_bind_type = "wwpn (World Wide Port Name)"
Class = "scsi_host"
cmd_per_lun = "1"
host_busy = "0"
proc_name = "zfcp"
queue_full = "0 91001920976"
sg_tablesize = "538"
state = "running"
unchecked_isa_dma = "0"
unique_id = "0"
utilization = "0 2 0"
The following displays are for the 1st Redhat guest that is brought up.
It sees the wwpn and luns
[r...@tdcrac01 ~]# lscss | grep 2107
0.0.2107 0.0.000b 1732/03 1731/03 yes 80 80 ff 49000000 00000000
[r...@tdcrac01 ~]# lszfcp -D
0.0.2107/0x50050763030384ac/0x4011402600000000 0:0:0:1
0.0.2107/0x500507630308c4ac/0x4011402600000000 0:0:1:1
[r...@tdcrac01 ~]# lszfcp -a -b 0.0.2107
0.0.2107 host0
Bus = "ccw"
availability = "good"
card_version = "0x0004"
cmb_enable = "0"
cutype = "1731/03"
devtype = "1732/03"
failed = "0"
hardware_version = "0x00000000"
in_recovery = "0"
lic_version = "0x00000b02"
modalias = "ccw:t1731m03dt1732dm03"
online = "1"
peer_d_id = "0x000000"
peer_wwnn = "0x0000000000000000"
peer_wwpn = "0x0000000000000000"
status = "0x5400082e"
Class = "fc_host"
maxframe_size = "2112 bytes"
node_name = "0x5005076400cb90c4"
permanent_port_name = "0x5005076401e2c929"
port_id = "0x01a400"
port_name = "0x5005076401e2c929"
port_type = "NPort (fabric via point-to-point)"
serial_number = "IBM020000000B90C4"
speed = "2 Gbit"
supported_classes = "Class 2, Class 3"
supported_speeds = "4 Gbit"
tgtid_bind_type = "wwpn (World Wide Port Name)"
Class = "scsi_host"
cmd_per_lun = "1"
host_busy = "0"
proc_name = "zfcp"
queue_full = "0 103530559246"
sg_tablesize = "538"
state = "running"
unchecked_isa_dma = "0"
unique_id = "0"
utilization = "1 12 0"
Thank you, Bob
-----Original Message-----
From: Linux on 390 Port [mailto:linux-...@vm.marist.edu] On Behalf Of
Raymond Higgs
Sent: Thursday, June 24, 2010 1:50 PM
To: LINUX-390@VM.MARIST.EDU
Subject: Re: Shared fcp between two linux guests
Linux on 390 Port <LINUX-390@vm.marist.edu> wrote on 06/24/2010 01:02:06
PM:
> Bob McCarthy <bob.mccar...@custserv.com> Sent by: Linux on 390 Port
> <LINUX-390@vm.marist.edu>
>
> 06/24/2010 01:02 PM
>
> Please respond to
> Linux on 390 Port <LINUX-390@vm.marist.edu>
>
> To
>
> LINUX-390@vm.marist.edu
>
> cc
>
> Subject
>
> Re: Shared fcp between two linux guests
>
> Rick,
> Are FCP adapters that you are referring to the same as the physical
> fcp channels (or CHPIDs) that are defined to the vm lpar through HCD?
> If so, I have (4) physical FCP channels defined on the lpar, and I am
> using a different channel for each linux guest. This is the same
> configuration for both RedHat and SUSE. When I used the same FCP
> channel for both guests, I received an additional "path in use" error
> message, which I should have expected. We have reversed the order in
> which the guests are brought up with the RedHat guests, and the 1st
> guest that comes up will successfully access the lun, and the 2nd
> guest will receive the error.
> Thank you, Bob
>
> -----Original Message-----
> From: Linux on 390 Port [mailto:linux-...@vm.marist.edu] On Behalf Of
> Richard Troth
> Sent: Thursday, June 24, 2010 10:56 AM
> To: LINUX-390@VM.MARIST.EDU
> Subject: Re: Shared fcp between two linux guests
>
> Bob --
>
> You said:
>
> > NPIV is not turned on at the lpar level, but it is turned on at the
> > SAN level.
>
> If you're sharing the same physical FCP adapter(s) between the two
> Linux guests, then you probably need NPIV (at the LPAR level).
>
> I cannot imagine how your other Linux guests are able to share a LUN
> if the storage frame sees the same Linux-side WWPN (FCP WWPN).
> Since you indicated that your SuSE guests *can* share a LUN between
> them, I have to ask if they are using different physical FCP adapters
> or if there is NPIV in play for the FCP adapter(s) they are using.
> What's the deal there?
>
> The only time I have been able to share a LUN, the storage frame has
> always seen different "HBA-side" WWPNs, whether physically different
> FCP adapters or with NPIV.
>
> Try reversing the order in qhich the guests are brought up to test
things.
>
> -- Rick; <><
>
>
>
>
>
> On Thu, Jun 24, 2010 at 10:43, Bob McCarthy
> <bob.mccar...@custserv.com>
wrote:
> > We are planning to setup an Oracle RAC environment with two linux
> > guests on the same vm lpar. They will be accessing fcp disk. The
> > problem is as
> > follows:
> > 1. Guest 1 is brought up. "lszfcp -D" command will show the wwpn and
> > lun as expected 2. Guest 2 is brought up. "lszfcp -D" command shows
> > nothing. "lszfcp -P"
> > command will show the wwpn
> > Looking at the error log in linux we see the following messages :
> > Jun 21 15:36:52 tdcrac02 kernel: zfcp: The adapter 0.0.8001 reported
> > the following characteristics:
> > Jun 21 15:36:52 tdcrac02 kernel: zfcp: Switched fabric fibrechannel
> > network detected at adapter 0.0.8001.
> > Jun 21 15:36:52 tdcrac02 kernel: zfcp: unit erp failed on unit
> > 0x0020000000000000 on port 0x5001738001820141 on adapter 0.0.8001
> > We are running zVM V5.4 and RedHat linux v5.5. The fcp disk is
> > assigned separate channel paths in each guest through DEDICATE
> > statements in
vm.
> > NPIV is not turned on at the lpar level, but it is turned on at the
> > SAN level. Additionally, we have set up two guests with the exact
> > same
> > configuration, but using SUSE 10SP2. This configuration has no
> > problems sharing the SAN disk. Is there configuration in RedHat that
> > must be done that would be different from SUSE ?
> > Thank you, Bob
> >
> > --------------------------------------------------------------------
> > -- For LINUX-390 subscribe / signoff / archive access instructions,
> > send email to lists...@vm.marist.edu with the message: INFO
> > LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390
> > --------------------------------------------------------------------
> > -- For more information on Linux on System z, visit
> > http://wiki.linuxvm.org/
> >
>
> ----------------------------------------------------------------------
> For LINUX-390 subscribe / signoff / archive access instructions, send
> email to lists...@vm.marist.edu with the message: INFO LINUX-390 or
> visit http://www.marist.edu/htbin/wlvindex?LINUX-390
> ----------------------------------------------------------------------
> For more information on Linux on System z, visit
http://wiki.linuxvm.org/
>
> ----------------------------------------------------------------------
> For LINUX-390 subscribe / signoff / archive access instructions, send
> email to lists...@vm.marist.edu with the message: INFO LINUX-390 or
visit
> http://www.marist.edu/htbin/wlvindex?LINUX-390
> ----------------------------------------------------------------------
> For more information on Linux on System z, visit
> http://wiki.linuxvm.org/
Bob,
The output from lscss would help answer questions about which devices
are for which channel. Maybe run
lscss | grep 8001
to show us what's going on in your 2nd guest that keeps failing. Then
show similar output for the 1st guest that is working.
Also, the output of lszfcp -D, and lszfcp -a -b x.x.xxxx would be
helpful too.
Regards,
Ray Higgs
System z FCP Development
Bld. 706, B24
2455 South Road
Poughkeepsie, NY 12601
(845) 435-8666, T/L 295-8666
rayhi...@us.ibm.com
----------------------------------------------------------------------
For LINUX-390 subscribe / signoff / archive access instructions, send
email to lists...@vm.marist.edu with the message: INFO LINUX-390 or
visit http://www.marist.edu/htbin/wlvindex?LINUX-390
----------------------------------------------------------------------
For more information on Linux on System z, visit
http://wiki.linuxvm.org/
----------------------------------------------------------------------
For LINUX-390 subscribe / signoff / archive access instructions,
send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit
http://www.marist.edu/htbin/wlvindex?LINUX-390
----------------------------------------------------------------------
For more information on Linux on System z, visit
http://wiki.linuxvm.org/
