Hi all,
Last night I had one of my production servers bounced for maintenance and it didn't came up. In the console I can see that one of my zfcp luns are available (VG_oracle_archives/archives) and all other are not (No such file or directory while trying to open <file system name>). After 2 retries to logoff the user and logon again I started the guest on a different z/VM system and all worked fine. A little about the environment. 2 z/VMs for production PRD1 and PRD2 (the guest is usually working on PRD2). z10 with 2 IFLs shared between PRD1 and PRD2. 2xFCP channels with NPIV enabled (shared between PRD1 and PRD2). The storage used is XIV for oracle data/logs etc. DASD is used for operating system and oracle binaries (shared by PRD1 and PRD2) Multipathd is in use to work with 6 paths for each scsi device (attached multipath.conf) User direct for the guest is exactly the same on PRD1 and PRD2. The only different between the Guest on PRD1 and PRD2 is the WWPN numbers because of NPIV. The fact is that Redhat was able to work with one of the Luns on PRD1 so zoning is not the problem. (Surly XIV is available thru the physical paths). Furthermore, the XIV host definition is one for both PRD1 and PRD2. Meaning luns are only assigned to the host once. So, Luns is not the problem. XIV host definitions includes all4 WWPNs (2 from PRD1 and 2 from PRD2). Leaving me with 2 options: 1. Redhat zfcp devices has a bug (couldn't find a fix for this) perhaps this is a timing issue. 2. XIV has a bug working with Redhat zfcp (first time this had happened to me). I attached the console output, multipath.conf and zfcp.conf. Note that zfcp.conf also contains the paths of my DRP site (these paths only come online when the server is started on the DR site - it is controlled by zoning). Any ideas? Thanks in advance! Offer Baruch ---------------------------------------------------------------------- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390 ---------------------------------------------------------------------- For more information on Linux on System z, visit http://wiki.linuxvm.org/
Setting clock (utc): Tue Jul 27 01:30:44 IDT 2010 [ OK ]""
Starting udev:
[ OK ]""
Setting hostname PISRSDB2.isracard.co.il: [ OK ]""
Setting up Logical Volume Management:
8 logical volume(s) in volume group "VG_middleware" now active"
2 logical volume(s) in volume group "VolGroup00" now active"
1 logical volume(s) in volume group "VG_oracle_archives" now active"
[ OK ]""
Checking filesystems"
Checking all file systems."
[/sbin/fsck.ext3 (1) -- /] fsck.ext3 -a /dev/VolGroup00/LogVol00 "
/dev/VolGroup00/LogVol00: clean, 137035/1147392 files, 882303/1171456 bl
[/sbin/fsck.ext3 (1) -- /home/oracle] fsck.ext3 -a /dev/VG_middleware/or
/dev/VG_middleware/oracle-home: clean, 39/25600 files, 3772/25600 blocks
[/sbin/fsck.ext3 (1) -- /oracle] fsck.ext3 -a /dev/VG_middleware/oracle-
/dev/VG_middleware/oracle-base: clean, 25/128000 files, 8400/128000 bloc
[/sbin/fsck.ext3 (1) -- /oracle/software] fsck.ext3 -a /dev/VG_middlewar
/dev/VG_middleware/oracle-software: clean, 51004/655360 files, 1015435/1
[/sbin/fsck.ext3 (1) -- /oracle/archives] fsck.ext3 -a /dev/VG_oracle_ar
/dev/VG_oracle_archives/archives: clean, 12/10485760 files, 376119/20970
[/sbin/fsck.ext3 (1) -- /oracle/redologs] fsck.ext3 -a /dev/VG_oracle_lo
fsck.ext3: No such file or directory while trying to open /dev/VG_oracle
/dev/VG_oracle_logs/logs: "
The superblock could not be read or does not describe a correct ext2"
filesystem. If the device is valid and it really contains an ext2"
filesystem (and not swap or ufs or something else), then the superblock"
is corrupt, and you might try running e2fsck with an alternate superbloc
e2fsck -b 8193 <device>"
"
[/sbin/fsck.ext3 (1) -- /oracle/controlfiles] fsck.ext3 -a /dev/VG_oracl
fsck.ext3: No such file or directory while trying to open /dev/VG_oracle
/dev/VG_oracle_control/control: "
The superblock could not be read or does not describe a correct ext2"
filesystem. If the device is valid and it really contains an ext2"
filesystem (and not swap or ufs or something else), then the superblock"
is corrupt, and you might try running e2fsck with an alternate superbloc
e2fsck -b 8193 <device>"
"
[/sbin/fsck.ext3 (1) -- /oracle/datafiles] fsck.ext3 -a /dev/VG_oracle_d
fsck.ext3: No such file or directory while trying to open /dev/VG_oracle
/dev/VG_oracle_data/data: "
The superblock could not be read or does not describe a correct ext2"
filesystem. If the device is valid and it really contains an ext2"
filesystem (and not swap or ufs or something else), then the superblock"
is corrupt, and you might try running e2fsck with an alternate superbloc
e2fsck -b 8193 <device>"
"
[/sbin/fsck.ext3 (1) -- /oracle/backup] fsck.ext3 -a /dev/VG_oracle_back
fsck.ext3: No such file or directory while trying to open /dev/VG_oracle
/dev/VG_oracle_backups/backups: "
The superblock could not be read or does not describe a correct ext2"
filesystem. If the device is valid and it really contains an ext2"
filesystem (and not swap or ufs or something else), then the
superblock"
is corrupt, and you might try running e2fsck with an alternate superbloc
e2fsck -b 8193 <device>"
"
[/sbin/fsck.ext3 (1) -- /oracle/oraOMS] fsck.ext3 -a /dev/VG_middleware/
/dev/VG_middleware/oracle-OMS: clean, 8724/196608 files, 268470/390144 b
[/sbin/fsck.ext3 (1) -- /boot] fsck.ext3 -a /dev/dasda1 "
/boot: clean, 22/25600 files, 5439/25596 blocks"
[FAILED]""
"
*** An error occurred during the file system check."
*** Dropping you to a shell; the system will reboot"
*** when you leave the shell."
Give root password for maintenance"
(or type Control-D to continue):
----------------------------------------------------------------------
For LINUX-390 subscribe / signoff / archive access instructions,
send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit
http://www.marist.edu/htbin/wlvindex?LINUX-390
----------------------------------------------------------------------
For more information on Linux on System z, visit
http://wiki.linuxvm.org/
multipath.conf
Description: Binary data
zfcp.conf
Description: Binary data
