UNCLASSIFIED Hi Paul, I'm not a database person, nor have I seen this error, but it sounds like oracle is driving the volume too fast for vxsync to keep up. I would try stopping all I/O on this volume, run the unix sync command a few times, and then dissociate the plex. We've done a few mirrors and dissociations, and we are a lower revision than you for vxvm, but higher for vxfs. But our volumes are not heavily used. Greg.
IMPORTANT: This email remains the property of the Department of Defence and is subject to the jurisdiction of section 70 of the Crimes Act 1914. If you have received this email in error, you are requested to contact the sender and delete the email. ________________________________ From: [email protected] [mailto:[email protected]] On Behalf Of Paul Robertson Sent: Thursday, 14 July 2011 2:19 AM To: [email protected] Subject: [Veritas-vx] "vxplex dis" error "v-5-1-2321 cannot lock into memory:resource temporarily unavailable" with SFORAC 5.0MP3 We are currently running SFORA RAC 5.0MP3 on Solaris 10 64-bit two-node cluster. We run a large 10TB Oracle RAC database on this cluster, and we are in the process of VxVM mirroring the data from an old EMC array to a new EMC array. We provisioned the new EMC storage without incident, added the new disks to the existing diskgroups, and the mirrored the data between arrays. As the final step in the process, we then ran "vxplex -g dgname dis plex-nn", and saw the following for three separate volumes: v arch - ENABLED ACTIVE 6487707904 SELECT - fsgen pl arch-01 arch ENABLED ACTIVE 6487707904 CONCAT - RW sd 0804088C-01 arch-01 0804088C 0 1696907008 0 c3t50000972C00C915Cd25 ENA sd 080408BC-01 arch-01 080408BC 0 1696907008 1696907008 c3t50000972C00C915Cd26 ENA sd 080408EC-01 arch-01 080408EC 0 1696907008 3393814016 c3t50000972C00C915Cd27 ENA sd 0804091C-01 arch-01 0804091C 0 1396986880 5090721024 c3t50000972C00C915Cd28 ENA pl arch-02 arch ENABLED ACTIVE 6487707904 CONCAT - RW sd 20520113-01 arch-02 20520113 0 1428029344 0 c3t5006016844600097d8 ENA sd 20520061-02 arch-02 20520061 861984256 666538784 1428029344 c2t5006016244600097d12 ENA sd 20520121-01 arch-02 20520121 0 1537081088 2094568128 c2t5006016244600097d16 ENA sd 20520064-01 arch-02 20520064 0 1428029344 3631649216 c3t5006016844600097d25 ENA sd 20520103-01 arch-02 20520103 0 1428029344 5059678560 c3t5006016844600097d26 ENA racnyc05:~>sudo vxplex -g oradg dis arch-02 VxVM vxsync ERROR V-5-1-2321 Cannot lock into memory: Resource temporarily unavailable VxVM vxplex ERROR V-5-1-10870 fsgen/vxplex: Warning: vxsync exited with exitcode 42: Volume data may not be flushed to all plexes Despite the warning above, it seemed to work, however, in that the plex is disassociated and the filesystem is still accessible: racnyc05:~>vxprint -htg oradg arch arch-02 V NAME RVG/VSET/CO KSTATE STATE LENGTH READPOL PREFPLEX UTYPE PL NAME VOLUME KSTATE STATE LENGTH LAYOUT NCOL/WID MODE SD NAME PLEX DISK DISKOFFS LENGTH [COL/]OFF DEVICE MODE SV NAME PLEX VOLNAME NVOLLAYR LENGTH [COL/]OFF AM/NM MODE SC NAME PLEX CACHE DISKOFFS LENGTH [COL/]OFF DEVICE MODE DC NAME PARENTVOL LOGVOL SP NAME SNAPVOL DCO EX NAME ASSOC VC PERMS MODE STATE SR NAME KSTATE pl arch-02 - DISABLED - 6487707904 CONCAT - RW sd 20520113-01 arch-02 20520113 0 1428029344 0 c3t5006016844600097d8 ENA sd 20520061-02 arch-02 20520061 861984256 666538784 1428029344 c2t5006016244600097d12 ENA sd 20520121-01 arch-02 20520121 0 1537081088 2094568128 c2t5006016244600097d16 ENA sd 20520064-01 arch-02 20520064 0 1428029344 3631649216 c3t5006016844600097d25 ENA sd 20520103-01 arch-02 20520103 0 1428029344 5059678560 c3t5006016844600097d26 ENA v arch - ENABLED ACTIVE 6487707904 SELECT - fsgen pl arch-01 arch ENABLED ACTIVE 6487707904 CONCAT - RW sd 0804088C-01 arch-01 0804088C 0 1696907008 0 c3t50000972C00C915Cd25 ENA sd 080408BC-01 arch-01 080408BC 0 1696907008 1696907008 c3t50000972C00C915Cd26 ENA sd 080408EC-01 arch-01 080408EC 0 1696907008 3393814016 c3t50000972C00C915Cd27 ENA sd 0804091C-01 arch-01 0804091C 0 1396986880 5090721024 c3t50000972C00C915Cd28 ENA racnyc05:~>df -h /arch Filesystem size used avail capacity Mounted on /dev/vx/dsk/oradg/arch 3.0T 54G 2.8T 2% /arch racnyc05:~>sudo fstyp /dev/vx/rdsk/oradg/arch vxfs It's happened on three volumes in two different clustered diskgroups on this cluster. I'm unwilling to proceed with the more critical volumes until I get a better understanding of the root cause. I'm concerned that the remaining active plex on the new array may become inconsistent during the plex disassociation, which could cause serious problems for our database. Here's a little more information: racnyc05:~>modinfo | grep -i vx 39 7bea2000 3e4e0 307 1 vxdmp (VxVM 5.0MP3: DMP Driver) 41 7ba00000 209248 272 1 vxio (VxVM 5.0MP3 I/O driver) 43 7bea11e8 c78 273 1 vxspec (VxVM 5.0MP3 control/status driv) 236 7afc54a8 cb0 310 1 vxportal (VxFS 5.0_REV-5.0MP3A25_sol port) 240 7a600000 1d89e0 20 1 vxfs (VxFS 5.0_REV-5.0MP3A25_sol SunO) 260 7a7ec000 a9e0 311 1 fdd (VxQIO 5.0_REV-5.0MP3A25_sol Qui) 264 7ab4a000 51c10 315 1 vxfen (VRTS Fence 5.0MP3) 265 7b600000 21ec0 316 1 vxglm (VxGLM 5.0MP3 (SunOS 5.10)) 266 7ab9e000 5418 317 1 vxgms (VxGMS 5.0MP3 (SunOS)) Let me know if you need any additional information. Cheers, Paul
_______________________________________________ Veritas-vx maillist - [email protected] http://mailman.eng.auburn.edu/mailman/listinfo/veritas-vx
