[zfs-discuss] Steps to Recover a ZFS pool.
Did a search, but could not find the info I am looking for. I built out my OSOL system about a month ago and have been gradually making changes before I move it into production. I have setup a mirrored rpool and a 6 drive raidz2 pool for data. In my system I have 2 8-port SAS cards and 6 ports on the motherboard. I was short on SAS to SATA cables so I originally built the system out using the 6 ports on the motherboard and one SAS to SATA breakout cable. My new cables came and I reran all the cables to spread out the drives between controllers... Rebooted and my raidz2 pool is unavailable: pool: tank state: UNAVAIL status: One or more devices could not be opened. There are insufficient replicas for the pool to continue functioning. action: Attach the missing device and online it using 'zpool online'. see: http://www.sun.com/msg/ZFS-8000-3C scrub: none requested config: NAME STATE READ WRITE CKSUM tank UNAVAIL 0 0 0 insufficient replicas raidz2-0 UNAVAIL 0 0 0 insufficient replicas c4t16d0 UNAVAIL 0 0 0 cannot open c4t17d0 ONLINE 0 0 0 c10t0d0 ONLINE 0 0 0 c10t2d0 ONLINE 0 0 0 c10t3d0 UNAVAIL 0 0 0 cannot open c10t5d0 FAULTED 0 0 0 corrupted data However, when I look at format I see all my disks -- but the labels don't seem to match up: AVAILABLE DISK SELECTIONS: 0. c4t17d0 /p...@0,0/pci1002,5...@3/pci1014,3...@0/s...@11,0 1. c4t18d0 /p...@0,0/pci1002,5...@3/pci1014,3...@0/s...@12,0 2. c6t4d0 /p...@0,0/pci1002,5...@2/pci1014,3...@0/s...@4,0 3. c6t9d0 /p...@0,0/pci1002,5...@2/pci1014,3...@0/s...@9,0 4. c10t1d0 /p...@0,0/pci1462,7...@11/d...@1,0 5. c10t2d0 /p...@0,0/pci1462,7...@11/d...@2,0 6. c10t4d0 /p...@0,0/pci1462,7...@11/d...@4,0 7. c10t5d0 /p...@0,0/pci1462,7...@11/d...@5,0 How, do I recover my raidz2 pool? Is what I did wrong? I was under the impression that zfs wrote a label to each disk so you can move it around between controllers...? -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Steps to Recover a ZFS pool.
On Tue, 22 Jun 2010, Brian wrote: Is what I did wrong? I was under the impression that zfs wrote a label to each disk so you can move it around between controllers...? You are correct. Normally exporting and importing the pool should cause zfs to import the pool correctly. Moving disks around without first exporting the pool is something which is best avoided. Bob -- Bob Friesenhahn bfrie...@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer,http://www.GraphicsMagick.org/ ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Steps to Recover a ZFS pool.
On Tue, June 22, 2010 17:32, Bob Friesenhahn wrote: > On Tue, 22 Jun 2010, Brian wrote: >> >> Is what I did wrong? I was under the impression that zfs wrote a >> label to each disk so you can move it around between controllers...? > > You are correct. Normally exporting and importing the pool should > cause zfs to import the pool correctly. Moving disks around without > first exporting the pool is something which is best avoided. Perhaps an issue with stale data in "/etc/zfs/zpool.cache"? ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Steps to Recover a ZFS pool.
Did some more reading.. Should have exported first... gulp... So, I powered down and moved the drives around until the system came back up and zpool status is clean.. However, now I can't seem to boot. During boot it finds all 17 ZFS filesystems and starts mounting them. I have several file systems under /media. I have media/TV, media/Movies, media/Music, media/HomeVideos. During boot, I get an error message that states cannot mount /media directory is not empty and drops me into the recovery console. Now, when I go into /media, I have all the filesystems there and can go into each and the directories contain my contents.. If I unmount each filesystem under /media the directories each one mounts under stays there.. as expected.. And I don't see any other files in there besides the mountpoints.. Any advice on how to correct the mounting /media problem? I am not even sure where to look since the /media directory appears empty. -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Steps to Recover a ZFS pool.
Ok - So I unmounted all the directories, and then deleted them from /media, then I rebooted and everything remounted correctly and the system is functioning again.. Ok. time for a zpool scrub, then I will try my export and import.. whew :-) -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Steps to Recover a ZFS pool.
I ran into the same thing where I had to manually delete directories. Once you export the pool you can plug in the drives anywhere else. Reimport the pool and the file systems come right up — as long as the drives can be seen by the system. -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
