Re: Problems replacing failing drive in ZFS pool

2010-07-21 Thread Dan Langille
On 7/19/2010 10:50 PM, Adam Vande More wrote: On Mon, Jul 19, 2010 at 9:07 PM, Dan Langille wrote: I think it's because you pull the old drive, boot with the new drive, the controller re-numbers all the devices (ie da3 is now da2, da2 is now da1, da1 is now da0, da0 is now da6, etc), and ZFS

Re: Problems replacing failing drive in ZFS pool

2010-07-21 Thread Freddie Cash
On Tue, Jul 20, 2010 at 11:43 PM, Charles Sprickman wrote: > Two things: > > -What's the preferred labelling method for disks that will be used with zfs > these days?  geom_label or gpt labels?  I've been using the latter and I > find them a little simpler. If the disks will only be used in FreeB

Re: Problems replacing failing drive in ZFS pool

2010-07-21 Thread Dan Langille
On 7/21/2010 2:54 AM, Charles Sprickman wrote: On Wed, 21 Jul 2010, Charles Sprickman wrote: On Tue, 20 Jul 2010, alan bryan wrote: --- On Mon, 7/19/10, Dan Langille wrote: From: Dan Langille Subject: Re: Problems replacing failing drive in ZFS pool To: "Freddie Cash" Cc

Re: Problems replacing failing drive in ZFS pool

2010-07-20 Thread Charles Sprickman
On Wed, 21 Jul 2010, Charles Sprickman wrote: On Tue, 20 Jul 2010, alan bryan wrote: --- On Mon, 7/19/10, Dan Langille wrote: From: Dan Langille Subject: Re: Problems replacing failing drive in ZFS pool To: "Freddie Cash" Cc: "freebsd-stable" Date: Monday, July 19

Re: Problems replacing failing drive in ZFS pool

2010-07-20 Thread Charles Sprickman
On Tue, 20 Jul 2010, alan bryan wrote: --- On Mon, 7/19/10, Dan Langille wrote: From: Dan Langille Subject: Re: Problems replacing failing drive in ZFS pool To: "Freddie Cash" Cc: "freebsd-stable" Date: Monday, July 19, 2010, 7:07 PM On 7/19/2010 12:15 PM, Freddie

Re: Problems replacing failing drive in ZFS pool

2010-07-20 Thread jhell
On 07/21/2010 02:14, Joshua Boyd wrote: > [r...@foghornleghorn ~]# zpool replace tank da0 label/disk01 > cannot open 'label/disk01': no such GEOM provider > must be a full path or shorthand device name Of course you cant. You have labeled a disk that is already in use so in turn the label should n

Re: Problems replacing failing drive in ZFS pool

2010-07-20 Thread Joshua Boyd
On Wed, Jul 21, 2010 at 2:09 AM, Joshua Boyd wrote: > On Wed, Jul 21, 2010 at 1:57 AM, alan bryan wrote: > >> >> >> --- On Mon, 7/19/10, Dan Langille wrote: >> >> > From: Dan Langille >> > Subject: Re: Problems replacing failing drive in ZFS

Re: Problems replacing failing drive in ZFS pool

2010-07-20 Thread Joshua Boyd
On Wed, Jul 21, 2010 at 1:57 AM, alan bryan wrote: > > > --- On Mon, 7/19/10, Dan Langille wrote: > > > From: Dan Langille > > Subject: Re: Problems replacing failing drive in ZFS pool > > To: "Freddie Cash" > > Cc: "freebsd-stable" &

Re: Problems replacing failing drive in ZFS pool

2010-07-20 Thread alan bryan
--- On Mon, 7/19/10, Dan Langille wrote: > From: Dan Langille > Subject: Re: Problems replacing failing drive in ZFS pool > To: "Freddie Cash" > Cc: "freebsd-stable" > Date: Monday, July 19, 2010, 7:07 PM > On 7/19/2010 12:15 PM, Freddie Cash > w

Re: Problems replacing failing drive in ZFS pool

2010-07-20 Thread Pawel Tyll
Hi guys, > I second what others have said - crap. > But there could be some hope, not sure. > Can you check what is the actual size used by the pool on the disk? > It should be somewhere in zdb -C output ("asize"?). > If I remember correctly, that actual size should be a multiple of some rather >

Re: Problems replacing failing drive in ZFS pool

2010-07-20 Thread Andriy Gapon
on 20/07/2010 01:04 Garrett Moore said the following: > Well, hotswapping worked, but now I have a totally different problem. Just > for reference: > # zpool offline tank da3 > # camcontrol stop da3 > > # camcontrol rescan all > <'da3 lost device, removing device entry'> > # camcontrol rescan all

Re: Problems replacing failing drive in ZFS pool

2010-07-19 Thread Adam Vande More
On Mon, Jul 19, 2010 at 9:07 PM, Dan Langille wrote: > I think it's because you pull the old drive, boot with the new drive, >> the controller re-numbers all the devices (ie da3 is now da2, da2 is >> now da1, da1 is now da0, da0 is now da6, etc), and ZFS thinks that all >> the drives have changed

Re: Problems replacing failing drive in ZFS pool

2010-07-19 Thread Dan Langille
On 7/19/2010 12:15 PM, Freddie Cash wrote: On Mon, Jul 19, 2010 at 8:56 AM, Garrett Moore wrote: So you think it's because when I switch from the old disk to the new disk, ZFS doesn't realize the disk has changed, and thinks the data is just corrupt now? Even if that happens, shouldn't the pool

Re: Problems replacing failing drive in ZFS pool

2010-07-19 Thread Daniel O'Connor
On 20/07/2010, at 10:55, Clifton Royston wrote: > The space sacrificed is trivial compared to the convenience and safety > net. > > I think I got both those suggestions on this list, and I would hope > (assume?) that they have equivalents under ZFS. I partitioned my ZFS disks using GPT so I cou

Re: Problems replacing failing drive in ZFS pool

2010-07-19 Thread Clifton Royston
On Mon, Jul 19, 2010 at 06:28:16PM -0400, Garrett Moore wrote: > Well thank you very much Western Digital for your absolutely pathetic RMA > service sending me an inferior drive. I'll call tomorrow and see what can be > done; I'm going to insist on these 00R6B0 drives being sent back, and being > g

Re: Problems replacing failing drive in ZFS pool

2010-07-19 Thread Garrett Moore
Well thank you very much Western Digital for your absolutely pathetic RMA service sending me an inferior drive. I'll call tomorrow and see what can be done; I'm going to insist on these 00R6B0 drives being sent back, and being given a drive of >= 1,500,301,910,016 bytes capacity. At least now I le

Re: Problems replacing failing drive in ZFS pool

2010-07-19 Thread Adam Vande More
On Mon, Jul 19, 2010 at 5:04 PM, Garrett Moore wrote: > Well, hotswapping worked, but now I have a totally different problem. Just > for reference: > # zpool offline tank da3 > # camcontrol stop da3 > > # camcontrol rescan all > <'da3 lost device, removing device entry'> > # camcontrol rescan all

Re: Problems replacing failing drive in ZFS pool

2010-07-19 Thread Freddie Cash
On Mon, Jul 19, 2010 at 3:04 PM, Garrett Moore wrote: > Well, hotswapping worked, but now I have a totally different problem. Just Yay. :) > for reference: > # zpool offline tank da3 > # camcontrol stop da3 > > # camcontrol rescan all > <'da3 lost device, removing device entry'> > # camcontrol

Re: Problems replacing failing drive in ZFS pool

2010-07-19 Thread Garrett Moore
Well, hotswapping worked, but now I have a totally different problem. Just for reference: # zpool offline tank da3 # camcontrol stop da3 # camcontrol rescan all <'da3 lost device, removing device entry'> # camcontrol rescan all <'da3 at mpt0 ...', so new drive was found! yay> # zpool replace tank

Re: Problems replacing failing drive in ZFS pool

2010-07-19 Thread John Hawkes-Reed
On 19/07/2010 17:52, Garrett Moore wrote: I'm nervous to trust the hotswap features and camcontrol to set things up properly, but I guess I could try it. When I first set the system up before I put data on the array I tried the hotswap functionality and drives wouldn't always re-attach when reins

Re: Problems replacing failing drive in ZFS pool

2010-07-19 Thread Garrett Moore
I'm nervous to trust the hotswap features and camcontrol to set things up properly, but I guess I could try it. When I first set the system up before I put data on the array I tried the hotswap functionality and drives wouldn't always re-attach when reinserted, even if I fiddled with camcontrol, bu

Re: Problems replacing failing drive in ZFS pool

2010-07-19 Thread Freddie Cash
On Mon, Jul 19, 2010 at 9:33 AM, Garrett Moore wrote: > I forgot to ask in the last email, is there a way to convert from Z1 to Z2 > without losing data? I actually have far more storage than I need so I'd > consider going to Z2. No, unfortunately it's not currently possible to change vdev types

Re: Problems replacing failing drive in ZFS pool

2010-07-19 Thread Freddie Cash
On Mon, Jul 19, 2010 at 9:32 AM, Garrett Moore wrote: > The data on the disks is not irreplaceable so if I lose the array it isn't > the end of the world but I would prefer not to lose it as it would be a pain > to get all of the data again. > > Freddie's explanation is reasonable, but any ideas w

Re: Problems replacing failing drive in ZFS pool

2010-07-19 Thread Garrett Moore
I forgot to ask in the last email, is there a way to convert from Z1 to Z2 without losing data? I actually have far more storage than I need so I'd consider going to Z2. On Mon, Jul 19, 2010 at 12:18 PM, Adam Vande More wrote: > On Mon, Jul 19, 2010 at 10:56 AM, Garrett Moore wrote: > >> So you

Re: Problems replacing failing drive in ZFS pool

2010-07-19 Thread Garrett Moore
The data on the disks is not irreplaceable so if I lose the array it isn't the end of the world but I would prefer not to lose it as it would be a pain to get all of the data again. Freddie's explanation is reasonable, but any ideas why it didn't happen when I replaced my first dead drive (da5)? T

Re: Problems replacing failing drive in ZFS pool

2010-07-19 Thread Adam Vande More
On Mon, Jul 19, 2010 at 10:56 AM, Garrett Moore wrote: > So you think it's because when I switch from the old disk to the new disk, > ZFS doesn't realize the disk has changed, and thinks the data is just > corrupt now? Even if that happens, shouldn't the pool still be available, > since it's RAIDZ

Re: Problems replacing failing drive in ZFS pool

2010-07-19 Thread Freddie Cash
On Mon, Jul 19, 2010 at 8:56 AM, Garrett Moore wrote: > So you think it's because when I switch from the old disk to the new disk, > ZFS doesn't realize the disk has changed, and thinks the data is just > corrupt now? Even if that happens, shouldn't the pool still be available, > since it's RAIDZ1

Re: Problems replacing failing drive in ZFS pool

2010-07-19 Thread Garrett Moore
So you think it's because when I switch from the old disk to the new disk, ZFS doesn't realize the disk has changed, and thinks the data is just corrupt now? Even if that happens, shouldn't the pool still be available, since it's RAIDZ1 and only one disk has gone away? I don't have / on ZFS; I'm o

Re: Problems replacing failing drive in ZFS pool

2010-07-19 Thread Freddie Cash
On Mon, Jul 19, 2010 at 8:21 AM, Garrett Moore wrote: > I have an 8-drive ZFS array consisting of WD15EADS drives. One of my disks > has started to fail, so I got a replacement disk. I have replaced a disk > before by: > >  zpool offline tank /dev/da5 > shutting down, swapping from old disk to new

Re: Problems replacing failing drive in ZFS pool

2010-07-19 Thread Garrett Moore
Oops - shouldn't have forgotten that, sorry. FreeBSD leviathan 8.0-RELEASE FreeBSD 8.0-RELEASE #0: Sat Nov 21 15:02:08 UTC 2009 r...@mason.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC amd64 On Mon, Jul 19, 2010 at 11:24 AM, Jeremy Chadwick wrote: > On Mon, Jul 19, 2010 at 11:21:38AM -0400, Ga

Re: Problems replacing failing drive in ZFS pool

2010-07-19 Thread Jeremy Chadwick
On Mon, Jul 19, 2010 at 11:21:38AM -0400, Garrett Moore wrote: > I have an 8-drive ZFS array consisting of WD15EADS drives. One of my disks > has started to fail, so I got a replacement disk. I have replaced a disk > before by: > > zpool offline tank /dev/da5 > shutting down, swapping from old di