Re: [zfs-discuss] Another user looses his pool (10TB) in this case and 40

2009-07-31 Thread Ross
> wow, talk about a knee jerk reaction... Not at all. A long thread is started where the user lost his pool, and discussion shows it's a known problem. I love ZFS and I'm still very nervous about the risk of loosing an entire pool. > As has been described many times over the past few > years

Re: [zfs-discuss] How Virtual Box handles the IO

2009-07-31 Thread Mike Gerdts
On Fri, Jul 31, 2009 at 7:58 PM, Frank Middleton wrote: > Has anyone ever actually lost a pool on Sun hardware other than > by losing too many replicas or operator error? As you have so Yes, I have lost a pool when running on Sun hardware. http://mail.opensolaris.org/pipermail/zfs-discuss/2007-Se

Re: [zfs-discuss] Another user looses his pool (10TB) in this case and 40

2009-07-31 Thread Bryan Allen
+-- | On 2009-07-31 17:00:54, Jason A. Hoffman wrote: | | I have thousands and thousands and thousands of zpools. I started | collecting such zpools back in 2005. None have been lost. I don't have thousands and thousand

Re: [zfs-discuss] How Virtual Box handles the IO

2009-07-31 Thread Neil Perrin
I understand > that the ZILs are allocated out of the general pool. There is one intent log chain per dataset (file system or zvol). The head of each log the log is kept in the main pool. Without slog(s) we allocate (and chain) blocks from the main pool. If separate intent log(s) exist then bloc

Re: [zfs-discuss] Lundman home NAS

2009-07-31 Thread Jorgen Lundman
Finding a SATA card that would work with Solaris, and be hot-swap, and more than 4 ports, sure took a while. Oh and be reasonably priced ;) Double the price of the dual core Atom did not seem right. The SATA card was a close fit to the jumper were the power-switch cable attaches, as you can

Re: [zfs-discuss] Zfs deduplication

2009-07-31 Thread Dave McDorman
I don't think is at liberty to discuss ZFS Deduplication at this point in time: http://www.itworld.com/storage/71307/sun-tussles-de-duplication-startup Hopefully, the matter is resolved and discussions can proceed openly. "Send lawyers, guns and money." - Warren Zevon -- This message posted fro

Re: [zfs-discuss] Another user looses his pool (10TB) in this case and 40

2009-07-31 Thread Adam Sherman
On 31-Jul-09, at 20:00 , Jason A. Hoffman wrote: I have thousands and thousands and thousands of zpools. I started collecting such zpools back in 2005. None have been lost. Best regards, Jason Jason A. Hoffman, PhD | Founder, CTO,

[zfs-discuss] I Still Have My Data

2009-07-31 Thread Adam Sherman
My test setup of 8 x 2G virtual disks under Virtual Box on top of Mac OS X is running nicely! I haven't lost a *single* byte of data. ;) A. -- Adam Sherman CTO, Versature Corp. Tel: +1.877.498.3772 x113 ___ zfs-discuss mailing list zfs-discuss@op

Re: [zfs-discuss] How Virtual Box handles the IO

2009-07-31 Thread Frank Middleton
Great to hear a few success stories! We have been experimentally running ZFS on really crappy hardware and it has never lost a pool. Running on VB with ZFS/iscsi raw disks we have yet to see any errors at all. On sun4u with lsi sas/sata it is really rock solid. And we've been going out of our way

Re: [zfs-discuss] Another user looses his pool (10TB) in this case and 40

2009-07-31 Thread Ian Collins
Brian wrote: I must say this thread has also damaged the view I have of ZFS. Ive been considering just getting a Raid 5 controller and going the linux route I had planned on. That'll be you loss. I've never managed to loose a pool and I've all sorts of unreliable media and all sorts of na

Re: [zfs-discuss] Another user looses his pool (10TB) in this case and 40

2009-07-31 Thread Toby Thain
On 31-Jul-09, at 7:15 PM, Richard Elling wrote: wow, talk about a knee jerk reaction... On Jul 31, 2009, at 3:23 PM, Dave Stubbs wrote: I don't mean to be offensive Russel, but if you do ever return to ZFS, please promise me that you will never, ever, EVER run it virtualized on top of NTFS (

Re: [zfs-discuss] Another user looses his pool (10TB) in this case and 40

2009-07-31 Thread David Magda
On Jul 31, 2009, at 20:00, Jason A. Hoffman wrote: On Jul 31, 2009, at 4:54 PM, Bob Friesenhahn wrote: On Fri, 31 Jul 2009, Brian wrote: I must say this thread has also damaged the view I have of ZFS. Ive been considering just getting a Raid 5 controller and going the linux route I had pl

Re: [zfs-discuss] Another user looses his pool (10TB) in this case and 40

2009-07-31 Thread Jason A. Hoffman
On Jul 31, 2009, at 4:54 PM, Bob Friesenhahn wrote: On Fri, 31 Jul 2009, Brian wrote: I must say this thread has also damaged the view I have of ZFS. Ive been considering just getting a Raid 5 controller and going the linux route I had planned on. Thankfully, the zfs users who have never

Re: [zfs-discuss] Another user looses his pool (10TB) in this case and 40

2009-07-31 Thread Bob Friesenhahn
On Fri, 31 Jul 2009, Brian wrote: I must say this thread has also damaged the view I have of ZFS. Ive been considering just getting a Raid 5 controller and going the linux route I had planned on. Thankfully, the zfs users who have never lost a pool do not spend much time posting about their

Re: [zfs-discuss] Another user looses his pool (10TB) in this case and 40

2009-07-31 Thread David Magda
On Jul 31, 2009, at 19:26, Brian wrote: I must say this thread has also damaged the view I have of ZFS. Ive been considering just getting a Raid 5 controller and going the linux route I had planned on. It's your data, and you are responsible for it. So this thread, if nothing else, allo

Re: [zfs-discuss] Another user looses his pool (10TB) in this case and 40

2009-07-31 Thread Brian
I must say this thread has also damaged the view I have of ZFS. Ive been considering just getting a Raid 5 controller and going the linux route I had planned on. -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@open

Re: [zfs-discuss] Another user looses his pool (10TB) in this case and 40

2009-07-31 Thread Richard Elling
wow, talk about a knee jerk reaction... On Jul 31, 2009, at 3:23 PM, Dave Stubbs wrote: I don't mean to be offensive Russel, but if you do ever return to ZFS, please promise me that you will never, ever, EVER run it virtualized on top of NTFS (a.k.a. worst file system ever) in a production envi

Re: [zfs-discuss] Another user looses his pool (10TB) in this case and 40

2009-07-31 Thread Dave Stubbs
> I don't mean to be offensive Russel, but if you do > ever return to ZFS, please promise me that you will > never, ever, EVER run it virtualized on top of NTFS > (a.k.a. worst file system ever) in a production > environment. Microsoft Windows is a horribly > unreliable operating system in situatio

Re: [zfs-discuss] feature proposal

2009-07-31 Thread Kyle McDonald
dick hoogendijk wrote: On Fri, 31 Jul 2009 18:38:16 +1000 Tristan Ball wrote: Because it means you can create zfs snapshots from a non solaris/non local client... Like a linux nfs client, or a windows cifs client. So if I want a snapshot of i.e. "rpool/export/home/dick" I can do a

Re: [zfs-discuss] feature proposal

2009-07-31 Thread dick hoogendijk
On Fri, 31 Jul 2009 18:38:16 +1000 Tristan Ball wrote: > Because it means you can create zfs snapshots from a non solaris/non > local client... > > Like a linux nfs client, or a windows cifs client. So if I want a snapshot of i.e. "rpool/export/home/dick" I can do a "zfs snapshot rpool/export/

Re: [zfs-discuss] Managing ZFS Replication

2009-07-31 Thread Joseph L. Casale
>If I recall correctly, modifiable snapshot properties aren't support >in older versions of ZFS :( >I wrote the script on Opensolaris 2008.11, which did have modifiable >snapshot properties. >Can you upgrade your pool versions possibly? I could, just don't know of S10 would allow it on that side?

Re: [zfs-discuss] The importance of ECC RAM for ZFS

2009-07-31 Thread Victor Latushkin
On 31.07.09 22:04, Kurt Olsen wrote: On Jul 24, 2009, at 22:17, Bob Friesenhahn wrote: Most of the issues that I've read on this list would have been "solved" if there was a mechanism where the user / sysadmin could tell ZFS to simply go back until it found a TXG that worked. The trade

Re: [zfs-discuss] Managing ZFS Replication

2009-07-31 Thread Brent Jones
On Fri, Jul 31, 2009 at 10:25 AM, Joseph L. Casale wrote: >>I came up with a somewhat custom script, using some pre-existing >>scripts I found about the land. >> >>http://www.brentrjones.com/?p=45 > > Brent, > That was super helpful. I had to make some simple changes to the ssh > syntax as I use a

Re: [zfs-discuss] The importance of ECC RAM for ZFS

2009-07-31 Thread Kurt Olsen
> On Jul 24, 2009, at 22:17, Bob Friesenhahn wrote: > > Most of the issues that I've read on this list would > have been > "solved" if there was a mechanism where the user / > sysadmin could tell > ZFS to simply go back until it found a TXG that > worked. > > The trade off is that any tra

Re: [zfs-discuss] Managing ZFS Replication

2009-07-31 Thread Joseph L. Casale
>I came up with a somewhat custom script, using some pre-existing >scripts I found about the land. > >http://www.brentrjones.com/?p=45 Brent, That was super helpful. I had to make some simple changes to the ssh syntax as I use a specific user and identity file going from Solaris 10 to OpenSolaris

Re: [zfs-discuss] Install and boot from USB stick?

2009-07-31 Thread Jürgen Keil
> How can i implement that change, after installing the > OS? Or do I need to build my own livecd? Boot from the livecd, attach the usb stick, open a terminal window, "pfexec bash" starts a root shell, "zpool import -f rpool" should find and import the zpool from the usb stick. Mount the root fi

Re: [zfs-discuss] Best ways to contribute WAS: Fed up with ZFS causing data loss

2009-07-31 Thread Richard Elling
On Jul 31, 2009, at 7:24 AM, m...@bruningsystems.com wrote: Hi Ross, Ross wrote: #3 zfs unlike other things like the build system are extremely well documented. There are books on it, code to read and even instructors (Max Bruning) who can teach you about the internals. My project even

Re: [zfs-discuss] Fed up with ZFS causing data loss

2009-07-31 Thread Bob Friesenhahn
On Thu, 30 Jul 2009, Ross wrote: Yes, I did miss that one, but could you remind me what exactly are the sd and ssd drivers? I can find lots of details about configuring them, but no basic documentation telling me what they are. Is your system lacking manual pages? I find excruciating deta

Re: [zfs-discuss] How Virtual Box handles the IO

2009-07-31 Thread Richard Elling
Thanks for following up with this, Russel. On Jul 31, 2009, at 7:11 AM, Russel wrote: After all the discussion here about VB, and all the finger pointing I raised a bug on VB about flushing. Remember I am using RAW disks via the SATA emulation in VB the disks are WD 2TB drives. Also remember t

Re: [zfs-discuss] Install and boot from USB stick?

2009-07-31 Thread tore
How can i implement that change, after installing the OS? Or do I need to build my own livecd? -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

[zfs-discuss] Zfs deduplication

2009-07-31 Thread Ashley Avileli
Will the material ever be posted. Looks there is some huge bugs with zfs deduplication that the organizers do not want to post it also there is no indication on sun website if there will be a deduplication feature. I think its best they concentrate on improving zfs performance and speed with compre

Re: [zfs-discuss] Install and boot from USB stick?

2009-07-31 Thread Jürgen Keil
> Well, here is the error: > > ... usb stick reports(?) scsi error: medium may have changed ... That's strange. The media in a flash memory stick can't be changed - although most sticks report that they do have removable media. Maybe this stick needs one of the workarounds that can be enabled i

Re: [zfs-discuss] sam-fs on zfs-pool

2009-07-31 Thread Tobias Exner
No, just did "zfs create -V". and I didn't change the size of the zpool or zvol at any time.. regards, Tobias Jim Klimov schrieb: Concerning the reservations, here's a snip from "man zfs": The reservation is kept equal to the volume's logical size to prevent unex

Re: [zfs-discuss] Install and boot from USB stick?

2009-07-31 Thread Jürgen Keil
> I've found it only works for USB sticks up to 4GB :( > If I tried a USB stick bigeer than that, it didn't boot. Works for me on 8GB USB sticks. It is possible that the stick you've tried has some issues with the Solaris USB drivers, and needs to have one of the workarounds from the scsa2usb.con

Re: [zfs-discuss] Install and boot from USB stick?

2009-07-31 Thread tore
Well, here is the error: Cant seem to find anything on google. Only thing i found were some source code where it seems this error accour: http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/uts/common/io/scsi/impl/scsi_subr.c Suggestions? -- This message posted from opensolaris.org

Re: [zfs-discuss] Best ways to contribute WAS: Fed up with ZFS causing data loss

2009-07-31 Thread m...@bruningsystems.com
Hi Ross, Ross wrote: #3 zfs unlike other things like the build system are extremely well documented. There are books on it, code to read and even instructors (Max Bruning) who can teach you about the internals. My project even rganized a free online training for this Again, brilli

Re: [zfs-discuss] sam-fs on zfs-pool

2009-07-31 Thread Jim Klimov
Concerning the reservations, here's a snip from "man zfs": The reservation is kept equal to the volume's logical size to prevent unexpected behavior for consumers. Without the reservation, the volume could run out of space, resulting in undefined

Re: [zfs-discuss] sam-fs on zfs-pool

2009-07-31 Thread Jim Klimov
> If I understand you right it is as you said. > Here's an example and you can see what happened. > The sam-fs is filled to only 6% and the zvol ist full. I'm afraid I was not clear with my question, so I'd elaborate, then. It remains standing as: during this situation, can you write new data int

Re: [zfs-discuss] Fed up with ZFS causing data loss

2009-07-31 Thread Larry Becke
sd is the older scsi-disk driver, ssd is the new scsi-disk driver (part of the leadville driver package) that allowed for more than 256 luns per target... We've had systems that used the sd drivers until we upgraded to newer, sun provided drivers for qlogic / emulex cards, which then were using

Re: [zfs-discuss] Fed up with ZFS causing data loss

2009-07-31 Thread Larry Becke
You might check the hardware compatibility list at Sun's site.. It might list the driver that will be used for the card your looking at... I'm not sure, it's been a while since I've looked at it... -- This message posted from opensolaris.org ___ zfs-di

Re: [zfs-discuss] Fed up with ZFS causing data loss

2009-07-31 Thread Ross
Heh, that's one thing I love about Linux & Solaris - the amount of info you can find if you know what you're doing is scary. However, while that will work for the Marvell SATA card I do have fitted in a server, it's not going to help for the others - they are all items I'm researching for our n

Re: [zfs-discuss] Install and boot from USB stick?

2009-07-31 Thread Pablo Méndez Hernández
Hi: On Fri, Jul 31, 2009 at 07:54, Jürgen Keil wrote: >> The GRUB menu is presented, no problem there, and >> then the opensolaris progress bar. But im unable to >> find a way to view any details on whats happening >> there. The progress bar just keep scrolling and >> scrolling. > > Press the ESC

[zfs-discuss] How Virtual Box handles the IO

2009-07-31 Thread Russel
After all the discussion here about VB, and all the finger pointing I raised a bug on VB about flushing. Remember I am using RAW disks via the SATA emulation in VB the disks are WD 2TB drives. Also remember the HOST machine NEVER crashed or stopped. BUT the guest OS OpenSolaris was hung and so I

Re: [zfs-discuss] Fed up with ZFS causing data loss

2009-07-31 Thread Ross
> you could have tried "man sd" and "man ssd" D'oh. I'm far too used to downloading documentation online... when you come from a windows background having driver manuals on your system is rather unexpected :) Thanks James. -- This message posted from opensolaris.org __

Re: [zfs-discuss] Fed up with ZFS causing data loss

2009-07-31 Thread Larry Becke
Where to find information?Do some searching... 1st off, run through the drivers loaded via modinfo - look to see if anything there is specific to your card. prtconf -v | pg - again, looking for your controller card... once you find it - look at the driver listed or tied to it, or failing t

Re: [zfs-discuss] Lundman home NAS

2009-07-31 Thread Nathan Fiedler
Yes, please write more about this. The photos are terrific and I appreciate the many useful observations you've made. For my home NAS I chose the Chenbro ES34069 and the biggest problem was finding a SATA/PCI card that would work with OpenSolaris and fit in the case (technically impossible without

Re: [zfs-discuss] surprisingly poor performance

2009-07-31 Thread Roch Bourbonnais
The things I'd pay most attention to would be all single threaded 4K, 32K, and 128K writes to the raw device. Maybe sure the SSD has a capacitor and enable the write cache on the device. -r Le 5 juil. 09 à 12:06, James Lever a écrit : On 04/07/2009, at 3:08 AM, Bob Friesenhahn wrote: I

Re: [zfs-discuss] article on btrfs, comparison with zfs

2009-07-31 Thread Mario Goebbels
An introduction to btrfs, from somebody who used to work on ZFS: http://www.osnews.com/story/21920/A_Short_History_of_btrfs *very* interesting article.. Not sure why James didn't directly link to it, but courteous of Valerie Aurora (formerly Henson) http://lwn.net/Articles/342892/ I'm trying

Re: [zfs-discuss] Lundman home NAS

2009-07-31 Thread Thomas Burgess
i used a 4u case for mine, it's MASSIVE...i used this case here http://members.multiweb.nl/nan1/img/norco05.jpg http://www.newegg.com/Product/Product.aspx?Item=N82E16811219021 it's an awesome case for the money...i plan to build another one soon. On Fri, Jul 31, 2009 at 8:22 AM, Jorgen Lundma

[zfs-discuss] Lundman home NAS

2009-07-31 Thread Jorgen Lundman
I have assembled my home RAID finally, and I think it looks rather good. http://www.lundman.net/gallery/v/lraid5/p1150547.jpg.html Feedback is welcome. I have yet to do proper speed tests, I will do so in the coming week should people be interested. Even though I have tried to use only exis

Re: [zfs-discuss] sam-fs on zfs-pool

2009-07-31 Thread Tobias Exner
Hi Jim, first of all I'm sure this behaviour is a bug or has been changed sometime in the past, because I've used this configuration a lot of times. If I understand you right it is as you said. Here's an example and you can see what happened. The sam-fs is filled to only 6% and the zvol ist

Re: [zfs-discuss] Fed up with ZFS causing data loss

2009-07-31 Thread James C. McPherson
On Thu, 30 Jul 2009 23:55:19 -0700 (PDT) Ross wrote: > Yes, I did miss that one, but could you remind me what exactly are the > sd and ssd drivers? I can find lots of details about configuring them, > but no basic documentation telling me what they are. you could have tried "man sd" and "man ss

Re: [zfs-discuss] sam-fs on zfs-pool

2009-07-31 Thread Jim Klimov
Hello tobex, While the original question may have been answered by posts above, I'm interested: when you say "according to zfs list the zvol is 100% full", does it only mean that it uses all 20Gb on the pool (like a non-sparse uncompressed file), or does it also imply that you can't write int

Re: [zfs-discuss] Fed up with ZFS causing data loss

2009-07-31 Thread Ross
Interesting, thanks Miles. Up to this week I've never heard that any of this was tunable, but I'm more than happy to go in that direction if that's the way to do it. :-) Can anybody point me in the direction of where I find documentation for tunables for the Marvell SATA driver, the LSI SAS dr

Re: [zfs-discuss] [n/zfs-discuss] Strange speeds with x4500, Solaris 10 10/08

2009-07-31 Thread Ross
> Ross wrote: > > Great idea, much neater than most of my suggestions > too :-) > > > What is? Please keep some context for those of us on > email! x25-e drives as a mirrored boot volume on an x4500, partitioning off some of the space for the slog. -- This message posted from opensolaris.org

Re: [zfs-discuss] Fed up with ZFS causing data loss

2009-07-31 Thread Robert Milkowski
Hi, Most of the time while waiting on a disk to fail is spent in disk drivers and not ZFS itself. If you want to lower the timeouts than you can do so by configuring different timeouts for sd. ssd or any other driver you are using. See http://wikis.sun.com/display/StorageDev/Retry-Reset+Parame

Re: [zfs-discuss] feature proposal

2009-07-31 Thread Tristan Ball
Because it means you can create zfs snapshots from a non solaris/non local client... Like a linux nfs client, or a windows cifs client. T dick hoogendijk wrote: On Wed, 29 Jul 2009 17:34:53 -0700 Roman V Shaposhnik wrote: On the read-write front: wouldn't it be cool to be able to snapsh

Re: [zfs-discuss] feature proposal

2009-07-31 Thread Gaëtan Lehmann
Le 31 juil. 09 à 10:24, dick hoogendijk a écrit : On Wed, 29 Jul 2009 17:34:53 -0700 Roman V Shaposhnik wrote: On the read-write front: wouldn't it be cool to be able to snapshot things by: $ mkdir .zfs/snapshot/ I've followed this thread but I fail to see the advantages of this. I gues

Re: [zfs-discuss] feature proposal

2009-07-31 Thread Andrew Gabriel
dick hoogendijk wrote: On Wed, 29 Jul 2009 17:34:53 -0700 Roman V Shaposhnik wrote: On the read-write front: wouldn't it be cool to be able to snapshot things by: $ mkdir .zfs/snapshot/ I've followed this thread but I fail to see the advantages of this. I guess I m

Re: [zfs-discuss] feature proposal

2009-07-31 Thread dick hoogendijk
On Wed, 29 Jul 2009 17:34:53 -0700 Roman V Shaposhnik wrote: > On the read-write front: wouldn't it be cool to be able to snapshot > things by: > $ mkdir .zfs/snapshot/ I've followed this thread but I fail to see the advantages of this. I guess I miss something here. Can you explain to me wh

Re: [zfs-discuss] Best ways to contribute WAS: Fed up with ZFS causing data loss

2009-07-31 Thread Ross
I'm going to reply because I think you're being a little short sighted here. In response to your 'patches welcome' comment. I'd love to submit a patch, but since I've had no programming training and my only real experience is with Visual Basic, I doubt I'm going to be much use. I'm more likely

Re: [zfs-discuss] [n/zfs-discuss] Strange speeds with x4500, Solaris 10 10/08

2009-07-31 Thread Ian Collins
Ross wrote: Great idea, much neater than most of my suggestions too :-) What is? Please keep some context for those of us on email! -- Ian. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-