[zfs-discuss] Lackluster ZFS performance trials using various ZIL and L2ARC configurations...

2009-01-14 Thread Gray Carper
Hey, all! Using iozone (with the sequential read, sequential write, random read, and random write categories), on a Sun X4240 system running OpenSolaris b104 (NexentaStor 1.1.2, actually), we recently ran a number of relative performance tests using a few ZIL and L2ARC configurations (meant to try

Re: [zfs-discuss] SDXC and the future of ZFS

2009-01-14 Thread Chris Ridd
On 14 Jan 2009, at 10:01, Andrew Gabriel wrote: > DOS/FAT filesystem implementations in appliances can be found in less > than 8K code and data size (mostly that's code). Limited functionality > implementations can be smaller than 1kB size. Just for the sake of comparison, how big is the limited

Re: [zfs-discuss] (no subject)

2009-01-14 Thread JZ
Ok, it's also important, in many many cases, but not all - taking the problem into tomorrow is also not very good. IMHO, maybe all you smart open folks that know all about this and that, but dunno how to fix your darn email address to appear "zfs user" on the darn list discussion? do I have to s

Re: [zfs-discuss] zfs send and file fragmentation

2009-01-14 Thread JZ
Yes, that's more like it. hahahahahahahaha, it's all happy. chatting on, Sun folks. best, z - Original Message - From: "David Shirley" To: Sent: Wednesday, January 14, 2009 11:44 PM Subject: Re: [zfs-discuss] zfs send and file fragmentation > CoW = copy on write, a ZFS feature, whic

Re: [zfs-discuss] zfs send and file fragmentation

2009-01-14 Thread David Shirley
CoW = copy on write, a ZFS feature, which makes snapshots easier to maintain. However it also introduces file fragmentation in database datafiles. > Sorry, I just cannot tell how is this name related to > Sun, IMHO. > > In my days and enterprise environments, lots of CoWs > are stored in > rela

Re: [zfs-discuss] zfs send and file fragmentation

2009-01-14 Thread JZ
Sorry, I just cannot tell how is this name related to Sun, IMHO. In my days and enterprise environments, lots of CoWs are stored in relational databases. I dunno where the hell you come from. best, z - Original Message - From: "David Shirley" To: Sent: Wednesday, January 14, 2009 1

[zfs-discuss] zfs send and file fragmentation

2009-01-14 Thread David Shirley
Hi Guys, We are in the process of using snapshots and zfs send/recv to copy terrabytes of database datafiles. Due to CoW not being very friendly to databases we have a LOT of fragmentation on the datafiles. This really slows down zfs send. Is it possible (or already done) to have zfs send/rec

Re: [zfs-discuss] What are the usual suspects in data errors?

2009-01-14 Thread Richard Elling
well, since this is part of how I make my living, or at least what is in my current job description... Gary Mills wrote: > I realize that any error can occur in a storage subsystem, but most > of these have an extremely low probability. I'm interested in this > discussion in only those that do oc

Re: [zfs-discuss] What are the usual suspects in data errors?

2009-01-14 Thread JZ
Folks, I am very sorry, for don't know how to be not misleading. I was not challenging the Ten Commandments. That is a good code. And maybe the first one we need to follow. Vain and pride and arrogance and courage are all very different, but very similar. Before you can truely understand the cod

Re: [zfs-discuss] What are the usual suspects in data errors?

2009-01-14 Thread JZ
folks, please, chatting on - don't make me stop you, we are all open folks. [but darn] ok, thank you much for the anticipation for something actually useful, here is another thing I shared with MS Storage but not with you folks yet -- we win with real advantages, not lies, not scales, but only

Re: [zfs-discuss] What are the usual suspects in data errors?

2009-01-14 Thread JZ
darn, Darren, learning fast! best, z - Original Message - From: "A Darren Dunham" To: Sent: Wednesday, January 14, 2009 6:15 PM Subject: Re: [zfs-discuss] What are the usual suspects in data errors? > On Wed, Jan 14, 2009 at 04:39:03PM -0600, Gary Mills wrote: >> I realize that any

Re: [zfs-discuss] What are the usual suspects in data errors?

2009-01-14 Thread A Darren Dunham
On Wed, Jan 14, 2009 at 04:39:03PM -0600, Gary Mills wrote: > I realize that any error can occur in a storage subsystem, but most > of these have an extremely low probability. I'm interested in this > discussion in only those that do occur occasionally, and that are > not catastrophic. What level

Re: [zfs-discuss] OpenSolaris better Than Solaris10u6 with requards to ARECA Raid Card

2009-01-14 Thread James C. McPherson
Just to let everybody know, I'm in touch with Charles and we're working on this problem offline. We'll report back to the list when we've got something to talk about. James On Wed, 14 Jan 2009 08:37:44 -0800 (PST) Charles Wright wrote: > Here's an update: > > I thought that the error message

Re: [zfs-discuss] ZFS on partitions

2009-01-14 Thread Mattias Pantzare
>> >> ZFS will always flush the disk cache at appropriate times. If ZFS >> thinks that is alone it will turn the write cache on the disk on. > > I'm not sure if you're trying to argue or agree. If you're trying to argue, > you're going to have to do a better job than "zfs will always flush disk >

[zfs-discuss] zpool upgrade while some disks are faulted

2009-01-14 Thread Amer Ather
What happens when zpool upgrade is run on a zpool that has some faulted disks? I guess it is safe to run zpool upgrade while zpool is online. Thanks, ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/z

[zfs-discuss] What are the usual suspects in data errors?

2009-01-14 Thread Gary Mills
I realize that any error can occur in a storage subsystem, but most of these have an extremely low probability. I'm interested in this discussion in only those that do occur occasionally, and that are not catastrophic. Consider the common configuration of two SCSI disks connected to the same HBA

Re: [zfs-discuss] questions on zfs backups

2009-01-14 Thread Ian Collins
Mark Shellenbaum wrote: > Ian Collins wrote: >> satya wrote: >>> Any idea if we can use pax command to backup ZFS acls? will -p >>> option of pax utility do the trick? >> pax should, according to >> http://docs.sun.com/app/docs/doc/819-5461/gbchx?a=view >> > > pax isn't ACL aware. It does handle ex

Re: [zfs-discuss] questions on zfs backups

2009-01-14 Thread Mark Shellenbaum
Ian Collins wrote: > satya wrote: >> Any idea if we can use pax command to backup ZFS acls? will -p option of >> pax utility do the trick? >> >> > pax should, according to > http://docs.sun.com/app/docs/doc/819-5461/gbchx?a=view > pax isn't ACL aware. It does handle extended attributes, th

[zfs-discuss] help please - Zpool import : I/O error

2009-01-14 Thread Mathieu
Hi, I have a big problem with my ZFS drive. After a kernel panic, I cannot import the pool anymore : --- => zpool status no pools available => zpool list no pools available -

Re: [zfs-discuss] questions on zfs backups

2009-01-14 Thread Ian Collins
satya wrote: > Any idea if we can use pax command to backup ZFS acls? will -p option of pax > utility do the trick? > > pax should, according to http://docs.sun.com/app/docs/doc/819-5461/gbchx?a=view tar and cpio do. It should be simple enough to test, just generate an archive and have a lo

Re: [zfs-discuss] ZFS on partitions

2009-01-14 Thread Richard Elling
?? Tim wrote: > On Wed, Jan 14, 2009 at 2:40 PM, Mattias Pantzare > wrote: > > On Wed, Jan 14, 2009 at 20:03, Tim > wrote: > > > > > > On Tue, Jan 13, 2009 at 6:26 AM, Brian Wilson > mailto:bfwil...@doit.wisc.edu>> >

Re: [zfs-discuss] questions on zfs backups

2009-01-14 Thread satya
Any update on star ability to backup ZFS ACLs? Any idea if we can use pax command to backup ZFS acls? will -p option of pax utility do the trick? -satya -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.o

Re: [zfs-discuss] ZFS on partitions

2009-01-14 Thread Tim
On Wed, Jan 14, 2009 at 2:40 PM, Mattias Pantzare wrote: > On Wed, Jan 14, 2009 at 20:03, Tim wrote: > > > > > > On Tue, Jan 13, 2009 at 6:26 AM, Brian Wilson > > wrote: > >> > >> Does creating ZFS pools on multiple partitions on the same physical > drive > >> still run into the performance and

Re: [zfs-discuss] ZFS on partitions

2009-01-14 Thread Tim
On Wed, Jan 14, 2009 at 2:48 PM, Miles Nordin wrote: > but, the write cache on/offness is a stateful setting stored on the > disk platter, right? so it survives reboots of the disk, and ZFS > doesn't turn it off, and UFS arguably should turn it off but > doesn't---once you've dedicated a disk to

Re: [zfs-discuss] ZFS on partitions

2009-01-14 Thread Miles Nordin
but, the write cache on/offness is a stateful setting stored on the disk platter, right? so it survives reboots of the disk, and ZFS doesn't turn it off, and UFS arguably should turn it off but doesn't---once you've dedicated a disk to ZFS, you have to turn the write cache off yourself somehow usi

Re: [zfs-discuss] ZFS on partitions

2009-01-14 Thread Mattias Pantzare
On Wed, Jan 14, 2009 at 20:03, Tim wrote: > > > On Tue, Jan 13, 2009 at 6:26 AM, Brian Wilson > wrote: >> >> Does creating ZFS pools on multiple partitions on the same physical drive >> still run into the performance and other issues that putting pools in slices >> does? > > > Is zfs going to own

Re: [zfs-discuss] ZFS on partitions

2009-01-14 Thread Tim
On Tue, Jan 13, 2009 at 6:26 AM, Brian Wilson wrote: > > Does creating ZFS pools on multiple partitions on the same physical drive > still run into the performance and other issues that putting pools in slices > does? > Is zfs going to own the whole drive or not? The *issue* is that zfs will no

Re: [zfs-discuss] Why is st_size of a zfs directory equal to the

2009-01-14 Thread David Collier-Brown
"Richard L. Hamilton" wrote: >> I did find the earlier discussion on the subject (someone e-mailed me that >> there had been >> such). It seemed to conclude that some apps are statically linked with old >> scandir() code >> that (incorrectly) assumed that the number of directory entries could b

Re: [zfs-discuss] Solaris destroys large discs?? Bug in install?

2009-01-14 Thread Orvar Korvar
Ok, ive upgraded mother board's BIOS. Installed ZFS with b105 over the existing UFS b104. It works better now. The disk sounds almost like normal, barely audiable. But sometimes it goes back and sounds like hell. Very seldom now. I dont get it. Why does UFS do this? Hmm... -- This message poste

Re: [zfs-discuss] Why is st_size of a zfs directory equal to the

2009-01-14 Thread Joerg Schilling
"Richard L. Hamilton" wrote: > I did find the earlier discussion on the subject (someone e-mailed me that > there had been > such). It seemed to conclude that some apps are statically linked with old > scandir() code > that (incorrectly) assumed that the number of directory entries could be >

Re: [zfs-discuss] OpenSolaris better Than Solaris10u6 with requards to ARECA Raid Card

2009-01-14 Thread Richard Elling
Charles Wright wrote: > Here's an update: > > I thought that the error message > arcmsr0: too many outstanding commands > might be due to a Scsi queue being over ran > Rather than messing with sd_max_throttle, you might try changing the number of iops ZFS will queue to a vdev. IMHO this is

Re: [zfs-discuss] Why is st_size of a zfs directory equal to the

2009-01-14 Thread Richard L. Hamilton
> "Richard L. Hamilton" wrote: > > > Cute idea, maybe. But very inconsistent with the > size in blocks (reported by ls -dls dir). > > Is there a particular reason for this, or is it one > of those just for the heck of it things? > > > > Granted that it isn't necessarily _wrong_. I just > checke

Re: [zfs-discuss] OpenSolaris better Than Solaris10u6 with requards to ARECA Raid Card

2009-01-14 Thread Charles Wright
Here's an update: I thought that the error message arcmsr0: too many outstanding commands might be due to a Scsi queue being over ran The areca driver has #*define*ARCMSR_MAX_OUTSTANDING_CMD 256 What might be happe

Re: [zfs-discuss] OpenSolaris better Than Solaris10u6 with requards to ARECA Raid Card

2009-01-14 Thread Charles Wright
Thanks for the info.I'm running the Latest Firmware for my card: V1.46 with BOOT ROM Version V1.45 Could you tell me how you have your card configured? Are you using JBOD, RAID, or Pass Through? What is your Max SATA mode set too? How may drives do you have attached? What is your ZFS

Re: [zfs-discuss] mirror rpool

2009-01-14 Thread Richard Elling
mijenix wrote: > yes, that's the way zpool likes it > > I think I've to understand how (Open)Solaris create disks or how > the partition thing works under OSol. Do you know any guide or howto? > We've tried to make sure the ZFS Admin Guide covers these things, including the procedure for mirro

Re: [zfs-discuss] zpool export+import doesn't maintain snapshot

2009-01-14 Thread Nico Sabbi
On Wednesday 14 January 2009 16:49:48 cindy.swearin...@sun.com wrote: > Nico, > > If you want to enable snapshot display as in previous releases, > then set this parameter on the pool: > > # zpool set listsnapshots=on pool-name > > Cind > thanks, it works as I need. ___

Re: [zfs-discuss] zpool export+import doesn't maintain snapshot

2009-01-14 Thread Cindy . Swearingen
Nico, If you want to enable snapshot display as in previous releases, then set this parameter on the pool: # zpool set listsnapshots=on pool-name Cind Nico Sabbi wrote: > On Wednesday 14 January 2009 11:44:56 Peter Tribble wrote: > >>On Wed, Jan 14, 2009 at 10:11 AM, Nico Sabbi > > wrote: >

Re: [zfs-discuss] Why is st_size of a zfs directory equal to the number of entries?

2009-01-14 Thread Joerg Schilling
"Richard L. Hamilton" wrote: > Cute idea, maybe. But very inconsistent with the size in blocks (reported by > ls -dls dir). > Is there a particular reason for this, or is it one of those just for the > heck of it things? > > Granted that it isn't necessarily _wrong_. I just checked SUSv3 for

Re: [zfs-discuss] zfs & iscsi sustained write performance

2009-01-14 Thread milosz
sorry, that 60% statement was misleading... i will VERY OCCASIONALLY get a spike to 60%, but i'm averaging more like 15%, with the throughput often dropping to zero for several seconds at a time. that iperf test more or less demonstrates it isn't a network problem, no? also i have been using mi

Re: [zfs-discuss] Reboot during import (now with kernel panic log)

2009-01-14 Thread Tobbe Lundberg
I have now installed OpenSolaris 2008.11 to a harddrive so I could catch the shutdown messages that gets written to /var/adm/messages. When my computer reboots I get a kernel panic and this is the relevant part of the log: (also posted here if you don't like the linebreaks: http://paste2.org/p/

[zfs-discuss] Why is st_size of a zfs directory equal to the number of entries?

2009-01-14 Thread Richard L. Hamilton
Cute idea, maybe. But very inconsistent with the size in blocks (reported by ls -dls dir). Is there a particular reason for this, or is it one of those just for the heck of it things? Granted that it isn't necessarily _wrong_. I just checked SUSv3 for stat() and sys/stat.h, and it appears tha

Re: [zfs-discuss] mirror rpool

2009-01-14 Thread Johan Hartzenberg
On Wed, Jan 14, 2009 at 10:58 AM, mijenix wrote: > yes, that's the way zpool likes it > > I think I've to understand how (Open)Solaris create disks or how > the partition thing works under OSol. Do you know any guide or howto? > http://initialprogramload.blogspot.com/2008/07/how-solaris-disk-dev

Re: [zfs-discuss] OpenSolaris better Than Solaris10u6 with requards to ARECA Raid Card

2009-01-14 Thread Johan Hartzenberg
There is an update in build 105, but it is only pertaining to the Raid Management tool: Issues Resolved: BUG/RFE:6776690Areca raid management util doesn't work on solaris Files Changed: update:usr/src/uts/intel/io/scsi/adapters/

Re: [zfs-discuss] OpenSolaris better Than Solaris10u6 with requards to ARECA Raid Card

2009-01-14 Thread Orvar Korvar
Ive read about some Areca bug(?) being fixed in SXCE b105? -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Re: [zfs-discuss] zpool export+import doesn't maintain snapshot

2009-01-14 Thread Nico Sabbi
On Wednesday 14 January 2009 11:44:56 Peter Tribble wrote: > On Wed, Jan 14, 2009 at 10:11 AM, Nico Sabbi wrote: > > Hi, > > I wanted to migrate a virtual disk from a S10U6 to OpenSolaris > > 2008.11. > > In the first machine I rebooted to single-user and ran > > $ zpool export disco > > > > then

Re: [zfs-discuss] zpool export+import doesn't maintain snapshot

2009-01-14 Thread Peter Tribble
On Wed, Jan 14, 2009 at 10:11 AM, Nico Sabbi wrote: > Hi, > I wanted to migrate a virtual disk from a S10U6 to OpenSolaris > 2008.11. > In the first machine I rebooted to single-user and ran > $ zpool export disco > > then copied the disk files to the target VM, rebooted as single-user > and ran >

Re: [zfs-discuss] Odd network performance with ZFS/CIFS

2009-01-14 Thread fredrick phol
Turning off windows quality of service seems to have given me sustained write speeds hitting about 90MB/s using cifs wites to the ISCSI device are hitting about 40mb/s but the network utilisation graph is very jagged, it's just a constant spike to 60% utilisation then a drop to 0 and repeat I

[zfs-discuss] zpool export+import doesn't maintain snapshot

2009-01-14 Thread Nico Sabbi
Hi, I wanted to migrate a virtual disk from a S10U6 to OpenSolaris 2008.11. In the first machine I rebooted to single-user and ran $ zpool export disco then copied the disk files to the target VM, rebooted as single-user and ran $ zpool import disco The disc was mounted, but none of the hundreds

Re: [zfs-discuss] ZFS vs ZFS + HW raid? Which is best?

2009-01-14 Thread Ashish Nabira
Hi; It's all about performance when you consider H/W raid. It will put extra overhead on your OS . As ZFS is fast, I will always prefer ZFS based RAID. It will also save cost of RAID card. Ashish Nabira nab...@sun.com http://sun.com Work is worship." On 13-J

Re: [zfs-discuss] mirror rpool

2009-01-14 Thread JZ
thank you, at least the list is alive. ok, let me provide some comments beyond IT, since the zpool likes it. knowledge is power. truth is knowledge. one can only understand truth if one can handle truth. and that is through learning, and reasoning. when you possess enough knowledge, you will be a

Re: [zfs-discuss] SDXC and the future of ZFS

2009-01-14 Thread Andrew Gabriel
Roch Bourbonnais wrote: > Le 12 janv. 09 à 17:39, Carson Gaspar a écrit : > > >> Joerg Schilling wrote: >> >>> Fabian Wörner wrote: >>> >>> my post was not to start a discuss gpl<>cddl. It just an idea to promote ZFS and OPENSOLARIS If it was against anything than

Re: [zfs-discuss] zfs & iscsi sustained write performance

2009-01-14 Thread Roch
milosz writes: > iperf test coming out fine, actually... > > iperf -s -w 64k > > iperf -c -w 64k -t 900 -i 5 > > [ ID] Interval Transfer Bandwidth > [ 5] 0.0-899.9 sec 81.1 GBytes774 Mbits/sec > > totally steady. i could probably implement some tweaks to improve it,

Re: [zfs-discuss] ZFS vs HardWare raid - data integrity?

2009-01-14 Thread JZ
Folks, what can I post to the list to make the discussion go on? Is this what you folks want to see? which I shared with King and High but not you folks? http://www.excelsioritsolutions.com/jz/jzbrush/jzbrush.htm This is not even IT stuff so that I never thought I should post this to the list...

Re: [zfs-discuss] mirror rpool

2009-01-14 Thread mijenix
yes, that's the way zpool likes it I think I've to understand how (Open)Solaris create disks or how the partition thing works under OSol. Do you know any guide or howto? -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discu