Re: [zfs-discuss] ZFS pegging the system

2009-07-17 Thread Louis-Frédéric Feuillette
On Thu, 2009-07-16 at 10:51 -0700, Jeff Haferman wrote: > We have a SGE array task that we wish to run with elements 1-7. > Each task generates output and takes roughly 20 seconds to 4 minutes > of CPU time. We're doing them on a machine with about 144 8-core nodes, > and we've divvied the

Re: [zfs-discuss] deduplication

2009-07-17 Thread Brandon High
The keynote was given on Wednesday. Any more willingness to discuss dedup on the list now? -B -- Brandon High : bh...@freaks.com ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Re: [zfs-discuss] Understanding SAS/SATA Backplanes and Connectivity

2009-07-17 Thread Miles Nordin
> "rl" == Rob Logan writes: rl> Is there some magic that load balances the 4 SAS ports as this rl> shows up as one "scsi-bus"? The LSI card is not SATA framework. I've the impression drive enumeration and topology is handled by the proprietary firmware on the card, so it's likely th

Re: [zfs-discuss] ZFS pegging the system

2009-07-17 Thread Scott Laird
Have each node record results locally, and then merge pair-wise until a single node is left with the final results? If you can do merges that way while reducing the size of the result set, then that's probably going to be the most scalable way to generate overall results. On Thu, Jul 16, 2009 at

Re: [zfs-discuss] Understanding SAS/SATA Backplanes and Connectivity

2009-07-17 Thread Will Murnane
On Fri, Jul 17, 2009 at 11:43, Adam Sherman wrote: > On 17-Jul-09, at 1:45 , Will Murnane wrote: >>> >>> I'm looking at the LSI SAS3801X because it seems to be what Sun OEMs for >>> my >>> X4100s: >> >> If you're given the choice (i.e., you have the M2 revision), PCI >> Express is probably the bus

Re: [zfs-discuss] Can't offline a RAID-Z2 device: "no valid replica"

2009-07-17 Thread Cindy . Swearingen
Hi Laurent, Yes, you should able to offline a faulty device in a redundant configuration as long as enough devices are available to keep the pool redundant. On my Solaris Nevada system (latest bits), injecting a fault into a disk in a RAID-Z configuration and then offlining a disk works as expec

Re: [zfs-discuss] Understanding SAS/SATA Backplanes and Connectivity

2009-07-17 Thread Adam Sherman
On 17-Jul-09, at 1:45 , Will Murnane wrote: I'm looking at the LSI SAS3801X because it seems to be what Sun OEMs for my X4100s: If you're given the choice (i.e., you have the M2 revision), PCI Express is probably the bus to go with. It's basically the same card, but on a faster bus. But ther

[zfs-discuss] triple-parity: RAID-Z3

2009-07-17 Thread David Magda
Don't hear about triple-parity RAID that often: > Author: Adam Leventhal > Repository: /hg/onnv/onnv-gate > Latest revision: 17811c723fb4f9fce50616cb740a92c8f6f97651 > Total changesets: 1 > Log message: > 6854612 triple-parity RAID-Z http://mail.opensolaris.org/pipermail/onnv-notify/2009-July/009

[zfs-discuss] ZFS as a native cluster file system

2009-07-17 Thread Michael Sichler
I understand that ZFS in not a native cluster file system that permits concurrent access to multiple hosts as noted in the ZFS FAQs. In the FAQ it states that in the long term, it will be investigated. ZFS is an excellent file system without the clustering feature, but if it had it, it would pu

[zfs-discuss] assertion failure

2009-07-17 Thread Thomas Maier-Komor
Hi, I am just having trouble with my opensolaris in a virtual box. It refuses to boot with the following crash dump: panic[cpu0]/thread=d5a3edc0: assertion failed: 0 == dmu_buf_hold_array(os, object, offset, size, FALSE, FTAG, &numbufs, &dbp), file: ../../common/fs/zfs/dmu.c, line: 614 d5a3eb08