to gmirror or to ZFS

2013-07-15 Thread aurfalien
... thats the question :) At any rate, I'm building a rather large 100+TB NAS using ZFS. However for my OS, should I also ZFS or simply gmirror as I've a dedicated pair of 256GB SSD drives for it. I didn't ask for SSD sys drives, this system just came with em. This is more of a best

Re: to gmirror or to ZFS

2013-07-15 Thread aurfalien
On Jul 15, 2013, at 9:23 PM, Warren Block wrote: On Mon, 15 Jul 2013, aurfalien wrote: ... thats the question :) At any rate, I'm building a rather large 100+TB NAS using ZFS. However for my OS, should I also ZFS or simply gmirror as I've a dedicated pair of 256GB SSD drives

Re: to gmirror or to ZFS

2013-07-16 Thread aurfalien
On Jul 16, 2013, at 2:41 AM, Shane Ambler wrote: On 16/07/2013 14:41, aurfalien wrote: On Jul 15, 2013, at 9:23 PM, Warren Block wrote: On Mon, 15 Jul 2013, aurfalien wrote: ... thats the question :) At any rate, I'm building a rather large 100+TB NAS using ZFS. However for my OS

Odd behavior while booting off Install media for 9.1...

2013-07-16 Thread aurfalien
... sometimes I get a normal boot procedure were I can proceed to install. Other times I get the mountroot prompt and upon pressing enter, the system reboots. This seems random with the same hardware setup. I literally have to stare at the screen for it to finally push through to the install

gpart: table 'da0' is corrupt; operation not permitted

2013-07-16 Thread aurfalien
Hello again, Not happy to be posting so much lately especially being so new. I grabbed a few disks from a Mac and am using them for sys disks. Upon booting from an install CD into a shell, I type; gpart show and see several partitions; 34 78165293da0

Re: gpart: table 'da0' is corrupt; operation not permitted

2013-07-16 Thread aurfalien
On Jul 16, 2013, at 1:50 PM, Michael Sierchio wrote: On Tue, Jul 16, 2013 at 1:44 PM, aurfalien aurfal...@gmail.com wrote: Upon doing; gpart destroy da0 I get; gpart: Device busy crude but effective: DISK=da0 offset=`diskinfo $DISK | awk '{ print $4 - 131072 }'` dd

Re: gpart: table 'da0' is corrupt; operation not permitted

2013-07-16 Thread aurfalien
On Jul 16, 2013, at 3:01 PM, Warren Block wrote: On Tue, 16 Jul 2013, aurfalien wrote: On Jul 16, 2013, at 1:50 PM, Michael Sierchio wrote: On Tue, Jul 16, 2013 at 1:44 PM, aurfalien aurfal...@gmail.com wrote: Upon doing; gpart destroy da0 I get; gpart: Device busy crude

Re: to gmirror or to ZFS

2013-07-19 Thread aurfalien
On Jul 16, 2013, at 11:42 AM, Warren Block wrote: On Tue, 16 Jul 2013, aurfalien wrote: On Jul 16, 2013, at 2:41 AM, Shane Ambler wrote: I doubt that you would save any ram having the os on a non-zfs drive as you will already be using zfs chances are that non-zfs drives would only

ZFS trim patches

2013-07-19 Thread aurfalien
Hi, Is this; http://lists.freebsd.org/pipermail/freebsd-current/2012-September/036777.html ... available in the form of a patch for stable rels? Its ZFS TRIM support. - aurf ___ freebsd-questions@freebsd.org mailing list

TRIM and changing mount options

2013-07-23 Thread aurfalien
Hi, I've some what blindly followed a how to on installing FreeBSD 9.1 on a ZFS mirror. My typing is horrid so I simply ssh'd to a live CD env and pasted line by line as per the how to found here; http://wp.strahlert.net/wordpress/zfs-2/installing-freebsd-9-1-using-root-on-zfs-and-gpt-disks/

Re: TRIM and changing mount options

2013-07-23 Thread aurfalien
On Jul 23, 2013, at 7:55 PM, Dan Nelson wrote: In the last episode (Jul 23), aurfalien said: I've some what blindly followed a how to on installing FreeBSD 9.1 on a ZFS mirror. My typing is horrid so I simply ssh'd to a live CD env and pasted line by line as per the how to found here

Re: TRIM and changing mount options

2013-07-23 Thread aurfalien
On Jul 23, 2013, at 8:10 PM, kpn...@pobox.com wrote: On Tue, Jul 23, 2013 at 03:54:57PM -0700, aurfalien wrote: Hi, I've some what blindly followed a how to on installing FreeBSD 9.1 on a ZFS mirror. My typing is horrid so I simply ssh'd to a live CD env and pasted line by line

Re: TRIM and changing mount options

2013-07-24 Thread aurfalien
On Jul 24, 2013, at 9:01 AM, Dan Nelson wrote: In the last episode (Jul 23), aurfalien said: On Jul 23, 2013, at 7:55 PM, Dan Nelson wrote: In the last episode (Jul 23), aurfalien said: At any rate, could some one; a) Explain how I am loading my file system as I'm used to fstab? b) How

Re: TRIM and changing mount options

2013-07-24 Thread aurfalien
On Jul 24, 2013, at 9:01 AM, Dan Nelson wrote: In the last episode (Jul 23), aurfalien said: On Jul 23, 2013, at 7:55 PM, Dan Nelson wrote: In the last episode (Jul 23), aurfalien said: At any rate, could some one; a) Explain how I am loading my file system as I'm used to fstab? b) How

Re: TRIM and changing mount options

2013-07-24 Thread aurfalien
On Jul 24, 2013, at 12:51 PM, Alexandre Labarre wrote: Le mercredi 24 juillet 2013, aurfalien a écrit : On Jul 24, 2013, at 9:01 AM, Dan Nelson wrote: In the last episode (Jul 23), aurfalien said: On Jul 23, 2013, at 7:55 PM, Dan Nelson wrote: In the last episode (Jul 23), aurfalien

Re: TRIM and changing mount options

2013-07-25 Thread aurfalien
On Jul 24, 2013, at 12:51 PM, Alexandre Labarre wrote: Le mercredi 24 juillet 2013, aurfalien a écrit : On Jul 24, 2013, at 9:01 AM, Dan Nelson wrote: In the last episode (Jul 23), aurfalien said: On Jul 23, 2013, at 7:55 PM, Dan Nelson wrote: In the last episode (Jul 23), aurfalien

Re: TRIM and changing mount options

2013-07-26 Thread aurfalien
On Jul 25, 2013, at 9:15 PM, Trond Endrestøl wrote: On Thu, 25 Jul 2013 19:25-0700, aurfalien wrote: On Jul 24, 2013, at 12:51 PM, Alexandre Labarre wrote: Le mercredi 24 juillet 2013, aurfalien a écrit : On Jul 24, 2013, at 9:01 AM, Dan Nelson wrote: In the last episode (Jul 23

Re: TRIM and changing mount options

2013-07-26 Thread aurfalien
On Jul 25, 2013, at 9:15 PM, Trond Endrestøl wrote: On Thu, 25 Jul 2013 19:25-0700, aurfalien wrote: On Jul 24, 2013, at 12:51 PM, Alexandre Labarre wrote: Le mercredi 24 juillet 2013, aurfalien a écrit : On Jul 24, 2013, at 9:01 AM, Dan Nelson wrote: In the last episode (Jul 23

FusionIO - Extreme support, 9.1

2013-07-27 Thread aurfalien
Hi all, I've 2 IOExtreme 80GB cards that work as a stipe yielding 160GB. These cards use exceptionally fast high quality RAM. I called support about Centos6/FreeBSD support but they said nada. The cards do work in Centos6 and I suspect they just wanted to reduce support load, etc... Does

Re: dhclient and the LiveCD

2013-07-30 Thread aurfalien
On Jul 30, 2013, at 8:56 PM, Sam Fourman Jr. wrote: hello list, when using the bootonly.iso from the ftp servers... if you drop to a shell, use dhclient to obtain an ipaddress.. well you get one.. but you have no DNS, because I think dhclient can't write to /etc/resolv.conf what is

Re: learn

2013-08-01 Thread aurfalien
On Aug 1, 2013, at 8:31 AM, Mike Jeays wrote: On Thu, 1 Aug 2013 14:21:34 +0100 (BST) Anton Shterenlikht me...@bris.ac.uk wrote: Date: Thu, 1 Aug 2013 14:29:25 +0200 From: herbert langhans w...@langhans.com.pl To: freebsd-questions@freebsd.org Subject: Re: learn The handbook is a

Re: TRIM on ZFS mirror

2013-08-02 Thread aurfalien
Confirmed in beta 1. - aurf On Aug 2, 2013, at 2:12 AM, John Andreasson wrote: Hi. I read that FreeBSD 9.2 will bring TRIM to ZFS. Does anyone know if this works even if the zpool is a mirror? John ___ freebsd-questions@freebsd.org mailing

Re: learn

2013-08-07 Thread aurfalien
: aurfalien aurfal...@gmail.com To: Mike Jeays mike.je...@rogers.com Cc: me...@bris.ac.uk; freebsd-questions@freebsd.org Sent: Thursday, 1 August 2013 9:25 PM Subject: Re: learn On Aug 1, 2013, at 8:31 AM, Mike Jeays wrote: On Thu, 1 Aug 2013 14:21:34 +0100 (BST) Anton Shterenlikht me

SolarFlare 10GB card

2013-08-12 Thread aurfalien
Hi all, We've a brand spanking new SolarFlare 10GB nic for use with our beast of a server. However the vendor support page says the driver is in beta. Has any one used this card in production? Thanks in advance, - aurf ___

Re: SolarFlare 10GB card

2013-08-12 Thread aurfalien
On Aug 12, 2013, at 11:12 AM, Roland Smith wrote: On Mon, Aug 12, 2013 at 10:47:27AM -0700, aurfalien wrote: Hi all, We've a brand spanking new SolarFlare 10GB nic for use with our beast of a server. However the vendor support page says the driver is in beta. If you look

Re: SolarFlare 10GB card

2013-08-13 Thread aurfalien
On Aug 12, 2013, at 11:12 AM, Roland Smith wrote: On Mon, Aug 12, 2013 at 10:47:27AM -0700, aurfalien wrote: Hi all, We've a brand spanking new SolarFlare 10GB nic for use with our beast of a server. However the vendor support page says the driver is in beta. If you look

Re: SolarFlare 10GB card

2013-08-13 Thread aurfalien
On Aug 12, 2013, at 11:12 AM, Roland Smith wrote: On Mon, Aug 12, 2013 at 10:47:27AM -0700, aurfalien wrote: Hi all, We've a brand spanking new SolarFlare 10GB nic for use with our beast of a server. However the vendor support page says the driver is in beta. If you look

Re: SolarFlare 10GB card

2013-08-13 Thread aurfalien
On Aug 13, 2013, at 8:30 PM, kpn...@pobox.com wrote: On Tue, Aug 13, 2013 at 07:13:57PM -0700, aurfalien wrote: On Aug 12, 2013, at 11:12 AM, Roland Smith wrote: On Mon, Aug 12, 2013 at 10:47:27AM -0700, aurfalien wrote: Hi all, We've a brand spanking new SolarFlare 10GB nic for use

Re: SolarFlare 10GB card

2013-08-14 Thread aurfalien
On Aug 14, 2013, at 5:49 AM, Mark Felder wrote: Don't use the driver on their website. It's very old. Use the driver that comes with FreeBSD 9.1 which you don't have to compile. Yea, that driver sux actually. But how would I compile the driver in 9.2RC1 as I see the source is included? -

Re: SolarFlare 10GB card

2013-08-14 Thread aurfalien
On Aug 14, 2013, at 11:34 AM, Mark Felder wrote: On Wed, 14 Aug 2013 10:51:03 -0700 aurfalien aurfal...@gmail.com wrote: On Aug 14, 2013, at 5:49 AM, Mark Felder wrote: Don't use the driver on their website. It's very old. Use the driver that comes with FreeBSD 9.1 which you don't

Re: SolarFlare 10GB card

2013-08-14 Thread aurfalien
On Aug 14, 2013, at 11:56 AM, Mark Felder wrote: On Wed, 14 Aug 2013 11:48:52 -0700 aurfalien aurfal...@gmail.com wrote: On Aug 14, 2013, at 11:34 AM, Mark Felder wrote: On Wed, 14 Aug 2013 10:51:03 -0700 aurfalien aurfal...@gmail.com wrote: On Aug 14, 2013, at 5:49 AM, Mark

Re: SolarFlare 10GB card

2013-08-14 Thread aurfalien
On Aug 14, 2013, at 12:20 PM, Mark Felder wrote: On Wed, 14 Aug 2013 12:05:56 -0700 aurfalien aurfal...@gmail.com wrote: Well my fine feathered friend, thats my dilemma. I do not see the SolarFlare via ifconfig. Now pciconf -l shows much stuff, even my built in 1Gb nics but not my

copying milllions of small files and millions of dirs

2013-08-15 Thread aurfalien
Hi all, Is there a faster way to copy files over NFS? Currently breaking up a simple rsync over 7 or so scripts which copies 22 dirs having ~500,000 dirs or files each. Obviously reading all the meta data is a PITA. Doin 10Gb/jumbos but in this case it don't make much of a hoot of a diff.

Re: copying milllions of small files and millions of dirs

2013-08-15 Thread aurfalien
On Aug 15, 2013, at 11:26 AM, Charles Swiger wrote: On Aug 15, 2013, at 11:13 AM, aurfalien aurfal...@gmail.com wrote: Is there a faster way to copy files over NFS? Probably. Ok, thanks for the specifics. Currently breaking up a simple rsync over 7 or so scripts which copies 22 dirs

Re: copying milllions of small files and millions of dirs

2013-08-15 Thread aurfalien
On Aug 15, 2013, at 11:52 AM, Charles Swiger wrote: On Aug 15, 2013, at 11:37 AM, aurfalien aurfal...@gmail.com wrote: On Aug 15, 2013, at 11:26 AM, Charles Swiger wrote: On Aug 15, 2013, at 11:13 AM, aurfalien aurfal...@gmail.com wrote: Is there a faster way to copy files over NFS

Re: copying milllions of small files and millions of dirs

2013-08-15 Thread aurfalien
On Aug 15, 2013, at 12:36 PM, Adam Vande More wrote: On Thu, Aug 15, 2013 at 1:13 PM, aurfalien aurfal...@gmail.com wrote: Hi all, Is there a faster way to copy files over NFS? Remove NFS from the setup. Yea, your mouth to gods ears. My BlueArc is an NFS NAS only box. So no way

Re: copying milllions of small files and millions of dirs

2013-08-15 Thread aurfalien
On Aug 15, 2013, at 1:35 PM, Roland Smith wrote: On Thu, Aug 15, 2013 at 11:13:25AM -0700, aurfalien wrote: Hi all, Is there a faster way to copy files over NFS? Can you log into your NAS with ssh or telnet? I can but thats a back channel link of 100Mb link. - aurf

Re: copying milllions of small files and millions of dirs

2013-08-15 Thread aurfalien
mirroring, that would likely do better than userland tools. I'd be interested to know whether tar is still worth using in this world of volume managers and SMP. Yes. On Aug 15, 2013, at 12:14 PM, aurfalien aurfal...@gmail.com wrote: [ ... ] Doin 10Gb/jumbos but in this case it don't make

zilstat.ksh

2013-08-15 Thread aurfalien
Hi all, I seem to have dtrace enabled on my system which is great. However the dirs on FreeBSDs site for enabling dtrace are really easy to follow so no big deal on that front. Hats off to the docs, very very simple and thorough. Lovin the FreeBSD community. Ok, hugs over. When I run

Myrinet 10Gb odd behavior

2013-08-16 Thread aurfalien
Hi, I've been suspecting my NIC is not up to par and notice this in the logs every few minutes; Aug 16 08:05:06 prometheus kernel: mxge0: slice 0 struck? ring state: Aug 16 08:05:06 prometheus kernel: mxge0: tx.req=1914503981 tx.done=1914503810, tx.queue_active=0 Aug 16 08:05:06 prometheus

Re: Myrinet 10Gb odd behavior

2013-08-16 Thread aurfalien
Forgot to mention my loader.conf; if_mxge_load=YES mxge_ethp_z8e_load=YES mxge_eth_z8e_load=YES mxge_rss_ethp_z8e_load=YES mxge_rss_eth_z8e_load=YES I blindly added these w/o thinking what they do. Should I simply only load the first line? - aurf On Aug 16, 2013, at 8:18 AM, aurfalien wrote

Re: Myrinet 10Gb odd behavior - SOLVED

2013-08-16 Thread aurfalien
On Aug 16, 2013, at 8:47 AM, aurfalien wrote: Forgot to mention my loader.conf; if_mxge_load=YES mxge_ethp_z8e_load=YES mxge_eth_z8e_load=YES mxge_rss_ethp_z8e_load=YES mxge_rss_eth_z8e_load=YES I blindly added these w/o thinking what they do. Should I simply only load the first

Re: Myrinet 10Gb odd behavior - SOLVED

2013-08-17 Thread aurfalien
, at 8:14 PM, iamatt wrote: Wow myricom still around... used to use the lanai stuff never on bsd though. All FDR Infiniband these days. Are you using the myrinet protocol or ethernet, just curious. Glad you got it working! On Aug 16, 2013 8:12 PM, aurfalien aurfal...@gmail.com wrote

Re: copying milllions of small files and millions of dirs

2013-08-19 Thread aurfalien
On Aug 19, 2013, at 10:41 AM, Mark Felder wrote: On Fri, Aug 16, 2013, at 1:46, Nicolas KOWALSKI wrote: On Thu, Aug 15, 2013 at 11:13:25AM -0700, aurfalien wrote: Is there a faster way to copy files over NFS? I would use find+cpio. This handles hard links, permissions, and in case

Proper way to share ZFS via NFS

2013-09-06 Thread aurfalien
Hi, Wondering whats the correct way to share ZFS, /etc/exports or via zfs commands which alter /etc/zfs/exports? I see a lot of both on line. Thanks in advance, - aurf ___ freebsd-questions@freebsd.org mailing list

Re: NFS file modes consistency among different operating systems

2013-09-16 Thread aurfalien
From your non MS$ clients, open a shell and type umask, what returns? Sounds like your default umask needs changing is all. I would suggest going with a umask of 775 and ensuring all ppl requiring mod access be group members of what you have settled on. - aurf On Sep 16, 2013, at 8:41 PM,

Re: NFS file modes consistency among different operating systems

2013-09-16 Thread aurfalien
When a file is modified by a user , Whats that users umask? - aurf ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: NFS file modes consistency among different operating systems

2013-09-16 Thread aurfalien
When a file is modified by a user Also curious whats that users group? - aurf ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to

Re: NFS file modes consistency among different operating systems

2013-09-17 Thread aurfalien
On Sep 16, 2013, at 11:27 PM, Mehmet Erol Sanliturk wrote: On Tue, Sep 17, 2013 at 1:28 AM, aurfalien aurfal...@gmail.com wrote: When a file is modified by a user , Whats that users umask? - aurf 755 Ok, well thats your answer. Only that user can mod the file, every one

SES tools and RRD perhaps?

2013-09-20 Thread aurfalien
Hi all, 1) Any one have a way to monitor fan speeds/temp of a JBOD connected via a SAS cable? 2) Any one integrate SES into something like Cacti or Zabbix? I know the later is sort of not FreeBSD specific but this list has many a guru lurking. Thanks in advance, - aurf

Re: SES tools and RRD perhaps?

2013-09-20 Thread aurfalien
On Sep 20, 2013, at 12:05 PM, Juan Bernhard wrote: El 20/09/2013 03:48 p.m., aurfalien escribió: Hi all, 1) Any one have a way to monitor fan speeds/temp of a JBOD connected via a SAS cable? You can get disk temperature by sysutils/smartmontools, and motherboard fans sysutils/mbmon

calculating vfs.zfs.l2arc_write_max and vfs.zfs.l2arc_write_boost

2013-09-24 Thread aurfalien
Hi all, Curious, since I have 3xSSDs capable of 550MB/s each as my L2ARC, should I add them up to roughly determine max and boost values? I couldn't find anything conclusive regarding this. Thanks in advance, - aurf ___

4K vs 512byte sector drives on Seagate Constellation E.2

2013-10-10 Thread aurfalien
Hi, I've a Seagate constellation ES.2 which supports 4K sectors but diskinfo shows it as 512bytes; da0 512 3000592982016 5860533168 0 0 364801 255 63 I understand that Seagate ships these drives to be compatible with 512byte sectors so that older Windows OSs

Re: copying milllions of small files and millions of dirs

2013-10-10 Thread aurfalien
On Aug 15, 2013, at 11:46 PM, Nicolas KOWALSKI wrote: On Thu, Aug 15, 2013 at 11:13:25AM -0700, aurfalien wrote: Is there a faster way to copy files over NFS? I would use find+cpio. This handles hard links, permissions, and in case of later runs, will not copy files if they already exist

FreeBSD, Centos and ZFS

2013-10-12 Thread aurfalien
Hi, I would like to first say that by no means is this a hey, why is my Mac faster then my PC kind of email. I'm really hoping its an LSI driver issue. My hardware; 39 SATA drives via SAS expanders 2 SSD for ZIL 2 SSD for L2Arc 128GB ECC Ram Intel 2400SC Mobo 2 Xeon E5 Hexacore procs 2 LSI

Re: FreeBSD, Centos and ZFS

2013-10-12 Thread aurfalien
On Oct 12, 2013, at 10:56 AM, Mark Felder wrote: On Sat, Oct 12, 2013, at 10:53, aurfalien wrote: Hi, I would like to first say that by no means is this a hey, why is my Mac faster then my PC kind of email. I'm really hoping its an LSI driver issue. It may very well be an LSI

Re: FreeBSD, Centos and ZFS

2013-10-12 Thread aurfalien
On Oct 12, 2013, at 10:56 AM, Mark Felder wrote: On Sat, Oct 12, 2013, at 10:53, aurfalien wrote: Hi, I would like to first say that by no means is this a hey, why is my Mac faster then my PC kind of email. I'm really hoping its an LSI driver issue. It may very well be an LSI

Re: FreeBSD, Centos and ZFS

2013-10-14 Thread aurfalien
On Oct 12, 2013, at 10:56 AM, Mark Felder wrote: On Sat, Oct 12, 2013, at 10:53, aurfalien wrote: Hi, I would like to first say that by no means is this a hey, why is my Mac faster then my PC kind of email. I'm really hoping its an LSI driver issue. It may very well be an LSI

Re: FreeBSD, Centos and ZFS

2013-10-14 Thread aurfalien
On Oct 12, 2013, at 10:56 AM, Mark Felder wrote: On Sat, Oct 12, 2013, at 10:53, aurfalien wrote: Hi, I would like to first say that by no means is this a hey, why is my Mac faster then my PC kind of email. I'm really hoping its an LSI driver issue. It may very well be an LSI