from:"aurfalien"

Hi all,

Is there a faster way to copy files over NFS?

Currently breaking up a simple rsync over 7 or so scripts which copies 22 dirs 
having ~500,000 dirs or files each.

Obviously reading all the meta data is a PITA.

Doin 10Gb/jumbos but in this case it don't make much of a hoot of a diff.

Going from a 38TB used, 50TB total BlueArc Titan 3200 to a new shiny 80TB total 
FreeBSD 9.2RC1 ZFS bad boy.

Thanks in advance,

- aurf



___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: copying milllions of small files and millions of dirs


On Aug 15, 2013, at 11:26 AM, Charles Swiger wrote:

 On Aug 15, 2013, at 11:13 AM, aurfalien aurfal...@gmail.com wrote:
 Is there a faster way to copy files over NFS?
 
 Probably.

Ok, thanks for the specifics.

 Currently breaking up a simple rsync over 7 or so scripts which copies 22 
 dirs having ~500,000 dirs or files each.
 
 There's a maximum useful concurrency which depends on how many disk spindles 
 and what flavor of RAID is in use; exceeding it will result in thrashing the 
 disks and heavily reducing throughput due to competing I/O requests.  Try 
 measuring aggregate performance when running fewer rsyncs at once and see 
 whether it improves.

Its 35 disks broken into 7 striped RaidZ groups with an SLC based ZIL and no 
atime, the server it self has 128GB ECC RAM.  I didn't have time to tune or 
really learn ZFS but at this point its only backing up the data for emergency 
purposes.

 Of course, putting half a million files into a single directory level is also 
 a bad idea, even with dirhash support.  You'd do better to break them up into 
 subdirs containing fewer than ~10K files apiece.

I can't, thats our job structure obviously developed by scrip kiddies and not 
systems ppl, but I digress.

 Obviously reading all the meta data is a PITA.
 
 Yes.
 
 Doin 10Gb/jumbos but in this case it don't make much of a hoot of a diff.
 
 Yeah, probably not-- you're almost certainly I/O bound, not network bound.

Actually it was network bound via 1 rsync process which is why I broke up 154 
dirs into 7 batches of 22 each.

I'll have to acquaint myself with ZFS centric tools to help me determine whats 
going on.

But 


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: copying milllions of small files and millions of dirs


On Aug 15, 2013, at 11:52 AM, Charles Swiger wrote:

 On Aug 15, 2013, at 11:37 AM, aurfalien aurfal...@gmail.com wrote:
 On Aug 15, 2013, at 11:26 AM, Charles Swiger wrote:
 On Aug 15, 2013, at 11:13 AM, aurfalien aurfal...@gmail.com wrote:
 Is there a faster way to copy files over NFS?
 
 Probably.
 
 Ok, thanks for the specifics.
 
 You're most welcome.
 
 Currently breaking up a simple rsync over 7 or so scripts which copies 22 
 dirs having ~500,000 dirs or files each.
 
 There's a maximum useful concurrency which depends on how many disk 
 spindles and what flavor of RAID is in use; exceeding it will result in 
 thrashing the disks and heavily reducing throughput due to competing I/O 
 requests.  Try measuring aggregate performance when running fewer rsyncs at 
 once and see whether it improves.
 
 Its 35 disks broken into 7 striped RaidZ groups with an SLC based ZIL and no 
 atime, the server it self has 128GB ECC RAM.  I didn't have time to tune or 
 really learn ZFS but at this point its only backing up the data for 
 emergency purposes.
 
 OK.  If you've got 7 independent groups and can use separate network pipes 
 for each parallel copy, then using 7 simultaneous scripts is likely 
 reasonable.
 
 Of course, putting half a million files into a single directory level is 
 also a bad idea, even with dirhash support.  You'd do better to break them 
 up into subdirs containing fewer than ~10K files apiece.
 
 I can't, thats our job structure obviously developed by scrip kiddies and 
 not systems ppl, but I digress.
 
 Identifying something which is broken as designed is still helpful, since 
 it indicates what needs to change.
 
 Obviously reading all the meta data is a PITA.
 
 Yes.
 
 Doin 10Gb/jumbos but in this case it don't make much of a hoot of a diff.
 
 Yeah, probably not-- you're almost certainly I/O bound, not network bound.
 
 Actually it was network bound via 1 rsync process which is why I broke up 
 154 dirs into 7 batches of 22 each.
 
 Oh.  Um, unless you can make more network bandwidth available, you've 
 saturated the bottleneck.
 Doing a single copy task is likely to complete faster than splitting up the 
 job into subtasks in such a case.

Well, using iftop, I am now at least able to get ~1Gb with 7 scripts going were 
before it was in the 10Ms with 1.

Also, physically looking at my ZFS server, it now shows the drives lights are 
blinking faster, like every second.  Were as before it was sort of seldom, like 
every 3 seconds or so.

I was thinking to perhaps zip dirs up and then xfer the file over but it would 
prolly take as long to zip/unzip.

This bloody project structure we have is nuts.

- aurf
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: copying milllions of small files and millions of dirs


On Aug 15, 2013, at 12:36 PM, Adam Vande More wrote:

 On Thu, Aug 15, 2013 at 1:13 PM, aurfalien aurfal...@gmail.com wrote:
 Hi all,
 
 Is there a faster way to copy files over NFS?
 
 Remove NFS from the setup.  

Yea, your mouth to gods ears.

My BlueArc is an NFS NAS only box.

So no way to get to the data other then NFS.

- aurf
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: copying milllions of small files and millions of dirs


On Aug 15, 2013, at 1:35 PM, Roland Smith wrote:

 On Thu, Aug 15, 2013 at 11:13:25AM -0700, aurfalien wrote:
 Hi all,
 
 Is there a faster way to copy files over NFS?
 
 Can you log into your NAS with ssh or telnet?

I can but thats a back channel link of 100Mb link.

- aurf
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: copying milllions of small files and millions of dirs


On Aug 15, 2013, at 1:22 PM, Charles Swiger wrote:

 [ ...combining replies for brevity... ]
 
 On Aug 15, 2013, at 1:02 PM, Frank Leonhardt fra...@fjl.co.uk wrote:
 I'm reading all this with interest. The first thing I'd have tried would be 
 tar (and probably netcat) but I'm a probably bit of a dinosaur. (If someone 
 wants to buy me some really big drives I promise I'll update). If it's 
 really NFS or nothing I guess you couldn't open a socket anyway.
 
 Either tar via netcat or SSH, or dump / restore via similar pipeline are 
 quite traditional.  tar is more flexible for partial filesystem copies, 
 whereas the dump / restore is more oriented towards complete filesystem 
 copies.  If the destination starts off empty, they're probably faster than 
 rsync, but rsync does delta updates which is a huge win if you're going to be 
 copying changes onto a slightly older version.

Yep, so looks like it is what it is as the data set is changing while I do the 
base sync.  So I'll have to do several more to pick up new comers etc...

 Anyway, you're entirely right that the capabilities of the source matter a 
 great deal.
 If it could do zfs send / receive, or similar snapshot mirroring, that would 
 likely do better than userland tools.
 
 I'd be interested to know whether tar is still worth using in this world of 
 volume managers and SMP.
 
 Yes.
 
 On Aug 15, 2013, at 12:14 PM, aurfalien aurfal...@gmail.com wrote:
 [ ... ]
 Doin 10Gb/jumbos but in this case it don't make much of a hoot of a diff.
 
 Yeah, probably not-- you're almost certainly I/O bound, not network bound.
 
 Actually it was network bound via 1 rsync process which is why I broke up 
 154 dirs into 7 batches of 22 each.
 
 Oh.  Um, unless you can make more network bandwidth available, you've 
 saturated the bottleneck.
 Doing a single copy task is likely to complete faster than splitting up the 
 job into subtasks in such a case.
 
 Well, using iftop, I am now at least able to get ~1Gb with 7 scripts going 
 were before it was in the 10Ms with 1.
 
 1 gigabyte of data per second is pretty decent for a 10Gb link; 10 MB/s 
 obviously wasn't close saturating a 10Gb link.

Cool.  Looks like I am doing my best which is what I wanted to know.  I chose 
to do 7 rsync scripts as it evenly divides into 154 parent dirs :)

You should see how our backup system deal with this; Atempo Time Navigator or 
Tina as its called.

It takes an hour just to lay down the dirs on tape before even starting to 
backup, crazyness.  And thats just for 1 parent dir having an avg of 500,000 
dirs.  Actually I'm prolly wrong as the initial creation is 125,000 dirs, of 
which a few are sym links.

Then it grows from there.  Looking at the Tina stats, we see a million objects 
or more.

- aurf
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

zilstat.ksh

Hi all,

I seem to have dtrace enabled on my system which is great.

However the dirs on FreeBSDs site for enabling dtrace are really easy to follow 
so no big deal on that front.  Hats off to the docs, very very simple and 
thorough.   Lovin the FreeBSD community.

Ok, hugs over.

When I run zilstat.ksh -p poolname

I get;

dtrace: invalid probe specifier 

And it looks to print out the scripts contents with this nugget at the end;

: probe description fbt::txg_quiesce:entry does not match any probes

Is this simply a matter of commenting whats related to this probe?

Of course, I have no idea what I'm really saying here.  But it sounds cool.

- aurf


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: SolarFlare 10GB card


On Aug 14, 2013, at 5:49 AM, Mark Felder wrote:

 Don't use the driver on their website. It's very old. Use the driver
 that comes with FreeBSD 9.1 which you don't have to compile. 

Yea, that driver sux actually.

But how would I compile the driver in 9.2RC1 as I see the source is included?


- aurf 
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: SolarFlare 10GB card


On Aug 14, 2013, at 11:34 AM, Mark Felder wrote:

 On Wed, 14 Aug 2013 10:51:03 -0700
 aurfalien aurfal...@gmail.com wrote:
 
 
 On Aug 14, 2013, at 5:49 AM, Mark Felder wrote:
 
 Don't use the driver on their website. It's very old. Use the driver
 that comes with FreeBSD 9.1 which you don't have to compile. 
 
 Yea, that driver sux actually.
 
 But how would I compile the driver in 9.2RC1 as I see the source is included?
 
 
 
 Why do you believe the driver in 9.1-RELEASE sucks? Do you have a
 specific issue?

I meant the driver off there site.  I'm trying the one with 9.1 in a few.

Didn't meant to sound like a barney.

Unsure why the SolarFlare driver is even up on there site, seems unstable.

- aurf
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: SolarFlare 10GB card


On Aug 14, 2013, at 11:56 AM, Mark Felder wrote:

 On Wed, 14 Aug 2013 11:48:52 -0700
 aurfalien aurfal...@gmail.com wrote:
 
 
 On Aug 14, 2013, at 11:34 AM, Mark Felder wrote:
 
 On Wed, 14 Aug 2013 10:51:03 -0700
 aurfalien aurfal...@gmail.com wrote:
 
 
 On Aug 14, 2013, at 5:49 AM, Mark Felder wrote:
 
 Don't use the driver on their website. It's very old. Use the driver
 that comes with FreeBSD 9.1 which you don't have to compile. 
 
 Yea, that driver sux actually.
 
 But how would I compile the driver in 9.2RC1 as I see the source is 
 included?
 
 
 
 Why do you believe the driver in 9.1-RELEASE sucks? Do you have a
 specific issue?
 
 I meant the driver off there site.  I'm trying the one with 9.1 in a few.
 
 Didn't meant to sound like a barney.
 
 Unsure why the SolarFlare driver is even up on there site, seems unstable.
 
 - aurf
 
 Ahhh, I see. 
 
 You won't have to compile anything with FreeBSD 9.1 or later. Just boot
 up the OS and you'll see sfxge in the output of ifconfig.

Well my fine feathered friend, thats my dilemma.

I do not see the SolarFlare via ifconfig.

Now pciconf -l shows much stuff, even my built in 1Gb nics but not my 10Gb 
Solars.

I'm sure one of the many PCI devices is listed, but not as a SlarFlare, but 
some generic device.

Any guidance?

- aurf


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: SolarFlare 10GB card


On Aug 14, 2013, at 12:20 PM, Mark Felder wrote:

 On Wed, 14 Aug 2013 12:05:56 -0700
 aurfalien aurfal...@gmail.com wrote:
 
 
 Well my fine feathered friend, thats my dilemma.
 
 I do not see the SolarFlare via ifconfig.
 
 Now pciconf -l shows much stuff, even my built in 1Gb nics but not my 10Gb 
 Solars.
 
 I'm sure one of the many PCI devices is listed, but not as a SlarFlare, but 
 some generic device.
 
 Any guidance?
 
 - aurf
 
 
 
 Just logged into the only Solarflare box I have access to --
 
 /boot/loader.conf has
 
 sfxge_load=YES
 
 
 So on a running system you'll have to
 
 # kldload sfxge
 
 And my pciconf -l has these entries:
 
 sfxge0@pci0:6:0:0:  class=0x02 card=0x71041924 chip=0x08131924 rev=0x00 
 hdr=0x00
 sfxge1@pci0:6:0:1:  class=0x02 card=0x71041924 chip=0x08131924 rev=0x00 
 hdr=0x00

Bingo!

Still getting used to loader.conf, thanks man!

- aurf
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: SolarFlare 10GB card

2013-08-13 Thread aurfalien


On Aug 12, 2013, at 11:12 AM, Roland Smith wrote:

 On Mon, Aug 12, 2013 at 10:47:27AM -0700, aurfalien wrote:
 Hi all,
 
 We've a brand spanking new SolarFlare 10GB nic for use with our beast of a 
 server.
 
 However the vendor support page says the driver is in beta.
 
 If you look in the download[1], you'll see that the driver is named sfxge. It
 was released in November 2011. This driver is already present in FreeBSD 9.1,
 look at the source in /usr/src/sys/dev/sfxge.
 So it seems like it is as much out of beta as any other driver. :-)

Well, how would I compile it?:)

I can the dir in my 9.2RC1 install.

- aurf
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: SolarFlare 10GB card

2013-08-13 Thread aurfalien


On Aug 12, 2013, at 11:12 AM, Roland Smith wrote:

 On Mon, Aug 12, 2013 at 10:47:27AM -0700, aurfalien wrote:
 Hi all,
 
 We've a brand spanking new SolarFlare 10GB nic for use with our beast of a 
 server.
 
 However the vendor support page says the driver is in beta.
 
 If you look in the download[1], you'll see that the driver is named sfxge. It
 was released in November 2011. This driver is already present in FreeBSD 9.1,
 look at the source in /usr/src/sys/dev/sfxge.
 So it seems like it is as much out of beta as any other driver. :-)

It was actually easier to dl the driver from SolarF;ares site and follow there 
dirs.

But for future, ref, would be cool to now how to do this.

- aurf
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: SolarFlare 10GB card

2013-08-13 Thread aurfalien


On Aug 13, 2013, at 8:30 PM, kpn...@pobox.com wrote:

 On Tue, Aug 13, 2013 at 07:13:57PM -0700, aurfalien wrote:
 
 On Aug 12, 2013, at 11:12 AM, Roland Smith wrote:
 
 On Mon, Aug 12, 2013 at 10:47:27AM -0700, aurfalien wrote:
 Hi all,
 
 We've a brand spanking new SolarFlare 10GB nic for use with our beast of a 
 server.
 
 However the vendor support page says the driver is in beta.
 
 If you look in the download[1], you'll see that the driver is named sfxge. 
 It
 was released in November 2011. This driver is already present in FreeBSD 
 9.1,
 look at the source in /usr/src/sys/dev/sfxge.
 So it seems like it is as much out of beta as any other driver. :-)
 
 It was actually easier to dl the driver from SolarF;ares site and follow 
 there dirs.
 
 But for future, ref, would be cool to now how to do this.
 
 I haven't been paying that much attention, but ...
 
 If you are running 9.1 or later, what happens if you run as root these two
 commands:
 
 # kldload if_sfxge
 # kldstat

Hi,

Thanks for the reply.

It fails as cannot find module.

Eh, no biggy, building it from there actual source is trivial.

- aurf
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

SolarFlare 10GB card

2013-08-12 Thread aurfalien

Hi all,

We've a brand spanking new SolarFlare 10GB nic for use with our beast of a 
server.

However the vendor support page says the driver is in beta.

Has any one used this card in production?

Thanks in advance,

- aurf
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: SolarFlare 10GB card

2013-08-12 Thread aurfalien


On Aug 12, 2013, at 11:12 AM, Roland Smith wrote:

 On Mon, Aug 12, 2013 at 10:47:27AM -0700, aurfalien wrote:
 Hi all,
 
 We've a brand spanking new SolarFlare 10GB nic for use with our beast of a 
 server.
 
 However the vendor support page says the driver is in beta.
 
 If you look in the download[1], you'll see that the driver is named sfxge. It
 was released in November 2011. This driver is already present in FreeBSD 9.1,
 look at the source in /usr/src/sys/dev/sfxge.

Ahh, thanks man.

Didn't even think to look there.

 So it seems like it is as much out of beta as any other driver. :-)

Yea, I concur :)

- aurf
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: learn

2013-08-07 Thread aurfalien

You've the zip and pull over hoodies;

https://www.freebsdmall.com/cgi-bin/fm/scan/fi=prod_bsd/tf=list_order/sf=category/se=shirts?id=dInoZShjmv_pc=12

Then you have this site which looks to have a slightly better shopping cart;

http://www.cafepress.com/+freebsd+sweatshirts-hoodies

Unsure if any purchases go to supporting FreeBSD as it looks like they may not
:(

However one can, at worst case show there love of the OS to the world :)

At best case FreeBSD.org gets some monayz from this.

- aurf
On Aug 7, 2013, at 9:21 AM, Quark wrote:

From: aurfalien aurfal...@gmail.com
To: Mike Jeays mike.je...@rogers.com
Cc: me...@bris.ac.uk; freebsd-questions@freebsd.org
Sent: Thursday, 1 August 2013 9:25 PM
Subject: Re: learn

On Aug 1, 2013, at 8:31 AM, Mike Jeays wrote:

On Thu, 1 Aug 2013 14:21:34 +0100 (BST)
Anton Shterenlikht me...@bris.ac.uk wrote:

Date: Thu, 1 Aug 2013 14:29:25 +0200
From: herbert langhans w...@langhans.com.pl
To: freebsd-questions@freebsd.org
Subject: Re: learn

The handbook is a monster, even technically interested people get lost
there. You know that, corebug.

I completely disagree.

The handbook is of excellent quality for a volunteer project.
In particular, it is far ahead of any linux documentation
effort I've seen. Indeed, it was the handbook that made me
start using FreeBSD in the first place. In about 2003 I tried
several linux distros, and got completely lost. The available
documentation for linux, at least at that time, was not designed
for a novice, certainly not at my level. In contrast, the
FreeBSD handbook was very clear and allowed me to install
and start using FreeBSD quickly and easily. This was version 4.9.

Since then the quality of the handbook improved a lot.
The handbook is certantly the first FreeBSD resource
I would recommend to a FreeBSD novice.

Anton
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to
freebsd-questions-unsubscr...@freebsd.org

Agreed - the handbook has been a great resource since I started using
FreeBSD in 1997,
at version 2.2.something.

Greg Lehey's book The Complete FreeBSD is also excellent, and available
as a free
download - although I am sure he would appreciate contributions or
purchases.

http://www.lemis.com/grog/Documentation/CFBSD/

I suggest downloading the USB image, combine that with Googling and bayam,
off you go.

Of course, supplement with RTFMing which should always be at your side and
all will be well.

And lastly, having membership on this fine list is key. The FreeBSD
community is indeed grand.

Hell, I may even get a hoody from the store :)

hey, where are the hoodies??? I found for mozilla openSUSE on their
respective sites very good looking hoodies, but nor FreeBSD
I won't hesitate to order one for reasonable price of 20-30 USD

- aurf
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: TRIM on ZFS mirror

2013-08-02 Thread aurfalien

Confirmed in beta 1.

- aurf

On Aug 2, 2013, at 2:12 AM, John Andreasson wrote:

 Hi.
 
 I read that FreeBSD 9.2 will bring TRIM to ZFS. Does anyone know if this
 works even if the zpool is a mirror?
 
 John
 ___
 freebsd-questions@freebsd.org mailing list
 http://lists.freebsd.org/mailman/listinfo/freebsd-questions
 To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: learn

2013-08-01 Thread aurfalien

On Aug 1, 2013, at 8:31 AM, Mike Jeays wrote:

 On Thu, 1 Aug 2013 14:21:34 +0100 (BST)
 Anton Shterenlikht me...@bris.ac.uk wrote:

 Date: Thu, 1 Aug 2013 14:29:25 +0200
 From: herbert langhans w...@langhans.com.pl
 To: freebsd-questions@freebsd.org
 Subject: Re: learn

 The handbook is a monster, even technically interested people get lost
 there. You know that, corebug.

 I completely disagree.

 The handbook is of excellent quality for a volunteer project.
 In particular, it is far ahead of any linux documentation
 effort I've seen. Indeed, it was the handbook that made me
 start using FreeBSD in the first place. In about 2003 I tried
 several linux distros, and got completely lost. The available
 documentation for linux, at least at that time, was not designed
 for a novice, certainly not at my level. In contrast, the
 FreeBSD handbook was very clear and allowed me to install
 and start using FreeBSD quickly and easily. This was version 4.9.

 Since then the quality of the handbook improved a lot.
 The handbook is certantly the first FreeBSD resource
 I would recommend to a FreeBSD novice.

 Anton
 ___
 freebsd-questions@freebsd.org mailing list
 http://lists.freebsd.org/mailman/listinfo/freebsd-questions
 To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

 Agreed - the handbook has been a great resource since I started using FreeBSD 
 in 1997,
 at version 2.2.something.

 Greg Lehey's book The Complete FreeBSD is also excellent, and available as 
 a free
 download - although I am sure he would appreciate contributions or purchases.

 http://www.lemis.com/grog/Documentation/CFBSD/

I suggest downloading the USB image, combine that with Googling and bayam, off 
you go.

Of course, supplement with RTFMing which should always be at your side and all 
will be well.

And lastly, having membership on this fine list is key.  The FreeBSD community 
is indeed grand.

Hell, I may even get a hoody from the store :)

- aurf
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: dhclient and the LiveCD

2013-07-30 Thread aurfalien


On Jul 30, 2013, at 8:56 PM, Sam Fourman Jr. wrote:

 hello list,
 
 when using the bootonly.iso from the ftp servers...
 
 if you drop to a shell, use dhclient to obtain an ipaddress.. well you get
 one.. but you have no DNS, because I think dhclient can't write to
 /etc/resolv.conf
 
 what is the correct way to fix this?

Well, if its anything like the LiveCD option from there regular full iso, then 
you can do 2 things;

issue;

mkdir /tmp/etc
mount_unionfs /tmp/etc /etc

* this makes all things done on the fs temporary

or issue;

mount -rw /

* renders anything you write permanent

I do either of these during LiveCD sessions depending on my goals.

Unsure if this pertains to bootonly.iso but perhaps it helps?

I'm also very new to the FreeBSD scene so any one feel free to correct.

- aurf


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

FusionIO - Extreme support, 9.1

2013-07-27 Thread aurfalien

Hi all,

I've 2 IOExtreme 80GB cards that work as a stipe yielding 160GB.

These cards use exceptionally fast high quality RAM.

I called support about Centos6/FreeBSD support but they said nada.

The cards do work in Centos6 and I suspect they just wanted to reduce support 
load, etc...

Does this stuff work in FreeBSD =9.1?

Thanks in advance,

- aurf

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: TRIM and changing mount options

2013-07-26 Thread aurfalien


On Jul 25, 2013, at 9:15 PM, Trond Endrestøl wrote:

 On Thu, 25 Jul 2013 19:25-0700, aurfalien wrote:
 
 
 On Jul 24, 2013, at 12:51 PM, Alexandre Labarre wrote:
 
 Le mercredi 24 juillet 2013, aurfalien a écrit :
 
 On Jul 24, 2013, at 9:01 AM, Dan Nelson wrote:
 
 In the last episode (Jul 23), aurfalien said:
 On Jul 23, 2013, at 7:55 PM, Dan Nelson wrote:
 In the last episode (Jul 23), aurfalien said:
 At any rate, could some one;
 
 a) Explain how I am loading my file system as I'm used to fstab?
 b) How to run tunefs on my zroot
 c) How to determine if I actually have the needed TRIM support in my
 kernel
 
 I'm not sure if there's a way to query TRIM status on arbitrary geom
 providers, but you can see whether zfs successfully sent any TRIM
 requests by watching the output of sysctl kstat.zfs.misc.zio_trim.  If
 .zio_trim.success increments and .unsupported (or .failed) doesn't, then
 you know that it's working.
 
 Looks like I don't have it.
 
 I keep reading that I must download the patch and make it which is not an
 issue.
 
 But I can't seem to find it.
 
 I've dl'd the 9.2 beta in hopes to check its src and see if its there.
 
 Looks like all I really need is the current rel.
 
 ZFS TRIM support was MFC'd into the 9 branch in June, so it wasn't in 9.1
 but will be available in 9.2:
 
 http://svnweb.freebsd.org/base?view=revisionrevision=251419
 
 
 I actually got the 9.2 src and found what i was looking for  so many thanks.
 
 Gonna figure out what step are required to compile this in to my current 
 9.1 rel.
 
 Thanks again.
 
 - aurf
 Hi,
 Why you do not track 9/Stable or wait 9.2-Release?
 We are at the first Beta stage of 9.2. (9.2-Beta 1). You cannot use 
 freebsd-update to upgrade your 9.1-Release to 9.2-Beta 1 because there 
 was a problem, but this will be resolved for 9.2-Beta 2 in the next days or 
 weeks.
 Just my .2 cents
 
 Kind regards,
 Alexandre
 
 Hi,
 
 Whats the best list to submit oddities regarding freeBSD 9.2 Beta 1?
 
 Specifically, this line in 9.1 creates and mounts the fs under /mnt;
 
 zpool create -o altroot=/mnt -o cachefile=/var/tmp/zpool.cache zroot mirror 
 /dev/gpt/disk0 /dev/gpt/disk1
 
 But in 9.2 beta 1, its under /mnt/zroot.
 
 Just seems a bit odd is all.
 
 - aurf
 
 What does zfs get mountpoint zroot tell you in each case?

Hi Trond,

Mind you, this is a Live CD env.  I am doing zpool mirror on a system during 
install.

At any rate, in 9.2 beta 1 it shows;

NAME   PROPERTYVALUE   SOURCE
zroot  mountpoint  /mnt/zroot  default

On 9.1 it shows;

NAME   PROPERTYVALUE   SOURCE
zroot  mountpoint  /mnt  local

HTH and hope I am doing something wrong.

- aurf
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: TRIM and changing mount options

2013-07-26 Thread aurfalien


On Jul 25, 2013, at 9:15 PM, Trond Endrestøl wrote:

 On Thu, 25 Jul 2013 19:25-0700, aurfalien wrote:
 
 
 On Jul 24, 2013, at 12:51 PM, Alexandre Labarre wrote:
 
 Le mercredi 24 juillet 2013, aurfalien a écrit :
 
 On Jul 24, 2013, at 9:01 AM, Dan Nelson wrote:
 
 In the last episode (Jul 23), aurfalien said:
 On Jul 23, 2013, at 7:55 PM, Dan Nelson wrote:
 In the last episode (Jul 23), aurfalien said:
 At any rate, could some one;
 
 a) Explain how I am loading my file system as I'm used to fstab?
 b) How to run tunefs on my zroot
 c) How to determine if I actually have the needed TRIM support in my
 kernel
 
 I'm not sure if there's a way to query TRIM status on arbitrary geom
 providers, but you can see whether zfs successfully sent any TRIM
 requests by watching the output of sysctl kstat.zfs.misc.zio_trim.  If
 .zio_trim.success increments and .unsupported (or .failed) doesn't, then
 you know that it's working.
 
 Looks like I don't have it.
 
 I keep reading that I must download the patch and make it which is not an
 issue.
 
 But I can't seem to find it.
 
 I've dl'd the 9.2 beta in hopes to check its src and see if its there.
 
 Looks like all I really need is the current rel.
 
 ZFS TRIM support was MFC'd into the 9 branch in June, so it wasn't in 9.1
 but will be available in 9.2:
 
 http://svnweb.freebsd.org/base?view=revisionrevision=251419
 
 
 I actually got the 9.2 src and found what i was looking for  so many thanks.
 
 Gonna figure out what step are required to compile this in to my current 
 9.1 rel.
 
 Thanks again.
 
 - aurf
 Hi,
 Why you do not track 9/Stable or wait 9.2-Release?
 We are at the first Beta stage of 9.2. (9.2-Beta 1). You cannot use 
 freebsd-update to upgrade your 9.1-Release to 9.2-Beta 1 because there 
 was a problem, but this will be resolved for 9.2-Beta 2 in the next days or 
 weeks.
 Just my .2 cents
 
 Kind regards,
 Alexandre
 
 Hi,
 
 Whats the best list to submit oddities regarding freeBSD 9.2 Beta 1?
 
 Specifically, this line in 9.1 creates and mounts the fs under /mnt;
 
 zpool create -o altroot=/mnt -o cachefile=/var/tmp/zpool.cache zroot mirror 
 /dev/gpt/disk0 /dev/gpt/disk1
 
 But in 9.2 beta 1, its under /mnt/zroot.
 
 Just seems a bit odd is all.
 
 - aurf
 
 What does zfs get mountpoint zroot tell you in each case?

Hi again,

Specifying the command as follows forces same behavior as 9.1 so all is well 
with a slight mod;

zpool create -o altroot=/ -o cachefile=/var/tmp/zpool.cache zroot mirror 
/dev/gpt/disk0 /dev/gpt/disk1

The change is colored in red.  It was /mnt.

- aurf
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: TRIM and changing mount options

2013-07-25 Thread aurfalien


On Jul 24, 2013, at 12:51 PM, Alexandre Labarre wrote:

 Le mercredi 24 juillet 2013, aurfalien a écrit :
 
 On Jul 24, 2013, at 9:01 AM, Dan Nelson wrote:
 
  In the last episode (Jul 23), aurfalien said:
  On Jul 23, 2013, at 7:55 PM, Dan Nelson wrote:
  In the last episode (Jul 23), aurfalien said:
  At any rate, could some one;
 
  a) Explain how I am loading my file system as I'm used to fstab?
  b) How to run tunefs on my zroot
  c) How to determine if I actually have the needed TRIM support in my
  kernel
 
  I'm not sure if there's a way to query TRIM status on arbitrary geom
  providers, but you can see whether zfs successfully sent any TRIM
  requests by watching the output of sysctl kstat.zfs.misc.zio_trim.  If
  .zio_trim.success increments and .unsupported (or .failed) doesn't, then
  you know that it's working.
 
  Looks like I don't have it.
 
  I keep reading that I must download the patch and make it which is not an
  issue.
 
  But I can't seem to find it.
 
  I've dl'd the 9.2 beta in hopes to check its src and see if its there.
 
  Looks like all I really need is the current rel.
 
  ZFS TRIM support was MFC'd into the 9 branch in June, so it wasn't in 9.1
  but will be available in 9.2:
 
  http://svnweb.freebsd.org/base?view=revisionrevision=251419
 
 
 I actually got the 9.2 src and found what i was looking for  so many thanks.
 
 Gonna figure out what step are required to compile this in to my current 9.1 
 rel.
 
 Thanks again.
 
 - aurf
 Hi,
 Why you do not track 9/Stable or wait 9.2-Release?
 We are at the first Beta stage of 9.2. (9.2-Beta 1). You cannot use 
 freebsd-update to upgrade your 9.1-Release to 9.2-Beta 1 because there was 
 a problem, but this will be resolved for 9.2-Beta 2 in the next days or weeks.
 Just my .2 cents
 
 Kind regards,
 Alexandre

Hi,

Whats the best list to submit oddities regarding freeBSD 9.2 Beta 1?

Specifically, this line in 9.1 creates and mounts the fs under /mnt;

zpool create -o altroot=/mnt -o cachefile=/var/tmp/zpool.cache zroot mirror 
/dev/gpt/disk0 /dev/gpt/disk1

But in 9.2 beta 1, its under /mnt/zroot.

Just seems a bit odd is all.

- aurf

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: TRIM and changing mount options

2013-07-24 Thread aurfalien


On Jul 24, 2013, at 9:01 AM, Dan Nelson wrote:

 In the last episode (Jul 23), aurfalien said:
 On Jul 23, 2013, at 7:55 PM, Dan Nelson wrote:
 In the last episode (Jul 23), aurfalien said:
 At any rate, could some one;
 
 a) Explain how I am loading my file system as I'm used to fstab?
 b) How to run tunefs on my zroot
 c) How to determine if I actually have the needed TRIM support in my
 kernel
 
 I'm not sure if there's a way to query TRIM status on arbitrary geom
 providers, but you can see whether zfs successfully sent any TRIM
 requests by watching the output of sysctl kstat.zfs.misc.zio_trim.  If
 .zio_trim.success increments and .unsupported (or .failed) doesn't, then
 you know that it's working.
 
 Looks like I don't have it.
 
 I keep reading that I must download the patch and make it which is not an
 issue.
 
 But I can't seem to find it.
 
 I've dl'd the 9.2 beta in hopes to check its src and see if its there.
 
 Looks like all I really need is the current rel.
 
 ZFS TRIM support was MFC'd into the 9 branch in June, so it wasn't in 9.1
 but will be available in 9.2:
 
 http://svnweb.freebsd.org/base?view=revisionrevision=251419

Thanks for the link.

Is it something I can simply compile in to my 9.1?

If so, would you know how do I get the patches?

- aurf
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: TRIM and changing mount options

2013-07-24 Thread aurfalien


On Jul 24, 2013, at 9:01 AM, Dan Nelson wrote:

 In the last episode (Jul 23), aurfalien said:
 On Jul 23, 2013, at 7:55 PM, Dan Nelson wrote:
 In the last episode (Jul 23), aurfalien said:
 At any rate, could some one;
 
 a) Explain how I am loading my file system as I'm used to fstab?
 b) How to run tunefs on my zroot
 c) How to determine if I actually have the needed TRIM support in my
 kernel
 
 I'm not sure if there's a way to query TRIM status on arbitrary geom
 providers, but you can see whether zfs successfully sent any TRIM
 requests by watching the output of sysctl kstat.zfs.misc.zio_trim.  If
 .zio_trim.success increments and .unsupported (or .failed) doesn't, then
 you know that it's working.
 
 Looks like I don't have it.
 
 I keep reading that I must download the patch and make it which is not an
 issue.
 
 But I can't seem to find it.
 
 I've dl'd the 9.2 beta in hopes to check its src and see if its there.
 
 Looks like all I really need is the current rel.
 
 ZFS TRIM support was MFC'd into the 9 branch in June, so it wasn't in 9.1
 but will be available in 9.2:
 
 http://svnweb.freebsd.org/base?view=revisionrevision=251419


I actually got the 9.2 src and found what i was looking for  so many thanks.

Gonna figure out what step are required to compile this in to my current 9.1 
rel.

Thanks again.

- aurf
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: TRIM and changing mount options

2013-07-24 Thread aurfalien


On Jul 24, 2013, at 12:51 PM, Alexandre Labarre wrote:

 Le mercredi 24 juillet 2013, aurfalien a écrit :
 
 On Jul 24, 2013, at 9:01 AM, Dan Nelson wrote:
 
  In the last episode (Jul 23), aurfalien said:
  On Jul 23, 2013, at 7:55 PM, Dan Nelson wrote:
  In the last episode (Jul 23), aurfalien said:
  At any rate, could some one;
 
  a) Explain how I am loading my file system as I'm used to fstab?
  b) How to run tunefs on my zroot
  c) How to determine if I actually have the needed TRIM support in my
  kernel
 
  I'm not sure if there's a way to query TRIM status on arbitrary geom
  providers, but you can see whether zfs successfully sent any TRIM
  requests by watching the output of sysctl kstat.zfs.misc.zio_trim.  If
  .zio_trim.success increments and .unsupported (or .failed) doesn't, then
  you know that it's working.
 
  Looks like I don't have it.
 
  I keep reading that I must download the patch and make it which is not an
  issue.
 
  But I can't seem to find it.
 
  I've dl'd the 9.2 beta in hopes to check its src and see if its there.
 
  Looks like all I really need is the current rel.
 
  ZFS TRIM support was MFC'd into the 9 branch in June, so it wasn't in 9.1
  but will be available in 9.2:
 
  http://svnweb.freebsd.org/base?view=revisionrevision=251419
 
 
 I actually got the 9.2 src and found what i was looking for  so many thanks.
 
 Gonna figure out what step are required to compile this in to my current 9.1 
 rel.
 
 Thanks again.
 
 - aurf
 Hi,
 Why you do not track 9/Stable or wait 9.2-Release?
 We are at the first Beta stage of 9.2. (9.2-Beta 1). You cannot use 
 freebsd-update to upgrade your 9.1-Release to 9.2-Beta 1 because there was 
 a problem, but this will be resolved for 9.2-Beta 2 in the next days or weeks.
 Just my .2 cents

Thanks for the money :)

I'll wait, spending too much time futzing with this versus learning FreeBSD.

- aurf
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

TRIM and changing mount options

2013-07-23 Thread aurfalien

Hi,

I've some what blindly followed a how to on installing FreeBSD 9.1 on a ZFS 
mirror.

My typing is horrid so I simply ssh'd to a live CD env and pasted line by line 
as per the how to found here;

http://wp.strahlert.net/wordpress/zfs-2/installing-freebsd-9-1-using-root-on-zfs-and-gpt-disks/

All is well, no issues with replacing disks, testing failures etc...

But seeing that my system drives are SSDs, I thought to perhaps add noatime, 
etc... to avoid slow downs common in excessive SSD usage.

However my fstab is only mounting swap partitions and I have no idea how my 
file system is being mounted :)

Also, I would like to use tunefs in finding if I have TRIM enabled as I did 
load it via boot.conf

I kinda feel like I'm willy nilly adding load lines w/o seeing if I actually 
have the TRIM patch installed :)

At any rate, could some one;

a) Explain how I am loading my file system as I'm used to fstab?
b) How to run tunefs on my zroot
c) How to determine if I actually have the needed TRIM support in my kernel

I'm running 9.1 with the latest updates via freebsd-update (fetch/install).

Thanks in advance,

-airf

I know enough to kill a system


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: TRIM and changing mount options

2013-07-23 Thread aurfalien

On Jul 23, 2013, at 7:55 PM, Dan Nelson wrote:

In the last episode (Jul 23), aurfalien said:
I've some what blindly followed a how to on installing FreeBSD 9.1 on a
ZFS mirror.

My typing is horrid so I simply ssh'd to a live CD env and pasted line by
line as per the how to found here;

http://wp.strahlert.net/wordpress/zfs-2/installing-freebsd-9-1-using-root-on-zfs-and-gpt-disks/

All is well, no issues with replacing disks, testing failures etc...

But seeing that my system drives are SSDs, I thought to perhaps add
noatime, etc... to avoid slow downs common in excessive SSD usage.

However my fstab is only mounting swap partitions and I have no idea how
my file system is being mounted :)

Also, I would like to use tunefs in finding if I have TRIM enabled as I
did load it via boot.conf

I kinda feel like I'm willy nilly adding load lines w/o seeing if I
actually have the TRIM patch installed :)

At any rate, could some one;

a) Explain how I am loading my file system as I'm used to fstab?
b) How to run tunefs on my zroot
c) How to determine if I actually have the needed TRIM support in my kernel

ZFS automatically opens pools that were previously imported ( this info is
stored in /boot/zfs/zpool.cache ), and automatically mounts any filesystems
that have a mountpoint specified, so fstab isn't needed.

Tunefs is a UFS-only command,

Read the man page after sending, sorry for this.

I try not to post obvious stuff, meaning ones that you can 'man' :)

so it won't help you here. Most zfs
properties can be set on the fly with the zfs command. You can disable
atime on your ZFS filesytem with zfs set atime=off zroot. All the
filesystems created in zpool will inherit the value.

I'm not sure if there's a way to query TRIM status on arbitrary geom
providers, but you can see whether zfs successfully sent any TRIM requests
by watching the output of sysctl kstat.zfs.misc.zio_trim. If
.zio_trim.success increments and .unsupported (or .failed) doesn't, then you
know that it's working.

Looks like I don't have it.

I keep reading that I must download the patch and make it which is not an issue.

But I can't seem to find it.

So I got this;

http://blog.multiplay.co.uk/dropzone/freebsd/zfs-trim-patchset83.tbz

But I keep reading that I need PJDs zfs patch set in addition.

I've been reading this;

http://freebsd.1045724.n5.nabble.com/ZFS-TRIM-support-committed-to-HEAD-td5746045.html

Do you know how I can pull the source for this?

I've dl'd the 9.2 beta in hopes to check its src and see if its there.

Looks like all I really need is the current rel.

- aurf
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: TRIM and changing mount options

2013-07-23 Thread aurfalien

On Jul 23, 2013, at 8:10 PM, kpn...@pobox.com wrote:

On Tue, Jul 23, 2013 at 03:54:57PM -0700, aurfalien wrote:
Hi,

I've some what blindly followed a how to on installing FreeBSD 9.1 on a ZFS
mirror.

My typing is horrid so I simply ssh'd to a live CD env and pasted line by
line as per the how to found here;

http://wp.strahlert.net/wordpress/zfs-2/installing-freebsd-9-1-using-root-on-zfs-and-gpt-disks/

All is well, no issues with replacing disks, testing failures etc...

But seeing that my system drives are SSDs, I thought to perhaps add noatime,
etc... to avoid slow downs common in excessive SSD usage.

However my fstab is only mounting swap partitions and I have no idea how my
file system is being mounted :)

That's typical for ZFS. Usually ZFS handles mounting filesystems (datasets
in ZFS parlance) itself.

Thats actually really cool and powerful.

Use the zfs command to see all the settings for individual datasets. For
example:

[kpn@gunsight1 ~]$ zfs get atime gs1p/usr
NAME PROPERTY VALUE SOURCE
gs1p/usr atime on default

To see the atime setting for all datasets use 'zfs get atime'.

To see all settings replace 'atime' with 'all'.

To change the setting use 'zfs set'.

Settings are inherited by datasets mounted inside a dataset. To disable
atime for all datasets you can set it to 'off' at the top dataset. Or you
can set it for just some of your datasets, like maybe the one mounted at
/usr. You'll probably need atime enabled if you read mail on this machine.

Also see 'zfs inherit'.

For sure, thanks for this.

Also, I would like to use tunefs in finding if I have TRIM enabled as I did
load it via boot.conf

Sorry, I can't help with that. Somebody else can chime in.

Wondering if I should query the dev list but don't wanna post rather mundane
questions for them.

I can't seem to find the patch set to download.

- aurf
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: to gmirror or to ZFS

2013-07-19 Thread aurfalien


On Jul 16, 2013, at 11:42 AM, Warren Block wrote:

 On Tue, 16 Jul 2013, aurfalien wrote:
 On Jul 16, 2013, at 2:41 AM, Shane Ambler wrote:
 
 I doubt that you would save any ram having the os on a non-zfs drive as
 you will already be using zfs chances are that non-zfs drives would only
 increase ram usage by adding a second cache. zfs uses it's own cache
 system and isn't going to share it's cache with other system managed
 drives. I'm not actually certain if the system cache still sits above
 zfs cache or not, I think I read it bypasses the traditional drive cache.
 
 For zfs cache you can set the max usage by adjusting vfs.zfs.arc_max
 that is a system wide setting and isn't going to increase if you have
 two zpools.
 
 Tip: set the arc_max value - by default zfs will use all physical ram
 for cache, set it to be sure you have enough ram left for any services
 you want running.
 
 Have you considered using one or both SSD drives with zfs? They can be
 added as cache or log devices to help performance.
 See man zpool under Intent Log and Cache Devices.
 
 This is a very interesting point.
 
 In terms if SSDs for cache, I was planning on using a pair of Samsung Pro 
 512GB SSDs for this purpose (which I haven't bought yet).
 
 But I tire of buying stuff, so I have a pair of 40GB Intel SSDs for use as 
 sys disks and several Intel 160GB SSDs lying around that I can combine with 
 the existing 256GB SSDs for a cache.
 
 Then use my 36x3TB for the beasty NAS.
 
 Agreed that 256G mirrored SSDs are kind of wasted as system drives.  The 40G 
 mirror sounds ideal.


Update;

I went with ZFS as I didn't want to confuse the toolset needed to support this 
server.  Although gmirror is not hard to figure out, I wanted consistency in 
systems.

So I've a booted 9.1 rel using a mirrored ZFS system disk.

The drives do support TRIM but am unsure how this plays with ZFS.  I did the 
standard partition scheme of;

root@kronos:/root # gpart show
=  34  78165293  da0  GPT  (37G)
34   1281  freebsd-boot  (64k)
   162 6   - free -  (3.0k)
   168   83886082  freebsd-swap  (4.0G)
   8388776  697765443  freebsd-zfs  (33G)
  78165320 7   - free -  (3.5k)

=  34  78165293  da1  GPT  (37G)
34   1281  freebsd-boot  (64k)
   162 6   - free -  (3.0k)
   168   83886082  freebsd-swap  (4.0G)
   8388776  697765443  freebsd-zfs  (33G)
  78165320 7   - free -  (3.5k)

At any rate, thank you for the replies, very much appreciate it.

Especially since building a rather large production worthy NAS not knowing a 
lick of freeBSD.

The reasons going with freeBSD are 2 fold;

ZFS stability,seems a better marriage then ZOL.
Correctly provides NFS pre attributes on write reply; mtime.  Linux does not.

While its a steep learning curve, the 2 points above require the use of freeBSD 
or alike.

- aurf
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

ZFS trim patches

2013-07-19 Thread aurfalien

Hi,

Is this;

http://lists.freebsd.org/pipermail/freebsd-current/2012-September/036777.html

... available in the form of a patch for stable rels?

Its ZFS TRIM support.

- aurf

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: to gmirror or to ZFS


On Jul 16, 2013, at 2:41 AM, Shane Ambler wrote:

 On 16/07/2013 14:41, aurfalien wrote:
 
 On Jul 15, 2013, at 9:23 PM, Warren Block wrote:
 
 On Mon, 15 Jul 2013, aurfalien wrote:
 
 ... thats the question :)
 
 At any rate, I'm building a rather large 100+TB NAS using ZFS.
 
 However for my OS, should I also ZFS or simply gmirror as I've a
 dedicated pair of 256GB SSD drives for it.  I didn't ask for SSD
 sys drives, this system just came with em.
 
 This is more of a best practices q.
 
 ZFS has data integrity checking, gmirror has low RAM overhead.
 gmirror is, at present, restricted to MBR partitioning due to
 metadata conflicts with GPT, so 2TB is the maximum size.
 
 Best practices... depends on your use.  gmirror for the system
 leaves more RAM for ZFS.
 
 Perfect, thanks Warren.
 
 Just what I was looking for.
 
 I doubt that you would save any ram having the os on a non-zfs drive as
 you will already be using zfs chances are that non-zfs drives would only
 increase ram usage by adding a second cache. zfs uses it's own cache
 system and isn't going to share it's cache with other system managed
 drives. I'm not actually certain if the system cache still sits above
 zfs cache or not, I think I read it bypasses the traditional drive cache.
 
 For zfs cache you can set the max usage by adjusting vfs.zfs.arc_max
 that is a system wide setting and isn't going to increase if you have
 two zpools.
 
 Tip: set the arc_max value - by default zfs will use all physical ram
 for cache, set it to be sure you have enough ram left for any services
 you want running.
 
 Have you considered using one or both SSD drives with zfs? They can be
 added as cache or log devices to help performance.
 See man zpool under Intent Log and Cache Devices.

This is a very interesting point.

In terms if SSDs for cache, I was planning on using a pair of Samsung Pro 512GB 
SSDs for this purpose (which I haven't bought yet).

But I tire of buying stuff, so I have a pair of 40GB Intel SSDs for use as sys 
disks and several Intel 160GB SSDs lying around that I can combine with the 
existing 256GB SSDs for a cache.

Then use my 36x3TB for the beasty NAS.

- aurf


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Odd behavior while booting off Install media for 9.1...

... sometimes I get a normal boot procedure were I can proceed to install.

Other times I get the mountroot prompt and upon pressing enter, the system 
reboots.

This seems random with the same hardware setup.  I literally have to stare at 
the screen for it to finally push through to the install procedure.

I'm clearly new to freeBSD and was wondering what is going on here?

I'm happily installing now as I managed to find time and stare at the screen 
long enough but would like some insight n this if possible.

- aurf
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

gpart: table 'da0' is corrupt; operation not permitted

Hello again,

Not happy to be posting so much lately especially being so new.

I grabbed a few disks from a Mac and am using them for sys disks.

Upon booting from an install CD into a shell, I type;

gpart show

and see several partitions;

34  78165293da0 GPT 
(37G)   [CORRUPT]
34  6   - free -
(3.0k)
40  409600  1   efi 
(200M)
409640  774935362   
!52414944--11aa-aa11-00306543eacac  (37G)
77903176262144  3   apple-boot  
(128M)
781653207   - free- 
(3.5k)


Upon doing;

gpart destroy da0

I get;

gpart: Device busy


Upon doing;

gpart delete -i 1 da0

I get;

gpart: table da0 is corrupt: Operation not permitted

Any insight would be huge, thanks in advance,

- aurf


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: gpart: table 'da0' is corrupt; operation not permitted


On Jul 16, 2013, at 1:50 PM, Michael Sierchio wrote:

 On Tue, Jul 16, 2013 at 1:44 PM, aurfalien aurfal...@gmail.com wrote:
 
 Upon doing;
 
 gpart destroy da0
 
 I get;
 
 gpart: Device busy
 
 crude but effective:
 
 
 DISK=da0
 
 offset=`diskinfo $DISK | awk '{ print $4 - 131072 }'`
 dd if=/dev/zero of=/dev/$DISK bs=64k count=1
 dd if=/dev/zero of=/dev/$DISK bs=64k seek=$offset
 
 gpart create -s gpt ${DISK}

This is what I ended up doing.

I unplugged it, waited a few, re plugged and then I was able to delete/destroy.

I will keep your method on hand though as I prefer not doing a hot plug.

- aurf
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: gpart: table 'da0' is corrupt; operation not permitted