Re: hardware for home use large storage
On Mon, 15 Feb 2010, Dan Naumov wrote: DN PSU: Corsair 400CX 80+ - 59 euro - DN DN http://www.corsair.com/products/cx/default.aspx DN DN http://www.newegg.com/Product/Product.aspx?Item=N82E16817139008 for $50 DN DN Is that sufficient power up to 10 SATA HDD and an optical drive? DN DN Disk power use varies from about 8 watt/disk for green disks to 20 DN watt/disk for really powerhungry ones. So yes. The only thing one should be aware that startup current on contemporary 3.5 SATA disks would exceed 2.5A on 12V buse, so delaying plate startup is rather vital. Or get 500-520 VA PSU to be sure. Or do both just to be on the safe side ;-) -- Sincerely, D.Marck [DM5020, MCK-RIPE, DM3-RIPN] [ FreeBSD committer: ma...@freebsd.org ] *** Dmitry Morozovsky --- D.Marck --- Wild Woozle --- ma...@rinet.ru *** ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: hardware for home use large storage
On Mon, 15 Feb 2010, Dmitry Morozovsky wrote: On Sun, 14 Feb 2010, Dan Langille wrote: [snip] DL SAS controller ($120): DL http://www.buy.com/prod/supermicro-lsi-megaraid-lsisas1068e-8-port-sas-raid-controller-16mb/q/loc/101/207929556.html DL Note: You'll need to change or remove the mounting bracket since it is DL backwards. I was able to find a bracket with matching screw holes on an DL old nic and secure it to my case. It uses the same chipset as the more DL expensive 3081E-R, if I remember correctly. DL DL I follow what you say, but cannot comprehend why the bracket is backwards. It's because IO slot is ot the other side of the bracked, like good old ISA Yeah. Mirror image would be a more accurate description. I'm surprised I had an ISA card that matched up with the mounting holes. Supermicro calls it UIO. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: hardware for home use large storage
On Mon, Feb 15, 2010 at 08:57:10AM +0100, Alexander Leidinger wrote: Quoting Dan Naumov dan.nau...@gmail.com (from Mon, 15 Feb 2010 01:10:49 +0200): Get a dock for holding 2 x 2,5 disks in a single 5,25 slot and put it at the top, in the only 5,25 bay of the case. Now add an additional PCI-E SATA controller card, like the often mentioned PCIE SIL3124. Now you have 2 x 2,5 disk slots and 8 x 3,5 disk slots, with 6 native SATA ports on the motherboard and more ports on the controller card. Now get 2 x 80gb Intel SSDs and put them into the dock. Now partition each of them in the following fashion: 1: swap: 4-5gb 2: freebsd-zfs: ~10-15gb for root filesystem 3: freebsd-zfs: rest of the disk: dedicated L2ARC vdev If you already have 2 SSDs I suggest to make 4 partitions. The additional one for the ZIL (decide yourself what you want to speed up more and size the L2ARC and ZIL partitions accordingly...). This should speed up write operations. The ZIL one should be zfs mirrored, because the ZIL is more sensitive to disk failures than the L2ARC: zpool add pool log mirror SSD1pX SSD2pX GMirror your SSD swap partitions. Make a ZFS mirror pool out of your SSD root filesystem partitions Build your big ZFS pool however you like out of the mechanical disks you have. Add the 2 x ~60gb partitions as dedicated independant L2ARC devices for your SATA disk ZFS pool. BTW, the cheap way of doing something like this is to add a USB memory stick as L2ARC: http://www.leidinger.net/blog/2010/02/10/making-zfs-faster/ This will not give you the speed boost of a real SSD attached via SATA, but for the price (maybe you even got the memory stick for free somewhere) you can not get something better. I had a feeling someone would bring up L2ARC/cache devices. This gives me the opportunity to ask something that's been on my mind for quite some time now: Aside from the capacity different (e.g. 40GB vs. 1GB), is there a benefit to using a dedicated RAM disk (e.g. md(4)) to a pool for L2ARC/cache? The ZFS documentation explicitly states that cache device content is considered volatile. Example: # zpool status storage pool: storage state: ONLINE scrub: none requested config: NAMESTATE READ WRITE CKSUM storage ONLINE 0 0 0 mirrorONLINE 0 0 0 ad10ONLINE 0 0 0 ad14ONLINE 0 0 0 errors: No known data errors # mdconfig -a -t malloc -o reserve -s 256m -u 16 # zpool add storage cache md16 # zpool status storage pool: storage state: ONLINE scrub: none requested config: NAMESTATE READ WRITE CKSUM storage ONLINE 0 0 0 mirrorONLINE 0 0 0 ad10ONLINE 0 0 0 ad14ONLINE 0 0 0 cache md16 ONLINE 0 0 0 And removal: # zpool remove storage md16 # mdconfig -d -u 16 # -- | Jeremy Chadwick j...@parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
RE: hardware for home use large storage
I had a feeling someone would bring up L2ARC/cache devices. This gives me the opportunity to ask something that's been on my mind for quite some time now: Aside from the capacity different (e.g. 40GB vs. 1GB), is there a benefit to using a dedicated RAM disk (e.g. md(4)) to a pool for L2ARC/cache? The ZFS documentation explicitly states that cache device content is considered volatile. Using a ramdisk as an L2ARC vdev doesn't make any sense at all. If you have RAM to spare, it should be used by regular ARC. - Sincerely, Dan Naumov ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: hardware for home use large storage
On Mon, Feb 15, 2010 at 10:49:47AM +0200, Dan Naumov wrote: I had a feeling someone would bring up L2ARC/cache devices. This gives me the opportunity to ask something that's been on my mind for quite some time now: Aside from the capacity different (e.g. 40GB vs. 1GB), is there a benefit to using a dedicated RAM disk (e.g. md(4)) to a pool for L2ARC/cache? The ZFS documentation explicitly states that cache device content is considered volatile. Using a ramdisk as an L2ARC vdev doesn't make any sense at all. If you have RAM to spare, it should be used by regular ARC. ...except that it's already been proven on FreeBSD that the ARC getting out of control can cause kernel panics[1], horrible performance until ZFS has had its active/inactive lists flushed[2], and brings into question how proper tuning is to be established and what the effects are on the rest of the system[3]. There are still reports of people disabling ZIL for stability reasons as well. My thought process basically involves getting rid of the ARC and using L2ARC entirely, given that it provides more control/containment which cannot be achieved on FreeBSD (see above). In English: I'd trust a whole series of md(4) disks (with sizes that I choose) over something variable/dynamic which cannot be controlled or managed effectively. The Internals section of Brendan Gregg's blog[4] outlines where the L2ARC sits in the scheme of things, or if the ARC could essentially be disabled by setting the minimum size to something very small (a few megabytes) and instead using L2ARC which is manageable. [1]: http://lists.freebsd.org/pipermail/freebsd-questions/2010-January/211009.html [2]: http://lists.freebsd.org/pipermail/freebsd-stable/2010-January/053949.html [3]: http://lists.freebsd.org/pipermail/freebsd-stable/2010-February/055073.html [4]: http://blogs.sun.com/brendan/entry/test -- | Jeremy Chadwick j...@parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: hardware for home use large storage
On Sun, Feb 14, 2010 at 07:33:07PM -0500, Dan Langille wrote: Get a dock for holding 2 x 2,5 disks in a single 5,25 slot and put it at the top, in the only 5,25 bay of the case. That sounds very interesting. I just looking around for such a thing, and could not find it. Is there a more specific name? URL? I had an Addonics 5.25 frame for 4x 2.5 SAS/SATA but the small fans in it are unfortunatly of the cheap kind. I ended up using the 2x2.5 to 3.5 frame from Silverstone (for the small Silverstone case I got). -- Regards, Ulf. - Ulf Zimmermann, 1525 Pacific Ave., Alameda, CA-94501, #: 510-865-0204 You can find my resume at: http://www.Alameda.net/~ulf/resume.html ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
kernel compile failure
I'm getting: cc -c -O2 -frename-registers -pipe -fno-strict-aliasing -std=c99 -g -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -nostdinc -I. -I/usr/src/sys -I/usr/src/sys/contrib/altq -D_KERNEL -DHAVE_KERNEL_OPTION_HEADERS -include opt_global.h -fno-common -finline-limit=8000 --param inline-unit-growth=100 --param large-function-growth=1000 -fno-omit-frame-pointer -mcmodel=kernel -mno-red-zone -mfpmath=387 -mno-sse -mno-sse2 -mno-sse3 -mno-mmx -mno-3dnow -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fstack-protector -Werror /usr/src/sys/cam/ata/ata_xpt.c /usr/src/sys/cam/ata/ata_xpt.c: In function 'probestart': /usr/src/sys/cam/ata/ata_xpt.c:331: error: 'ATA_SF_PUIS_SPINUP' undeclared (first use in this function) /usr/src/sys/cam/ata/ata_xpt.c:331: error: (Each undeclared identifier is reported only once /usr/src/sys/cam/ata/ata_xpt.c:331: error: for each function it appears in.) /usr/src/sys/cam/ata/ata_xpt.c: In function 'probedone': /usr/src/sys/cam/ata/ata_xpt.c:789: error: 'ATA_RESP_INCOMPLETE' undeclared (first use in this function) *** Error code 1 Stop in /usr/obj/usr/src/sys/BORG. *** Error code 1 Stop in /usr/src. *** Error code 1 Stop in /usr/src. with a RELENG_8 csup'ed yesterday. Any ideas? kernel Config: # # # For more information on this file, please read the handbook section on # Kernel Configuration Files: # # http://www.FreeBSD.org/doc/en_US.ISO8859-1/books/handbook/kernelconfig-config.html # # The handbook is also available locally in /usr/share/doc/handbook # if you've installed the doc distribution, otherwise always see the # FreeBSD World Wide Web server (http://www.FreeBSD.org/) for the # latest information. # # An exhaustive list of options and more detailed explanations of the # device lines is also present in the ../../conf/NOTES and NOTES files. # If you are in doubt as to the purpose or necessity of a line, check first # in NOTES. # # $FreeBSD: src/sys/amd64/conf/GENERIC,v 1.475 2007/04/10 21:40:12 pjd Exp $ cpu HAMMER ident BORG # To statically compile in device wiring instead of /boot/device.hints #hints GENERIC.hints # Default places to look for devices. makeoptions DEBUG=-g# Build kernel with gdb(1) debug symbols #optionsSCHED_4BSD # 4BSD scheduler options SCHED_ULE # ULE scheduler options PREEMPTION # Enable kernel thread preemption options INET# InterNETworking options INET6 # IPv6 communications protocols options FFS # Berkeley Fast Filesystem options SOFTUPDATES # Enable FFS soft updates support options UFS_ACL # Support for access control lists options UFS_DIRHASH # Improve performance on big directories options UFS_GJOURNAL# Enable gjournal-based UFS journaling options MD_ROOT # MD is a potential root device options NFSCLIENT # Network Filesystem Client options NFSSERVER # Network Filesystem Server options NFS_ROOT# NFS usable as /, requires NFSCLIENT options NFSLOCKD# Network Lock Manager options NTFS# NT File System options MSDOSFS # MSDOS Filesystem options CD9660 # ISO 9660 Filesystem options PROCFS # Process filesystem (requires PSEUDOFS) options PSEUDOFS# Pseudo-filesystem framework options GEOM_PART_GPT # GUID Partition Tables. options GEOM_LABEL # Provides labelization options COMPAT_43TTY# BSD 4.3 TTY compat [KEEP THIS!] options COMPAT_IA32 # Compatible with i386 binaries options COMPAT_FREEBSD4 # Compatible with FreeBSD4 options COMPAT_FREEBSD5 # Compatible with FreeBSD5 options COMPAT_FREEBSD6 # Compatible with FreeBSD6 #8+ options COMPAT_FREEBSD7 # Compatible with FreeBSD7 options SCSI_DELAY=5000 # Delay (in ms) before probing SCSI options KTRACE # ktrace(1) support options SYSVSHM # SYSV-style shared memory options SYSVMSG # SYSV-style message queues options SYSVSEM # SYSV-style semaphores options _KPOSIX_PRIORITY_SCHEDULING # POSIX P1003_1B real-time extensions options KBD_INSTALL_CDEV# install a CDEV entry in /dev ###8+ default now #optionsADAPTIVE_GIANT # Giant mutex is adaptive. #optionsSTOP_NMI# Stop CPUS using NMI instead of IPI options
Re: hardware for home use large storage
Quoting Jeremy Chadwick free...@jdc.parodius.com (from Mon, 15 Feb 2010 01:07:56 -0800): On Mon, Feb 15, 2010 at 10:49:47AM +0200, Dan Naumov wrote: I had a feeling someone would bring up L2ARC/cache devices. This gives me the opportunity to ask something that's been on my mind for quite some time now: Aside from the capacity different (e.g. 40GB vs. 1GB), is there a benefit to using a dedicated RAM disk (e.g. md(4)) to a pool for L2ARC/cache? The ZFS documentation explicitly states that cache device content is considered volatile. Using a ramdisk as an L2ARC vdev doesn't make any sense at all. If you have RAM to spare, it should be used by regular ARC. ...except that it's already been proven on FreeBSD that the ARC getting out of control can cause kernel panics[1], horrible performance until There are other ways (not related to ZFS) to shoot into your feet too, I'm tempted to say that this is a) a documentation bug and b) a lack of sanity checking of the values... anyone out there with a good algorithm for something like this? Normally you do some testing with the values you use, so once you resolved the issues, the system should be stable. ZFS has had its active/inactive lists flushed[2], and brings into Someone needs to sit down and play a little bit with ways to tell the ARC that there is free memory. The mail you reference already tells that the inactive/cached lists should maybe taken into account too (I didn't had a look at this part of the ZFS code). question how proper tuning is to be established and what the effects are on the rest of the system[3]. There are still reports of people That's what I talk about regarding b) above. If you specify an arc_max which is too big (arc_max kmem_size - SOME_SAVE_VALUE), there should be a message from the kernel and the value should be adjusted to a save amount. Until the problems are fixed, a MD for L2ARC may be a viable alternative (if you have enough mem to give for this). Feel free to provide benchmark numbers, but in general I see this just as a workaround for the current issues. disabling ZIL for stability reasons as well. For the ZIL you definitively do not want to have a MD. If you do not specify a log vdev for the pool, the ZIL will be written somewhere on the disks of the pool. When the data hits the ZIL, it has to be really on a non-volatile storage. If you lose the ZIL, you lose data. The Internals section of Brendan Gregg's blog[4] outlines where the L2ARC sits in the scheme of things, or if the ARC could essentially be disabled by setting the minimum size to something very small (a few megabytes) and instead using L2ARC which is manageable. At least in 7-stable, 8-stable and 9-current, the arc_max now really corresponds to a max value, so it is more of providing a save arc_max than a minimal arc_max. No matter how you construct the L2ARC, ARC access will be faster than L2ARC access. [1]: http://lists.freebsd.org/pipermail/freebsd-questions/2010-January/211009.html [2]: http://lists.freebsd.org/pipermail/freebsd-stable/2010-January/053949.html [3]: http://lists.freebsd.org/pipermail/freebsd-stable/2010-February/055073.html [4]: http://blogs.sun.com/brendan/entry/test Bye, Alexander. -- BOFH excuse #439: Hot Java has gone cold http://www.Leidinger.netAlexander @ Leidinger.net: PGP ID = B0063FE7 http://www.FreeBSD.org netchild @ FreeBSD.org : PGP ID = 72077137 ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: kernel compile failure
On Mon, Feb 15, 2010 at 03:43:36AM -0600, Larry Rosenman wrote: I'm getting: cc -c -O2 -frename-registers -pipe -fno-strict-aliasing -std=c99 -g -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -nostdinc -I. -I/usr/src/sys -I/usr/src/sys/contrib/altq -D_KERNEL -DHAVE_KERNEL_OPTION_HEADERS -include opt_global.h -fno-common -finline-limit=8000 --param inline-unit-growth=100 --param large-function-growth=1000 -fno-omit-frame-pointer -mcmodel=kernel -mno-red-zone -mfpmath=387 -mno-sse -mno-sse2 -mno-sse3 -mno-mmx -mno-3dnow -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fstack-protector -Werror /usr/src/sys/cam/ata/ata_xpt.c /usr/src/sys/cam/ata/ata_xpt.c: In function 'probestart': /usr/src/sys/cam/ata/ata_xpt.c:331: error: 'ATA_SF_PUIS_SPINUP' undeclared (first use in this function) /usr/src/sys/cam/ata/ata_xpt.c:331: error: (Each undeclared identifier is reported only once /usr/src/sys/cam/ata/ata_xpt.c:331: error: for each function it appears in.) /usr/src/sys/cam/ata/ata_xpt.c: In function 'probedone': /usr/src/sys/cam/ata/ata_xpt.c:789: error: 'ATA_RESP_INCOMPLETE' undeclared (first use in this function) *** Error code 1 Stop in /usr/obj/usr/src/sys/BORG. *** Error code 1 Stop in /usr/src. *** Error code 1 Stop in /usr/src. with a RELENG_8 csup'ed yesterday. Any ideas? 1) When running csup, always take note of what src-all pieces are getting touched. I'm 100% certain your csup would have shown that the above code had recently been modified (commits done to it). I tend to review every single source code piece that gets committed that appears relevant or interests me. ATA or CAM subsystem, SMP, VM, or UFS/FFS stuff is a big focus of mine, so I watch these like a hawk. 2) When encountering a kernel build error like the above, start reviewing commits on the web: http://www.freebsd.org/cgi/cvsweb.cgi/src/sys/cam/ata/ata_xpt.c You can see there that code was modified ~14 hours ago, and who the committer was. It's safe to say this commit is responsible for your problem, since the error is in regards to PUIS (Power Up In Stand-by): = Revision 1.3.2.20: download - view: text, markup, annotated - select for diffs Sun Feb 14 19:50:33 2010 UTC (14 hours ago) by mav Branches: RELENG_8 Diff to: previous 1.3.2.19: preferred, colored; branchpoint 1.3: preferred, colored Changes since revision 1.3.2.19: +36 -2 lines SVN rev 203893 on 2010-02-14 19:50:33Z by mav MFC r203421: Add Power Up In Stand-by feature support. Device with PUIS enabled require explicit command to do initial spin-up. Mark that command with CAM_HIGH_POWER flag, to allow CAM manage staggered spin-up. = I've CC'd the committer here. -- | Jeremy Chadwick j...@parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
ACK and RST packets sent after successfully terminating TCP connection
Hi all, I'm reposting this from the freebsd-questions hoping for some answers. I feel there is something wrong here, but would really appreciate a second opinion before opening a bug report. The problematic part is marked with [what is this?]. - in case of successful connection: [begin handshake] 14:52:57.866040 IP client.example.net.6524 server.example.net.9002: S 813851098:813851098(0) win 8192 mss 1380,nop,wscale 2,nop,nop,sackOK 14:52:57.866057 IP server.example.net.9002 client.example.net.6524: S 3888621507:3888621507(0) ack 813851099 win 65535 mss 1380,nop,wscale 3,sackOK,eol 14:52:57.867143 IP client.example.net.6524 server.example.net.9002: . ack 3888621508 win 16560 [end handshake begin data] 14:52:57.868333 IP client.example.net.6524 server.example.net.9002: P 813851099:813852180(1081) ack 3888621508 win 16560 14:52:57.967858 IP server.example.net.9002 client.example.net.6524: . ack 813852180 win 8144 14:53:35.533165 IP server.example.net.9002 client.example.net.6524: P 3888621508:3888621542(34) ack 813852180 win 8144 [end data begin teardown] 14:53:35.564542 IP server.example.net.9002 client.example.net.6524: FP 3888621542:3888621675(133) ack 813852180 win 8280 14:53:35.566228 IP client.example.net.6524 server.example.net.9002: . ack 3888621676 win 16518 14:53:35.566289 IP client.example.net.6524 server.example.net.9002: F 813852180:813852180(0) ack 3888621676 win 16518 14:53:35.566318 IP server.example.net.9002 client.example.net.6524: . ack 813852181 win 8279 [end teardown] [what is this?] 14:53:36.172081 IP server.example.net.9002 client.example.net.6524: . ack 813852180 win 0 14:53:36.172101 IP server.example.net.9002 client.example.net.6524: . ack 813852181 win 8279 - in case of unsuccessful connection: [begin handshake] 14:53:00.411337 IP client.example.net.6547 server.example.net.9002: S 1055031875:1055031875(0) win 8192 mss 1380,nop,wscale 2,nop,nop,sackOK 14:53:00.411354 IP server.example.net.9002 client.example.net.6547: S 2849043653:2849043653(0) ack 1055031876 win 65535 mss 1380,nop,wscale 3,sackOK,eol 14:53:00.412242 IP client.example.net.6547 server.example.net.9002: . ack 2849043654 win 16560 [end handshake reset connection] 14:53:00.412251 IP server.example.net.9002 client.example.net.6547: R 2849043654:2849043654(0) win 0 [what is this?] 14:53:01.168076 IP server.example.net.9002 client.example.net.6547: . ack 1055031876 win 0 14:53:01.168100 IP server.example.net.9002 client.example.net.6547: R 2849043654:2849043654(0) win 0 14:53:01.168393 IP client.example.net.6547 server.example.net.9002: R 1055031876:1055031876(0) ack 2849043653 win 0 The server is running 7.2 GENERIC. Thanks, -- Nino ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Hello and a small problem with 8.0-RELEASE (amd64)
On Thu, 2010-02-11 at 14:00 -0700, Sean McCullough wrote: Hello, freebsd-stable folks! I sincerely hope I am in the correct place to inquire about a small problem I am having implementing FreeBSD 8.0-RELEASE on my AMD Athlon-64 machine. This machine runs FreeBSD 7.2 (amd64 version) without the slightest problem; but when I attempt to load 8.0 onto the machine, I can't even get sysinstall to put the kernel on to boot it. Attempting to compile and install the 8.0 kernel from source code results in a kernel which locks up at boot time after emitting a message stating attempting to mount volumes; a reboot of this system results in a bootloader prompt and an error message stating that no bootable kernel can be found. Can you provide a verbose dmesg -a from the system while it is running 7.2? It would be useful if you could also boot 8.0 with verbose messages, and mark on it where exactly you see the hang, as I don't know where the attempting to mount volumes message is coming from (I don't see it on my 8.0 machine, and I can't see it anywhere in the source). Thanks! Gavin ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: hardware for home use large storage
On Mon, Feb 15, 2010 at 10:50:00AM +0100, Alexander Leidinger wrote: Quoting Jeremy Chadwick free...@jdc.parodius.com (from Mon, 15 Feb 2010 01:07:56 -0800): On Mon, Feb 15, 2010 at 10:49:47AM +0200, Dan Naumov wrote: I had a feeling someone would bring up L2ARC/cache devices. This gives me the opportunity to ask something that's been on my mind for quite some time now: Aside from the capacity different (e.g. 40GB vs. 1GB), is there a benefit to using a dedicated RAM disk (e.g. md(4)) to a pool for L2ARC/cache? The ZFS documentation explicitly states that cache device content is considered volatile. Using a ramdisk as an L2ARC vdev doesn't make any sense at all. If you have RAM to spare, it should be used by regular ARC. ...except that it's already been proven on FreeBSD that the ARC getting out of control can cause kernel panics[1], horrible performance until First and foremost, sorry for the long post. I tried to keep it short, but sometimes there's just a lot to be said. There are other ways (not related to ZFS) to shoot into your feet too, I'm tempted to say that this is a) a documentation bug and b) a lack of sanity checking of the values... anyone out there with a good algorithm for something like this? Normally you do some testing with the values you use, so once you resolved the issues, the system should be stable. What documentation? :-) The Wiki? If so, that's been outdated for some time; I know Ivan Voras was doing his best to put good information there, but it's hard given the below chaos. The following tunables are recurrently mentioned as focal points, but no one's explained in full how to tune these properly, or which does what (perfect example: vm.kmem_size_max vs. vm.kmem_size. _max used to be what you'd adjust to solve kmem exhaustion issues, but now people are saying otherwise?). I realise it may differ per system (given how much RAM the system has), so different system configurations/examples would need to be provided. I realise that the behaviour of some have changed too (e.g. -RELEASE differs from -STABLE, and 7.x differs from 8.x). I've marked commonly-referred-to tunables with an asterisk: kern.maxvnodes * vm.kmem_size * vm.kmem_size_max * vfs.zfs.arc_min * vfs.zfs.arc_max vfs.zfs.prefetch_disable (auto-tuned based on available RAM on 8-STABLE) vfs.zfs.txg.timeout vfs.zfs.vdev.cache.size vfs.zfs.vdev.cache.bshift vfs.zfs.vdev.max_pending vfs.zfs.zil_disable Then, when it comes to debugging problems as a result of tuning improperly (or entire lack of), the following counters (not tunables) are thrown into the mix as things people should look at: kstat.zfs.misc.arcstats.c kstat.zfs.misc.arcstats.c_min kstat.zfs.misc.arcstats.c_max kstat.zfs.misc.arcstats.evict_skip kstat.zfs.misc.arcstats.memory_throttle_count kstat.zfs.misc.arcstats.size None of these have sysctl descriptions (sysctl -d) either. I can provide posts to freebsd-stable, freebsd-current, freebsd-fs, or freebsd-questions, or freebsd-users referencing these variables or counters if you need context. All that said: I would be more than happy to write some coherent documentation that folks could refer to officially, but rather than spend my entire lifetime reverse-engineering the ZFS code I think it'd make more sense to get some official parties involved to explain things. I'd like to add some kind of monitoring section as well -- how administrators could keep an eye on things and detect, semi-early, if additional tuning is required or something along those lines. ZFS has had its active/inactive lists flushed[2], and brings into Someone needs to sit down and play a little bit with ways to tell the ARC that there is free memory. The mail you reference already tells that the inactive/cached lists should maybe taken into account too (I didn't had a look at this part of the ZFS code). question how proper tuning is to be established and what the effects are on the rest of the system[3]. There are still reports of people That's what I talk about regarding b) above. If you specify an arc_max which is too big (arc_max kmem_size - SOME_SAVE_VALUE), there should be a message from the kernel and the value should be adjusted to a save amount. Until the problems are fixed, a MD for L2ARC may be a viable alternative (if you have enough mem to give for this). Feel free to provide benchmark numbers, but in general I see this just as a workaround for the current issues. I've played with this a bit (2-disk mirror + one 256MB md), but I'm not completely sure how to read the bonnie++ results, nor am I sure I'm using the right arguments (bonnie++ -s8192 -n64 -d/pool on a machine that has 4GB). L2ARC (cache vdev) is supposed to improve random reads, while a log vdev (presumably something that links in with the ZIL) improves random writes. I'm not sure where bonnie++ tests random reads, but I do see it testing random seeks.
Sudden mbuf demand increase and shortage under the load
Hi, Our company have a FreeBSD based product that consists of the numerous interconnected processes and it does some high-PPS UDP processing (30-50K PPS is not uncommon). We are seeing some strange periodic failures under the load in several such systems, which usually evidences itself in IPC (even through unix domain sockets) suddenly either breaking down or pausing and restoring only some time later (like 5-10 minutes). The only sign of failure I managed to find was the increase of the requests for mbufs denied in the netstat -m and number of total mbuf clusters (nmbclusters) raising up to the limit. I have tried to raise some network-related limits (most notably maxusers and nmbclusters), but it has not helped with the issue - it's still happening from time to time to us. Below you can find output from the netstat -m few minutes right after that shortage period - you see that somehow the system has allocated huge amount of memory for the network (700MB), with only tiny amount of that being actually in use. This is for the kern.ipc.nmbclusters: 302400. Eventually the system reclaims all that memory and goes back to its normal use of 30-70MB. This problem is killing us, so any suggestions are greatly appreciated. My current hypothesis is that due to some issues either with the network driver or network subsystem itself, the system goes insane and eats up all mbufs up to nmbclusters limit. But since mbufs are shared between network and local IPC, IPC goes down as well. We observe this issue with systems using both em(4) driver and igb(4) driver. I believe both drivers share the same design, however I am not sure if this is some kind of design flaw in the driver or part of a larger problem with the network subsystem. This happens on amd64 7.2-RELEASE and 7.3-PRERELEASE alike, with 8GB of memory. I have not tried upgrading to 8.0, this is production system so upgrading will not be easy. I don't believe there are some differences that let us hope that this problem will go away after upgrade, but I can try it as the last resort. As I said, this is very critical issue, so I can provide any additional debug information upon request. We are ready to go as far as paying somebody reasonable amount of money for tracking down and resolving the issue. Regards, -- Maksym Sobolyev Sippy Software, Inc. Internet Telephony (VoIP) Experts T/F: +1-646-651-1110 Web: http://www.sippysoft.com MSN: sa...@sippysoft.com Skype: SippySoft [ssp-r...@ds-467 /usr/src]$ netstat -m 17061/417669/434730 mbufs in use (current/cache/total) 10420/291980/302400/302400 mbuf clusters in use (current/cache/total/max) 10420/0 mbuf+clusters out of packet secondary zone in use (current/cache) 19/1262/1281/51200 4k (page size) jumbo clusters in use (current/cache/total/max) 0/0/0/25600 9k jumbo clusters in use (current/cache/total/max) 0/0/0/12800 16k jumbo clusters in use (current/cache/total/max) 25181K/693425K/718606K bytes allocated to network (current/cache/total) 1246681/129567494/67681640 requests for mbufs denied (mbufs/clusters/mbuf+clusters) 0/0/0 requests for jumbo clusters denied (4k/9k/16k) 0/0/0 sfbufs in use (current/peak/max) 0 requests for sfbufs denied 0 requests for sfbufs delayed 0 requests for I/O initiated by sendfile 0 calls to protocol drain routines [FEW MINUTES LATER] [ssp-r...@ds-467 /usr/src]$ netstat -m 10001/84574/94575 mbufs in use (current/cache/total) 6899/6931/13830/302400 mbuf clusters in use (current/cache/total/max) 6899/6267 mbuf+clusters out of packet secondary zone in use (current/cache) 2/1151/1153/51200 4k (page size) jumbo clusters in use (current/cache/total/max) 0/0/0/25600 9k jumbo clusters in use (current/cache/total/max) 0/0/0/12800 16k jumbo clusters in use (current/cache/total/max) 16306K/39609K/55915K bytes allocated to network (current/cache/total) 1246681/129567494/67681640 requests for mbufs denied (mbufs/clusters/mbuf+clusters) 0/0/0 requests for jumbo clusters denied (4k/9k/16k) 0/0/0 sfbufs in use (current/peak/max) 0 requests for sfbufs denied 0 requests for sfbufs delayed 0 requests for I/O initiated by sendfile 0 calls to protocol drain routines ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: kernel compile failure
Jeremy Chadwick wrote: On Mon, Feb 15, 2010 at 03:43:36AM -0600, Larry Rosenman wrote: I'm getting: cc -c -O2 -frename-registers -pipe -fno-strict-aliasing -std=c99 -g -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -nostdinc -I. -I/usr/src/sys -I/usr/src/sys/contrib/altq -D_KERNEL -DHAVE_KERNEL_OPTION_HEADERS -include opt_global.h -fno-common -finline-limit=8000 --param inline-unit-growth=100 --param large-function-growth=1000 -fno-omit-frame-pointer -mcmodel=kernel -mno-red-zone -mfpmath=387 -mno-sse -mno-sse2 -mno-sse3 -mno-mmx -mno-3dnow -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fstack-protector -Werror /usr/src/sys/cam/ata/ata_xpt.c /usr/src/sys/cam/ata/ata_xpt.c: In function 'probestart': /usr/src/sys/cam/ata/ata_xpt.c:331: error: 'ATA_SF_PUIS_SPINUP' undeclared (first use in this function) /usr/src/sys/cam/ata/ata_xpt.c:331: error: (Each undeclared identifier is reported only once /usr/src/sys/cam/ata/ata_xpt.c:331: error: for each function it appears in.) /usr/src/sys/cam/ata/ata_xpt.c: In function 'probedone': /usr/src/sys/cam/ata/ata_xpt.c:789: error: 'ATA_RESP_INCOMPLETE' undeclared (first use in this function) *** Error code 1 Stop in /usr/obj/usr/src/sys/BORG. *** Error code 1 Stop in /usr/src. *** Error code 1 Stop in /usr/src. with a RELENG_8 csup'ed yesterday. Any ideas? Try to update sources again. Updated sys/ata.h file was committed same time and it includes all these constants. CVSWEB also shows all required pieces in place there. -- Alexander Motin ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Sudden mbuf demand increase and shortage under the load
On 02/15/10 13:25, Maxim Sobolev wrote: Hi, Our company have a FreeBSD based product that consists of the numerous interconnected processes and it does some high-PPS UDP processing (30-50K PPS is not uncommon). We are seeing some strange periodic I have nothing very useful to help you with but maybe you can detect if it's a em/igp issue by buying a cheap Realtek gigabit (re) card and trying it out. Those can be bought for a few dollars now (e.g. from D-Link and many others), and I can confirm that at least the one I tried can carry around 50K pps, but not much more (I can tell you the exact chip later today if you are interested). failures under the load in several such systems, which usually evidences itself in IPC (even through unix domain sockets) suddenly either breaking down or pausing and restoring only some time later (like 5-10 minutes). The only sign of failure I managed to find was the increase of the requests for mbufs denied in the netstat -m and number of total mbuf clusters (nmbclusters) raising up to the limit. I have tried to raise some network-related limits (most notably maxusers and nmbclusters), but it has not helped with the issue - it's still happening from time to time to us. Below you can find output from the netstat -m few minutes right after that shortage period - you see that somehow the system has allocated huge amount of memory for the network (700MB), with only tiny amount of that being actually in use. This is for the kern.ipc.nmbclusters: 302400. Eventually the system reclaims all that memory and goes back to its normal use of 30-70MB. This problem is killing us, so any suggestions are greatly appreciated. My current hypothesis is that due to some issues either with the network driver or network subsystem itself, the system goes insane and eats up all mbufs up to nmbclusters limit. But since mbufs are shared between network and local IPC, IPC goes down as well. We observe this issue with systems using both em(4) driver and igb(4) driver. I believe both drivers share the same design, however I am not sure if this is some kind of design flaw in the driver or part of a larger problem with the network subsystem. This happens on amd64 7.2-RELEASE and 7.3-PRERELEASE alike, with 8GB of memory. I have not tried upgrading to 8.0, this is production system so upgrading will not be easy. I don't believe there are some differences that let us hope that this problem will go away after upgrade, but I can try it as the last resort. As I said, this is very critical issue, so I can provide any additional debug information upon request. We are ready to go as far as paying somebody reasonable amount of money for tracking down and resolving the issue. Regards, ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: freebsd7 (and 8), radeon, xorg-server - deadlock or so
On Sat, 13 Feb 2010 15:27:04 -0600 Robert Noland rnol...@freebsd.org wrote: On Sat, 2010-02-13 at 11:37 -0800, Norbert Papke wrote: On February 13, 2010, Robert Noland wrote: Ok, I've put up a patch at: http://people.freebsd.org/~rnoland/drm-radeon-test.patch http://people.freebsd.org/~rnoland/drm-radeon-8-test.patch This one should work on 8... robert. This is sort of a mega patch and includes: Re-worked drm mapping code, that ensures that we don't end up incorrectly mapping certain maps with overlapping offsets. This generally shows up as the ring buffer not being cleared (contents != 0 in xorg.log) which leads to corruption and other bad behavior. Re-written scatter gather allocation code. This interacts directly with the VM system, rather than using bus_dma to allow us to grab non-contiguous pages for the scatter gather backing of the GART. It also makes it easier to handle the caching mode of the backing pages. Disable cache snooping on radeon cards, since we have write combining set properly now. I have at least done a test build on -CURRENT with this patch, but I haven't had time to do much else without the rest of the code in my tree. I've been running most all of this code for a month or two now at least, so it is mostly just a question of whether or not I got all of the conflicts sorted out properly when I made this patch. The re-mapping code has the most widespread impact and has been tested on radeon r600 amd64, intel g45 i386 and mga amd64. robert. The patch applied cleanly. I have applied the patch to a clean 8-STABLE environment with WITNESS, INVARIANTS and KDB_UNATTENDED in the kernel. I still see the crashes when starting X with DRI on. This is what I see in messages: Feb 14 19:13:44 alpha kernel: [drm:pid30467:drm_mmap] called with offset 070001c7b000 Feb 14 19:13:44 alpha kernel: [drm:pid30467:drm_mmap] called with offset 070001c7c000 Feb 14 19:13:44 alpha kernel: Feb 14 19:13:44 alpha kernel: [drm:pid30467:drm_mmap] called with offset 070001c7d000 Feb 14 19:13:44 alpha kernel: Feb 14 19:13:44 alpha kernel: [drm:pid30467:drm_mmap] called with offset 070001c7e000 Feb 14 19:13:44 alpha kernel: [drm:pid30467:drm_mmap] called with offset 070001c7f000 Feb 14 19:13:44 alpha kernel: Feb 14 19:13:44 alpha kernel: [drm:pid30467:drm_ioctl] pid=30467, cmd=0xc0286415, nr=0x15, dev 0xff0001a79400, auth=1 Feb 14 19:13:44 alpha kernel: Feb 14 19:13:44 alpha kernel: [drm:pid30467:drm_addmap] offset = 0xfe8e, size = 0x0001, type = 1 Feb 14 19:13:44 alpha kernel: [drm:pid30467:drm_addmap] Found kernel map 1 Feb 14 19:13:44 alpha kernel: [drm:pid30467:drm_addmap] Added map 1 0xfe8e/0x1 Feb 14 19:13:44 alpha kernel: [drm:pid30467:drm_ioctl] pid=30467, cmd=0x80106459, nr=0x59, dev 0xff0001a79400, auth=1 There has been one odd development. If I startx with DRI off or NoAccel set it starts as usual. If I then quit and to cli and restart, I see the same crash as if I had DRI on. Martin ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
RE: kernel compile failure
For the record, it appears that cvsup17.us.freebsd.org is serving outdated files. $ find . -name ata.h ./sys/ata.h $ cd sys $ ls -l ata.h -rw-r--r-- 1 root wheel 25308 Feb 6 12:35 ata.h $ sudo -s Password: # rm ata.h # csup -h cvsup17.us.freebsd.org -L 2 -g /usr/share/examples/cvsup/stand* Parsing supfile /usr/share/examples/cvsup/standard-supfile Connecting to cvsup17.us.freebsd.org Connected to 65.212.71.21 Server software version: SNAP_16_1h Negotiating file attribute support Exchanging collection information Establishing multiplexed-mode data connection Running Updating collection src-all/cvs Checkout src/sys/sys/ata.h Shutting down connection to server Finished successfully # ls -l ata.h -rw-r--r-- 1 root wheel 25308 Jan 19 06:58 ata.h # csup -h cvsup14.us.freebsd.org -L 2 -g /usr/share/examples/cvsup/stand* Parsing supfile /usr/share/examples/cvsup/standard-supfile Connecting to cvsup14.us.freebsd.org Connected to 216.87.78.137 Server software version: SNAP_16_1h Negotiating file attribute support Exchanging collection information Establishing multiplexed-mode data connection Running Updating collection src-all/cvs Edit src/sys/netinet/libalias/alias_mod.c Add delta 1.4.2.3 2010.02.11.18.34.06 mjacob Edit src/sys/netinet/sctp_asconf.c Add delta 1.40.2.4 2010.02.11.18.34.06 mjacob Edit src/sys/netinet/sctputil.c Add delta 1.93.2.7 2010.02.11.18.34.06 mjacob Edit src/sys/nfsclient/bootp_subr.c Add delta 1.86.2.4 2010.02.11.18.34.06 mjacob Edit src/sys/nfsclient/nfs.h Add delta 1.110.2.2 2010.02.10.16.16.50 rmacklem Edit src/sys/nfsclient/nfs_bio.c Add delta 1.180.2.2 2010.02.10.16.16.50 rmacklem Edit src/sys/nfsclient/nfs_nfsiod.c Add delta 1.95.2.2 2010.02.10.16.16.50 rmacklem Edit src/sys/nfsclient/nfs_subs.c Add delta 1.163.2.3 2010.02.10.16.16.50 rmacklem Edit src/sys/nfsclient/nfs_vnops.c Add delta 1.318.2.8 2010.02.10.16.16.50 rmacklem Edit src/sys/nfsclient/nfsnode.h Add delta 1.66.2.3 2010.02.10.16.16.50 rmacklem Edit src/sys/pci/ncr.c Add delta 1.197.10.2 2010.02.11.18.34.06 mjacob Edit src/sys/powerpc/aim/mmu_oea.c Add delta 1.130.2.2 2010.02.11.18.34.06 mjacob Edit src/sys/rpc/clnt_dg.c Add delta 1.7.2.3 2010.02.11.18.34.06 mjacob Edit src/sys/sys/ata.h Add delta 1.41.2.7 2010.02.14.19.50.33 mav Edit src/sys/ufs/ffs/ffs_snapshot.c Add delta 1.150.2.2 2010.02.11.18.34.06 mjacob Edit src/tools/make_libdeps.sh Add delta 1.9.10.2 2010.02.15.11.29.27 ru Edit src/usr.bin/netstat/if.c Add delta 1.70.2.3 2010.02.10.00.34.13 delphij Edit src/usr.bin/netstat/main.c Add delta 1.96.2.3 2010.02.10.00.34.13 delphij Edit src/usr.bin/netstat/netstat.1 Add delta 1.63.2.2 2010.02.10.00.34.13 delphij Edit src/usr.bin/netstat/netstat.h Add delta 1.58.2.3 2010.02.10.00.34.13 delphij Edit src/usr.sbin/rtsold/rtsold.c Add delta 1.23.2.2 2010.02.13.16.25.33 ume Add delta 1.23.2.3 2010.02.13.16.28.25 ume Shutting down connection to server Finished successfully # $ -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 512-248-2683E-Mail: l...@lerctr.org US Mail: 430 Valona Loop, Round Rock, TX 78681-3893 -Original Message- From: Alexander Motin [mailto:mav...@gmail.com] On Behalf Of Alexander Motin Sent: Monday, February 15, 2010 7:01 AM To: Larry Rosenman Cc: Jeremy Chadwick; freebsd-stable@freebsd.org Subject: Re: kernel compile failure Jeremy Chadwick wrote: On Mon, Feb 15, 2010 at 03:43:36AM -0600, Larry Rosenman wrote: I'm getting: cc -c -O2 -frename-registers -pipe -fno-strict-aliasing -std=c99 -g -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -nostdinc -I. -I/usr/src/sys -I/usr/src/sys/contrib/altq -D_KERNEL -DHAVE_KERNEL_OPTION_HEADERS -include opt_global.h -fno-common -finline-limit=8000 --param inline-unit-growth=100 --param large-function-growth=1000 -fno-omit-frame-pointer -mcmodel=kernel -mno-red-zone -mfpmath=387 -mno-sse -mno-sse2 -mno-sse3 -mno-mmx -mno-3dnow -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fstack-protector -Werror /usr/src/sys/cam/ata/ata_xpt.c /usr/src/sys/cam/ata/ata_xpt.c: In function 'probestart': /usr/src/sys/cam/ata/ata_xpt.c:331: error: 'ATA_SF_PUIS_SPINUP' undeclared (first use in this function) /usr/src/sys/cam/ata/ata_xpt.c:331: error: (Each undeclared identifier is reported only once /usr/src/sys/cam/ata/ata_xpt.c:331: error: for each function it appears in.) /usr/src/sys/cam/ata/ata_xpt.c: In function 'probedone': /usr/src/sys/cam/ata/ata_xpt.c:789: error: 'ATA_RESP_INCOMPLETE' undeclared (first use in this function) *** Error code 1 Stop in /usr/obj/usr/src/sys/BORG. *** Error code 1 Stop in /usr/src. *** Error code 1 Stop in /usr/src. with a RELENG_8 csup'ed yesterday. Any ideas? Try to update sources again. Updated sys/ata.h file was committed same time and it includes all these constants.
Re: More zfs benchmarks
On Sun, 14 Feb 2010 22:58:58 + Jonathan Belson wrote: On 14 Feb 2010, at 21:15, Joshua Boyd wrote: Here are my relevant settings: vfs.zfs.prefetch_disable=0 ^^ [1] I already had prefetch disabled, but ... Just a note: prefetch is not disabled here [1]. -- WBR, Boris Samorodov (bsam) Research Engineer, http://www.ipt.ru Telephone Internet SP FreeBSD Committer, http://www.FreeBSD.org The Power To Serve ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: hardware for home use large storage
Ulf Zimmermann wrote: On Sun, Feb 14, 2010 at 07:33:07PM -0500, Dan Langille wrote: Get a dock for holding 2 x 2,5 disks in a single 5,25 slot and put it at the top, in the only 5,25 bay of the case. That sounds very interesting. I just looking around for such a thing, and could not find it. Is there a more specific name? URL? I had an Addonics 5.25 frame for 4x 2.5 SAS/SATA but the small fans in it are unfortunatly of the cheap kind. I ended up using the 2x2.5 to 3.5 frame from Silverstone (for the small Silverstone case I got). Ahh, something like this: http://silverstonetek.com/products/p_contents.php?pno=SDP08area=usa I understand now. Thank you. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: More zfs benchmarks
On 14.02.10 18:28, Jonathan Belson wrote: The machine is a Dell SC440, dual core 2GHz E2180, 2GB of RAM and ICH7 SATA300 controller. There are three Hitachi 500GB drives (HDP725050GLA360) in a raidz1 configuration (version 13). I'm running amd64 7.2-STABLE from 14th Jan. First of all, I tried creating a 200MB file on / (the only non-zfs partition): ..snip.. Hi, FYI, I Just made the same tests, on a FreeBSD 8.0-STABLE #4: Thu Dec 3 19:00:06 CET 2009, 4GB RAM, zpool comprised of: NAME SIZE USED AVAILCAP HEALTH ALTROOT tank1.81T 1.57T 251G86% ONLINE - NAMESTATE READ WRITE CKSUM tankONLINE 0 0 0 mirrorONLINE 0 0 0 ad10ONLINE 0 0 0 ad12ONLINE 0 0 0 zpool upgrade This system is currently running ZFS pool version 13. I'm getting near-to-hardware performance on all tests, i.e. 94MB/s minimum. Tried with 200MB, 2000MB, 4000MB and 8000MB files repeatedly. All wonderful. E.g.: dd if=/tank/testfs/testfile.dat bs=1m of=/dev/null count=8000 8388608000 bytes transferred in 83.569786 secs (100378479 bytes/sec) marx# dd if=/tank/testfs/testfile.dat bs=1m of=/dev/null count=8000 8388608000 bytes transferred in 78.234149 secs (107224378 bytes/sec) Did repeated writing and reading. I have NO ZFS-related tunables at all in /boot/loader.conf. All left to self-tuning and defaults as advised since 8.0. kstat.zfs.misc.arcstats.memory_throttle_count: 0 at all times. Regards, Lorenzo ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: hardware for home use large storage
Quoting Jeremy Chadwick free...@jdc.parodius.com (from Mon, 15 Feb 2010 04:27:44 -0800): On Mon, Feb 15, 2010 at 10:50:00AM +0100, Alexander Leidinger wrote: Quoting Jeremy Chadwick free...@jdc.parodius.com (from Mon, 15 Feb 2010 01:07:56 -0800): On Mon, Feb 15, 2010 at 10:49:47AM +0200, Dan Naumov wrote: I had a feeling someone would bring up L2ARC/cache devices. This gives me the opportunity to ask something that's been on my mind for quite some time now: Aside from the capacity different (e.g. 40GB vs. 1GB), is there a benefit to using a dedicated RAM disk (e.g. md(4)) to a pool for L2ARC/cache? The ZFS documentation explicitly states that cache device content is considered volatile. Using a ramdisk as an L2ARC vdev doesn't make any sense at all. If you have RAM to spare, it should be used by regular ARC. ...except that it's already been proven on FreeBSD that the ARC getting out of control can cause kernel panics[1], horrible performance until First and foremost, sorry for the long post. I tried to keep it short, but sometimes there's just a lot to be said. And sometimes a shorter answer takes longer... There are other ways (not related to ZFS) to shoot into your feet too, I'm tempted to say that this is a) a documentation bug and b) a lack of sanity checking of the values... anyone out there with a good algorithm for something like this? Normally you do some testing with the values you use, so once you resolved the issues, the system should be stable. What documentation? :-) The Wiki? If so, that's been outdated for Hehe... :) some time; I know Ivan Voras was doing his best to put good information there, but it's hard given the below chaos. Do you want write access to it (in case you haven't, I didn't check)? The following tunables are recurrently mentioned as focal points, but no one's explained in full how to tune these properly, or which does what (perfect example: vm.kmem_size_max vs. vm.kmem_size. _max used to be what you'd adjust to solve kmem exhaustion issues, but now people are saying otherwise?). I realise it may differ per system (given how much RAM the system has), so different system configurations/examples would need to be provided. I realise that the behaviour of some have changed too (e.g. -RELEASE differs from -STABLE, and 7.x differs from 8.x). I've marked commonly-referred-to tunables with an asterisk: It can also be that some people just tell something without really knowing what they say (based upon some kind of observed evidence, not because of being a bad guy). kern.maxvnodes Needs to be tuned if you run out of vnodes... ok, this is obvious. I do not know how it will show up (panic or graceful error handling, e.g. ENOMEM). * vm.kmem_size * vm.kmem_size_max I tried kmem_size_max on -current (this year), and I got a panic during use, I changed kmem_size to the same value I have for _max and it didn't panic anymore. It looks (from mails on the lists) that _max is supposed to give a max value for auto-enhancement, but at least it was not working with ZFS last month (and I doubt it works now). * vfs.zfs.arc_min * vfs.zfs.arc_max _min = minimum even when the system is running out of memory (the ARC gives back memory if other parts of the kernel need it). _max = maximum (with a recent ZFS on 7/8/9 (7.3 will have it, 8.1 will have it too) I've never seen the size exceed the _max anymore) vfs.zfs.prefetch_disable (auto-tuned based on available RAM on 8-STABLE) vfs.zfs.txg.timeout It looks like the txg is just a workaround. I've read a little bit in Brendan's blog and it seems they noticed the periodic writes too (with the nice graphical performance monitoring of OpenStorage) and they are investigating the issue. It looks like we are more affected by this (for whatever reason). What it is doing (attention, this is an observation, not a technical description of code I've read!) seems to be to write out data to the disks more early (and thus there is less data to write - less blocking to notice). vfs.zfs.vdev.cache.size vfs.zfs.vdev.cache.bshift vfs.zfs.vdev.max_pending Uhm... this smells like you got it out of one of my posts where I told that I experiment with this on a system. I can tell you that I have no system with this tuned anymore, tuning kmem_size (and KVA_PAGES during kernel compile) has a bigger impact. vfs.zfs.zil_disable What it does should be obvious. IMHO this should not help much regarding stability (changing kmem_size should give a bigger impact). As don't know what was tested on systems where this is disabled, I want to highlight the IMHO in the sentence before... Then, when it comes to debugging problems as a result of tuning improperly (or entire lack of), the following counters (not tunables) are thrown into the mix as things people should look at: kstat.zfs.misc.arcstats.c kstat.zfs.misc.arcstats.c_min
Re: loading module sdhci causes panic
On Sunday 14 February 2010 01:53:11 pm Gavin Atkinson wrote: On Sat, 30 Jan 2010, Steven Friedrich wrote: snip What happens if you just load sdhci? panic WHat happens if you load sdhci and mmcsd, but not mmc? panic WHat happens if you load sdhci and mmc, but not mmcsd? panic Given how early in the boot process you see problems, I'm wondering if this is somehow related to PR kern/141756... Thanks, Gavin If I load sdhci as a module, the system panics with a page fault while in kernel mode. All is ok if I build sdhci into the kernel. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: freebsd7 (and 8), radeon, xorg-server - deadlock or so
On Mon, 2010-02-15 at 14:23 +0100, Martin Kristensen wrote: On Sat, 13 Feb 2010 15:27:04 -0600 Robert Noland rnol...@freebsd.org wrote: On Sat, 2010-02-13 at 11:37 -0800, Norbert Papke wrote: On February 13, 2010, Robert Noland wrote: Ok, I've put up a patch at: http://people.freebsd.org/~rnoland/drm-radeon-test.patch http://people.freebsd.org/~rnoland/drm-radeon-8-test.patch This one should work on 8... robert. This is sort of a mega patch and includes: Re-worked drm mapping code, that ensures that we don't end up incorrectly mapping certain maps with overlapping offsets. This generally shows up as the ring buffer not being cleared (contents != 0 in xorg.log) which leads to corruption and other bad behavior. Re-written scatter gather allocation code. This interacts directly with the VM system, rather than using bus_dma to allow us to grab non-contiguous pages for the scatter gather backing of the GART. It also makes it easier to handle the caching mode of the backing pages. Disable cache snooping on radeon cards, since we have write combining set properly now. I have at least done a test build on -CURRENT with this patch, but I haven't had time to do much else without the rest of the code in my tree. I've been running most all of this code for a month or two now at least, so it is mostly just a question of whether or not I got all of the conflicts sorted out properly when I made this patch. The re-mapping code has the most widespread impact and has been tested on radeon r600 amd64, intel g45 i386 and mga amd64. robert. The patch applied cleanly. I have applied the patch to a clean 8-STABLE environment with WITNESS, INVARIANTS and KDB_UNATTENDED in the kernel. I still see the crashes when starting X with DRI on. This is what I see in messages: Feb 14 19:13:44 alpha kernel: [drm:pid30467:drm_mmap] called with offset 070001c7b000 Feb 14 19:13:44 alpha kernel: [drm:pid30467:drm_mmap] called with offset 070001c7c000 Feb 14 19:13:44 alpha kernel: Feb 14 19:13:44 alpha kernel: [drm:pid30467:drm_mmap] called with offset 070001c7d000 Feb 14 19:13:44 alpha kernel: Feb 14 19:13:44 alpha kernel: [drm:pid30467:drm_mmap] called with offset 070001c7e000 Feb 14 19:13:44 alpha kernel: [drm:pid30467:drm_mmap] called with offset 070001c7f000 Feb 14 19:13:44 alpha kernel: Feb 14 19:13:44 alpha kernel: [drm:pid30467:drm_ioctl] pid=30467, cmd=0xc0286415, nr=0x15, dev 0xff0001a79400, auth=1 Feb 14 19:13:44 alpha kernel: Feb 14 19:13:44 alpha kernel: [drm:pid30467:drm_addmap] offset = 0xfe8e, size = 0x0001, type = 1 Feb 14 19:13:44 alpha kernel: [drm:pid30467:drm_addmap] Found kernel map 1 Feb 14 19:13:44 alpha kernel: [drm:pid30467:drm_addmap] Added map 1 0xfe8e/0x1 Feb 14 19:13:44 alpha kernel: [drm:pid30467:drm_ioctl] pid=30467, cmd=0x80106459, nr=0x59, dev 0xff0001a79400, auth=1 There has been one odd development. If I startx with DRI off or NoAccel set it starts as usual. If I then quit and to cli and restart, I see the same crash as if I had DRI on. I'm really starting to think that this is a bug in the Xserver somewhere... If DRI is off, the kernel drm is not involved at all. The radeon driver does grope around on the pci bus (via libpciaccess) which could potentially cause issues, but... miwi and a few other folks have picked up the ball to get us up to xorg 7.5, since I just don't have time to do it all now. That might be a good thing to try, I expect that they will have a patch ready soon, like within a few days. robert. Martin -- Robert Noland rnol...@freebsd.org FreeBSD ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: trap 12: page fault while in kernel mode on 8.0-RELEASE (possibly bge(4) related)
hw.bge.allow_asf: 0 On Mon, Feb 15, 2010 at 2:23 AM, Giacomo Olgeni g.olg...@colby.it wrote: Hello, Are you running with hw.bge.allow_asf enabled? ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
7.3-RC1 Available...
The second of the test builds for the 7.3-RELEASE cycle, 7.3-RC1, is now available for amd64, i386, pc98, and sparc64 architectures. The target schedule as well as the current status of the release is available here: http://wiki.freebsd.org/Releng/7.3TODO The schedule has slipped by about a week but so far it looks like we are on track for just having one more public test build (7.3-RC2) followed by the release itself. If you notice problems you can report them through the normal Gnats PR system or on the freebsd-stable mailing list. ISO images for the architectures listed above are available on the FTP mirror sites. Packages were included for amd64 and i386 architectures though the list of packages is still preliminary and the packages themselves were taken from what is currently available in the packages-7-stable directories on the FTP servers. There have been some significant changes to the ports that are not incorporated in this set of pre-built packages (e.g. the default version of perl has been updated to 5.10). If you are using csup/cvsup methods to update an older system the branch tag to use is now RELENG_7_3. Note that due to the mechanism still in place for exporting the SVN repository to CVS unfortunately the version numbers for all the files get changed. If you have not looked into it before check out the -F argument for mergemaster(8). The freebsd-update(8) utility supports binary upgrades of i386 and amd64 systems running earlier FreeBSD releases. Systems running 7.1-RELEASE 7.2-RELEASE, or 7.3-BETA1 can upgrade as follows: # freebsd-update upgrade -r 7.3-RC1 During this process, FreeBSD Update may ask the user to help by merging some configuration files or by confirming that the automatically performed merging was done correctly. # freebsd-update install The system must be rebooted with the newly installed kernel before continuing. # shutdown -r now After rebooting, freebsd-update needs to be run again to install the new userland components, and the system needs to be rebooted again: # freebsd-update install # shutdown -r now Users of earlier FreeBSD releases (FreeBSD 6.x) can also use freebsd-update to upgrade to FreeBSD 7.3-RC1, but will be prompted to rebuild all third-party applications (e.g., anything installed from the ports tree) after the second invocation of freebsd-update install, in order to handle differences in the system libraries between FreeBSD 6.x and FreeBSD 7.x. Checksums: MD5 (FreeBSD-7.3-RC1-amd64-bootonly.iso) = 9203d41e40bfaa916a493e0ec7de7b43 MD5 (FreeBSD-7.3-RC1-amd64-disc1.iso) = e6601834cb700e4c250439ada6e55684 MD5 (FreeBSD-7.3-RC1-amd64-disc2.iso) = 4e8b9f30078b0bee18b8cded3b9889b4 MD5 (FreeBSD-7.3-RC1-amd64-disc3.iso) = 045cb0e6fb365d3542fe1ff22bdb386b MD5 (FreeBSD-7.3-RC1-amd64-docs.iso) = 6f84de26ee4141c84dfbc3e75937553f MD5 (FreeBSD-7.3-RC1-amd64-dvd1.iso) = 3db866ef9b922a2ee4fa05860370f66f MD5 (FreeBSD-7.3-RC1-amd64-livefs.iso) = 0bd317eaacb4b410c6a9b505570cdcf2 MD5 (FreeBSD-7.3-RC1-i386-bootonly.iso) = 72e07086fd7d772dab19b3c37158228e MD5 (FreeBSD-7.3-RC1-i386-disc1.iso) = 94beb0afaa3f7b90403842b32d23e5f8 MD5 (FreeBSD-7.3-RC1-i386-disc2.iso) = 2972b3033fb5f49c46e5896ce59c0de6 MD5 (FreeBSD-7.3-RC1-i386-disc3.iso) = 129eb39afdb5ed80b08cc425cdd838af MD5 (FreeBSD-7.3-RC1-i386-docs.iso) = d754c44cee26f1d386db9550d3839c0e MD5 (FreeBSD-7.3-RC1-i386-dvd1.iso) = 53553d8b3197f2146e1e135e3779ab39 MD5 (FreeBSD-7.3-RC1-i386-livefs.iso) = 72bfb8309379e2f2b0cb00fa82aa4329 MD5 (FreeBSD-7.3-RC1-pc98-bootonly.iso) = ef34e0b903a16212c40d3a28c124bf1e MD5 (FreeBSD-7.3-RC1-pc98-disc1.iso) = f6df8cf617a96d4fbcc6732cbd92de27 MD5 (FreeBSD-7.3-RC1-pc98-livefs.iso) = 72816364465e561074d6260e862c40ee MD5 (FreeBSD-7.3-RC1-sparc64-bootonly.iso) = fa2d3a04b3524c0a6441b27ab3e9c260 MD5 (FreeBSD-7.3-RC1-sparc64-disc1.iso) = 8b7c20c4de27bd6f8dcdcacc9c3086fd MD5 (FreeBSD-7.3-RC1-sparc64-disc2.iso) = 856250a506426adea48a2d8c36eaaf60 MD5 (FreeBSD-7.3-RC1-sparc64-disc3.iso) = 9e91eba398769bb3b8bf88b3a45a7e9f MD5 (FreeBSD-7.3-RC1-sparc64-docs.iso) = 392698fa73e325a49ca8a350bca7e15c SHA256 (FreeBSD-7.3-RC1-amd64-bootonly.iso) = 244a7b3a14cdd03b69038d19236929085b76867b238ecaab0bdeda21be98e6f8 SHA256 (FreeBSD-7.3-RC1-amd64-disc1.iso) = 55b62c9926c4b15561d9fb8b4dae74ce051f0389e00fbf08d888f41491288bc1 SHA256 (FreeBSD-7.3-RC1-amd64-disc2.iso) = 3f8d314d917ace574c98957cb99e6094d6b3ee43e15a27786fe305afcb61c267 SHA256 (FreeBSD-7.3-RC1-amd64-disc3.iso) = 349c0da03bf42c399da2e8235dbdf8877dfc5ca601b38110c1decd88b8322239 SHA256 (FreeBSD-7.3-RC1-amd64-docs.iso) = 901bb101d7c428f10065b2b78a2a27670c36d832afb4e96f239f3ff1b5f3603a SHA256 (FreeBSD-7.3-RC1-amd64-dvd1.iso) = 6ebfba0e66d3a23077c74407bb6d1bdff7f45d690aae7f1c08753c7a41ee5125 SHA256 (FreeBSD-7.3-RC1-amd64-livefs.iso) = 88b2c22f37ed5a80eb2600aaa85d347af534a18ff41450462bd8174c06f033b2 SHA256 (FreeBSD-7.3-RC1-i386-bootonly.iso) = dd7a06c197c62f10b85b9fd9bad209b677d9c0a497bb84b9f5276ee088e55b1d SHA256
Re: hardware for home use large storage
* vm.kmem_size * vm.kmem_size_max I tried kmem_size_max on -current (this year), and I got a panic during use, I changed kmem_size to the same value I have for _max and it didn't panic anymore. It looks (from mails on the lists) that _max is supposed to give a max value for auto-enhancement, but at least it was not working with ZFS last month (and I doubt it works now). It used to be that vm.kmem_size_max needed to be bumped to allow for larger vm.kmem_size. It's no longer needed on amd64. Not sure about i386. vm.kmem_size still needs tuning, though. While vm.kmem_size_max is no longer a limit, there are other checks in place that result in default vm.kmem_size being a bit on the conservative side for ZFS. Then, when it comes to debugging problems as a result of tuning improperly (or entire lack of), the following counters (not tunables) are thrown into the mix as things people should look at: kstat.zfs.misc.arcstats.c kstat.zfs.misc.arcstats.c_min kstat.zfs.misc.arcstats.c_max c_max is vfs.zfs.arc_max, c_min is vfs.zfs.arc_min. kstat.zfs.misc.arcstats.evict_skip kstat.zfs.misc.arcstats.memory_throttle_count kstat.zfs.misc.arcstats.size I'm not very sure about size and c... both represent some kind of current size, but they are not the same. arcstats.c -- adaptive ARC target size. I.e. that's what ZFS thinks it can grow ARC to. It's dynamically adjusted based on when/how ZFS is back-pressured for memory. arcstats.size -- current ARC size arcstats.p -- portion of arcstats.c that's used by Most Recently Used items. What's left of arcstats.c is used by Most Frequently Used items. --Artem ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: More zfs benchmarks
On Sun, Feb 14, 2010 at 05:28:28PM +, Jonathan Belson wrote: Hiya After reading some earlier threads about zfs performance, I decided to test my own server. I found the results rather surprising... Below are my results from my home machine. Note that my dd size and count differ from what the OP provided. I should note that powerd(8) is in effect on this box; I probably should have disabled it and forced the CPU frequency to be at max before doing these tests. -- | Jeremy Chadwick j...@parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | # uname -a FreeBSD icarus.home.lan 8.0-STABLE FreeBSD 8.0-STABLE #0: Sat Jan 16 17:48:04 PST 2010 r...@icarus.home.lan:/usr/obj/usr/src/sys/X7SBA_RELENG_8_amd64 amd64 # uptime 6:51AM up 29 days, 12:48, 2 users, load averages: 0.06, 0.04, 0.01 # sysctl hw.machine hw.model hw.ncpu hw.physmem hw.usermem hw.realmem hw.pagesizes hw.machine: amd64 hw.model: Intel(R) Core(TM)2 Duo CPU E8400 @ 3.00GHz hw.ncpu: 2 hw.physmem: 4285317120 hw.usermem: 3520425984 hw.realmem: 5100273664 hw.pagesizes: 4096 2097152 0 # sysctl vm.kmem_size vm.kmem_size_min vm.kmem_size_max vm.kmem_size_scale vm.kmem_size: 1378439168 vm.kmem_size_min: 0 vm.kmem_size_max: 329853485875 vm.kmem_size_scale: 3 # dmesg | egrep '(ata[57]|atapci0)' atapci0: Intel ICH9 SATA300 controller port 0x1c50-0x1c57,0x1c44-0x1c47,0x1c48-0x1c4f,0x1c40-0x1c43,0x18e0-0x18ff mem 0xdc000800-0xdc000fff irq 17 at device 31.2 on pci0 atapci0: [ITHREAD] atapci0: AHCI called from vendor specific driver atapci0: AHCI v1.20 controller with 6 3Gbps ports, PM supported ata2: ATA channel 0 on atapci0 ata3: ATA channel 1 on atapci0 ata4: ATA channel 2 on atapci0 ata5: ATA channel 3 on atapci0 ata5: [ITHREAD] ata6: ATA channel 4 on atapci0 ata7: ATA channel 5 on atapci0 ata7: [ITHREAD] ad10: 953869MB WDC WD1001FALS-00J7B1 05.00K05 at ata5-master UDMA100 SATA 3Gb/s ad14: 953869MB WDC WD1001FALS-00J7B1 05.00K05 at ata7-master UDMA100 SATA 3Gb/s # egrep '^[a-z]' /boot/loader.conf kern.maxdsiz=1536M kern.dfldsiz=1536M kern.maxssiz=256M hint.sio.1.disabled=1 vm.pmap.pg_ps_enabled=1 vfs.zfs.prefetch_disable=1 debug.cpufreq.lowest=1500 # zpool status pool: storage state: ONLINE scrub: scrub stopped after 0h27m with 0 errors on Fri Feb 12 10:55:49 2010 config: NAMESTATE READ WRITE CKSUM storage ONLINE 0 0 0 mirrorONLINE 0 0 0 ad10ONLINE 0 0 0 ad14ONLINE 0 0 0 errors: No known data errors kstat.zfs.misc.arcstats before tests == kstat.zfs.misc.arcstats.hits: 102892520 kstat.zfs.misc.arcstats.misses: 1043985 kstat.zfs.misc.arcstats.demand_data_hits: 100502054 kstat.zfs.misc.arcstats.demand_data_misses: 1010714 kstat.zfs.misc.arcstats.demand_metadata_hits: 2390466 kstat.zfs.misc.arcstats.demand_metadata_misses: 33271 kstat.zfs.misc.arcstats.prefetch_data_hits: 0 kstat.zfs.misc.arcstats.prefetch_data_misses: 0 kstat.zfs.misc.arcstats.prefetch_metadata_hits: 0 kstat.zfs.misc.arcstats.prefetch_metadata_misses: 0 kstat.zfs.misc.arcstats.mru_hits: 4675003 kstat.zfs.misc.arcstats.mru_ghost_hits: 11655 kstat.zfs.misc.arcstats.mfu_hits: 98217517 kstat.zfs.misc.arcstats.mfu_ghost_hits: 15079 kstat.zfs.misc.arcstats.deleted: 2456180 kstat.zfs.misc.arcstats.recycle_miss: 6236 kstat.zfs.misc.arcstats.mutex_miss: 1238 kstat.zfs.misc.arcstats.evict_skip: 0 kstat.zfs.misc.arcstats.hash_elements: 5753 kstat.zfs.misc.arcstats.hash_elements_max: 23704 kstat.zfs.misc.arcstats.hash_collisions: 643164 kstat.zfs.misc.arcstats.hash_chains: 229 kstat.zfs.misc.arcstats.hash_chain_max: 5 kstat.zfs.misc.arcstats.p: 839285616 kstat.zfs.misc.arcstats.c: 841024368 kstat.zfs.misc.arcstats.c_min: 107690560 kstat.zfs.misc.arcstats.c_max: 861524480 kstat.zfs.misc.arcstats.size: 96783432 kstat.zfs.misc.arcstats.hdr_size: 1196624 kstat.zfs.misc.arcstats.l2_hits: 258 kstat.zfs.misc.arcstats.l2_misses: 0 kstat.zfs.misc.arcstats.l2_feeds: 3337 kstat.zfs.misc.arcstats.l2_rw_clash: 0 kstat.zfs.misc.arcstats.l2_writes_sent: 576 kstat.zfs.misc.arcstats.l2_writes_done: 576 kstat.zfs.misc.arcstats.l2_writes_error: 0 kstat.zfs.misc.arcstats.l2_writes_hdr_miss: 6 kstat.zfs.misc.arcstats.l2_evict_lock_retry: 2 kstat.zfs.misc.arcstats.l2_evict_reading: 0 kstat.zfs.misc.arcstats.l2_free_on_write: 797 kstat.zfs.misc.arcstats.l2_abort_lowmem: 14 kstat.zfs.misc.arcstats.l2_cksum_bad: 0 kstat.zfs.misc.arcstats.l2_io_error: 0 kstat.zfs.misc.arcstats.l2_size: 0 kstat.zfs.misc.arcstats.l2_hdr_size: 0 kstat.zfs.misc.arcstats.memory_throttle_count: 8929 test #1 (327,680,000 bytes) = # dd if=/dev/zero of=/storage/test01 bs=64k count=5000 5000+0 records in 5000+0
Re: hardware for home use large storage
Dan Naumov wrote: On Sun, Feb 14, 2010 at 11:38 PM, Dan Langille d...@langille.org wrote: Dan Naumov wrote: On Sun, 14 Feb 2010, Dan Langille wrote: After creating three different system configurations (Athena, Supermicro, and HP), my configuration of choice is this Supermicro setup: 1. Samsung SATA CD/DVD Burner $20 (+ $8 shipping) 2. SuperMicro 5046A $750 (+$43 shipping) 3. LSI SAS 3081E-R $235 4. SATA cables $60 5. Crucial 3×2G ECC DDR3-1333 $191 (+ $6 shipping) 6. Xeon W3520 $310 You do realise how much of a massive overkill this is and how much you are overspending? I appreciate the comments and feedback. I'd also appreciate alternative suggestions in addition to what you have contributed so far. Spec out the box you would build. == Case: Fractal Design Define R2 - 89 euro: http://www.fractal-design.com/?view=productprod=32 Mobo/CPU: Supermicro X7SPA-H / Atom D510 - 180-220 euro: http://www.supermicro.com/products/motherboard/ATOM/ICH9/X7SPA.cfm?typ=H PSU: Corsair 400CX 80+ - 59 euro: http://www.corsair.com/products/cx/default.aspx RAM: Corsair 2x2GB, DDR2 800MHz SO-DIMM, CL5 - 85 euro == Total: ~435 euro The motherboard has 6 native AHCI-capable ports on ICH9R controller and you have a PCI-E slot free if you want to add an additional controller card. Feel free to blow the money you've saved on crazy fast SATA disks and if your system workload is going to have a lot of random reads, then spend 200 euro on a 80gb Intel X25-M for use as a dedicated L2ARC device for your pool. Based on the Fractal Design case mentioned above, I was told about Lian Lia cases, which I think are great. As a result, I've gone with a tower case without hot-swap. The parts are listed at and reproduced below: http://dan.langille.org/2010/02/15/a-full-tower-case/ 1. LIAN LI PC-A71F Black Aluminum ATX Full Tower Computer Case $240 (from mwave) 2. Antec EarthWatts EA650 650W PSU $80 3. Samsung SATA CD/DVD Burner $20 (+ $8 shipping) 4. Intel S3200SHV LGA 775 Intel 3200 m/b $200 5. Intel Core2 Quad Q9400 CPU $190 6. SATA cables $22 7. Supermicro LSI MegaRAID 8 Port SAS RAID Controller $118 8. Kingston ValueRAM 4GB (2 x 2GB) 240-Pin DDR2 SDRAM ECC $97 Total cost is about $1020 with shipping. Plus HDD. No purchases yet, but the above is what appeals to me now. Thank you. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
[HEADSUP]: ports feature freeze now in effect
In preparation for 7.3-RELEASE, the ports tree is now in feature freeze. Normal upgrade, new ports, and changes that only affect other branches are allowed without prior approval but with the extra Feature safe: yes tag in the commit message. Any commit that is sweeping, i.e. touches a large number of ports, infrastructural changes, commts to ports with unusually high number of dependent ports, and any other commit that requires the rebuilding of many packages is not allowed without prior explicit approval from portmgr after that date. When in doubt, please do not hesitate to contact portmgr. -erwin -- Erwin Lansing http://droso.org Prediction is very difficult especially about the futureer...@freebsd.org pgpilVCtRv3g7.pgp Description: PGP signature
Re: More zfs benchmarks
On 14/02/2010 17:28, Jonathan Belson wrote: After reading some earlier threads about zfs performance, I decided to test my own server. I found the results rather surprising... Thanks to everyone who responded. I experimented with my load.conf settings, leaving me with the following: vm.kmem_size=1280M vfs.zfs.prefetch_disable=1 That kmem_size seems quite big for a machine with only (!) 2GB of RAM, but I wanted to see if it gave better results than 1024MB (it did, an extra ~5MB/s). The rest of the settings are defaults: vm.kmem_size_scale: 3 vm.kmem_size_max: 329853485875 vm.kmem_size_min: 0 vm.kmem_size: 1342177280 vfs.zfs.arc_min: 104857600 vfs.zfs.arc_max: 838860800 My numbers are a lot better with these settings: # dd if=/dev/zero of=/tank/test/zerofile.000 bs=1M count=2000 2000+0 records in 2000+0 records out 2097152000 bytes transferred in 63.372441 secs (33092492 bytes/sec) # dd if=/dev/zero of=/tank/test/zerofile.000 bs=1M count=2000 2000+0 records in 2000+0 records out 2097152000 bytes transferred in 60.647568 secs (34579326 bytes/sec) # dd if=/dev/zero of=/tank/test/zerofile.000 bs=1M count=2000 2000+0 records in 2000+0 records out 2097152000 bytes transferred in 68.241539 secs (30731312 bytes/sec) # dd if=/dev/zero of=/tank/test/zerofile.000 bs=1M count=2000 2000+0 records in 2000+0 records out 2097152000 bytes transferred in 68.722902 secs (30516057 bytes/sec) Writing a 200MB file to a UFS partition gives around 37MB/s, so the zfs overhead is costing me a few MB per second. I'm guessing that the hard drives themselves have rather sucky performance (I used to use Spinpoints, but receiving three faulty ones in a row put me off them). Reading from a raw device: # dd if=/dev/ad4s1a of=/dev/null bs=1M count=2000 1024+0 records in 1024+0 records out 1073741824 bytes transferred in 11.286550 secs (95134635 bytes/sec) # dd if=/dev/ad4s1a of=/dev/null bs=1M count=2000 1024+0 records in 1024+0 records out 1073741824 bytes transferred in 11.445131 secs (93816473 bytes/sec) # dd if=/dev/ad4s1a of=/dev/null bs=1M count=2000 1024+0 records in 1024+0 records out 1073741824 bytes transferred in 11.284961 secs (95148032 bytes/sec) Reading from zfs file: # dd if=/tank/test/zerofile.000 of=/dev/null bs=1M count=4000 2000+0 records in 2000+0 records out 2097152000 bytes transferred in 25.643737 secs (81780281 bytes/sec) # dd if=/tank/test/zerofile.000 of=/dev/null bs=1M count=4000 2000+0 records in 2000+0 records out 2097152000 bytes transferred in 25.444214 secs (82421567 bytes/sec) # dd if=/tank/test/zerofile.000 of=/dev/null bs=1M count=4000 2000+0 records in 2000+0 records out 2097152000 bytes transferred in 25.572888 secs (82006851 bytes/sec) So, the value of arc_max from the zfs tuning wiki seemed to be the main brake on performance. Cheers, --Jon ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: hardware for home use large storage
* vm.kmem_size * vm.kmem_size_max I tried kmem_size_max on -current (this year), and I got a panic during use, I changed kmem_size to the same value I have for _max and it didn't panic anymore. It looks (from mails on the lists) that _max is supposed to give a max value for auto-enhancement, but at least it was not working with ZFS last month (and I doubt it works now). It used to be that vm.kmem_size_max needed to be bumped to allow for larger vm.kmem_size. It's no longer needed on amd64. Not sure about i386. vm.kmem_size still needs tuning, though. While vm.kmem_size_max is no longer a limit, there are other checks in place that result in default vm.kmem_size being a bit on the conservative side for ZFS. Then, when it comes to debugging problems as a result of tuning improperly (or entire lack of), the following counters (not tunables) are thrown into the mix as things people should look at: kstat.zfs.misc.arcstats.c kstat.zfs.misc.arcstats.c_min kstat.zfs.misc.arcstats.c_max c_max is vfs.zfs.arc_max, c_min is vfs.zfs.arc_min. kstat.zfs.misc.arcstats.evict_skip kstat.zfs.misc.arcstats.memory_throttle_count kstat.zfs.misc.arcstats.size I'm not very sure about size and c... both represent some kind of current size, but they are not the same. arcstats.c -- adaptive ARC target size. I.e. that's what ZFS thinks it can grow ARC to. It's dynamically adjusted based on when/how ZFS is back-pressured for memory. arcstats.size -- current ARC size arcstats.p -- portion of arcstats.c that's used by Most Recently Used items. What's left of arcstats.c is used by Most Frequently Used items. --Artem ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org How much ram are you running with? In a latest test with 8.0-R on i386 with 2GB of ram, an install to a ZFS root *will* panic the kernel with kmem_size too small with default settings. Even dropping down to Cy Schubert's uber-small config will panic the kernel (vm.kmem_size_max = 330M, vfs.zfs.arc_size = 40M, vfs.zfs.vdev.cache_size = 5M); the system is currently stable using DIST kernel, vm.kmem_size/max = 512M, arc_size = 40M and vdev.cache_size = 5M. -- Peter C. Lai ITS Systems Administrator Bard College at Simon's Rock 84 Alford Rd. Great Barrington, MA 01230 (413) 528-7428 peter at simons-rock.edu ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: More zfs benchmarks
On Mon, Feb 15, 2010 at 9:51 AM, Jonathan Belson j...@witchspace.com wrote: On 14/02/2010 17:28, Jonathan Belson wrote: After reading some earlier threads about zfs performance, I decided to test my own server. I found the results rather surprising... Thanks to everyone who responded. I experimented with my load.conf settings, leaving me with the following: vm.kmem_size=1280M vfs.zfs.prefetch_disable=1 That kmem_size seems quite big for a machine with only (!) 2GB of RAM, but I wanted to see if it gave better results than 1024MB (it did, an extra ~5MB/s). For a system with 2 GB of RAM, and possibly slow harddrives, consider adding a cache vdev (L2ARC). The 4 GB and larger USB flash drives are getting to be pretty fast for reads (which is what the L2ARC is for). On my home system, which is a 32-bit FreeBSD 8-STABLE box with a 3.0 GHz P4 and 2 GB of RAM, adding a 4 GB Transcend JetFlash has done wonders for improving stability and read speed. Most of my apps now load from the USB stick instead of the slow raidz1 vdev (3x 120 GB SATA drives). Haven't done any real benchmarks yet (still upgrading to KDE 4.4), but things feel smoother, and it hasn't locked up since adding the USB stick. On this box, running ktorrent 24/7 used to lock up the box after 3-5 days (can't even toggle numlock). This box uses a kmem_max of 1 GB, and an arc_max of 512 MB. With a 4 GB L2ARC. :) -- Freddie Cash fjwc...@gmail.com ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: booting off a ZFS pool consisting of multiple striped mirror vdevs
On Sat, Feb 13, 2010 at 12:04 PM, Dan Naumov dan.nau...@gmail.com wrote: Hello I have succesfully tested and used a full ZFS install of FreeBSD 8.0 on both single disk and mirror disk configurations using both MBR and GPT partitioning. AFAIK, with the more recent -CURRENT and -STABLE it is also possible to boot off a root filesystem located on raidz/raidz2 pools. But what about booting off pools consisting of multiple striped mirror or raidz vdevs? Like this: Assume each disk looks like a half of a traditional ZFS mirror root configuration using GPT 1: freebsd-boot 2: freebsd-swap 3: freebsd-zfs |disk1+disk2| + |disk3+disk4| + |disk5+disk6| My logic tells me that while booting off any of the 6 disks, boot0 and boot1 stage should obviously work fine, but what about the boot2 stage? Can it properly handle booting off a root filesystem thats striped across 3 mirror vdevs or is booting off a single mirror vdev the best that one can do right now? I don't know, but I plan to test that scenario in a few days. Matt ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: hardware for home use large storage
On Mon, 15 Feb 2010, Artem Belevich wrote: AB It used to be that vm.kmem_size_max needed to be bumped to allow for AB larger vm.kmem_size. It's no longer needed on amd64. Not sure about AB i386. AB AB vm.kmem_size still needs tuning, though. While vm.kmem_size_max is no AB longer a limit, there are other checks in place that result in default AB vm.kmem_size being a bit on the conservative side for ZFS. it seems so at least: on a machine with 8G RAM kmem_size is set to 2G, from which 1.5G is allocated for arc_max. I'll try to increase them to 4G / 3G and test whether machine is stable... -- Sincerely, D.Marck [DM5020, MCK-RIPE, DM3-RIPN] [ FreeBSD committer: ma...@freebsd.org ] *** Dmitry Morozovsky --- D.Marck --- Wild Woozle --- ma...@rinet.ru *** ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: booting off a ZFS pool consisting of multiple striped mirror vdevs
On Mon, 2010-02-15 at 10:07 -0800, Matt Reimer wrote: On Sat, Feb 13, 2010 at 12:04 PM, Dan Naumov dan.nau...@gmail.com wrote: Hello I have succesfully tested and used a full ZFS install of FreeBSD 8.0 on both single disk and mirror disk configurations using both MBR and GPT partitioning. AFAIK, with the more recent -CURRENT and -STABLE it is also possible to boot off a root filesystem located on raidz/raidz2 pools. But what about booting off pools consisting of multiple striped mirror or raidz vdevs? Like this: Assume each disk looks like a half of a traditional ZFS mirror root configuration using GPT 1: freebsd-boot 2: freebsd-swap 3: freebsd-zfs |disk1+disk2| + |disk3+disk4| + |disk5+disk6| My logic tells me that while booting off any of the 6 disks, boot0 and boot1 stage should obviously work fine, but what about the boot2 stage? Can it properly handle booting off a root filesystem thats striped across 3 mirror vdevs or is booting off a single mirror vdev the best that one can do right now? I don't know, but I plan to test that scenario in a few days. It *should* work... I made changes a while back that allow for multiple vdevs to attach to the root. In this case you should have 3 mirror vdevs attached to the root, so as long as the BIOS can enumerate all of the drives, we should find all of the vdevs and build the tree correctly. It should be simple enough to test in qemu, except that the BIOS in qemu is a little broken and might not id all of the drives. robert. Matt ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org -- Robert Noland rnol...@freebsd.org FreeBSD ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: More zfs benchmarks
Jeremy Chadwick wrote: On Sun, Feb 14, 2010 at 05:28:28PM +, Jonathan Belson wrote: Hiya After reading some earlier threads about zfs performance, I decided to test my own server. I found the results rather surprising... Below are my results from my home machine. Note that my dd size and count differ from what the OP provided. I should note that powerd(8) is in effect on this box; I probably should have disabled it and forced the CPU frequency to be at max before doing these tests. I did the same tests as you on my backup storage server HP ML110 G5 with 4x 1TB Samsung drives in RAIDZ. Unfortunately there is no kstat.zfs.misc.arcstats.memory_throttle_count on FreeBSD 7.2 I can run this test on Sun Fire X2100 with 4GB RAM, 2x 500GB Hitachi drives in ZFS mirror on FreeBSD 7.2 (let me know if somebody is interested in results for comparision) r...@kiwi ~/# uname -a FreeBSD kiwi.codelab.cz 7.2-RELEASE-p4 FreeBSD 7.2-RELEASE-p4 #0: Fri Oct 2 08:22:32 UTC 2009 r...@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64 r...@kiwi ~/# uptime 6:46PM up 6 days, 7:30, 1 user, load averages: 0.00, 0.00, 0.00 r...@kiwi ~/# sysctl hw.machine hw.model hw.ncpu hw.physmem hw.usermem hw.realmem hw.pagesizes hw.machine: amd64 hw.model: Intel(R) Pentium(R) Dual CPU E2160 @ 1.80GHz hw.ncpu: 2 hw.physmem: 5219966976 hw.usermem: 801906688 hw.realmem: 5637144576 sysctl: unknown oid 'hw.pagesizes' r...@kiwi ~/# sysctl vm.kmem_size vm.kmem_size_min vm.kmem_size_max vm.kmem_size_scale vm.kmem_size: 1684733952 vm.kmem_size_min: 0 vm.kmem_size_max: 3865468109 vm.kmem_size_scale: 3 r...@kiwi ~/# dmesg | egrep '(ata[01]|atapci0)' atapci0: Intel ICH9 SATA300 controller port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x1c10-0x1c1f,0x1c00-0x1c0f at device 31.2 on pci0 ata0: ATA channel 0 on atapci0 ata0: [ITHREAD] ata1: ATA channel 1 on atapci0 ata1: [ITHREAD] ad0: 953869MB SAMSUNG HD103UJ 1AA01113 at ata0-master SATA300 ad1: 953869MB SAMSUNG HD103UJ 1AA01113 at ata0-slave SATA300 ad2: 953869MB SAMSUNG HD103UJ 1AA01113 at ata1-master SATA300 ad3: 953869MB SAMSUNG HD103UJ 1AA01113 at ata1-slave SATA300 r...@kiwi ~/# egrep '^[a-z]' /boot/loader.conf hw.bge.allow_asf=1 r...@kiwi ~/# zpool status pool: tank state: ONLINE scrub: none requested config: NAMESTATE READ WRITE CKSUM tankONLINE 0 0 0 raidz1ONLINE 0 0 0 ad0 ONLINE 0 0 0 ad1 ONLINE 0 0 0 ad2 ONLINE 0 0 0 ad3 ONLINE 0 0 0 errors: No known data errors before tests r...@kiwi ~/# sysctl kstat.zfs.misc.arcstats kstat.zfs.misc.arcstats.hits: 350294273 kstat.zfs.misc.arcstats.misses: 8369056 kstat.zfs.misc.arcstats.demand_data_hits: 4336959 kstat.zfs.misc.arcstats.demand_data_misses: 135936 kstat.zfs.misc.arcstats.demand_metadata_hits: 267825050 kstat.zfs.misc.arcstats.demand_metadata_misses: 6177625 kstat.zfs.misc.arcstats.prefetch_data_hits: 138128 kstat.zfs.misc.arcstats.prefetch_data_misses: 400434 kstat.zfs.misc.arcstats.prefetch_metadata_hits: 77994136 kstat.zfs.misc.arcstats.prefetch_metadata_misses: 1655061 kstat.zfs.misc.arcstats.mru_hits: 158218094 kstat.zfs.misc.arcstats.mru_ghost_hits: 9777 kstat.zfs.misc.arcstats.mfu_hits: 114654575 kstat.zfs.misc.arcstats.mfu_ghost_hits: 244807 kstat.zfs.misc.arcstats.deleted: 9904481 kstat.zfs.misc.arcstats.recycle_miss: 2855906 kstat.zfs.misc.arcstats.mutex_miss: 9362 kstat.zfs.misc.arcstats.evict_skip: 1483848 kstat.zfs.misc.arcstats.hash_elements: 0 kstat.zfs.misc.arcstats.hash_elements_max: 553646 kstat.zfs.misc.arcstats.hash_collisions: 8012499 kstat.zfs.misc.arcstats.hash_chains: 15382 kstat.zfs.misc.arcstats.hash_chain_max: 16 kstat.zfs.misc.arcstats.p: 1107222849 kstat.zfs.misc.arcstats.c: 1263550464 kstat.zfs.misc.arcstats.c_min: 52647936 kstat.zfs.misc.arcstats.c_max: 1263550464 kstat.zfs.misc.arcstats.size: 1263430144 test #1 (327,680,000 bytes) [~412MB/s - buffered] = r...@kiwi ~/# dd if=/dev/zero of=/tank/test01 bs=64k count=5000 5000+0 records in 5000+0 records out 32768 bytes transferred in 0.758220 secs (432170107 bytes/sec) test #1 (kstat.zfs.misc.arcstats) === r...@kiwi ~/# sysctl kstat.zfs.misc.arcstats kstat.zfs.misc.arcstats.hits: 350294422 kstat.zfs.misc.arcstats.misses: 8369059 kstat.zfs.misc.arcstats.demand_data_hits: 4337042 kstat.zfs.misc.arcstats.demand_data_misses: 135936 kstat.zfs.misc.arcstats.demand_metadata_hits: 267825116 kstat.zfs.misc.arcstats.demand_metadata_misses: 6177628 kstat.zfs.misc.arcstats.prefetch_data_hits: 138128 kstat.zfs.misc.arcstats.prefetch_data_misses: 400434 kstat.zfs.misc.arcstats.prefetch_metadata_hits: 77994136 kstat.zfs.misc.arcstats.prefetch_metadata_misses: 1655061 kstat.zfs.misc.arcstats.mru_hits: 158218145 kstat.zfs.misc.arcstats.mru_ghost_hits: 9777
Re: ntpd struggling to keep up - how to fix?
On Fri, Feb 12, 2010 at 11:46:04AM -0800, Jeremy Chadwick wrote: Technical footnote: I wish I understood 1) the difference between ACPI-safe and ACPI-fast, and 2) how the system or OS ranks the timecounters (the higher the value in parenthesis, supposedly the more accurate/preferred it is). Xin, do you happen to know how this works? 1) When you read the ACPI timing register, you should get a sensible answer. However on some (most?) hardware, you can read the register and get it half way through an update. When the kernel finds the ACPI timer, it tries reading it a few times in a row, and checks the results look good - if they do, you get ACPI-fast. If it catches a half-updated register, then you get ACPI-slow, which reads the register multiple times in an effort to avoid the problem. 2) The ranking of timers is essentially hard wired, though for some times it is adjusted in some way. For example, the ranking of the TSC may be reduced if it looks like an SMP system. I believe the ranking was originally intended to be a measure of how fast the counter could be read, but things have turned out to be complicated by difficult hardware. David. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: hardware for home use large storage
On Mon, Feb 15, 2010 at 7:14 PM, Dan Langille d...@langille.org wrote: Dan Naumov wrote: On Sun, Feb 14, 2010 at 11:38 PM, Dan Langille d...@langille.org wrote: Dan Naumov wrote: On Sun, 14 Feb 2010, Dan Langille wrote: After creating three different system configurations (Athena, Supermicro, and HP), my configuration of choice is this Supermicro setup: 1. Samsung SATA CD/DVD Burner $20 (+ $8 shipping) 2. SuperMicro 5046A $750 (+$43 shipping) 3. LSI SAS 3081E-R $235 4. SATA cables $60 5. Crucial 3×2G ECC DDR3-1333 $191 (+ $6 shipping) 6. Xeon W3520 $310 You do realise how much of a massive overkill this is and how much you are overspending? I appreciate the comments and feedback. I'd also appreciate alternative suggestions in addition to what you have contributed so far. Spec out the box you would build. == Case: Fractal Design Define R2 - 89 euro: http://www.fractal-design.com/?view=productprod=32 Mobo/CPU: Supermicro X7SPA-H / Atom D510 - 180-220 euro: http://www.supermicro.com/products/motherboard/ATOM/ICH9/X7SPA.cfm?typ=H PSU: Corsair 400CX 80+ - 59 euro: http://www.corsair.com/products/cx/default.aspx RAM: Corsair 2x2GB, DDR2 800MHz SO-DIMM, CL5 - 85 euro == Total: ~435 euro The motherboard has 6 native AHCI-capable ports on ICH9R controller and you have a PCI-E slot free if you want to add an additional controller card. Feel free to blow the money you've saved on crazy fast SATA disks and if your system workload is going to have a lot of random reads, then spend 200 euro on a 80gb Intel X25-M for use as a dedicated L2ARC device for your pool. Based on the Fractal Design case mentioned above, I was told about Lian Lia cases, which I think are great. As a result, I've gone with a tower case without hot-swap. The parts are listed at and reproduced below: http://dan.langille.org/2010/02/15/a-full-tower-case/ 1. LIAN LI PC-A71F Black Aluminum ATX Full Tower Computer Case $240 (from mwave) 2. Antec EarthWatts EA650 650W PSU $80 3. Samsung SATA CD/DVD Burner $20 (+ $8 shipping) 4. Intel S3200SHV LGA 775 Intel 3200 m/b $200 5. Intel Core2 Quad Q9400 CPU $190 6. SATA cables $22 7. Supermicro LSI MegaRAID 8 Port SAS RAID Controller $118 8. Kingston ValueRAM 4GB (2 x 2GB) 240-Pin DDR2 SDRAM ECC $97 Total cost is about $1020 with shipping. Plus HDD. No purchases yet, but the above is what appeals to me now. A C2Q CPU makes little sense right now from a performance POV. For the price of that C2Q CPU + LGA775 board you can get an i5 750 CPU and a 1156 socket motherboard that will run circles around that C2Q. You would lose the ECC though, since that requires the more expensive 1366 socket CPUs and boards. - Sincerely, Dan Naumov ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: hardware for home use large storage
On Hét, Február 15, 2010 9:39 pm, Dan Naumov wrote: On Mon, Feb 15, 2010 at 7:14 PM, Dan Langille d...@langille.org wrote: Dan Naumov wrote: On Sun, Feb 14, 2010 at 11:38 PM, Dan Langille d...@langille.org wrote: Dan Naumov wrote: On Sun, 14 Feb 2010, Dan Langille wrote: After creating three different system configurations (Athena, Supermicro, and HP), my configuration of choice is this Supermicro setup: 1. Samsung SATA CD/DVD Burner $20 (+ $8 shipping) 2. SuperMicro 5046A $750 (+$43 shipping) 3. LSI SAS 3081E-R $235 4. SATA cables $60 5. Crucial 3×2G ECC DDR3-1333 $191 (+ $6 shipping) 6. Xeon W3520 $310 You do realise how much of a massive overkill this is and how much you are overspending? I appreciate the comments and feedback. I'd also appreciate alternative suggestions in addition to what you have contributed so far. Spec out the box you would build. == Case: Fractal Design Define R2 - 89 euro: http://www.fractal-design.com/?view=productprod=32 Mobo/CPU: Supermicro X7SPA-H / Atom D510 - 180-220 euro: http://www.supermicro.com/products/motherboard/ATOM/ICH9/X7SPA.cfm?typ =H PSU: Corsair 400CX 80+ - 59 euro: http://www.corsair.com/products/cx/default.aspx RAM: Corsair 2x2GB, DDR2 800MHz SO-DIMM, CL5 - 85 euro == Total: ~435 euro The motherboard has 6 native AHCI-capable ports on ICH9R controller and you have a PCI-E slot free if you want to add an additional controller card. Feel free to blow the money you've saved on crazy fast SATA disks and if your system workload is going to have a lot of random reads, then spend 200 euro on a 80gb Intel X25-M for use as a dedicated L2ARC device for your pool. Based on the Fractal Design case mentioned above, I was told about Lian Lia cases, which I think are great. As a result, I've gone with a tower case without hot-swap. The parts are listed at and reproduced below: http://dan.langille.org/2010/02/15/a-full-tower-case/ 1. LIAN LI PC-A71F Black Aluminum ATX Full Tower Computer Case $240 (from mwave) 2. Antec EarthWatts EA650 650W PSU $80 3. Samsung SATA CD/DVD Burner $20 (+ $8 shipping) 4. Intel S3200SHV LGA 775 Intel 3200 m/b $200 5. Intel Core2 Quad Q9400 CPU $190 6. SATA cables $22 7. Supermicro LSI MegaRAID 8 Port SAS RAID Controller $118 8. Kingston ValueRAM 4GB (2 x 2GB) 240-Pin DDR2 SDRAM ECC $97 Total cost is about $1020 with shipping. Plus HDD. No purchases yet, but the above is what appeals to me now. A C2Q CPU makes little sense right now from a performance POV. For the price of that C2Q CPU + LGA775 board you can get an i5 750 CPU and a 1156 socket motherboard that will run circles around that C2Q. You would lose the ECC though, since that requires the more expensive 1366 socket CPUs and boards. - Sincerely, Dan Naumov Hi, Do have test about this? I'm not really impressed with the i5 series. Regards, Andras ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: hardware for home use large storage
On 02/15/10 12:14, Dan Langille wrote: Dan Naumov wrote: On Sun, Feb 14, 2010 at 11:38 PM, Dan Langille d...@langille.org wrote: Dan Naumov wrote: On Sun, 14 Feb 2010, Dan Langille wrote: After creating three different system configurations (Athena, Supermicro, and HP), my configuration of choice is this Supermicro setup: 1. Samsung SATA CD/DVD Burner $20 (+ $8 shipping) 2. SuperMicro 5046A $750 (+$43 shipping) 3. LSI SAS 3081E-R $235 4. SATA cables $60 5. Crucial 3×2G ECC DDR3-1333 $191 (+ $6 shipping) 6. Xeon W3520 $310 You do realise how much of a massive overkill this is and how much you are overspending? I appreciate the comments and feedback. I'd also appreciate alternative suggestions in addition to what you have contributed so far. Spec out the box you would build. == Case: Fractal Design Define R2 - 89 euro: http://www.fractal-design.com/?view=productprod=32 Mobo/CPU: Supermicro X7SPA-H / Atom D510 - 180-220 euro: http://www.supermicro.com/products/motherboard/ATOM/ICH9/X7SPA.cfm?typ=H PSU: Corsair 400CX 80+ - 59 euro: http://www.corsair.com/products/cx/default.aspx RAM: Corsair 2x2GB, DDR2 800MHz SO-DIMM, CL5 - 85 euro == Total: ~435 euro The motherboard has 6 native AHCI-capable ports on ICH9R controller and you have a PCI-E slot free if you want to add an additional controller card. Feel free to blow the money you've saved on crazy fast SATA disks and if your system workload is going to have a lot of random reads, then spend 200 euro on a 80gb Intel X25-M for use as a dedicated L2ARC device for your pool. Based on the Fractal Design case mentioned above, I was told about Lian Lia cases, which I think are great. As a result, I've gone with a tower case without hot-swap. The parts are listed at and reproduced below: http://dan.langille.org/2010/02/15/a-full-tower-case/ 1. LIAN LI PC-A71F Black Aluminum ATX Full Tower Computer Case $240 (from mwave) 2. Antec EarthWatts EA650 650W PSU $80 3. Samsung SATA CD/DVD Burner $20 (+ $8 shipping) 4. Intel S3200SHV LGA 775 Intel 3200 m/b $200 5. Intel Core2 Quad Q9400 CPU $190 6. SATA cables $22 7. Supermicro LSI MegaRAID 8 Port SAS RAID Controller $118 8. Kingston ValueRAM 4GB (2 x 2GB) 240-Pin DDR2 SDRAM ECC $97 Total cost is about $1020 with shipping. Plus HDD. No purchases yet, but the above is what appeals to me now. Dan, I'm not sure about that particular card, but we've never seen that great of performance out of the LSI MegaRAID cards that ship with Dell servers as the PERC. The newest incarnations are better, but I would try to get an Areca. The ones we have tested have displayed fantastic performance. They are fairly expensive in comparison, though. If you're using ZFS in place of the RAID on the LSI MegaRAID, I'd instead recommend other simpler SAS cards which are known to have good driver support. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: ACK and RST packets sent after successfully terminating TCP connection
Hello Jeremy,
Is it possible for you to upload these captures somewhere on the web?
tcpdump -p -i {iface} -s 0 -n -w {somefile} should be sufficient.
You can find the two pcaps at http://drop.io/llwiy8o. IP addresses and
the data have been anonymized, everything else has been left intact.
There was no ICMP traffic between the hosts. Thanks for looking into
it!
Regards,
--
Nino
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: hardware for home use large storage
A C2Q CPU makes little sense right now from a performance POV. For the price of that C2Q CPU + LGA775 board you can get an i5 750 CPU and a 1156 socket motherboard that will run circles around that C2Q. You would lose the ECC though, since that requires the more expensive 1366 socket CPUs and boards. - Sincerely, Dan Naumov Hi, Do have test about this? I'm not really impressed with the i5 series. Regards, Andras There: http://www.anandtech.com/cpuchipsets/showdoc.aspx?i=3634p=10 The i5 750, which is a 180 euro CPU, beats Q9650 C2Q, which is a 300 euro CPU. - Sincerely, Dan Naumov ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: ZFS tuning [was: hardware for home use large storage]
Alexander Leidinger wrote: [...] kstat.zfs.misc.arcstats.c kstat.zfs.misc.arcstats.c_min kstat.zfs.misc.arcstats.c_max c_max is vfs.zfs.arc_max, c_min is vfs.zfs.arc_min. kstat.zfs.misc.arcstats.evict_skip kstat.zfs.misc.arcstats.memory_throttle_count kstat.zfs.misc.arcstats.size I'm not very sure about size and c... both represent some kind of current size, but they are not the same. About the tuning I would recommend to depend upon a more human readable representation. I've seen someone posting something like this, but I do not know how it was generated (some kind of script, but I do not know where to get it). I think you are referring to this script: http://cuddletech.com/arc_summary/ and its FreeBSD version http://bitbucket.org/koie/arc_summary/changeset/dbe14d2cf52b/ It gives output like this: # arc_summary.sh System Memory: Physical RAM: 4978 MB Free Memory : 755 MB ARC Size: Current Size: 1028 MB (arcsize) Target Size (Adaptive): 1028 MB (c) Min Size (Hard Limit):50 MB (zfs_arc_min) Max Size (Hard Limit):1205 MB (zfs_arc_max) ARC Size Breakdown: Most Recently Used Cache Size: 93%963 MB (p) Most Frequently Used Cache Size: 6%65 MB (c-p) ARC Efficency: Cache Access Total: 358720716 Cache Hit Ratio: 97% 350351031 [Defined State for buffer] Cache Miss Ratio: 2% 8369685[Undefined State for Buffer] REAL Hit Ratio: 76% 272917080 [MRU/MFU Hits Only] Data Demand Efficiency:96% Data Prefetch Efficiency:27% CACHE HITS BY CACHE LIST: Anon: 22%77179355 [ New Customer, First Cache Hit ] Most Recently Used: 45%158252587 (mru) [ Return Customer ] Most Frequently Used: 32%114664493 (mfu) [ Frequent Customer ] Most Recently Used Ghost:0%9777 (mru_ghost) [ Return Customer Evicted, Now Back ] Most Frequently Used Ghost: 0%244819 (mfu_ghost) [ Frequent Customer Evicted, Now Back ] CACHE HITS BY DATA TYPE: Demand Data: 1%4375918 Prefetch Data: 0%150148 Demand Metadata:76%267830502 Prefetch Metadata: 22%77994463 CACHE MISSES BY DATA TYPE: Demand Data: 1%135956 Prefetch Data: 4%400434 Demand Metadata:73%6177748 Prefetch Metadata: 19%1655547 - Another useful script is arcstat.pl from http://blogs.sun.com/realneel/entry/zfs_arc_statistics There are FreeBSD version floating around but I can't find a link to it, so I am sending it as attachment. It would be nice to have some standardized scripts for monitoring debugging ZFS issues attached to FreeBSD Wiki page about ZFS tuning. Then everebody will use the same scripts, same output format. It will be easier to compare results in discussions etc. So if anybody of you have write permissions to Wiki, can you add those two scripts? (or make some better ;]) Understanding to tuning of ZFS is really hard with lack of documentation ;( Miroslav Lachman #!/usr/bin/perl -w # # Print out ZFS ARC Statistics exported via kstat(1) # For a definition of fields, or usage, use arctstat.pl -v # # Author: Neelakanth Nadgir http://blogs.sun.com/realneel # Comments/Questions/Feedback to neel_sun.com or neel_gnu.org # # CDDL HEADER START # # The contents of this file are subject to the terms of the # Common Development and Distribution License, Version 1.0 only # (the License). You may not use this file except in compliance # with the License. # # You can obtain a copy of the license at usr/src/OPENSOLARIS.LICENSE # or http://www.opensolaris.org/os/licensing. # See the License for the specific language governing permissions # and limitations under the License. # # When distributing Covered Code, include this CDDL HEADER in each # file and include the License file at usr/src/OPENSOLARIS.LICENSE. # If applicable, add the following below this CDDL HEADER, with the # fields enclosed by brackets [] replaced with your own identifying # information: Portions Copyright [] [name of copyright owner] # # CDDL HEADER END # # # Fields have a fixed width. Every interval, we fill the v # hash with its corresponding value (v[field]=value) using calculate(). # @hdr is the array of fields that needs to be printed, so we # just iterate over this array and print the values using our pretty printer. use strict; use POSIX qw(strftime); #use Sun::Solaris::Kstat; use Getopt::Long; use IO::Handle; my %cols = (# HDR = [Size, Description] Time =[8, Time], hits =[4,
Re: hardware for home use large storage
On Hét, Február 15, 2010 10:15 pm, Dan Naumov wrote: A C2Q CPU makes little sense right now from a performance POV. For the price of that C2Q CPU + LGA775 board you can get an i5 750 CPU and a 1156 socket motherboard that will run circles around that C2Q. You would lose the ECC though, since that requires the more expensive 1366 socket CPUs and boards. - Sincerely, Dan Naumov Hi, Do have test about this? I'm not really impressed with the i5 series. Regards, Andras There: http://www.anandtech.com/cpuchipsets/showdoc.aspx?i=3634p=10 The i5 750, which is a 180 euro CPU, beats Q9650 C2Q, which is a 300 euro CPU. - Sincerely, Dan Naumov Oh, I was not up to date on price performance ratio. However I'd compare the i5 750 to the Q8400 which is also a 2,66GHz one. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: ACK and RST packets sent after successfully terminating TCP connection
On Mon, Feb 15, 2010 at 10:07:32PM +0100, n j wrote:
Hello Jeremy,
Is it possible for you to upload these captures somewhere on the web?
tcpdump -p -i {iface} -s 0 -n -w {somefile} should be sufficient.
You can find the two pcaps at http://drop.io/llwiy8o. IP addresses and
the data have been anonymized, everything else has been left intact.
There was no ICMP traffic between the hosts. Thanks for looking into
it!
succ.pcap --
skipping obvious stuff
Packet #9: client -- server: client requests TCP connection close (FIN+ACK)
Packet #10: server -- client: server sends ACK
approximately 0.6 seconds passes
Packet #11: server -- client: server announces TCP window size of 0,
indicating TCP receive buffers are exhausted and that the
client should wait before doing anything more
Packet #12: server -- client: identical re-sent ACK of packet #10
fail.pcap --
skipping obvious stuff
Packet #3: client -- server: initial handshake; TCP ACK
Packet #4: server -- client: server sends TCP RST. Software on
server likely closed the socket/fd
approximately 0.75 seconds passes
Packet #5: server -- client: server announces TCP window size of 0,
indicating TCP receive buffers are exhausted and that the
client should wait before doing anything more
Packet #6: server -- client: identical re-sent RST of packet #4
Packet #7: client -- server: confirms reset (RST+ACK)
Whatever this client/server protocol is, it isn't normal/standard. It's
not something like, for example, HTTP, SSH, or FTP; It's a custom
protocol and one I haven't seen before.
Do you see the above awkward behaviour (zero-sized TCP window packets
followed by a retransmission of a prior packet) when using standardised
protocols or software, such as Apache (HTTP), OpenSSH (SSH), or FTP?
If not, then the client/server software is probably to blame. It may be
operating on a raw socket level, populating IP and/or TCP portions of
the packet itself rather than relying on socket(2) entirely.
If it uses standard kernel socket(2) functionality with PF_INET and
SOCK_STREAM, then I'd ask if the source is available publicly to be
analysed to determine if this behaviour is intentional or not.
Is there VPN and/or NAT involved between the client and server
(re: NAT: particularly around the server)?
Finally, is it possible to get ifconfig -a and netstat -m output
from the server?
--
| Jeremy Chadwick j...@parodius.com |
| Parodius Networking http://www.parodius.com/ |
| UNIX Systems Administrator Mountain View, CA, USA |
| Making life hard for others since 1977. PGP: 4BD6C0CB |
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: [HEADSUP]: ports feature freeze now in effect
On Monday 15 February 2010 12:19:01 pm Erwin Lansing wrote: In preparation for 7.3-RELEASE, the ports tree is now in feature freeze. Normal upgrade, new ports, and changes that only affect other branches are allowed without prior approval but with the extra Feature safe: yes tag in the commit message. Any commit that is sweeping, i.e. touches a large number of ports, infrastructural changes, commts to ports with unusually high number of dependent ports, and any other commit that requires the rebuilding of many packages is not allowed without prior explicit approval from portmgr after that date. When in doubt, please do not hesitate to contact portmgr. -erwin I suspect this means we won't get KDE 4.4 for quite some time... ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: [HEADSUP]: ports feature freeze now in effect
2010/2/15 Steven Friedrich free...@insightbb.com: On Monday 15 February 2010 12:19:01 pm Erwin Lansing wrote: In preparation for 7.3-RELEASE, the ports tree is now in feature freeze. Normal upgrade, new ports, and changes that only affect other branches are allowed without prior approval but with the extra Feature safe: yes tag in the commit message. Any commit that is sweeping, i.e. touches a large number of ports, infrastructural changes, commts to ports with unusually high number of dependent ports, and any other commit that requires the rebuilding of many packages is not allowed without prior explicit approval from portmgr after that date. When in doubt, please do not hesitate to contact portmgr. -erwin I suspect this means we won't get KDE 4.4 for quite some time... http://miwi.bsdcrew.de/2010/02/cft-kde-sc-4-4-0-for-freebsd/ ___ freebsd-po...@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-ports To unsubscribe, send any mail to freebsd-ports-unsubscr...@freebsd.org -- Olivier Smedts _ ASCII ribbon campaign ( ) e-mail: oliv...@gid0.org- against HTML email vCards X www: http://www.gid0.org- against proprietary attachments / \ Il y a seulement 10 sortes de gens dans le monde : ceux qui comprennent le binaire, et ceux qui ne le comprennent pas. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: hardware for home use large storage
How much ram are you running with? 8GB on amd64. kmem_size=16G, zfs.arc_max=6G In a latest test with 8.0-R on i386 with 2GB of ram, an install to a ZFS root *will* panic the kernel with kmem_size too small with default settings. Even dropping down to Cy Schubert's uber-small config will panic the kernel (vm.kmem_size_max = 330M, vfs.zfs.arc_size = 40M, vfs.zfs.vdev.cache_size = 5M); the system is currently stable using DIST kernel, vm.kmem_size/max = 512M, arc_size = 40M and vdev.cache_size = 5M. On i386 you don't really have much wiggle room. Your address space is 32-bit and, to make things more interesting, it's split between user-land and kernel. You can keep bumping KVA_PAGES only so far and that's what limits your vm.kmem_size_max which is the upper limit for vm.kmem_size. The bottom line -- if you're planning to use ZFS, do switch to amd64. Even with only 2GB of physical RAM available, your box will behave better. At the very least it will be possible to avoid the panics caused by kmem exhaustion. --Artem ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: hardware for home use large storage
Dan Naumov wrote: On Mon, Feb 15, 2010 at 7:14 PM, Dan Langille d...@langille.org wrote: Dan Naumov wrote: On Sun, Feb 14, 2010 at 11:38 PM, Dan Langille d...@langille.org wrote: Dan Naumov wrote: On Sun, 14 Feb 2010, Dan Langille wrote: After creating three different system configurations (Athena, Supermicro, and HP), my configuration of choice is this Supermicro setup: 1. Samsung SATA CD/DVD Burner $20 (+ $8 shipping) 2. SuperMicro 5046A $750 (+$43 shipping) 3. LSI SAS 3081E-R $235 4. SATA cables $60 5. Crucial 3×2G ECC DDR3-1333 $191 (+ $6 shipping) 6. Xeon W3520 $310 You do realise how much of a massive overkill this is and how much you are overspending? I appreciate the comments and feedback. I'd also appreciate alternative suggestions in addition to what you have contributed so far. Spec out the box you would build. == Case: Fractal Design Define R2 - 89 euro: http://www.fractal-design.com/?view=productprod=32 Mobo/CPU: Supermicro X7SPA-H / Atom D510 - 180-220 euro: http://www.supermicro.com/products/motherboard/ATOM/ICH9/X7SPA.cfm?typ=H PSU: Corsair 400CX 80+ - 59 euro: http://www.corsair.com/products/cx/default.aspx RAM: Corsair 2x2GB, DDR2 800MHz SO-DIMM, CL5 - 85 euro == Total: ~435 euro The motherboard has 6 native AHCI-capable ports on ICH9R controller and you have a PCI-E slot free if you want to add an additional controller card. Feel free to blow the money you've saved on crazy fast SATA disks and if your system workload is going to have a lot of random reads, then spend 200 euro on a 80gb Intel X25-M for use as a dedicated L2ARC device for your pool. Based on the Fractal Design case mentioned above, I was told about Lian Lia cases, which I think are great. As a result, I've gone with a tower case without hot-swap. The parts are listed at and reproduced below: http://dan.langille.org/2010/02/15/a-full-tower-case/ 1. LIAN LI PC-A71F Black Aluminum ATX Full Tower Computer Case $240 (from mwave) 2. Antec EarthWatts EA650 650W PSU $80 3. Samsung SATA CD/DVD Burner $20 (+ $8 shipping) 4. Intel S3200SHV LGA 775 Intel 3200 m/b $200 5. Intel Core2 Quad Q9400 CPU $190 6. SATA cables $22 7. Supermicro LSI MegaRAID 8 Port SAS RAID Controller $118 8. Kingston ValueRAM 4GB (2 x 2GB) 240-Pin DDR2 SDRAM ECC $97 Total cost is about $1020 with shipping. Plus HDD. No purchases yet, but the above is what appeals to me now. A C2Q CPU makes little sense right now from a performance POV. For the price of that C2Q CPU + LGA775 board you can get an i5 750 CPU and a 1156 socket motherboard that will run circles around that C2Q. You would lose the ECC though, since that requires the more expensive 1366 socket CPUs and boards. ECC RAM appeals and yes, that comes with a cost. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: [HEADSUP]: ports feature freeze now in effect
On Mon, Feb 15, 2010 at 4:11 PM, Steven Friedrich free...@insightbb.com wrote: On Monday 15 February 2010 12:19:01 pm Erwin Lansing wrote: In preparation for 7.3-RELEASE, the ports tree is now in feature freeze. Normal upgrade, new ports, and changes that only affect other branches are allowed without prior approval but with the extra Feature safe: yes tag in the commit message. Any commit that is sweeping, i.e. touches a large number of ports, infrastructural changes, commts to ports with unusually high number of dependent ports, and any other commit that requires the rebuilding of many packages is not allowed without prior explicit approval from portmgr after that date. When in doubt, please do not hesitate to contact portmgr. -erwin I suspect this means we won't get KDE 4.4 for quite some time... ___ I am not sure how close KDE 4.4 is but it would have been nice to get KDE in before the freeze Sam Fourman Jr. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: hardware for home use large storage
Just out of curiousity, would not an older server like this: http://www.geeks.com/details.asp?InvtId=DL145-5R (~$75 + shipping) or http://www.geeks.com/details.asp?invtid=DL360-6Rcat=SYS (~$190 + shipping) be a reasonable option? Unless you're looking to suck every last bit of speed or energy savings out the machine, I would think bumping the memory up on one of these, adding one or more eSATA or SAS interfaces and an external drive rack would result in an exceptional home server with several TB of storage, decent speed, still costing less than $1K usd John - J. T. Farmer jfar...@goldsword.comjfar...@orfencer.org GoldSword Systems, Knoxville TN Coach Instructor Consulting, Knoxville Academy of the Blade Software Development, Maryville Fencing Club Project Management ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: ZFS on root, serial console install
I did a pxeboot zfs-root install the other day. If you copy the dvd to an nfs export as the root mount, hack the requisite files to do serial console then you will drop to a login prompt when it boots over pxe-tftp. Had no problems setting up zfs root install by skipping sysinstall and fixit entirely: setup your ZFS root, then set DESTDIR and use install.sh in the individual package dirs. http://wiki.freebsd.org/RootOnZFS/GPTZFSBoot/RAIDZ2 On Fri, Feb 12, 2010 at 7:27 AM, Charles Sprickman sp...@bway.net wrote: Any hints on that one? I finally got around to getting dhcp/tftp/nfs setup on an internal network to perform normal installs (and with some pxelinux hackery, the ability to boot a DOS disk or memtest86 disk images). Sysinstall in general is kind of an unweildy beast over serial, but one thing I was not able to accomplish was to get a shell (no extra virtual consoles on serial) or attempt any mounting of fixit media. From my last install that put ZFS on root, I had to do quite a bit of tapdancing since I had no DVD or bootable USB media - lots of switching from the install disk to fixit, which brought me to many chicken and egg moments. I did it though... But remotely, I'm not seeing a good way to do this. If mfsroot were larger and had more tools, then I'd be in business. This is probably the direction I need to get shoved in. I've looked at some other options with pxelinux and perhaps booting the mini ISO, but I'm not sure that gets me anywhere. Any tips? This isn't a make or break situation, I live 15 minutes from the colo... It's more of a quest. :) I would installl a small UFS FBSD system of 1 or 2 Gig on say ad0s1. That gives you more then the equivalent of a fixit CD. You then use this mini system as base to install the real one on the other slice(s) After having finished the install, you use fdisk to change the active slice to the new install and reboot. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org -- Peter C. Lai ITS Systems Administrator Bard College at Simon's Rock 84 Alford Rd. Great Barrington, MA 01230 (413) 528-7428 peter at simons-rock.edu ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: hardware for home use large storage
Steve Polyack wrote: On 02/15/10 12:14, Dan Langille wrote: 7. Supermicro LSI MegaRAID 8 Port SAS RAID Controller $118 Dan, I'm not sure about that particular card, but we've never seen that great of performance out of the LSI MegaRAID cards that ship with Dell servers as the PERC. The newest incarnations are better, but I would try to get an Areca. The ones we have tested have displayed fantastic performance. They are fairly expensive in comparison, though. If you're using ZFS in place of the RAID on the LSI MegaRAID, I'd instead recommend other simpler SAS cards which are known to have good driver support. Yes, the card will be used as a straight-through and not use for RAID. ZFS will be running raidz for me, possibly raidz2. Given that, I'm not sure if you're suggesting the3 Areca or something else. In addition, I'm not sure what makes a SAS card simpler and supported. Recommendation? Other cards I have considered include: LSI SAS3041E-R 4 port $120 http://www.google.com/products/catalog?q=lsi+sas+pciehl=encid=1824913543877548833sa=title#p SYBA SY-PEX40008 PCI Express SATA II 4 port $60 http://www.newegg.com/Product/Product.aspx?Item=N82E16816124027 LSISAS1064 chipset - SAS3042e http://www.lsi.com/DistributionSystem/AssetDocument/PCIe_3GSAS_UG.pdf SUPERMICRO AOC-SAT2-MV8 64-bit PCI-X133MHz SATA Controller Card $99 http://www.newegg.com/Product/Product.aspx?Item=N82E16815121009 ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: hardware for home use large storage
On 2/15/2010 6:04 PM, Dan Langille wrote: Steve Polyack wrote: On 02/15/10 12:14, Dan Langille wrote: 7. Supermicro LSI MegaRAID 8 Port SAS RAID Controller $118 Dan, I'm not sure about that particular card, but we've never seen that great of performance out of the LSI MegaRAID cards that ship with Dell servers as the PERC. The newest incarnations are better, but I would try to get an Areca. The ones we have tested have displayed fantastic performance. They are fairly expensive in comparison, though. If you're using ZFS in place of the RAID on the LSI MegaRAID, I'd instead recommend other simpler SAS cards which are known to have good driver support. Yes, the card will be used as a straight-through and not use for RAID. ZFS will be running raidz for me, possibly raidz2. Given that, I'm not sure if you're suggesting the3 Areca or something else. In addition, I'm not sure what makes a SAS card simpler and supported. Recommendation? Other cards I have considered include: LSI SAS3041E-R 4 port $120 http://www.google.com/products/catalog?q=lsi+sas+pciehl=encid=1824913543877548833sa=title#p SYBA SY-PEX40008 PCI Express SATA II 4 port $60 http://www.newegg.com/Product/Product.aspx?Item=N82E16816124027 LSISAS1064 chipset - SAS3042e http://www.lsi.com/DistributionSystem/AssetDocument/PCIe_3GSAS_UG.pdf SUPERMICRO AOC-SAT2-MV8 64-bit PCI-X133MHz SATA Controller Card $99 http://www.newegg.com/Product/Product.aspx?Item=N82E16815121009 All I meant by simpler was that if you're not going to use the RAID portion then you do not have to pay for it. Same goes for SAS - if you're not going to use SAS disks, you only need a SATA controller. The SYBA card you have listed works great with the siis driver (NCQ support). If you don't need SAS support, I think there are Areca cards around $100 that just do SATA w/o RAID. As far as supported, I know that the Areca driver is very good, as is the recently revamped ahci generic and siis drivers. Like I said, those newer LSI cards may be fine, but I've had bad experiences with the PERC4 and PERC5 (/LSI/ MegaRAID SAS 8408E), which are both re-branded LSI MegaRAID cards. They were always very reliable and handled failed disks quite well, but performance was often ... just bad. YMMV. The PERC6 (one of the newer generations) isn't half as bad... If you end up with one of the LSI cards, let us know how it performs ;) ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: [HEADSUP]: ports feature freeze now in effect
On Mon 15 Feb 2010 at 14:11:47 PST Steven Friedrich wrote: I suspect this means we won't get KDE 4.4 for quite some time... I don't think that it was ever in the plan to get it in before the freeze. Here's what Martin Wilke said in the call for testing: Before you ask we don't want to put KDE 4.4.0 in the ports tree before FreeBSD 7.3 was released. But there's no reason to think it will be quite some time before we see it in the portstree. Given the past history of the KDE porting team, I would expect to see it shortly after the 7.3 release. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: ZFS on root, serial console install
On Mon, 15 Feb 2010, Peter C. Lai wrote: I did a pxeboot zfs-root install the other day. If you copy the dvd to an nfs export as the root mount, hack the requisite files to do serial console then you will drop to a login prompt when it boots over pxe-tftp. Had no problems setting up zfs root install by skipping sysinstall and fixit entirely: setup your ZFS root, then set DESTDIR and use install.sh in the individual package dirs. In short, did you do what I did somewhat accidentally? I did a netboot, set loader.conf to mount mfsroot as my root fs. For reasons I'm still unclear on, it did not grab mfsroot and proceeded to try and mount root over nfs (which happened to be exported RO). It seems like if my nfs was exported rw, I would have been running with all the tools I needed and the drives would be available to me... I'm going to try with rw nfs, currently the machine's locked up as it's confused about a ro root... Thanks, Charles http://wiki.freebsd.org/RootOnZFS/GPTZFSBoot/RAIDZ2 On Fri, Feb 12, 2010 at 7:27 AM, Charles Sprickman sp...@bway.net wrote: Any hints on that one? I finally got around to getting dhcp/tftp/nfs setup on an internal network to perform normal installs (and with some pxelinux hackery, the ability to boot a DOS disk or memtest86 disk images). Sysinstall in general is kind of an unweildy beast over serial, but one thing I was not able to accomplish was to get a shell (no extra virtual consoles on serial) or attempt any mounting of fixit media. From my last install that put ZFS on root, I had to do quite a bit of tapdancing since I had no DVD or bootable USB media - lots of switching from the install disk to fixit, which brought me to many chicken and egg moments. I did it though... But remotely, I'm not seeing a good way to do this. If mfsroot were larger and had more tools, then I'd be in business. This is probably the direction I need to get shoved in. I've looked at some other options with pxelinux and perhaps booting the mini ISO, but I'm not sure that gets me anywhere. Any tips? This isn't a make or break situation, I live 15 minutes from the colo... It's more of a quest. :) I would installl a small UFS FBSD system of 1 or 2 Gig on say ad0s1. That gives you more then the equivalent of a fixit CD. You then use this mini system as base to install the real one on the other slice(s) After having finished the install, you use fdisk to change the active slice to the new install and reboot. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org -- Peter C. Lai ITS Systems Administrator Bard College at Simon's Rock 84 Alford Rd. Great Barrington, MA 01230 (413) 528-7428 peter at simons-rock.edu ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: hardware for home use large storage
On Tue, 16 Feb 2010, Steve Polyack wrote: I'm not sure about that particular card, but we've never seen that great of performance out of the LSI MegaRAID cards that ship with Dell servers as the PERC. The newest incarnations are better, but I would try to get an Areca. The ones we have tested have displayed fantastic performance. They are fairly expensive in comparison, though. If you're using ZFS in place of the RAID on the LSI MegaRAID, I'd instead recommend other simpler SAS cards which are known to have good driver support. Why even bother with the LSI card at all? That board already has 6 SATA slots - depends how many disks you want to use of course. (5 HDs + 1 DVD drive?) -- Daniel O'Connor software and network engineer for Genesis Software - http://www.gsoft.com.au The nice thing about standards is that there are so many of them to choose from. -- Andrew Tanenbaum GPG Fingerprint - 5596 B766 97C0 0E94 4347 295E E593 DC20 7B3F CE8C signature.asc Description: This is a digitally signed message part.
Re: Sudden mbuf demand increase and shortage under the load
* Maxim Sobolev sobo...@freebsd.org [100215 04:49] wrote: Hi, Our company have a FreeBSD based product that consists of the numerous interconnected processes and it does some high-PPS UDP processing (30-50K PPS is not uncommon). We are seeing some strange periodic failures under the load in several such systems, which usually evidences itself in IPC (even through unix domain sockets) suddenly either breaking down or pausing and restoring only some time later (like 5-10 minutes). The only sign of failure I managed to find was the increase of the requests for mbufs denied in the netstat -m and number of total mbuf clusters (nmbclusters) raising up to the limit. Hey Maxim Can you run a process to dump sysctl -a every second or so and mark the time when you did it? Other monitoring things would probably be helpful as well (netstat -m) in a timed log format. vmstat -i? (interrupts storm?) Perhaps ps output (showing interrupt threads, etc) would be good toknow perhaps some ithreads went off into the weeds... Any console messages of note? A few people have suggested that there may be too many packets on the outgoing interface, I think there should be a limit to the number of packets queued for outgoing and probably counters to show how many were dropped due to overflow of the outgoing queue. You should be able to check these counters to see what is going on. If the driver is broken and never drops outgoing packets when the card's queue is full, then those counters should be 0. I hope this helps. -Alfred ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: hardware for home use large storage
Daniel O'Connor wrote: On Tue, 16 Feb 2010, Steve Polyack wrote: I'm not sure about that particular card, but we've never seen that great of performance out of the LSI MegaRAID cards that ship with Dell servers as the PERC. The newest incarnations are better, but I would try to get an Areca. The ones we have tested have displayed fantastic performance. They are fairly expensive in comparison, though. If you're using ZFS in place of the RAID on the LSI MegaRAID, I'd instead recommend other simpler SAS cards which are known to have good driver support. Why even bother with the LSI card at all? That board already has 6 SATA slots - depends how many disks you want to use of course. (5 HDs + 1 DVD drive?) Plus two SATA drives in a gmirror for the base OS, and one optical. I want a minimum of 8 slots. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Broadcom USB wireless support?
Gentles I have an old HP Pavillion DV6000 laptop, which has a Broadcom USB wireless device. Worked under Windows Vista. I installed freeBSD 8- stable, and see as the last line in dmesg ugen2.2: Broadcom Corp at usbus2 Ferreting with google suggests that 8.0 might have usb support for the ndis wrapper, but I am unable to get any joy either using the HP bcmwl5 drivers for the DV6000, or in attempting to use the bwi driver. (I have an old Compaq N1020 with a LinkSys wireless PCMCIA card, which I have successfully generated the ndis wrapper and works happily under 8-stable) Any thoughts? JeffD _ M 0427565791 jeff.dows...@mac.com ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: [HEADSUP]: ports feature freeze now in effect
On Mon 15 Feb 2010 at 15:05:09 PST Charlie Kester wrote: On Mon 15 Feb 2010 at 14:11:47 PST Steven Friedrich wrote: I suspect this means we won't get KDE 4.4 for quite some time... I don't think that it was ever in the plan to get it in before the freeze. Here's what Martin Wilke said in the call for testing: Before you ask we don't want to put KDE 4.4.0 in the ports tree before FreeBSD 7.3 was released. But there's no reason to think it will be quite some time before we see it in the portstree. Given the past history of the KDE porting team, I would expect to see it shortly after the 7.3 release. Sorry, this was supposed to go to ports@ instead. Looks like I need to debug my muttrc. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: ZFS tuning [was: hardware for home use large storage]
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Mon, 15 Feb 2010 16:20, 000.fbsd@ wrote: Alexander Leidinger wrote: [...] kstat.zfs.misc.arcstats.c kstat.zfs.misc.arcstats.c_min kstat.zfs.misc.arcstats.c_max c_max is vfs.zfs.arc_max, c_min is vfs.zfs.arc_min. kstat.zfs.misc.arcstats.evict_skip kstat.zfs.misc.arcstats.memory_throttle_count kstat.zfs.misc.arcstats.size I'm not very sure about size and c... both represent some kind of current size, but they are not the same. About the tuning I would recommend to depend upon a more human readable representation. I've seen someone posting something like this, but I do not know how it was generated (some kind of script, but I do not know where to get it). I think you are referring to this script: http://cuddletech.com/arc_summary/ and its FreeBSD version http://bitbucket.org/koie/arc_summary/changeset/dbe14d2cf52b/ It gives output like this: # arc_summary.sh System Memory: Physical RAM: 4978 MB Free Memory : 755 MB ARC Size: Current Size: 1028 MB (arcsize) Target Size (Adaptive): 1028 MB (c) Min Size (Hard Limit):50 MB (zfs_arc_min) Max Size (Hard Limit):1205 MB (zfs_arc_max) ARC Size Breakdown: Most Recently Used Cache Size: 93%963 MB (p) Most Frequently Used Cache Size: 6%65 MB (c-p) ARC Efficency: Cache Access Total: 358720716 Cache Hit Ratio: 97% 350351031 [Defined State for buffer] Cache Miss Ratio: 2% 8369685[Undefined State for Buffer] REAL Hit Ratio: 76% 272917080 [MRU/MFU Hits Only] Data Demand Efficiency:96% Data Prefetch Efficiency:27% CACHE HITS BY CACHE LIST: Anon: 22%77179355 [ New Customer, First Cache Hit ] Most Recently Used: 45%158252587 (mru) [ Return Customer ] Most Frequently Used: 32%114664493 (mfu) [ Frequent Customer ] Most Recently Used Ghost:0%9777 (mru_ghost) [ Return Customer Evicted, Now Back ] Most Frequently Used Ghost: 0%244819 (mfu_ghost) [ Frequent Customer Evicted, Now Back ] CACHE HITS BY DATA TYPE: Demand Data: 1%4375918 Prefetch Data: 0%150148 Demand Metadata:76%267830502 Prefetch Metadata: 22%77994463 CACHE MISSES BY DATA TYPE: Demand Data: 1%135956 Prefetch Data: 4%400434 Demand Metadata:73%6177748 Prefetch Metadata: 19%1655547 - Another useful script is arcstat.pl from http://blogs.sun.com/realneel/entry/zfs_arc_statistics There are FreeBSD version floating around but I can't find a link to it, so I am sending it as attachment. It would be nice to have some standardized scripts for monitoring debugging ZFS issues attached to FreeBSD Wiki page about ZFS tuning. Then everebody will use the same scripts, same output format. It will be easier to compare results in discussions etc. So if anybody of you have write permissions to Wiki, can you add those two scripts? (or make some better ;]) Understanding to tuning of ZFS is really hard with lack of documentation ;( Miroslav Lachman It is funny that you guys are all of a sudden talking about this, as I was just working on some modifications to the arc_summary.pl script for some better formatting and inclusion of kmem statistics. My intent on the modifications is to make the output more usable to the whole community by revealing the relevant system information that can be included in an email to the lists for diagnosis by others. Previously the output of the script was a little bit groggy, had long lines and did not include relevant other system information. Currently I am working on cleaning up the code a little and moving the ZFS Tunable section to the bottom of the output where it will actually contain the values of the sysctl's instead of just being a blank list. I would certainly appreciate any feedback I could get from this other things you think might be relevant in its output. Thanks for bringing this subject up. As I make final modifications to the script I will keep the below URLs updated and welcome any bug reports or modification requests to me personally. Here is the URLs: http://jhell.googlecode.com/files/arc_summary.pl http://jhell.googlecode.com/files/arc_summary.pl.asc MD5 (arc_summary.pl) = bff13dcf119ff979d9aa52b3d8ae53b9 SHA256 (arc_summary.pl) = a29260946760a89614f888d53d0f188fb24bcd96acd5e0917604d494ed843ada SIZE (arc_summary.pl) = 9453 Example output: -
Re: ZFS tuning [was: hardware for home use large storage]
On Mon, Feb 15, 2010 at 08:49:38PM -0500 I heard the voice of jhell, and lo! it spake thus: As I make final modifications to the script I will keep the below URLs updated and welcome any bug reports or modification requests to me personally. Well, here's one: OS Revision: 199506 There's no reason to show this; it's just confusing because it'll be misinterpreted. kern.osrevision isn't what you probably think it is. It's just the BSD #define in param.h, which (aside from a blip which was instantly reverted) last changed in 1996 when the -Lite2 import was done. -- Matthew Fuller (MF4839) | fulle...@over-yonder.net Systems/Network Administrator | http://www.over-yonder.net/~fullermd/ On the Internet, nobody can hear you scream. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Broadcom USB wireless support?
On 2/16/10, Jeff Dowsley jeff.dows...@mac.com wrote: Gentles I have an old HP Pavillion DV6000 laptop, which has a Broadcom USB wireless device. Worked under Windows Vista. I installed freeBSD 8- stable, and see as the last line in dmesg ugen2.2: Broadcom Corp at usbus2 Ferreting with google suggests that 8.0 might have usb support for the ndis wrapper, but I am unable to get any joy either using the HP bcmwl5 drivers for the DV6000, or in attempting to use the bwi driver. (I have an old Compaq N1020 with a LinkSys wireless PCMCIA card, which I have successfully generated the ndis wrapper and works happily under 8-stable) Any thoughts? Firts, make sure you are using right driver. Second make sure that driver is for XP, because NDISulator supports only 5.1 NDIS api. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: ZFS tuning [was: hardware for home use large storage]
On Mon, 15 Feb 2010 21:20, fullermd@ wrote: On Mon, Feb 15, 2010 at 08:49:38PM -0500 I heard the voice of jhell, and lo! it spake thus: As I make final modifications to the script I will keep the below URLs updated and welcome any bug reports or modification requests to me personally. Well, here's one: OS Revision:199506 There's no reason to show this; it's just confusing because it'll be misinterpreted. kern.osrevision isn't what you probably think it is. It's just the BSD #define in param.h, which (aside from a blip which was instantly reverted) last changed in 1996 when the -Lite2 import was done. Thanks!, No I did not have any understanding of that till this moment but had included it just for completeness. In that case I will mark that for deletion. Regards, -- jhell ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: ZFS tuning [was: hardware for home use large storage]
On Mon, 15 Feb 2010 21:20, fullermd@ wrote: On Mon, Feb 15, 2010 at 08:49:38PM -0500 I heard the voice of jhell, and lo! it spake thus: As I make final modifications to the script I will keep the below URLs updated and welcome any bug reports or modification requests to me personally. Well, here's one: OS Revision:199506 There's no reason to show this; it's just confusing because it'll be misinterpreted. kern.osrevision isn't what you probably think it is. It's just the BSD #define in param.h, which (aside from a blip which was instantly reverted) last changed in 1996 when the -Lite2 import was done. Removed in revision 171, and added output for sysctl tunables to the bottom. Current branches or exact matches of sysctl's that are included are... kern.maxusers vfs.zfs vm.kmem_size vm.kmem_size_max If there is more sysctl's that you think should be added please let me know and I will add and update the script. The new revision(171) is in the same url as before. MD5 (arc_summary.pl) = 29b276a6e2f13eedf5d36370994b7f0e SHA256 (arc_summary.pl) = 15a27b9eb71eddd64ee07a515c136f8467783dfb1075d9707028a082387c5127 SIZE (arc_summary.pl) = 9449 Regards, -- jhell ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: ZFS on root, serial console install
On Mon, 15 Feb 2010, Peter C. Lai wrote: I did a pxeboot zfs-root install the other day. If you copy the dvd to an nfs export as the root mount, hack the requisite files to do serial console then you will drop to a login prompt when it boots over pxe-tftp. Had no problems setting up zfs root install by skipping sysinstall and fixit entirely: setup your ZFS root, then set DESTDIR and use install.sh in the individual package dirs. In short, did you do what I did somewhat accidentally? I did a netboot, set loader.conf to mount mfsroot as my root fs. For reasons I'm still unclear on, it did not grab mfsroot and proceeded to try and mount root over nfs (which happened to be exported RO). It seems like if my nfs was exported rw, I would have been running with all the tools I needed and the drives would be available to me... I'm going to try with rw nfs, currently the machine's locked up as it's confused about a ro root... Thanks, Charles I didn't muck with the loader at all (well except for ZFS tuning). TBH, my serial console is a hardware redirect that BIOS provides so I actually just mdconfig'ed the ISO and exported that via NFS. By booting NFS root RO, init will bail out before being able to run sysinstall and somehow it will spawn getty instead, asking me to login. Logged in as root and I dropped to /bin/tcsh. http://wiki.freebsd.org/RootOnZFS/GPTZFSBoot/RAIDZ2 On Fri, Feb 12, 2010 at 7:27 AM, Charles Sprickman sp...@bway.net wrote: Any hints on that one? I finally got around to getting dhcp/tftp/nfs setup on an internal network to perform normal installs (and with some pxelinux hackery, the ability to boot a DOS disk or memtest86 disk images). Sysinstall in general is kind of an unweildy beast over serial, but one thing I was not able to accomplish was to get a shell (no extra virtual consoles on serial) or attempt any mounting of fixit media. From my last install that put ZFS on root, I had to do quite a bit of tapdancing since I had no DVD or bootable USB media - lots of switching from the install disk to fixit, which brought me to many chicken and egg moments. I did it though... But remotely, I'm not seeing a good way to do this. If mfsroot were larger and had more tools, then I'd be in business. This is probably the direction I need to get shoved in. I've looked at some other options with pxelinux and perhaps booting the mini ISO, but I'm not sure that gets me anywhere. Any tips? This isn't a make or break situation, I live 15 minutes from the colo... It's more of a quest. :) I would installl a small UFS FBSD system of 1 or 2 Gig on say ad0s1. That gives you more then the equivalent of a fixit CD. You then use this mini system as base to install the real one on the other slice(s) After having finished the install, you use fdisk to change the active slice to the new install and reboot. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org -- Peter C. Lai ITS Systems Administrator Bard College at Simon's Rock 84 Alford Rd. Great Barrington, MA 01230 (413) 528-7428 peter at simons-rock.edu ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org -- Peter C. Lai ITS Systems Administrator Bard College at Simon's Rock 84 Alford Rd. Great Barrington, MA 01230 (413) 528-7428 peter at simons-rock.edu ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
