Re: 7.1, mpt and slow writes
On Sat, 31 Jan 2009, Gary Palmer wrote: On Sat, Jan 31, 2009 at 01:48:46AM -0500, Charles Sprickman wrote: On Fri, 30 Jan 2009, Gary Palmer wrote: On Thu, Jan 29, 2009 at 11:43:11PM -0500, Charles Sprickman wrote: [ snip ] Any idea what happened to the sysctl? Is there some other method to verify the loader tunable took (other than testing the throughput)? Boot with -v. If the loader tunable took effect, you should see "Enabling SATA WC on phy " instead of "Disabling SATA ..." Cool, it works then. Why was the info removed from the sysctl mib? mpt0: Enabling SATA WC on phy 0 mpt0: Enabling SATA WC on phy 1 Bonnie++ is showing me about 24MB/s writes and 70MB/s reads. Is any of this verbose stuff problematic? mpt0: No Handlers For Any Event Notify Frames. Event 0xa (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0x16 (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0x12 (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0x12 (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0x16 (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0xb (ACK not required). And is any of this info found at boot-time accessible while the system is running? Hi, Sorry, I can't answer your questions - all I did to find the boot -v information was to look in the kernel source code. Grepping through the CVS history I don't actually see a point in CVS history where there was a sysctl MIB value for the SATA WC status, although I might be mistaken. Perhaps you are remembering using kenv to get at hw.mpt.enable_sata_wc instead of sysctl? That, my friend, is precisely the problem. "kenv" didn't stick in my head because most of the FreeBSD-isms in my head still date back to 4.x. I am behind the times... Thanks for solving the mystery for me. Charles Regards, Gary mpt0:vol0(mpt0:0:0): Settings ( Hot-Plug-Spares High-Priority-ReSync ) mpt0:vol0(mpt0:0:0): Using Spare Pool: 0 mpt0:vol0(mpt0:0:0): 2 Members: (mpt0:1:32:0): Primary Online (mpt0:1:1:0): Secondary Online mpt0:vol0(mpt0:0:0): RAID-1 - Optimal mpt0:vol0(mpt0:0:0): Status ( Enabled ) (mpt0:vol0:1): Physical (mpt0:0:1:0), Pass-thru (mpt0:1:0:0) (mpt0:vol0:1): Online (mpt0:vol0:0): Physical (mpt0:0:32:0), Pass-thru (mpt0:1:1:0) (mpt0:vol0:0): Online Thanks, Charles ps - would it kill Dell to make a damn ISO of a bootable media for RAID controller firmware upgrades??? I don't even own anything with a floppy drive anymore. Regards, Gary ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org" ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Re: 7.1, mpt and slow writes
On Sat, Jan 31, 2009 at 01:48:46AM -0500, Charles Sprickman wrote: > On Fri, 30 Jan 2009, Gary Palmer wrote: > > >On Thu, Jan 29, 2009 at 11:43:11PM -0500, Charles Sprickman wrote: > > > >[ snip ] > > > >>Any idea what happened to the sysctl? Is there some other method to > >>verify the loader tunable took (other than testing the throughput)? > > > >Boot with -v. If the loader tunable took effect, you should see > >"Enabling SATA WC on phy " instead of "Disabling SATA ..." > > Cool, it works then. Why was the info removed from the sysctl mib? > > mpt0: Enabling SATA WC on phy 0 > mpt0: Enabling SATA WC on phy 1 > > Bonnie++ is showing me about 24MB/s writes and 70MB/s reads. > > Is any of this verbose stuff problematic? > > mpt0: No Handlers For Any Event Notify Frames. Event 0xa (ACK not required). > mpt0: No Handlers For Any Event Notify Frames. Event 0x16 (ACK not > required). > mpt0: No Handlers For Any Event Notify Frames. Event 0x12 (ACK not > required). > mpt0: No Handlers For Any Event Notify Frames. Event 0x12 (ACK not > required). > mpt0: No Handlers For Any Event Notify Frames. Event 0x16 (ACK not > required). > mpt0: No Handlers For Any Event Notify Frames. Event 0xb (ACK not required). > > And is any of this info found at boot-time accessible while the system is > running? Hi, Sorry, I can't answer your questions - all I did to find the boot -v information was to look in the kernel source code. Grepping through the CVS history I don't actually see a point in CVS history where there was a sysctl MIB value for the SATA WC status, although I might be mistaken. Perhaps you are remembering using kenv to get at hw.mpt.enable_sata_wc instead of sysctl? Regards, Gary > mpt0:vol0(mpt0:0:0): Settings ( Hot-Plug-Spares High-Priority-ReSync ) > mpt0:vol0(mpt0:0:0): Using Spare Pool: 0 > mpt0:vol0(mpt0:0:0): 2 Members: > (mpt0:1:32:0): Primary Online > (mpt0:1:1:0): Secondary Online > mpt0:vol0(mpt0:0:0): RAID-1 - Optimal > mpt0:vol0(mpt0:0:0): Status ( Enabled ) > (mpt0:vol0:1): Physical (mpt0:0:1:0), Pass-thru (mpt0:1:0:0) > (mpt0:vol0:1): Online > (mpt0:vol0:0): Physical (mpt0:0:32:0), Pass-thru (mpt0:1:1:0) > (mpt0:vol0:0): Online > > Thanks, > > Charles > > ps - would it kill Dell to make a damn ISO of a bootable media for RAID > controller firmware upgrades??? I don't even own anything with a floppy > drive anymore. > > >Regards, > > > >Gary > > > >___ > >freebsd-stable@freebsd.org mailing list > >http://lists.freebsd.org/mailman/listinfo/freebsd-stable > >To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org" > > > > ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Re: 7.1, mpt and slow writes
On Fri, 30 Jan 2009, Gary Palmer wrote: On Thu, Jan 29, 2009 at 11:43:11PM -0500, Charles Sprickman wrote: [ snip ] Any idea what happened to the sysctl? Is there some other method to verify the loader tunable took (other than testing the throughput)? Boot with -v. If the loader tunable took effect, you should see "Enabling SATA WC on phy " instead of "Disabling SATA ..." Cool, it works then. Why was the info removed from the sysctl mib? mpt0: Enabling SATA WC on phy 0 mpt0: Enabling SATA WC on phy 1 Bonnie++ is showing me about 24MB/s writes and 70MB/s reads. Is any of this verbose stuff problematic? mpt0: No Handlers For Any Event Notify Frames. Event 0xa (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0x16 (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0x12 (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0x12 (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0x16 (ACK not required). mpt0: No Handlers For Any Event Notify Frames. Event 0xb (ACK not required). And is any of this info found at boot-time accessible while the system is running? mpt0:vol0(mpt0:0:0): Settings ( Hot-Plug-Spares High-Priority-ReSync ) mpt0:vol0(mpt0:0:0): Using Spare Pool: 0 mpt0:vol0(mpt0:0:0): 2 Members: (mpt0:1:32:0): Primary Online (mpt0:1:1:0): Secondary Online mpt0:vol0(mpt0:0:0): RAID-1 - Optimal mpt0:vol0(mpt0:0:0): Status ( Enabled ) (mpt0:vol0:1): Physical (mpt0:0:1:0), Pass-thru (mpt0:1:0:0) (mpt0:vol0:1): Online (mpt0:vol0:0): Physical (mpt0:0:32:0), Pass-thru (mpt0:1:1:0) (mpt0:vol0:0): Online Thanks, Charles ps - would it kill Dell to make a damn ISO of a bootable media for RAID controller firmware upgrades??? I don't even own anything with a floppy drive anymore. Regards, Gary ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org" ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Re: 7.1, mpt and slow writes
On Thu, Jan 29, 2009 at 11:43:11PM -0500, Charles Sprickman wrote: [ snip ] > Any idea what happened to the sysctl? Is there some other method to > verify the loader tunable took (other than testing the throughput)? Boot with -v. If the loader tunable took effect, you should see "Enabling SATA WC on phy " instead of "Disabling SATA ..." Regards, Gary ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Re: 7.1, mpt and slow writes
On Thu, 29 Jan 2009, Richard Tector wrote: Charles Sprickman wrote: Hello, I think this needs a few more eyes: http://lists.freebsd.org/pipermail/freebsd-scsi/2009-January/003782.html In short, writes are slow, likely do to the write-cache being enabled on the controller. The sysctl used in 6.x to turn the cache off don't seem to be in 7.x. I have two Dell 860's here also running 7.1-REL. A simple dd on one shows roughly 60MB/s writes to a mirror of 2 320GB disks on what I'm assuming is the same LSI controller card (SAS5) rich...@moses:~# cat /boot/loader.conf hw.mpt.enable_sata_wc=1 Seems to work just fine for me. Well, now I'm puzzled. A "sysctl -a" shows no "hw.mpt." tree at all: # sysctl -a|grep hw.mpt # It's a poor test, but: # dd if=/dev/zero of=/jails/foo count=1M 1048576+0 records in 1048576+0 records out 536870912 bytes transferred in 144.830977 secs (3706879 bytes/sec) # dd if=/jails/foo of=/dev/null 1048576+0 records in 1048576+0 records out 536870912 bytes transferred in 4.136582 secs (129786112 bytes/sec) I added the tunable to loader.conf: $ cat /boot/loader.conf hw.mpt.enable_sata_wc=1 And still nothing in the sysctl output (there was on 6.4 on this same hardware, FWIW): $ sysctl -a |grep hw.mpt $ However, performance did improve: # dd if=/dev/zero of=/jails/foo count=16M 16777216+0 records in 16777216+0 records out 8589934592 bytes transferred in 276.332753 secs (31085474 bytes/sec) Any idea what happened to the sysctl? Is there some other method to verify the loader tunable took (other than testing the throughput)? I assume there's still no management tools for these controllers, right? Thanks, Charles Regards, Richard ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Re: 7.1, mpt and slow writes
Peter C. Lai wrote: I am guessing this is only related to SATA drives on SAS controllers? The only mpt hardware I have is LSILogic 1030 Ultra4 and it writes sustained 40MB/s to my LTO-2 drives out of the box without any tweaking. Correct. When SATA drives are used instead of SAS drives on this controller it disables the write cache resulting in poor performance. The tunable was added by Scott Long to solve the problem (though at the cost of greater risk to data). Richard smime.p7s Description: S/MIME Cryptographic Signature
Re: 7.1, mpt and slow writes
On 2009-01-29 11:43:46AM +, Richard Tector wrote: > Charles Sprickman wrote: >> Hello, >> >> I think this needs a few more eyes: >> >> http://lists.freebsd.org/pipermail/freebsd-scsi/2009-January/003782.html >> >> In short, writes are slow, likely do to the write-cache being enabled on >> the controller. The sysctl used in 6.x to turn the cache off don't seem >> to be in 7.x. > I am guessing this is only related to SATA drives on SAS controllers? The only mpt hardware I have is LSILogic 1030 Ultra4 and it writes sustained 40MB/s to my LTO-2 drives out of the box without any tweaking. -- === Peter C. Lai | Bard College at Simon's Rock Systems Administrator| 84 Alford Rd. Information Technology Svcs. | Gt. Barrington, MA 01230 USA peter AT simons-rock.edu | (413) 528-7428 === ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Re: 7.1, mpt and slow writes
Charles Sprickman wrote: Hello, I think this needs a few more eyes: http://lists.freebsd.org/pipermail/freebsd-scsi/2009-January/003782.html In short, writes are slow, likely do to the write-cache being enabled on the controller. The sysctl used in 6.x to turn the cache off don't seem to be in 7.x. I have two Dell 860's here also running 7.1-REL. A simple dd on one shows roughly 60MB/s writes to a mirror of 2 320GB disks on what I'm assuming is the same LSI controller card (SAS5) rich...@moses:~# cat /boot/loader.conf hw.mpt.enable_sata_wc=1 Seems to work just fine for me. Regards, Richard smime.p7s Description: S/MIME Cryptographic Signature
7.1, mpt and slow writes
Hello, I think this needs a few more eyes: http://lists.freebsd.org/pipermail/freebsd-scsi/2009-January/003782.html In short, writes are slow, likely do to the write-cache being enabled on the controller. The sysctl used in 6.x to turn the cache off don't seem to be in 7.x. Thanks, Charles ___ Charles Sprickman NetEng/SysAdmin Bway.net - New York's Best Internet - www.bway.net sp...@bway.net - 212.655.9344 ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
