Re: Dell PERC5/i SAS5/5IR - RAID monitoring
Am 21.07.2007 um 01:15 schrieb Tom Judge: Michael Worobcuk wrote: Am 21.07.2007 um 00:18 schrieb Tom Judge: Michael Worobcuk wrote: Tom Judge wrote: As for performance issues with the SAS5/i, there is a problem in the controller. A work arround was created by Scott Long which created a sysctl that could be set to cause the controller to turn on the on drive write cache's. These changes where commited to RELENG_6 on 2007-06-05 21:32:57 UTC. ... Here is the original commit log: scottl 2007-06-03 23:13:05 UTC FreeBSD src repository Modified files: sys/dev/mpt mpt.c mpt.h mpt_cam.c Log: mpt.c: mpt.h: Add support for reading extended configuration pages. mpt_cam.c: Do a top level topology scan on the SAS controller. If any SATA device are discovered in this scan, send a passthrough FIS to set the write cache. This is controllable through the following tunable at boot: hw.mpt.enable_sata_wc: -1 = Do not configure, use the controller default 0 = Disable the write cache 1 = Enable the write cache The default is -1. This tunable is just a hack and may be deprecated in the future. I set mpt.enable_sata_wc to 1, as hw.mpt.enable_sata_wc is, AFAIK not tunable in mpt_cam.c. This did not take any effect to the performance. Is there anything else to change ? Not that I know of, do you have SAS or SATA disks attached to the controller? yes, SAS. In that case the above sysctl is not going to work for you as as the name suggests it is only for sata devices. For someone with a bit more SCSI experience than me: Could this be solved by setting the WCE (Write cache enable) bit in the modepage (8) on sas devices if it is not already set? The driver could make this change on SAS devices during the topology scan in similar way to the way it does for SATA devices? Tom hey sorry. Already a bit tired yesterday. I have SATA drives connected, in my mind was the name: sas5ir. But I have SATA DRIVES. sorry again. Michael ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Dell PERC5/i SAS5/5IR - RAID monitoring
Tom Judge wrote: Michael Worobcuk wrote: Am 21.07.2007 um 00:18 schrieb Tom Judge: Michael Worobcuk wrote: Tom Judge wrote: As for performance issues with the SAS5/i, there is a problem in the controller. A work arround was created by Scott Long which created a sysctl that could be set to cause the controller to turn on the on drive write cache's. These changes where commited to RELENG_6 on 2007-06-05 21:32:57 UTC. ... Here is the original commit log: scottl 2007-06-03 23:13:05 UTC FreeBSD src repository Modified files: sys/dev/mpt mpt.c mpt.h mpt_cam.c Log: mpt.c: mpt.h: Add support for reading extended configuration pages. mpt_cam.c: Do a top level topology scan on the SAS controller. If any SATA device are discovered in this scan, send a passthrough FIS to set the write cache. This is controllable through the following tunable at boot: hw.mpt.enable_sata_wc: -1 = Do not configure, use the controller default 0 = Disable the write cache 1 = Enable the write cache The default is -1. This tunable is just a hack and may be deprecated in the future. I set mpt.enable_sata_wc to 1, as hw.mpt.enable_sata_wc is, AFAIK not tunable in mpt_cam.c. This did not take any effect to the performance. Is there anything else to change ? Not that I know of, do you have SAS or SATA disks attached to the controller? yes, SAS. In that case the above sysctl is not going to work for you as as the name suggests it is only for sata devices. For someone with a bit more SCSI experience than me: Could this be solved by setting the WCE (Write cache enable) bit in the modepage (8) on sas devices if it is not already set? The driver could make this change on SAS devices during the topology scan in similar way to the way it does for SATA devices? There are absolutely no plans for the MPT driver to automatically change WCE settings for SAS, FC, or SCSI drives. The hack that I put in for SATA is exactly what it is, a hack. It gets around the fact that there is no SATA layer within CAM yet and thus no way to send SATA commands from userland like there is with SCSI/FC/SAS. That will be addressed in the future. So yes, the proper way to handle this is via camcontrol. With that you should be able to change the WCE bit both temporarily (i.e. until the next bus reset or power reset) or permanently (i.e. in NVRAM of the drive). Worst case scenario is the the drive doesn't support permanent settings, so you write a simple RC script to run camcontrol on each boot. Scott ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Dell PERC5/i SAS5/5IR - RAID monitoring
Michael Worobcuk wrote: Tom Judge wrote: As for performance issues with the SAS5/i, there is a problem in the controller. A work arround was created by Scott Long which created a sysctl that could be set to cause the controller to turn on the on drive write cache's. These changes where commited to RELENG_6 on 2007-06-05 21:32:57 UTC. ... Here is the original commit log: scottl 2007-06-03 23:13:05 UTC FreeBSD src repository Modified files: sys/dev/mpt mpt.c mpt.h mpt_cam.c Log: mpt.c: mpt.h: Add support for reading extended configuration pages. mpt_cam.c: Do a top level topology scan on the SAS controller. If any SATA device are discovered in this scan, send a passthrough FIS to set the write cache. This is controllable through the following tunable at boot: hw.mpt.enable_sata_wc: -1 = Do not configure, use the controller default 0 = Disable the write cache 1 = Enable the write cache The default is -1. This tunable is just a hack and may be deprecated in the future. I set mpt.enable_sata_wc to 1, as hw.mpt.enable_sata_wc is, AFAIK not tunable in mpt_cam.c. This did not take any effect to the performance. Is there anything else to change ? Send me output from bootverbose. Also ensure that you have the following line in your /boot/loader.conf file: hw.mpt.enable_sata_wc=1 Scott ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Dell PERC5/i SAS5/5IR - RAID monitoring
Am 21.07.2007 um 21:33 schrieb Scott Long: Michael Worobcuk wrote: Tom Judge wrote: As for performance issues with the SAS5/i, there is a problem in the controller. A work arround was created by Scott Long which created a sysctl that could be set to cause the controller to turn on the on drive write cache's. These changes where commited to RELENG_6 on 2007-06-05 21:32:57 UTC. ... Here is the original commit log: scottl 2007-06-03 23:13:05 UTC FreeBSD src repository Modified files: sys/dev/mpt mpt.c mpt.h mpt_cam.c Log: mpt.c: mpt.h: Add support for reading extended configuration pages. mpt_cam.c: Do a top level topology scan on the SAS controller. If any SATA device are discovered in this scan, send a passthrough FIS to set the write cache. This is controllable through the following tunable at boot: hw.mpt.enable_sata_wc: -1 = Do not configure, use the controller default 0 = Disable the write cache 1 = Enable the write cache The default is -1. This tunable is just a hack and may be deprecated in the future. I set mpt.enable_sata_wc to 1, as hw.mpt.enable_sata_wc is, AFAIK not tunable in mpt_cam.c. This did not take any effect to the performance. Is there anything else to change ? Send me output from bootverbose. Also ensure that you have the following line in your /boot/loader.conf file: hw.mpt.enable_sata_wc=1 Yuppa, that worked ! Final score for writes: 285 Final score for reads : 16692 It was the line in my /boot/loader.conf. Thank you very very much. Very cool :) Michael ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Dell PERC5/i SAS5/5IR - RAID monitoring
Tom Judge wrote: As for performance issues with the SAS5/i, there is a problem in the controller. A work arround was created by Scott Long which created a sysctl that could be set to cause the controller to turn on the on drive write cache's. These changes where commited to RELENG_6 on 2007-06-05 21:32:57 UTC. ... Here is the original commit log: scottl 2007-06-03 23:13:05 UTC FreeBSD src repository Modified files: sys/dev/mpt mpt.c mpt.h mpt_cam.c Log: mpt.c: mpt.h: Add support for reading extended configuration pages. mpt_cam.c: Do a top level topology scan on the SAS controller. If any SATA device are discovered in this scan, send a passthrough FIS to set the write cache. This is controllable through the following tunable at boot: hw.mpt.enable_sata_wc: -1 = Do not configure, use the controller default 0 = Disable the write cache 1 = Enable the write cache The default is -1. This tunable is just a hack and may be deprecated in the future. I set mpt.enable_sata_wc to 1, as hw.mpt.enable_sata_wc is, AFAIK not tunable in mpt_cam.c. This did not take any effect to the performance. Is there anything else to change ? -- Michael ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Dell PERC5/i SAS5/5IR - RAID monitoring
Michael Worobcuk wrote: Tom Judge wrote: As for performance issues with the SAS5/i, there is a problem in the controller. A work arround was created by Scott Long which created a sysctl that could be set to cause the controller to turn on the on drive write cache's. These changes where commited to RELENG_6 on 2007-06-05 21:32:57 UTC. ... Here is the original commit log: scottl 2007-06-03 23:13:05 UTC FreeBSD src repository Modified files: sys/dev/mpt mpt.c mpt.h mpt_cam.c Log: mpt.c: mpt.h: Add support for reading extended configuration pages. mpt_cam.c: Do a top level topology scan on the SAS controller. If any SATA device are discovered in this scan, send a passthrough FIS to set the write cache. This is controllable through the following tunable at boot: hw.mpt.enable_sata_wc: -1 = Do not configure, use the controller default 0 = Disable the write cache 1 = Enable the write cache The default is -1. This tunable is just a hack and may be deprecated in the future. I set mpt.enable_sata_wc to 1, as hw.mpt.enable_sata_wc is, AFAIK not tunable in mpt_cam.c. This did not take any effect to the performance. Is there anything else to change ? Not that I know of, do you have SAS or SATA disks attached to the controller? Tom ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Dell PERC5/i SAS5/5IR - RAID monitoring
Am 21.07.2007 um 00:18 schrieb Tom Judge: Michael Worobcuk wrote: Tom Judge wrote: As for performance issues with the SAS5/i, there is a problem in the controller. A work arround was created by Scott Long which created a sysctl that could be set to cause the controller to turn on the on drive write cache's. These changes where commited to RELENG_6 on 2007-06-05 21:32:57 UTC. ... Here is the original commit log: scottl 2007-06-03 23:13:05 UTC FreeBSD src repository Modified files: sys/dev/mpt mpt.c mpt.h mpt_cam.c Log: mpt.c: mpt.h: Add support for reading extended configuration pages. mpt_cam.c: Do a top level topology scan on the SAS controller. If any SATA device are discovered in this scan, send a passthrough FIS to set the write cache. This is controllable through the following tunable at boot: hw.mpt.enable_sata_wc: -1 = Do not configure, use the controller default 0 = Disable the write cache 1 = Enable the write cache The default is -1. This tunable is just a hack and may be deprecated in the future. I set mpt.enable_sata_wc to 1, as hw.mpt.enable_sata_wc is, AFAIK not tunable in mpt_cam.c. This did not take any effect to the performance. Is there anything else to change ? Not that I know of, do you have SAS or SATA disks attached to the controller? yes, SAS. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Dell PERC5/i SAS5/5IR - RAID monitoring
Michael Worobcuk wrote: Am 21.07.2007 um 00:18 schrieb Tom Judge: Michael Worobcuk wrote: Tom Judge wrote: As for performance issues with the SAS5/i, there is a problem in the controller. A work arround was created by Scott Long which created a sysctl that could be set to cause the controller to turn on the on drive write cache's. These changes where commited to RELENG_6 on 2007-06-05 21:32:57 UTC. ... Here is the original commit log: scottl 2007-06-03 23:13:05 UTC FreeBSD src repository Modified files: sys/dev/mpt mpt.c mpt.h mpt_cam.c Log: mpt.c: mpt.h: Add support for reading extended configuration pages. mpt_cam.c: Do a top level topology scan on the SAS controller. If any SATA device are discovered in this scan, send a passthrough FIS to set the write cache. This is controllable through the following tunable at boot: hw.mpt.enable_sata_wc: -1 = Do not configure, use the controller default 0 = Disable the write cache 1 = Enable the write cache The default is -1. This tunable is just a hack and may be deprecated in the future. I set mpt.enable_sata_wc to 1, as hw.mpt.enable_sata_wc is, AFAIK not tunable in mpt_cam.c. This did not take any effect to the performance. Is there anything else to change ? Not that I know of, do you have SAS or SATA disks attached to the controller? yes, SAS. In that case the above sysctl is not going to work for you as as the name suggests it is only for sata devices. For someone with a bit more SCSI experience than me: Could this be solved by setting the WCE (Write cache enable) bit in the modepage (8) on sas devices if it is not already set? The driver could make this change on SAS devices during the topology scan in similar way to the way it does for SATA devices? Tom ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Dell PERC5/i SAS5/5IR - RAID monitoring
Michael Worobcuk wrote: Am 18.07.2007 um 01:27 schrieb Tom Judge: Michael Worobcuk wrote: Hi, I am trying to set up my first webserver. I bought a Dell Poweredge 860, provided with a SAS5/IR RAID-Controller. The problem is now, that I cannot find software, that monitors the state of my disks. I already tried megarc from the ports but all I get is a short answer that no adapters where found: # megarc -AllAdpInfo -nolog ** MEGARC MegaRAID Configuration Utility(FreeBSD)-1.04(03-02-2005) By LSI Logic Corp.,USA ** [Note: For SATA-2, 4 and 6 channel controllers, please specify Ch=0 Id=0..15 for specifying physical drive(Ch=channel, Id=Target)] Type ? as command line arg for help No Adapters Found Error: No MegaRaid Found # I had emails with Dell and LSI. Dell does not support FreeBSD and LSI says I should go and ask Dell ... The second thing is, the perfomance. SNIP Final score for writes:16 Final score for reads : 2025 # (Just to remember: Pentium D; 2,8GHZ; 4 GB RAM; 2 x 500GB SATA RAID1) That is pretty poor, isn't it ? I am wondering now, if somebody has experience with the PERC5/I Controller. Would it be possible to monitor the disks, if I would buy that controller ? Any hints are highly appreciated. Thanks Michael I don't know about monitoring the SAS5/I however I read some posts on one of the lists that was talking about the linux compatibility system providing all of the correct interface for the linux version of ?megacli? to work on FreeBSD. As the SAS5/I is mpt driver based could it not be checked with camcontrol? (Just an idea never tested). SNIP Hi Tom, thank you for your response. What about monitoring the PERC5/ie ? Does it work with megarc or any program under FreeBSD ? Just to clarify that the the following was related to the PERC5/ie and the mfi driver: I read some posts on one of the lists that was talking about the linux compatibility system providing all of the correct interface for the linux version of megacli/megarc to work on FreeBSD I think google can answer the rest for you. Tom ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Dell PERC5/i SAS5/5IR - RAID monitoring
Hi Tom, thank you for your response. What about monitoring the PERC5/ie ? Does it work with megarc or any program under FreeBSD ? I have some scripts on nagiosexchange.org; wrappers around megacli(8) and megarc(8). ~BAS ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED] l8* -lava (Brian A. Seklecki - Pittsburgh, PA, USA) http://www.spiritual-machines.org/ Guilty? Yeah. But he knows it. I mean, you're guilty. You just don't know it. So who's really in jail? ~Maynard James Keenan ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Dell PERC5/i SAS5/5IR - RAID monitoring
Am 18.07.2007 um 16:34 schrieb Brian A. Seklecki: Hi Tom, thank you for your response. What about monitoring the PERC5/ie ? Does it work with megarc or any program under FreeBSD ? I have some scripts on nagiosexchange.org; wrappers around megacli (8) and megarc(8). ~BAS Cool :) Thank you very much. Best Regards Michael ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Dell PERC5/i SAS5/5IR - RAID monitoring
On Wed, 18 Jul 2007, Michael Worobcuk wrote: Hi, Am 18.07.2007 um 16:34 schrieb Brian A. Seklecki: Hi Tom, thank you for your response. What about monitoring the PERC5/ie ? Does it work with megarc or any program under FreeBSD ? I have some scripts on nagiosexchange.org; wrappers around megacli(8) and megarc(8). ~BAS Cool :) Thank you very much. Also the ports for those utilities have periodic scripts that just need to be enabled in periodic.conf and give daily state and log changes for controllers. amr(4) and mfi(4) come to my mind as well as twa(4) which is not found in Dell servers. -- Bjoern A. Zeeb bzeeb at Zabbadoz dot NeT Software is harder than hardware so better get it right the first time. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Dell PERC5/i SAS5/5IR - RAID monitoring
Michael Worobcuk wrote: Hi, I am trying to set up my first webserver. I bought a Dell Poweredge 860, provided with a SAS5/IR RAID-Controller. The problem is now, that I cannot find software, that monitors the state of my disks. I already tried megarc from the ports but all I get is a short answer that no adapters where found: # megarc -AllAdpInfo -nolog ** MEGARC MegaRAID Configuration Utility(FreeBSD)-1.04(03-02-2005) By LSI Logic Corp.,USA ** [Note: For SATA-2, 4 and 6 channel controllers, please specify Ch=0 Id=0..15 for specifying physical drive(Ch=channel, Id=Target)] Type ? as command line arg for help No Adapters Found Error: No MegaRaid Found # I had emails with Dell and LSI. Dell does not support FreeBSD and LSI says I should go and ask Dell ... The second thing is, the perfomance. SNIP Final score for writes:16 Final score for reads : 2025 # (Just to remember: Pentium D; 2,8GHZ; 4 GB RAM; 2 x 500GB SATA RAID1) That is pretty poor, isn't it ? I am wondering now, if somebody has experience with the PERC5/I Controller. Would it be possible to monitor the disks, if I would buy that controller ? Any hints are highly appreciated. Thanks Michael I don't know about monitoring the SAS5/I however I read some posts on one of the lists that was talking about the linux compatibility system providing all of the correct interface for the linux version of ?megacli? to work on FreeBSD. As the SAS5/I is mpt driver based could it not be checked with camcontrol? (Just an idea never tested). As for performance issues with the SAS5/i, there is a problem in the controller. A work arround was created by Scott Long which created a sysctl that could be set to cause the controller to turn on the on drive write cache's. These changes where commited to RELENG_6 on 2007-06-05 21:32:57 UTC. The PERC5/[ei] controllers do not suffer the performance problems of the SAS5/i controller, we have ~30 systems with these controllers and have never seen any performance problems with them even when they have 20 drives attached to them. If you had search the archives you would have found an almost identical response by me to an almost identical question regarding the SAS5/i performance problem. Tom Here is the original commit log: scottl 2007-06-03 23:13:05 UTC FreeBSD src repository Modified files: sys/dev/mpt mpt.c mpt.h mpt_cam.c Log: mpt.c: mpt.h: Add support for reading extended configuration pages. mpt_cam.c: Do a top level topology scan on the SAS controller. If any SATA device are discovered in this scan, send a passthrough FIS to set the write cache. This is controllable through the following tunable at boot: hw.mpt.enable_sata_wc: -1 = Do not configure, use the controller default 0 = Disable the write cache 1 = Enable the write cache The default is -1. This tunable is just a hack and may be deprecated in the future. Turning on the write cache alleviates the write performance problems with SATA that many people have observed. It is not recommend for those who value data reliability! I cannot stress this strongly enough. However, it is useful in certain circumstances, and it brings the performence in line with what a generic SATA controller running under the FreeBSD ATA driver provides (and the ATA driver has had the WC enabled by default for years). ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Dell PERC5/i SAS5/5IR - RAID monitoring
Am 18.07.2007 um 01:27 schrieb Tom Judge: Michael Worobcuk wrote: Hi, I am trying to set up my first webserver. I bought a Dell Poweredge 860, provided with a SAS5/IR RAID-Controller. The problem is now, that I cannot find software, that monitors the state of my disks. I already tried megarc from the ports but all I get is a short answer that no adapters where found: # megarc -AllAdpInfo -nolog * * MEGARC MegaRAID Configuration Utility(FreeBSD)-1.04 (03-02-2005) By LSI Logic Corp.,USA * * [Note: For SATA-2, 4 and 6 channel controllers, please specify Ch=0 Id=0..15 for specifying physical drive(Ch=channel, Id=Target)] Type ? as command line arg for help No Adapters Found Error: No MegaRaid Found # I had emails with Dell and LSI. Dell does not support FreeBSD and LSI says I should go and ask Dell ... The second thing is, the perfomance. SNIP Final score for writes:16 Final score for reads : 2025 # (Just to remember: Pentium D; 2,8GHZ; 4 GB RAM; 2 x 500GB SATA RAID1) That is pretty poor, isn't it ? I am wondering now, if somebody has experience with the PERC5/I Controller. Would it be possible to monitor the disks, if I would buy that controller ? Any hints are highly appreciated. Thanks Michael I don't know about monitoring the SAS5/I however I read some posts on one of the lists that was talking about the linux compatibility system providing all of the correct interface for the linux version of ?megacli? to work on FreeBSD. As the SAS5/I is mpt driver based could it not be checked with camcontrol? (Just an idea never tested). As for performance issues with the SAS5/i, there is a problem in the controller. A work arround was created by Scott Long which created a sysctl that could be set to cause the controller to turn on the on drive write cache's. These changes where commited to RELENG_6 on 2007-06-05 21:32:57 UTC. The PERC5/[ei] controllers do not suffer the performance problems of the SAS5/i controller, we have ~30 systems with these controllers and have never seen any performance problems with them even when they have 20 drives attached to them. Hi Tom, thank you for your response. What about monitoring the PERC5/ie ? Does it work with megarc or any program under FreeBSD ? ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
