Re: Load Testing - what to look for and monitor/report
We're doing performance analysis and looking for bottlenecks ... In that case, you want to test a single server only, at least to start. You'll need to define user paths that are most likely to be followed by users within the application, and define timers for each step of the user path (where a step is a single user action that triggers any server-side response). Then, you'll run a typical performance analysis test (no pauses between requests) for a single user, then scale up by some increment (say, 5 users) until the application becomes unresponsive. The data you collect during this process will primarily be response time data (for each timer). You can then drop that data into a spreadsheet and chart the timer steps that increase more than others, and those are your bottlenecks. If those steps are themselves pretty complex, you can add CFTIMER tags within your page to find out which part of the page is the slower part, as well. ... and also memory leaks since we have a lot of application scoped components and large numbers of objects created per request. That's one of my main concerns actually.. Well, that might require a different test, or at least might affect the point at which the application becomes unresponsive as described above. Proper performance analysis testing can really only happen once you've removed functionality and operation bugs from your application, and memory leaks would fall into that category. That said, it's unlikely you'll run into true memory leaks with CF components - you just might run out of memory, though. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ http://training.figleaf.com/ Fig Leaf Software is a Veteran-Owned Small Business (VOSB) on GSA Schedule, and provides the highest caliber vendor-authorized instruction at our training centers, online, or onsite. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:349864 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: Load Testing - what to look for and monitor/report
Anyhow, what I really want to know from you experts is what should I be watching and recording during these load tests? Generally, you're interested in response time and throughput. Also should I pair down from a load balanced solution to a single server to make it easier to debug log files and track memory etc? And then scale up after a specific duration? Or for the second test interval? I don't have much experience with load testing and just want to make sure that this is money well spend in terms of having some actionable data. It's hard to answer this without more information. What is the goal of the load test? What kind of actionable data are you looking for? You can use load tests to answer a couple of different questions. There are two basic types of load test: performance analysis, and capacity planning. In a performance analysis test, you're looking for bottlenecks in your application with the goal of improving application performance. In a capacity planning test, you're trying to identify how many users your application can support as it's currently written. Which one of these are you doing? Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ http://training.figleaf.com/ Fig Leaf Software is a Veteran-Owned Small Business (VOSB) on GSA Schedule, and provides the highest caliber vendor-authorized instruction at our training centers, online, or onsite. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:349862 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
RE: Load Testing - what to look for and monitor/report
Hi Dave, We're doing performance analysis and looking for bottlenecks and also memory leaks since we have a lot of application scoped components and large numbers of objects created per request. That's one of my main concerns actually.. Brook -Original Message- From: Dave Watts [mailto:dwa...@figleaf.com] Sent: February-11-12 7:46 AM To: cf-talk Subject: Re: Load Testing - what to look for and monitor/report Anyhow, what I really want to know from you experts is what should I be watching and recording during these load tests? Generally, you're interested in response time and throughput. Also should I pair down from a load balanced solution to a single server to make it easier to debug log files and track memory etc? And then scale up after a specific duration? Or for the second test interval? I don't have much experience with load testing and just want to make sure that this is money well spend in terms of having some actionable data. It's hard to answer this without more information. What is the goal of the load test? What kind of actionable data are you looking for? You can use load tests to answer a couple of different questions. There are two basic types of load test: performance analysis, and capacity planning. In a performance analysis test, you're looking for bottlenecks in your application with the goal of improving application performance. In a capacity planning test, you're trying to identify how many users your application can support as it's currently written. Which one of these are you doing? Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ http://training.figleaf.com/ Fig Leaf Software is a Veteran-Owned Small Business (VOSB) on GSA Schedule, and provides the highest caliber vendor-authorized instruction at our training centers, online, or onsite. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:349863 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
RE: Load testing tools.
Mark, Jamie, Will, Thanks for the suggestions guys :-) I'll take a look into the different ones and see which works best for me JMeter certainly sounds very cool! Cheers all, Rob ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;207172674;29440083;f Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:317833 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
Re: Load testing tools.
I got quite into jMeter, but its a bit finicky to get into. Once you understand how it works, tho', its very flexible (and free!) Mark On Tue, Jan 13, 2009 at 6:28 AM, Robert Rawlins robert.rawl...@thinkbluemedia.co.uk wrote: Afternoon guys, Any good recommendations on load testing tools? I'm just looking for something that'll make HTTP requests to a bunch of given URLS on set intervals for a period of time, monitoring response times etc. I've used a couple in the past but forget which, thought I'd get your suggestions. Obviously I'm quite partial to something free or open source ;-) Cheers, Rob ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;207172674;29440083;f Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:317808 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
RE: Load testing tools.
+1 for jMeter. It's not *too* finicky... Coupla nice features worth mentioning: 1. You can set it to either remember or forget cookies. With cookies on, you can script a whole login sequence and use that as your load test. With cookies off, you can stress your server with 50,000 live sessions in the blinking of an eye. 2. The test scripts can read parameters out of a comma-delimited file. If you point the above-mentioned login sequence at a file containing a bunch of user accounts, you can get the worst of both worlds and have 50,000 live *authenticated* sessions. Kind of fun. Your server *will* crash - but do you know when? (cue spooky music). Jaime -Original Message- From: Mark Mandel [mailto:mark.man...@gmail.com] Sent: Tuesday, 13 January 2009 7:23 AM To: cf-talk Subject: Re: Load testing tools. I got quite into jMeter, but its a bit finicky to get into. Once you understand how it works, tho', its very flexible (and free!) Mark On Tue, Jan 13, 2009 at 6:28 AM, Robert Rawlins robert.rawl...@thinkbluemedia.co.uk wrote: Afternoon guys, Any good recommendations on load testing tools? I'm just looking for something that'll make HTTP requests to a bunch of given URLS on set intervals for a period of time, monitoring response times etc. I've used a couple in the past but forget which, thought I'd get your suggestions. Obviously I'm quite partial to something free or open source ;-) Cheers, Rob ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;207172674;29440083;f Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:317817 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Load testing tools.
I played around with WebLoad and thought it was pretty easy to use. http://www.webload.org/ Will ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;207172674;29440083;f Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:317821 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
RE: Load testing software for website with AD integrated authenti cation
How exactly do you record this? Is it a cookie that's set or do you need a network traffic sniffer to pick up whatever header is being passed? How often do the tokens or whatever is passed get changed? I'm assuming each time you login there's something that gets set? -Original Message- From: Dave Watts [mailto:[EMAIL PROTECTED] Sent: Wednesday, July 23, 2008 5:27 PM To: CF-Talk Subject: RE: Load testing software for website with AD integrated authenti cation We're having some serious trouble with an internal website that uses IIS pass-through authentication that logs you in automatically based on the user you're logged into your computer as. The problem is, I can't find any load testing apps that will test a site with that type of login. My thinking is that it doesn't exist because it would have to spoof to AD authentication which shouldn't be able to be done or it defeats the purpose of that type of security. Can anyone confirm this or point us toward a product that does it? I know most work with form authentication and cookies and such but none seem to do pass-through. I'm not interested in other solutions for debugging the code and finding the slow parts as we are unable to do that for contractual reasons. Thanks for your help. Almost any load testing tool will do this. There's nothing specific to AD here, you simply have to record your browser session from an authenticated machine. The credentials are just another HTTP request header. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ Fig Leaf Software provides the highest caliber vendor-authorized instruction at our training centers in Washington DC, Atlanta, Chicago, Baltimore, Northern Virginia, or on-site at your location. Visit http://training.figleaf.com/ for more information! ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;203748912;27390454;j Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:309571 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
Re: Load testing software for website with AD integrated authenti cation
Your load testing tool, if it's worth anything, should come with a browser proxy that records everything you do and provides a script you can then edit and to which you can add username/password pairs from a text file. On Thu, Jul 24, 2008 at 8:35 PM, Burns, John D [EMAIL PROTECTED] wrote: How exactly do you record this? Is it a cookie that's set or do you need a network traffic sniffer to pick up whatever header is being passed? How often do the tokens or whatever is passed get changed? I'm assuming each time you login there's something that gets set? -Original Message- From: Dave Watts [mailto:[EMAIL PROTECTED] Sent: Wednesday, July 23, 2008 5:27 PM To: CF-Talk Subject: RE: Load testing software for website with AD integrated authenti cation -- mxAjax / CFAjax docs and other useful articles: http://www.bifrost.com.au/blog/ ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;203748912;27390454;j Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:309580 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
RE: Load testing software for website with AD integrated authenti cation
Any suggestions on a tool like this? We haven't invested in anything yet so I'm willing to take suggestions. Just looking to find the right tool. -Original Message- From: James Holmes [mailto:[EMAIL PROTECTED] Sent: Thursday, July 24, 2008 9:25 AM To: CF-Talk Subject: Re: Load testing software for website with AD integrated authenti cation Your load testing tool, if it's worth anything, should come with a browser proxy that records everything you do and provides a script you can then edit and to which you can add username/password pairs from a text file. On Thu, Jul 24, 2008 at 8:35 PM, Burns, John D [EMAIL PROTECTED] wrote: How exactly do you record this? Is it a cookie that's set or do you need a network traffic sniffer to pick up whatever header is being passed? How often do the tokens or whatever is passed get changed? I'm assuming each time you login there's something that gets set? -Original Message- From: Dave Watts [mailto:[EMAIL PROTECTED] Sent: Wednesday, July 23, 2008 5:27 PM To: CF-Talk Subject: RE: Load testing software for website with AD integrated authenti cation -- mxAjax / CFAjax docs and other useful articles: http://www.bifrost.com.au/blog/ ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;203748912;27390454;j Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:309583 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
Re: Load testing software for website with AD integrated authenti cation
We're having some serious trouble with an internal website Almost any load testing tool will do this. There's nothing specific to AD here, you simply have to record your browser session from an authenticated machine. The credentials are just another HTTP request header. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ One combination I find that works very well is the Badboy (http://www.badboy.com.au/) tool for proxy recording and the Apache Jakarta Project's JMeter (jakarta.apache.org/jmeter/) load testing tool. You record your session using BadBoy, then export the scripts to Jmeter. Tweak them a bit and you have a very good load test setup in a very short time. hth, larry ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;203748912;27390454;j Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:309584 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
RE: Load testing software for website with AD integrated authenti cation
How exactly do you record this? Is it a cookie that's set or do you need a network traffic sniffer to pick up whatever header is being passed? How often do the tokens or whatever is passed get changed? I'm assuming each time you login there's something that gets set? Yes, every time you login, your browser sends an HTTP request header for every subsequent request. If you use a load testing tool that lets you record a browser session to create a script, this will be recorded along with everything else. Then when you run the script, the load testing tool will send the same HTTP request header along with everything else. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ Fig Leaf Software provides the highest caliber vendor-authorized instruction at our training centers in Washington DC, Atlanta, Chicago, Baltimore, Northern Virginia, or on-site at your location. Visit http://training.figleaf.com/ for more information! ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;203748912;27390454;j Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:309641 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
RE: Load testing software for website with AD integrated authenti cation
We're having some serious trouble with an internal website that uses IIS pass-through authentication that logs you in automatically based on the user you're logged into your computer as. The problem is, I can't find any load testing apps that will test a site with that type of login. My thinking is that it doesn't exist because it would have to spoof to AD authentication which shouldn't be able to be done or it defeats the purpose of that type of security. Can anyone confirm this or point us toward a product that does it? I know most work with form authentication and cookies and such but none seem to do pass-through. I'm not interested in other solutions for debugging the code and finding the slow parts as we are unable to do that for contractual reasons. Thanks for your help. Almost any load testing tool will do this. There's nothing specific to AD here, you simply have to record your browser session from an authenticated machine. The credentials are just another HTTP request header. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ Fig Leaf Software provides the highest caliber vendor-authorized instruction at our training centers in Washington DC, Atlanta, Chicago, Baltimore, Northern Virginia, or on-site at your location. Visit http://training.figleaf.com/ for more information! ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;203748912;27390454;j Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:309546 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Load Testing
I've had good luck with the MS stress test tool: http://www.microsoft.com/technet/archive/itsolutions/intranet/downloads/webstres.mspx?mfr=true On Wed, Apr 2, 2008 at 2:39 PM, Mike Harman [EMAIL PROTECTED] wrote: I'm interested in hearing what others are doing for load testing and what software they use. Thanks, Mike Harman ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;192386516;25150098;k Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:302516 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
RE: Load Testing
We have been using Empirix eTEST Suite for years, but we're about to also start using TestComplete Enterprise (handles both web-based and Windows forms-based apps). The most important thing is not the software you use, it's the methodology you use. I have seen a lot of load tests, and this may seem like an exaggeration, but hardly any of them are actually effective in testing what needs to be tested. We run a load testing lab, so whether you want to hire it out to us, or if you just want some advice, then contact me offlist and I'll be happy to help in either capacity. Respectfully, Adam Phillip Churvis President Productivity Enhancement -Original Message- From: Mike Harman [mailto:[EMAIL PROTECTED] Sent: Wednesday, April 02, 2008 2:39 PM To: CF-Talk Subject: Load Testing I'm interested in hearing what others are doing for load testing and what software they use. Thanks, Mike Harman ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;192386516;25150098;k Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:302518 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
Re: Load Testing
There's also Selenium (http://selenium-ide.openqa.org/download.jsp) and LoadRunner (now of HP, formerly of Mercury Software https://h10078.www1.hp.com/cda/hpms/display/main/hpms_content.jsp?zn=btocp=1-11-126-17%5E8_4000_100__). Selenium is free, LoadRunner is exceedingly not free. Matthew Williams Geodesic GraFX www.geodesicgrafx.com/blog ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;192386516;25150098;k Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:302520 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
RE: Load Testing Software
I did - but the download keeps corrupting and the install breaks :( I've tried again recently and it seems to have worked but I'm a bit nervous of using it now after the initial pain. Thanks for the advice tho t -Original Message- From: Jayesh Viradiya [mailto:[EMAIL PROTECTED] Sent: 02 October 2007 19:55 To: CF-Talk Subject: RE: Load Testing Software HI, Did you try using Microsoft Web Stress Tool? It's quite decent and it's free. Jayesh Viradiya Adobe CF Team -Original Message- From: Tim Ashworth [mailto:[EMAIL PROTECTED] Sent: Tuesday, October 02, 2007 7:23 AM To: CF-Talk Subject: Load Testing Software Hi All, Could anyone recommend a load testing tool? I've tried OpenSTA but didn't get on with the help contents too well.. Thanks in advance, Tim ~| Enterprise web applications, build robust, secure scalable apps today - Try it now ColdFusion Today ColdFusion 8 beta - Build next generation apps Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:290044 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
Re: Load Testing Software
On Tuesday 02 Oct 2007, [EMAIL PROTECTED] wrote: Did you try using Microsoft Web Stress Tool? It's quite decent and it's free. Assuming I've already paid a fortune for my O/S licence, right ? -- Tom Chiverton Helping to conveniently maintain value-added e-services on: http://thefalken.livejournal.com This email is sent for and on behalf of Halliwells LLP. Halliwells LLP is a limited liability partnership registered in England and Wales under registered number OC307980 whose registered office address is at St James's Court Brown Street Manchester M2 2JF. A list of members is available for inspection at the registered office. Any reference to a partner in relation to Halliwells LLP means a member of Halliwells LLP. Regulated by The Solicitors Regulation Authority. CONFIDENTIALITY This email is intended only for the use of the addressee named above and may be confidential or legally privileged. If you are not the addressee you must not read it and must not use any information contained in nor copy it nor inform any person other than Halliwells LLP or the addressee of its existence or contents. If you have received this email in error please delete it and notify Halliwells LLP IT Department on 0870 365 8008. For more information about Halliwells LLP visit www.halliwells.com. ~| ColdFusion is delivering applications solutions at at top companies around the world in government. Find out how and where now http://www.adobe.com/cfusion/showcase/index.cfm?event=finderproductID=1522loc=en_us Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:290046 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
Re: Load Testing Software
On Tuesday 02 Oct 2007, [EMAIL PROTECTED] wrote: Could anyone recommend a load testing tool? I've tried OpenSTA but didn't get on with the help contents too well.. I like Apache JMeter. -- Tom Chiverton Helping to globally envisioneer vertical deliverables on: http://thefalken.livejournal.com This email is sent for and on behalf of Halliwells LLP. Halliwells LLP is a limited liability partnership registered in England and Wales under registered number OC307980 whose registered office address is at St James's Court Brown Street Manchester M2 2JF. A list of members is available for inspection at the registered office. Any reference to a partner in relation to Halliwells LLP means a member of Halliwells LLP. Regulated by The Solicitors Regulation Authority. CONFIDENTIALITY This email is intended only for the use of the addressee named above and may be confidential or legally privileged. If you are not the addressee you must not read it and must not use any information contained in nor copy it nor inform any person other than Halliwells LLP or the addressee of its existence or contents. If you have received this email in error please delete it and notify Halliwells LLP IT Department on 0870 365 8008. For more information about Halliwells LLP visit www.halliwells.com. ~| ColdFusion is delivering applications solutions at at top companies around the world in government. Find out how and where now http://www.adobe.com/cfusion/showcase/index.cfm?event=finderproductID=1522loc=en_us Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:289930 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Load Testing Software
webload is open source and free and pretty popular. Never used it myself but I plan to.. www.webload.org ~| Create robust enterprise, web RIAs. Upgrade to ColdFusion 8 and integrate with Adobe Flex http://www.adobe.com/products/coldfusion/flex2/?sdid=RVJP Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:289945 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
RE: Load Testing Software
Cheers, I'll report back. t -Original Message- From: Rick Root [mailto:[EMAIL PROTECTED] Sent: 02 October 2007 16:34 To: CF-Talk Subject: Re: Load Testing Software webload is open source and free and pretty popular. Never used it myself but I plan to.. www.webload.org ~| Enterprise web applications, build robust, secure scalable apps today - Try it now ColdFusion Today ColdFusion 8 beta - Build next generation apps Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:289950 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
RE: Load Testing Software
HI, Did you try using Microsoft Web Stress Tool? It's quite decent and it's free. Jayesh Viradiya Adobe CF Team -Original Message- From: Tim Ashworth [mailto:[EMAIL PROTECTED] Sent: Tuesday, October 02, 2007 7:23 AM To: CF-Talk Subject: Load Testing Software Hi All, Could anyone recommend a load testing tool? I've tried OpenSTA but didn't get on with the help contents too well.. Thanks in advance, Tim ~| Enterprise web applications, build robust, secure scalable apps today - Try it now ColdFusion Today ColdFusion 8 beta - Build next generation apps Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:289975 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
RE: Load Testing
This Load Testing is very intriguing stuff, something I've not considered doing until this topic came up. How does this stuff work with user authentication? The large majority of my application (all except one lonely cfm) are behind my authentication system, is this passler software (or any of the others) able to work around that if I give them the correct credentials? This could be fun, 10,000 simultaneous users and 1,000,000 page views per hour hehe, that'll push my server on the floor I'm sure. Rob -Original Message- From: OÄuz Demirkapı [mailto:[EMAIL PROTECTED] Sent: 23 May 2007 22:12 To: CF-Talk Subject: Re: Load Testing Webserver Stress Tool http://www.paessler.com/webstress Jake Pilgrim wrote: I'm just wondering, what do you use for load testing your applications? Thanks! Jake -- ~~~ OÄuz Demirkapı TeraTech Inc. | Senior Developer 405 East Gude Dr Suite 207, Rockville, MD 20850, USA Voice: +1 (301) 424-3903 ext 111 | Fax: +1 (301) 762-8185 Web: http://www.teratech.com | E-mail: oguz.demirkapi AT teratech.com Winner in CFDJ awards Best Consulting. Member Team Fusebox. ~~~ ~| ColdFusion MX7 and Flex 2 Build sales marketing dashboard RIAâs for your business. Upgrade now http://www.adobe.com/products/coldfusion/flex2?sdid=RVJT Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:279041 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Load Testing
On Thursday 24 May 2007, Robert Rawlins - Think Blue wrote: How does this stuff work with user authentication? The large majority of my application (all except one lonely cfm) are behind my authentication system, is this passler software (or any of the others) able to work around that if I give them the correct credentials? In general stress tools look to your app just like a web browser, so if there are user/password forms to fill in, or basic/digest/NTLM authorisation they'll cope fine. -- Tom Chiverton Helping to dynamically monetize ubiquitous content on: http://thefalken.livejournal.com This email is sent for and on behalf of Halliwells LLP. Halliwells LLP is a limited liability partnership registered in England and Wales under registered number OC307980 whose registered office address is at St James's Court Brown Street Manchester M2 2JF. A list of members is available for inspection at the registered office. Any reference to a partner in relation to Halliwells LLP means a member of Halliwells LLP. Regulated by the Law Society. CONFIDENTIALITY This email is intended only for the use of the addressee named above and may be confidential or legally privileged. If you are not the addressee you must not read it and must not use any information contained in nor copy it nor inform any person other than Halliwells LLP or the addressee of its existence or contents. If you have received this email in error please delete it and notify Halliwells LLP IT Department on 0870 365 8008. For more information about Halliwells LLP visit www.halliwells.com. ~| Create robust enterprise, web RIAs. Upgrade integrate Adobe Coldfusion MX7 with Flex 2 http://www.adobe.com/products/coldfusion/flex2/?sdid=RVJP Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:279044 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
RE: Load Testing
That's great Tom, Just out of interest which tool are you using Tom? I've downloaded the trial edition of the Pasler one this morning and it seems to run very nicely and give me a decent level of feedback. Thanks. Rob -Original Message- From: Tom Chiverton [mailto:[EMAIL PROTECTED] Sent: 24 May 2007 09:56 To: CF-Talk Subject: Re: Load Testing On Thursday 24 May 2007, Robert Rawlins - Think Blue wrote: How does this stuff work with user authentication? The large majority of my application (all except one lonely cfm) are behind my authentication system, is this passler software (or any of the others) able to work around that if I give them the correct credentials? In general stress tools look to your app just like a web browser, so if there are user/password forms to fill in, or basic/digest/NTLM authorisation they'll cope fine. -- Tom Chiverton Helping to dynamically monetize ubiquitous content on: http://thefalken.livejournal.com This email is sent for and on behalf of Halliwells LLP. Halliwells LLP is a limited liability partnership registered in England and Wales under registered number OC307980 whose registered office address is at St James's Court Brown Street Manchester M2 2JF. A list of members is available for inspection at the registered office. Any reference to a partner in relation to Halliwells LLP means a member of Halliwells LLP. Regulated by the Law Society. CONFIDENTIALITY This email is intended only for the use of the addressee named above and may be confidential or legally privileged. If you are not the addressee you must not read it and must not use any information contained in nor copy it nor inform any person other than Halliwells LLP or the addressee of its existence or contents. If you have received this email in error please delete it and notify Halliwells LLP IT Department on 0870 365 8008. For more information about Halliwells LLP visit www.halliwells.com. ~| ColdFusion MX7 by Adobe® Dyncamically transform webcontent into Adobe PDF with new ColdFusion MX7. Free Trial. http://www.adobe.com/products/coldfusion?sdid=RVJV Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:279046 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Load Testing
On Thursday 24 May 2007, Robert Rawlins - Think Blue wrote: Just out of interest which tool are you using Tom? I've downloaded the trial edition of the Pasler one this morning and it seems to run very nicely and give me a decent level of feedback. We don't, actually, load test (yeah, I know, shoot me). Our server is huge, over spec'ed, and virtualised just in case we do need more oompf. In general, we just insure it's more or less instant on the dev. system, and trust that the beefier live server will therefore be fine. Our monitoring software records response time on our critical sites, so we would find out if it starts behaving poorly, then we can turn the VMWare knobs up a bit :-) In the past I have used Apache's ab (http://httpd.apache.org/docs/2.2/programs/ab.html) and JMeter (http://jakarta.apache.org/jmeter/index.html) -- Tom Chiverton Helping to dramatically reintermediate cross-media segments on: http://thefalken.livejournal.com This email is sent for and on behalf of Halliwells LLP. Halliwells LLP is a limited liability partnership registered in England and Wales under registered number OC307980 whose registered office address is at St James's Court Brown Street Manchester M2 2JF. A list of members is available for inspection at the registered office. Any reference to a partner in relation to Halliwells LLP means a member of Halliwells LLP. Regulated by the Law Society. CONFIDENTIALITY This email is intended only for the use of the addressee named above and may be confidential or legally privileged. If you are not the addressee you must not read it and must not use any information contained in nor copy it nor inform any person other than Halliwells LLP or the addressee of its existence or contents. If you have received this email in error please delete it and notify Halliwells LLP IT Department on 0870 365 8008. For more information about Halliwells LLP visit www.halliwells.com. ~| ColdFusion MX7 by Adobe® Dyncamically transform webcontent into Adobe PDF with new ColdFusion MX7. Free Trial. http://www.adobe.com/products/coldfusion?sdid=RVJV Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:279055 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Load Testing
We use LoadRunner This e-mail is from Reed Exhibitions (Gateway House, 28 The Quadrant, Richmond, Surrey, TW9 1DN, United Kingdom), a division of Reed Business, Registered in England, Number 678540. It contains information which is confidential and may also be privileged. It is for the exclusive use of the intended recipient(s). If you are not the intended recipient(s) please note that any form of distribution, copying or use of this communication or the information in it is strictly prohibited and may be unlawful. If you have received this communication in error please return it to the sender or call our switchboard on +44 (0) 20 89107910. The opinions expressed within this communication are not necessarily those expressed by Reed Exhibitions. Visit our website at http://www.reedexpo.com -Original Message- From: Jake Pilgrim To: CF-Talk Sent: Wed May 23 21:06:44 2007 Subject: Load Testing I'm just wondering, what do you use for load testing your applications? Thanks! Jake ~| Upgrade to Adobe ColdFusion MX7 Experience Flex 2 MX7 integration create powerful cross-platform RIAs http://www.adobe.com/products/coldfusion/flex2/?sdid=RVJQ Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:279013 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
Re: Load Testing
If you have access to a Windows box, Microsoft has a free and quite easy to use load testing tool: http://www.microsoft.com/downloads/details.aspx?FamilyID=e2c0585a-062a-439e-a67d-75a89aa36495DisplayLang=en On 5/23/07, Jake Pilgrim [EMAIL PROTECTED] wrote: I'm just wondering, what do you use for load testing your applications? Thanks! Jake ~| Macromedia ColdFusion MX7 Upgrade to MX7 experience time-saving features, more productivity. http://www.adobe.com/products/coldfusion?sdid=RVJW Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:279016 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Load Testing
Webserver Stress Tool http://www.paessler.com/webstress Jake Pilgrim wrote: I'm just wondering, what do you use for load testing your applications? Thanks! Jake -- ~~~ OÄuz Demirkapı TeraTech Inc. | Senior Developer 405 East Gude Dr Suite 207, Rockville, MD 20850, USA Voice: +1 (301) 424-3903 ext 111 | Fax: +1 (301) 762-8185 Web: http://www.teratech.com | E-mail: oguz.demirkapi AT teratech.com Winner in CFDJ awards Best Consulting. Member Team Fusebox. ~~~ ~| ColdFusion MX7 by Adobe® Dyncamically transform webcontent into Adobe PDF with new ColdFusion MX7. Free Trial. http://www.adobe.com/products/coldfusion?sdid=RVJV Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:279018 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
RE: Load testing and Maximum number of simultaneous requests
I generally go for around 8 per physical CPU that the server has. ColdFusions threading model is totally different to that of ASP and if your client is used to an ASP environment, 8 threads may seem a little low although it isn't when you consider how the threading model is implemented. I can't recall the links to the relevant documents right now but I'm sure someone will know. Paul ~| Create Web Applications With ColdFusion MX7 Flex 2. Build powerful, scalable RIAs. Free Trial http://www.adobe.com/products/coldfusion/flex2/ Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:270912 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
Re: Load testing and Maximum number of simultaneous requests
Awesome, That math is a perfect starting point for our tweaking. Thanks Paul. =] On 2/27/07, Paul Vernon [EMAIL PROTECTED] wrote: I generally go for around 8 per physical CPU that the server has. ColdFusions threading model is totally different to that of ASP and if your client is used to an ASP environment, 8 threads may seem a little low although it isn't when you consider how the threading model is implemented. I can't recall the links to the relevant documents right now but I'm sure someone will know. Paul ~| Upgrade to Adobe ColdFusion MX7 Experience Flex 2 MX7 integration create powerful cross-platform RIAs http://www.adobe.com/products/coldfusion/flex2/ Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:270919 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
RE: Load Testing ColdFusion Applications Using SeeFusion
Weird, where are the submit buttons? -Original Message- From: Steven Erat [mailto:[EMAIL PROTECTED] Sent: Thursday, April 14, 2005 3:02 PM To: CF-Talk Subject: Load Testing ColdFusion Applications Using SeeFusion The Online ColdFusion Meetup Group invites you to a virtual presentation on the ColdFusion monitoring tool, SeeFusion, Thursday April 14, 2005 at 6:00 PM EDT. RSVP here http://coldfusion.meetup.com/17/events/4387662/ for more information on where to view the meeting. SeeFusion, available at http://www.seefusion.com, is described as: ... a utility for monitoring ColdFusion application servers. SeeFusion gives you the ability to see how your ColdFusion servers are processing requests in real time., ... SeeFusion tracks 3 types of requests--currently running requests, recently completed requests, and recently completed long-running requests. In addition to providing detailed request monitoring, SeeFusion also offers a JDBC wrapper feature for obtaining detailed information about database interaction., ... SeeFusion is virtually undetectable as an overhead process on the server. It's implemented as a low-level servlet filter, which allows SeeFusion to provide valuable metrics even (and perhaps especially) on high-traffic production servers. What's a virtual meeting like? Check out this archived presentation on CFForm Enhancements by Simon Horwith: http://mmsupport.breezecentral.com/p75996948/ - Steven Erat Organizer, Online ColdFusion Meetup Group ~| Find out how CFTicket can increase your company's customer support efficiency by 100% http://www.houseoffusion.com/banners/view.cfm?bannerid=49 Message: http://www.houseoffusion.com/lists.cfm/link=i:4:202850 Archives: http://www.houseoffusion.com/cf_lists/threads.cfm/4 Subscription: http://www.houseoffusion.com/lists.cfm/link=s:4 Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4 Donations Support: http://www.houseoffusion.com/tiny.cfm/54
RE: Load Testing ColdFusion Applications Using SeeFusion
Bah, for some reason our proxy was blocking it... nm -Original Message- From: Calvin Ward [mailto:[EMAIL PROTECTED] Sent: Thursday, April 14, 2005 4:07 PM To: CF-Talk Subject: RE: Load Testing ColdFusion Applications Using SeeFusion Weird, where are the submit buttons? -Original Message- From: Steven Erat [mailto:[EMAIL PROTECTED] Sent: Thursday, April 14, 2005 3:02 PM To: CF-Talk Subject: Load Testing ColdFusion Applications Using SeeFusion The Online ColdFusion Meetup Group invites you to a virtual presentation on the ColdFusion monitoring tool, SeeFusion, Thursday April 14, 2005 at 6:00 PM EDT. RSVP here http://coldfusion.meetup.com/17/events/4387662/ for more information on where to view the meeting. SeeFusion, available at http://www.seefusion.com, is described as: ... a utility for monitoring ColdFusion application servers. SeeFusion gives you the ability to see how your ColdFusion servers are processing requests in real time., ... SeeFusion tracks 3 types of requests--currently running requests, recently completed requests, and recently completed long-running requests. In addition to providing detailed request monitoring, SeeFusion also offers a JDBC wrapper feature for obtaining detailed information about database interaction., ... SeeFusion is virtually undetectable as an overhead process on the server. It's implemented as a low-level servlet filter, which allows SeeFusion to provide valuable metrics even (and perhaps especially) on high-traffic production servers. What's a virtual meeting like? Check out this archived presentation on CFForm Enhancements by Simon Horwith: http://mmsupport.breezecentral.com/p75996948/ - Steven Erat Organizer, Online ColdFusion Meetup Group ~| Logware (www.logware.us): a new and convenient web-based time tracking application. Start tracking and documenting hours spent on a project or with a client with Logware today. Try it for free with a 15 day trial account. http://www.houseoffusion.com/banners/view.cfm?bannerid=67 Message: http://www.houseoffusion.com/lists.cfm/link=i:4:202856 Archives: http://www.houseoffusion.com/cf_lists/threads.cfm/4 Subscription: http://www.houseoffusion.com/lists.cfm/link=s:4 Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4 Donations Support: http://www.houseoffusion.com/tiny.cfm/54
Re: Load Testing ColdFusion Applications Using SeeFusion
If you missed this online presentation of SeeFusion monitoring for ColdFusion MX servers, it is now archived for public viewing here: http://mmsupport.breezecentral.com/p39006045/ This includes the slides, the live demo, the chat, and all the audio. Thanks to everyone who participated in this meeting, and especially to Webapper's Mike and Patrick for preparing this talk for the Online ColdFusion Meetup Group's April event. On 4/14/05, Steven Erat [EMAIL PROTECTED] wrote: The Online ColdFusion Meetup Group invites you to a virtual presentation on the ColdFusion monitoring tool, SeeFusion, Thursday April 14, 2005 at 6:00 PM EDT. RSVP here http://coldfusion.meetup.com/17/events/4387662/ for more information on where to view the meeting. SeeFusion, available at http://www.seefusion.com, is described as: ... a utility for monitoring ColdFusion application servers. SeeFusion gives you the ability to see how your ColdFusion servers are processing requests in real time., ... SeeFusion tracks 3 types of requests--currently running requests, recently completed requests, and recently completed long-running requests. In addition to providing detailed request monitoring, SeeFusion also offers a JDBC wrapper feature for obtaining detailed information about database interaction., ... SeeFusion is virtually undetectable as an overhead process on the server. It's implemented as a low-level servlet filter, which allows SeeFusion to provide valuable metrics even (and perhaps especially) on high-traffic production servers. What's a virtual meeting like? Check out this archived presentation on CFForm Enhancements by Simon Horwith: http://mmsupport.breezecentral.com/p75996948/ - Steven Erat Organizer, Online ColdFusion Meetup Group ~| Find out how CFTicket can increase your company's customer support efficiency by 100% http://www.houseoffusion.com/banners/view.cfm?bannerid=49 Message: http://www.houseoffusion.com/lists.cfm/link=i:4:202948 Archives: http://www.houseoffusion.com/cf_lists/threads.cfm/4 Subscription: http://www.houseoffusion.com/lists.cfm/link=s:4 Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4 Donations Support: http://www.houseoffusion.com/tiny.cfm/54
Re: Load Testing software
We use e-TEST Suite 7.0 in our load testing lab.It's an amazing product, but it's expensive. Regarding platform-specific tools, the main thing you're looking for is its ability to directly read and use metrics from the platform, which e-TEST Suite does quite well. Respectfully, Adam Phillip Churvis Member of Team Macromedia Advanced Intensive Training: * C# ASP.NET for ColdFusion Developers * ColdFusion MX Master Class * Advanced Development with CFMX and SQL Server 2000 http://www.ColdFusionTraining.com Download CommerceBlocks V2.1 and LoRCAT from http://www.ProductivityEnhancement.com The ColdFusion MX Bible is in bookstores now! - Original Message - From: Ben Frame [EMAIL PROTECTED] To: CF-Talk [EMAIL PROTECTED] Sent: Tuesday, September 07, 2004 11:53 AM Subject: Load Testing software Hi All, I've been working on Stress/Load testing some applications recently, and wondered which, if any, testing tools work best for testing CF applications? I've mostly used the general web stress test tools (Rational, MS Web Application Stress Tool, etc...).However, it seems there are some platform-specific testing tools available for J2EE, .NET, and PHP. Are there technology-specific tools for ColdFusion?If using CFMX 6.1 on JRUN, is there any value in using one of the J2EE specific tools against JRUN? I'd be interested in any thoughts or experiences people might have on this topic. Thanks! -Ben [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings] [Donations and Support]
RE: Load testing
I won't beat a dead horse here, other than to agree with the previous posters: look at the database and caching strategies first. We documented our recent load testing experience in an April CFDJ article; you can read it here: http://www.duoconsulting.com/index.cfm/fuseaction/news.detail/object_id/5ea7ed33-8896-49d1-9945-e6e216dc85ed/TheArtScienceofLoadTestingonaBudget.cfm -- Kelly Tetterton Technical Lead | Duo Consulting Internet Strategy, Design and Development 312.529.3000| main 312.529.3014 | direct 312.529.3001| fax www.duoconsulting.com -Original Message- From: Dave Watts [mailto:[EMAIL PROTECTED] Sent: Sunday, June 20, 2004 7:45 PM To: CF-Talk Subject: RE: Load testing I was wondering what was the general pratice for testing your app is In my experience, the general practice is to release your application, and it either supports the number of users it needs to, or it doesn't. Of course, that's not the best practice, but it's certainly the most common. Is there any way of similating a certain number of hits per minute? Yes, there are plenty of load testing tools. Some are free, such as my favorite free load tester, OpenSTA (http://www.opensta.org/). Some are incredibly expensive, such as Segue SilkPerformer, which can run up to $50K. The commercial tools generally provide richer feature sets, and if you do enough load testing, they're worth the money in the amount of time they save you. I'd like to test some sections of some apps and see what kind of performance my code is getting (or not getting). Does anyone have any suggestions as to how this test could be done? Unfortunately, load testing isn't a trivial task. In general, though, to oversimplify things a bit, you write a test script which travels through your application, then you give that script to your load test tool and let it run the script with some predetermined number of virtual users. As it runs the script, it measures response time and throughput, and stores those measurements. After the test has been run, you can generate data about which pages took longest on average, and those are your bottlenecks. You can then examine those pages specifically, and use GetTickCount within those pages to find out which section of the page is causing trouble. This kind of load test is called a performance test. You can also use load test tools to perform capacity planning tests. I liked the example on the houseoffusion.com home page where the question was asked, Is CFLOOP really needed?... little tricks like that, I'm sure are almost trivial but running sloppy queries/loopsetc... Just want to tighten it up. I'm sorry, but that kind of question is like asking how many angels can dance on the head of a pin. You won't find your performance problems can be solved by little tricks like that. I've analyzed literally hundreds of CF applications, and their problems were never caused by those sorts of things. Instead, the problems almost always come down to poor database schema design, poorly written SQL, inadequate caching, or some combination of those. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ phone: 202-797-5496 fax: 202-797-5444 _ [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings] [Donations and Support]
RE: Load testing
Thanks to all who replied... Thanks for the info Dave. :-) Yves _ From: Dave Watts [mailto:[EMAIL PROTECTED] Sent: June 20, 2004 9:45 PM To: CF-Talk Subject: RE: Load testing I was wondering what was the general pratice for testing your app is In my experience, the general practice is to release your application, and it either supports the number of users it needs to, or it doesn't. Of course, that's not the best practice, but it's certainly the most common. Is there any way of similating a certain number of hits per minute? Yes, there are plenty of load testing tools. Some are free, such as my favorite free load tester, OpenSTA (http://www.opensta.org/). Some are incredibly expensive, such as Segue SilkPerformer, which can run up to $50K. The commercial tools generally provide richer feature sets, and if you do enough load testing, they're worth the money in the amount of time they save you. I'd like to test some sections of some apps and see what kind of performance my code is getting (or not getting). Does anyone have any suggestions as to how this test could be done? Unfortunately, load testing isn't a trivial task. In general, though, to oversimplify things a bit, you write a test script which travels through your application, then you give that script to your load test tool and let it run the script with some predetermined number of virtual users. As it runs the script, it measures response time and throughput, and stores those measurements. After the test has been run, you can generate data about which pages took longest on average, and those are your bottlenecks. You can then examine those pages specifically, and use GetTickCount within those pages to find out which section of the page is causing trouble. This kind of load test is called a performance test. You can also use load test tools to perform capacity planning tests. I liked the example on the houseoffusion.com home page where the question was asked, Is CFLOOP really needed?... little tricks like that, I'm sure are almost trivial but running sloppy queries/loopsetc... Just want to tighten it up. I'm sorry, but that kind of question is like asking how many angels can dance on the head of a pin. You won't find your performance problems can be solved by little tricks like that. I've analyzed literally hundreds of CF applications, and their problems were never caused by those sorts of things. Instead, the problems almost always come down to poor database schema design, poorly written SQL, inadequate caching, or some combination of those. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ phone: 202-797-5496 fax: 202-797-5444 _ [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings] [Donations and Support]
RE: Load testing
And thanks Kelly... I'll certainly read the article. Yves _ From: Kelly Tetterton [mailto:[EMAIL PROTECTED] Sent: June 21, 2004 9:18 AM To: CF-Talk Subject: RE: Load testing I won't beat a dead horse here, other than to agree with the previous posters: look at the database and caching strategies first. We documented our recent load testing experience in an April CFDJ article; you can read it here: http://www.duoconsulting.com/index.cfm/fuseaction/news.detail/object_id/5ea7 ed33-8896-49d1-9945-e6e216dc85ed/TheArtScienceofLoadTestingonaBudget.cfm -- Kelly Tetterton Technical Lead | Duo Consulting Internet Strategy, Design and Development 312.529.3000| main 312.529.3014 | direct 312.529.3001| fax www.duoconsulting.com -Original Message- From: Dave Watts [mailto:[EMAIL PROTECTED] Sent: Sunday, June 20, 2004 7:45 PM To: CF-Talk Subject: RE: Load testing I was wondering what was the general pratice for testing your app is In my experience, the general practice is to release your application, and it either supports the number of users it needs to, or it doesn't. Of course, that's not the best practice, but it's certainly the most common. Is there any way of similating a certain number of hits per minute? Yes, there are plenty of load testing tools. Some are free, such as my favorite free load tester, OpenSTA (http://www.opensta.org/). Some are incredibly expensive, such as Segue SilkPerformer, which can run up to $50K. The commercial tools generally provide richer feature sets, and if you do enough load testing, they're worth the money in the amount of time they save you. I'd like to test some sections of some apps and see what kind of performance my code is getting (or not getting). Does anyone have any suggestions as to how this test could be done? Unfortunately, load testing isn't a trivial task. In general, though, to oversimplify things a bit, you write a test script which travels through your application, then you give that script to your load test tool and let it run the script with some predetermined number of virtual users. As it runs the script, it measures response time and throughput, and stores those measurements. After the test has been run, you can generate data about which pages took longest on average, and those are your bottlenecks. You can then examine those pages specifically, and use GetTickCount within those pages to find out which section of the page is causing trouble. This kind of load test is called a performance test. You can also use load test tools to perform capacity planning tests. I liked the example on the houseoffusion.com home page where the question was asked, Is CFLOOP really needed?... little tricks like that, I'm sure are almost trivial but running sloppy queries/loopsetc... Just want to tighten it up. I'm sorry, but that kind of question is like asking how many angels can dance on the head of a pin. You won't find your performance problems can be solved by little tricks like that. I've analyzed literally hundreds of CF applications, and their problems were never caused by those sorts of things. Instead, the problems almost always come down to poor database schema design, poorly written SQL, inadequate caching, or some combination of those. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ phone: 202-797-5496 fax: 202-797-5444 _ _ [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings] [Donations and Support]
RE: Load testing
I was wondering what was the general pratice for testing your app is In my experience, the general practice is to release your application, and it either supports the number of users it needs to, or it doesn't. Of course, that's not the best practice, but it's certainly the most common. Is there any way of similating a certain number of hits per minute? Yes, there are plenty of load testing tools. Some are free, such as my favorite free load tester, OpenSTA (http://www.opensta.org/). Some are incredibly expensive, such as Segue SilkPerformer, which can run up to $50K. The commercial tools generally provide richer feature sets, and if you do enough load testing, they're worth the money in the amount of time they save you. I'd like to test some sections of some apps and see what kind of performance my code is getting (or not getting). Does anyone have any suggestions as to how this test could be done? Unfortunately, load testing isn't a trivial task. In general, though, to oversimplify things a bit, you write a test script which travels through your application, then you give that script to your load test tool and let it run the script with some predetermined number of virtual users. As it runs the script, it measures response time and throughput, and stores those measurements. After the test has been run, you can generate data about which pages took longest on average, and those are your bottlenecks. You can then examine those pages specifically, and use GetTickCount within those pages to find out which section of the page is causing trouble. This kind of load test is called a performance test. You can also use load test tools to perform capacity planning tests. I liked the example on the houseoffusion.com home page where the question was asked, Is CFLOOP really needed?... little tricks like that, I'm sure are almost trivial but running sloppy queries/loopsetc... Just want to tighten it up. I'm sorry, but that kind of question is like asking how many angels can dance on the head of a pin. You won't find your performance problems can be solved by little tricks like that. I've analyzed literally hundreds of CF applications, and their problems were never caused by those sorts of things. Instead, the problems almost always come down to poor database schema design, poorly written SQL, inadequate caching, or some combination of those. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ phone: 202-797-5496 fax: 202-797-5444 [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings] [Donations and Support]
RE: Load testing
rant is cfloop really needed is a horrible thing to look at before you do load testing. ... Amen, brother! And of course, don't forget to load test after each and every step, excluding the BBQ ones. Unfortunately, if I don't load test after BBQ, I'll have to buy new pants. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ phone: 202-797-5496 fax: 202-797-5444 [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings] [Donations and Support]
RE: Load testing
Unfortunately, if I don't load test after BBQ, I'll have to buy new pants. That about takes the cake Dave, good heavens... Calm yourself! :-) [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings] [Donations and Support]
Re: Load testing
Unfortunately, if I don't load test after BBQ, I'll have to buy new pants. That about takes the cake Dave, good heavens... Calm yourself! No, that takes lots of detergent and sometimes bleach ;) [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings] [Donations and Support]
Re: Load testing
On Jun 20, 2004, at 7:05 PM, C. Hatton Humphrey wrote: Unfortunately, if I don't load test after BBQ, I'll have to buy new pants. That about takes the cake Dave, good heavens... Calm yourself! No, that takes lots of detergent and sometimes bleach ;) Or Spray and Toss -- must be a slow day hehe Dick [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings] [Donations and Support]
Re: Load testing
Weuse a product called: WebLoad by Radview Software www.radview.com - Original Message - From: Yves Arsenault To: CF-Talk Sent: Friday, June 18, 2004 7:51 PM Subject: Load testing Hello, I was wondering what was the general pratice for testing your app is Is there any way of similating a certain number of hits per minute? I'd like to test some sections of some apps and see what kind of performance my code is getting (or not getting). Does anyone have any suggestions as to how this test could be done? There are some projects that are coming up that I wouldreally love to use some kind of checking to really tighten up performance as much as possible. I liked the example on the houseoffusion.com home page where the question was asked, Is CFLOOP really needed?... little tricks like that, I'm sure are almost trivial but running sloppy queries/loopsetc... Just want to tighten it up. Any ideas? Thanks, Yves Arsenault [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings] [Donations and Support]
RE: Load testing
Thanks, I'll check this out. Yves _ From: ColdFusion Developer [mailto:[EMAIL PROTECTED] Sent: June 18, 2004 9:00 PM To: CF-Talk Subject: Re: Load testing Weuse a product called: WebLoad by Radview Software www.radview.com - Original Message - From: Yves Arsenault To: CF-Talk Sent: Friday, June 18, 2004 7:51 PM Subject: Load testing Hello, I was wondering what was the general pratice for testing your app is Is there any way of similating a certain number of hits per minute? I'd like to test some sections of some apps and see what kind of performance my code is getting (or not getting). Does anyone have any suggestions as to how this test could be done? There are some projects that are coming up that I wouldreally love to use some kind of checking to really tighten up performance as much as possible. I liked the example on the houseoffusion.com home page where the question was asked, Is CFLOOP really needed?... little tricks like that, I'm sure are almost trivial but running sloppy queries/loopsetc... Just want to tighten it up. Any ideas? Thanks, Yves Arsenault _ [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings] [Donations and Support]
RE: Load testing
You can spend zero to many thousand dollars on load testing software, depending on what you need.I've always been happy with httpload, which is an incredibly simple app (for *nix at least, don't know about windows) that will take a set of URLs, and request them at whatever speed you want, for however long you want, and then generate a nice little report afterwards. It's far from feature rich, but it's a very effective tool. rant is cfloop really needed is a horrible thing to look at before you do load testing.Improperly indexed databases, and ineffecient queries are the major culprits, so until you've exhaustively tested those, worry about nothing else.Once that's done, look for caching opportunities on the front side of the application (cache pregenerated content, either in memory, or as static files).Once that's done, make sure you code is as readable and well encapsulated as possible.After that, think about increasing the hardware resources that drive the application (split app and DB between boxes, make a cluster, add more servers to the cluster, whatever).Next, go BBQ some steaks, have a few beers, and watch some TV.Then start rewriting the application in a language designed with performance closer to the top of the priority list than CF (JSP would be a start, pure Servlets is better, some C/C++ web server filters/modules, and then perhaps even a dedicated webserver/application combination).Time to check the hardware setup again. Almost done now.Time for another BBQ, this time with some nice bratwurst, and maybe some fresh grilled corn on the cob.Finally, think about removing loops that aren't strictly necessary, but make code more readable. And of course, don't forget to load test after each and every step, excluding the BBQ ones. /rant Cheers, barneyb -Original Message- From: Yves Arsenault [mailto:[EMAIL PROTECTED] Sent: Friday, June 18, 2004 4:52 PM To: CF-Talk Subject: Load testing Hello, I was wondering what was the general pratice for testing your app is Is there any way of similating a certain number of hits per minute? I'd like to test some sections of some apps and see what kind of performance my code is getting (or not getting). Does anyone have any suggestions as to how this test could be done? There are some projects that are coming up that I would really love to use some kind of checking to really tighten up performance as much as possible. I liked the example on the houseoffusion.com home page where the question was asked, Is CFLOOP really needed?... little tricks like that, I'm sure are almost trivial but running sloppy queries/loopsetc... Just want to tighten it up. Any ideas? Thanks, Yves Arsenault [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings] [Donations and Support]
Re: Load Testing Tools
Sam komolafe wrote: Can someone recommend a good load testing tool for my ColdFusion server.I have a Compaq Pentium IIIDL380 - dual processor server with win2000 server. OpenSTA: http://www.opensta.org/ or the Microsoft Stress tool are both free, and work well. __ Pete Freitag http://www.cfdev.com/ Author of the CFMX Developers Cookbook http://www.petefreitag.com/bookshelf/ [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
Re: Load Testing Tools
you could check out LoRCAT at http://www.productivityenhancement.com/products.cfm not sure if it's 100% what you're looking for, but probably worth looking at. - Original Message - From: Sam komolafe [EMAIL PROTECTED] To: CF-Talk [EMAIL PROTECTED] Sent: Thursday, February 26, 2004 9:33 AM Subject: Load Testing Tools Can someone recommend a good load testing tool for my ColdFusion server. I have a Compaq Pentium IIIDL380 - dual processor server with win2000 server. Thanks Sam --- [This E-mail scanned for viruses.] [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
RE: load testing tools/services?
Hi Kelly, I have used www.opensta.org in the past. It's open source, fast, easy to use and very stable. Make sure you read the getting started guide though. Adam. -Original Message- From: Kelly Tetterton [mailto:[EMAIL PROTECTED] Sent: 01 December 2003 21:47 To: CF-Talk Subject: OT: load testing tools/services? What do people use for load testing? Ideally, we'd like to find a service that we could point to a pre-production version of a website, create several scripted scenarios, and test under various conditions. All for a low, low price, of course. Any recommendations? [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
RE: load testing tools/services?
Try jUnit, available from http://www.junit.org/index.htm. Very flexible testing package that comes for free. I use it for all my applications. M -Original Message- From: Kelly Tetterton [mailto:[EMAIL PROTECTED] Sent: Monday, December 01, 2003 4:47 PM To: CF-Talk Subject: OT: load testing tools/services? What do people use for load testing? Ideally, we'd like to find a service that we could point to a pre-production version of a website, create several scripted scenarios, and test under various conditions. All for a low, low price, of course. Any recommendations? Kelly Tetterton duo | Technical Lead One Web Company. Twice the Results. 312.224.9650 | main 312.224.9648 | direct 312.224.9651 | fax [EMAIL PROTECTED] www.duodesign.com duoDesign is a Web development and marketing firm that combines expertise in design, technology and online promotion to help businesses and organizations use the Internet marketing channel to greatest advantage. [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
Re: Load testing CFMX6.1
Thanks, Stacy. What drivers are you using, and to what database? I ask because we're running CFMX on WebSphere with Oracle drivers and have been running into some slowness issues, and lately some problems connecting to the database. thanks, Chris Norloff -- Original Message -- From: Stacy Young [EMAIL PROTECTED] Reply-To: [EMAIL PROTECTED] Date:Sun, 28 Sep 2003 22:30:16 -0400 We're prepping a cfmx cluster (cfmx on jrun4) of 2 severs to go live in the near future. I'm currently load testing break and destroy scripts on a single server to see our max capacity in the event one server goes down. I'm happy to report that @ 30 virtual users with an aggressive wait time (meaning low)...cfmx just smiles and keeps on coming. :) The application is very data intensive (reporting) so there's plenty of file i/o (outputting csv files)...loads of database work etc. The machine is also less powerful than our production boxes...and has 512 RAM. (Solaris 8) I have to say I'm very relieved. This same app used to explode on CF5. In fact, I can still browse the site with a very acceptable response time! Cheers, Stace AVIS IMPORTANT: --- Les informations contenues dans le present document et ses pieces jointes sont strictement confidentielles et reservees a l'usage de la (des) personne(s) a qui il est adresse. Si vous n'etes pas le destinataire, soyez avise que toute divulgation, distribution, copie, ou autre utilisation de ces informations est strictement prohibee. Si vous avez recu ce document par erreur, veuillez s'il vous plait communiquer immediatement avec l'expediteur et detruire ce document sans en faire de copie sous quelque forme. WARNING: --- The information contained in this document and attachments is confidential and intended only for the person(s) named above. If you are not the intended recipient you are hereby notified that any disclosure, copying, distribution, or any other use of the information is strictly prohibited. If you have received this document by mistake, please notify the sender immediately and destroy this document and attachments without making any copy of any kind. [Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]
RE: Load Testing Tools
Really? I just went to www.opensta.org and the website was fine! Kola -Original Message- From: Philipp Cielen [mailto:[EMAIL PROTECTED] Sent: 02 September 2003 19:11 To: CF-Talk Subject: RE: Load Testing Tools OpenSTA is dead - or at least their website is, obviously due to patent violations. best, philipp -- cielen.com ~| Archives: http://www.houseoffusion.com/lists.cfm?link=t:4 Subscription: http://www.houseoffusion.com/lists.cfm?link=s:4 Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4 Get the mailserver that powers this list at http://www.coolfusion.com
RE: Load Testing Tools
OpenSTA is dead - or at least their website is, obviously due to patent violations. I just went to www.opensta.org and the website was fine! I believe they were voluntarily participating in a website blackout to protest pending software patent legislation in Europe. You can click on the no ePatents image on their site for more information. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ voice: (202) 797-5496 fax: (202) 797-5444 ~| Archives: http://www.houseoffusion.com/lists.cfm?link=t:4 Subscription: http://www.houseoffusion.com/lists.cfm?link=s:4 Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4 Your ad could be here. Monies from ads go to support these lists and provide more resources for the community. http://www.fusionauthority.com/ads.cfm
Re: Load Testing Tools
eWeek reviewed dieseltest a couple issues back -- free, but Windows-only. www.dieseltest.com Regards, John Paul Ashenfelter CTO/Transitionpoint [EMAIL PROTECTED] - Original Message - From: Brandon Purcell [EMAIL PROTECTED] To: CF-Talk [EMAIL PROTECTED] Sent: Tuesday, September 02, 2003 12:23 PM Subject: Load Testing Tools Here are a few that may be helpful http://www.bpurcell.org/macromedia/loadtesting.cfm If you want something simple and inexpensive. Try Microsoft Web Application Stress tool. OpenSTA is a little more robust but a little more difficult to work with. - Brandon Purcell http://www.bpurcell.org ~| Archives: http://www.houseoffusion.com/lists.cfm?link=t:4 Subscription: http://www.houseoffusion.com/lists.cfm?link=s:4 Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4 Signup for the Fusion Authority news alert and keep up with the latest news in ColdFusion and related topics. http://www.fusionauthority.com/signup.cfm
RE: Load Testing Tools
Paessler has some nice tools : pretty cheap, great functionalities and very easy to use. Webserver Stress Tool : http://www.paessler.com/webstress You can download a trial version. Benoit Hediard www.benorama.com PS : IP Check Server monitor is also great (http://www.paessler.com/ipcheck) -Message d'origine- De : Ian Skinner [mailto:[EMAIL PROTECTED] Envoyé : mardi 2 septembre 2003 17:57 À : CF-Talk Objet : Load Testing Tools Can anybody recommend a relatively simple and hopefully inexpensive load testing tool that could be used to check a new CF built site. Preferably something that we can try before buying. Thanks. -- Ian Skinner Web Programmer BloodSource Sacramento, CA ~| Archives: http://www.houseoffusion.com/lists.cfm?link=t:4 Subscription: http://www.houseoffusion.com/lists.cfm?link=s:4 Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4 Signup for the Fusion Authority news alert and keep up with the latest news in ColdFusion and related topics. http://www.fusionauthority.com/signup.cfm
RE: Load Testing Tools
Ian, this is a reasonable tool that you can evaluate first and it is not that expensive to buy. http://www.paessler.com/index_eng.html Hth. Kind Regards - Mike Brunt Original Message --- Can anybody recommend a relatively simple and hopefully inexpensive load testing tool that could be used to check a new CF built site. Preferably something that we can try before buying. Thanks. -- Ian Skinner Web Programmer BloodSource Sacramento, CA ~| Archives: http://www.houseoffusion.com/lists.cfm?link=t:4 Subscription: http://www.houseoffusion.com/lists.cfm?link=s:4 Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4 Get the mailserver that powers this list at http://www.coolfusion.com
RE: Load Testing Tools
OpenSTA is dead - or at least their website is, obviously due to patent violations. best, philipp -- cielen.com ~| Archives: http://www.houseoffusion.com/lists.cfm?link=t:4 Subscription: http://www.houseoffusion.com/lists.cfm?link=s:4 Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4 Your ad could be here. Monies from ads go to support these lists and provide more resources for the community. http://www.fusionauthority.com/ads.cfm
Re: Load testing...
Thanks!! On 11/8/03 10:44, Andre Mohamed [EMAIL PROTECTED] wrote: Ryan, Try Google and free load testing tools. More specifically, you'll want to search for Load/Stress testing specific to web sites e.g. the following are all free: 1)Microsoft's Web Application Stress Tool http://www.microsoft.com/downloads/details.aspx?FamilyID=e2c0585a-062a-4 39e-a67d-75a89aa36495DisplayLang=en 2)Apache's JMeter http://jakarta.apache.org/jmeter 3)OpenSTA http://www.opensta.org Amongst MANY MANY MANY others. Micrsoft's tool is good to get started with if you are new to the area though somewhat limited in more advanced functionality. André -Original Message- From: Ryan Mitchell [mailto:[EMAIL PROTECTED] Sent: 11 August 2003 09:36 To: CF-Talk Subject: Load testing... Hello I want to load test one of my sites, to see what sort of traffic it can handle, to see if there are areas I need to improve etc... Am I dreaming thinking their are tools (free is good) out there to do this? Ryan ~| Archives: http://www.houseoffusion.com/cf_lists/index.cfm?forumid=4 Subscription: http://www.houseoffusion.com/cf_lists/index.cfm?method=subscribeforumid=4 FAQ: http://www.thenetprofits.co.uk/coldfusion/faq This list and all House of Fusion resources hosted by CFHosting.com. The place for dependable ColdFusion Hosting. http://www.cfhosting.com Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
RE: Load testing...
Ryan, Try Google and free load testing tools. More specifically, you'll want to search for Load/Stress testing specific to web sites e.g. the following are all free: 1)Microsoft's Web Application Stress Tool http://www.microsoft.com/downloads/details.aspx?FamilyID=e2c0585a-062a-4 39e-a67d-75a89aa36495DisplayLang=en 2)Apache's JMeter http://jakarta.apache.org/jmeter 3)OpenSTA http://www.opensta.org Amongst MANY MANY MANY others. Micrsoft's tool is good to get started with if you are new to the area though somewhat limited in more advanced functionality. André -Original Message- From: Ryan Mitchell [mailto:[EMAIL PROTECTED] Sent: 11 August 2003 09:36 To: CF-Talk Subject: Load testing... Hello I want to load test one of my sites, to see what sort of traffic it can handle, to see if there are areas I need to improve etc... Am I dreaming thinking their are tools (free is good) out there to do this? Ryan ~| Archives: http://www.houseoffusion.com/cf_lists/index.cfm?forumid=4 Subscription: http://www.houseoffusion.com/cf_lists/index.cfm?method=subscribeforumid=4 FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Signup for the Fusion Authority news alert and keep up with the latest news in ColdFusion and related topics. http://www.fusionauthority.com/signup.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
RE: Load testing
So what are the things I should look for during and after a load test? Will it be obvious once I run a test? Maybe I should ask if it will be pretty straight forward as to what I need to do. Like I said I don't have any previous experience with load testing. Well, unfortunately, load testing is far from a trivial process. There are people who do nothing but load testing, which should give you an idea of the potential complexity of the process. You can certainly learn how to do it, though, with a little work. You might find the tutorials on the OpenSTA site useful: http://www.opensta.org/ In summary, you build or write a load test script which follows a typical user's path through the site, and within the script, you provide instructions to record the timings of each step. Then, when you run the test, you look at the aggregated values of these timings to determine which pages take longer. Then, you examine those pages to see why they take longer, and whether you can do something about it. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ voice: (202) 797-5496 fax: (202) 797-5444 ~| Archives: http://www.houseoffusion.com/cf_lists/index.cfm?forumid=4 Subscription: http://www.houseoffusion.com/cf_lists/index.cfm?method=subscribeforumid=4 FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Host with the leader in ColdFusion hosting. Voted #1 ColdFusion host by CF Developers. Offering shared and dedicated hosting options. www.cfxhosting.com/default.cfm?redirect=10481 Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
RE: load testing...please don't shoot me
I may get raked over the coals for this one but.. Why? I'm looking for load testing software for an Oracle / CF 5/IIS/Win2K/ site.software names, URLs, opinionsthanks Segue SilkPerformer: http://www.segue.com/ SilkPerformer is the greatest, if you can afford it. It's very expensive. It lets you load test your web interfaces, and also your Oracle databases directly. OpenSTA: http://www.opensta.org/ OpenSTA is the nicest free product I've found. While it's not nearly as sophisticated as SilkPerformer, well, it's free, and it's good enough for much testing. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ voice: (202) 797-5496 fax: (202) 797-5444 ~| Archives: http://www.houseoffusion.com/cf_lists/index.cfm?forumid=4 Subscription: http://www.houseoffusion.com/cf_lists/index.cfm?method=subscribeforumid=4 FAQ: http://www.thenetprofits.co.uk/coldfusion/faq This list and all House of Fusion resources hosted by CFHosting.com. The place for dependable ColdFusion Hosting. Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
RE: load testing...please don't shoot me
I don't see any mention of CFFORM, Microsoft buying Macromedia or CF hosting, so I think you're in the clear there, Bryan :) Anyway, I've used WebLoad from RadView for a couple of years and it's always been very helpful in finding kinks and bottlenecks in a very large site. You can use it from a single computer or install clients on multiple computers and have them all send requests to a server to see what happens. I don't remember the cost specifically, but the single client was reasonable, though I know my company balked on the price of the distributed version due to the high cost... FYI. http://www.radview.com - Jim -Original Message- From: Bryan Stevenson [mailto:[EMAIL PROTECTED]] Sent: Thursday, February 13, 2003 3:01 PM To: CF-Talk Subject: load testing...please don't shoot me Hi All, I may get raked over the coals for this one but.. I'm looking for load testing software for an Oracle/ CF 5/IIS/Win2K/ site.software names, URLs, opinionsthanks Bryan Stevenson B.Comm. VP Director of E-Commerce Development Electric Edge Systems Group Inc. t. 250.920.8830 e. [EMAIL PROTECTED] - Macromedia Associate Partner www.macromedia.com - Vancouver Island ColdFusion Users Group Founder Director www.cfug-vancouverisland.com ~| Archives: http://www.houseoffusion.com/cf_lists/index.cfm?forumid=4 Subscription: http://www.houseoffusion.com/cf_lists/index.cfm?method=subscribeforumid=4 FAQ: http://www.thenetprofits.co.uk/coldfusion/faq This list and all House of Fusion resources hosted by CFHosting.com. The place for dependable ColdFusion Hosting. Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: load testing...please don't shoot me
Thanks Dave and Jim, yup I know the topic wasn't in the cycling threads of death list...but it's gotta be a contender ;-) Cheers Bryan Stevenson B.Comm. VP Director of E-Commerce Development Electric Edge Systems Group Inc. t. 250.920.8830 e. [EMAIL PROTECTED] - Macromedia Associate Partner www.macromedia.com - Vancouver Island ColdFusion Users Group Founder Director www.cfug-vancouverisland.com - Original Message - From: Jim Campbell [EMAIL PROTECTED] To: CF-Talk [EMAIL PROTECTED] Sent: Thursday, February 13, 2003 2:45 PM Subject: RE: load testing...please don't shoot me I don't see any mention of CFFORM, Microsoft buying Macromedia or CF hosting, so I think you're in the clear there, Bryan :) Anyway, I've used WebLoad from RadView for a couple of years and it's always been very helpful in finding kinks and bottlenecks in a very large site. You can use it from a single computer or install clients on multiple computers and have them all send requests to a server to see what happens. I don't remember the cost specifically, but the single client was reasonable, though I know my company balked on the price of the distributed version due to the high cost... FYI. http://www.radview.com - Jim -Original Message- From: Bryan Stevenson [mailto:[EMAIL PROTECTED]] Sent: Thursday, February 13, 2003 3:01 PM To: CF-Talk Subject: load testing...please don't shoot me Hi All, I may get raked over the coals for this one but.. I'm looking for load testing software for an Oracle/ CF 5/IIS/Win2K/ site.software names, URLs, opinionsthanks Bryan Stevenson B.Comm. VP Director of E-Commerce Development Electric Edge Systems Group Inc. t. 250.920.8830 e. [EMAIL PROTECTED] - Macromedia Associate Partner www.macromedia.com - Vancouver Island ColdFusion Users Group Founder Director www.cfug-vancouverisland.com ~| Archives: http://www.houseoffusion.com/cf_lists/index.cfm?forumid=4 Subscription: http://www.houseoffusion.com/cf_lists/index.cfm?method=subscribeforumid=4 FAQ: http://www.thenetprofits.co.uk/coldfusion/faq This list and all House of Fusion resources hosted by CFHosting.com. The place for dependable ColdFusion Hosting. Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
RE: load testing...please don't shoot me
Oh, also, its reporting is fantastic, you can get very detailed HTML documents or PDF's of everything and use any number of criteria in exactly *what* you're testing and what specific information you'd like back (time until first response, time between response and actual load, interstitial idle time, graphs of execution times based on x number of gradually increasing requests) - lots of goodies. - Jim -Original Message- From: Jim Campbell [mailto:[EMAIL PROTECTED]] Sent: Thursday, February 13, 2003 4:46 PM To: CF-Talk Subject: RE: load testing...please don't shoot me I don't see any mention of CFFORM, Microsoft buying Macromedia or CF hosting, so I think you're in the clear there, Bryan :) Anyway, I've used WebLoad from RadView for a couple of years and it's always been very helpful in finding kinks and bottlenecks in a very large site. You can use it from a single computer or install clients on multiple computers and have them all send requests to a server to see what happens. I don't remember the cost specifically, but the single client was reasonable, though I know my company balked on the price of the distributed version due to the high cost... FYI. http://www.radview.com - Jim -Original Message- From: Bryan Stevenson [mailto:[EMAIL PROTECTED]] Sent: Thursday, February 13, 2003 3:01 PM To: CF-Talk Subject: load testing...please don't shoot me Hi All, I may get raked over the coals for this one but.. I'm looking for load testing software for an Oracle/ CF 5/IIS/Win2K/ site.software names, URLs, opinionsthanks Bryan Stevenson B.Comm. VP Director of E-Commerce Development Electric Edge Systems Group Inc. t. 250.920.8830 e. [EMAIL PROTECTED] - Macromedia Associate Partner www.macromedia.com - Vancouver Island ColdFusion Users Group Founder Director www.cfug-vancouverisland.com ~| Archives: http://www.houseoffusion.com/cf_lists/index.cfm?forumid=4 Subscription: http://www.houseoffusion.com/cf_lists/index.cfm?method=subscribeforumid=4 FAQ: http://www.thenetprofits.co.uk/coldfusion/faq This list and all House of Fusion resources hosted by CFHosting.com. The place for dependable ColdFusion Hosting. Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: load testing...please don't shoot me
e-TEST Suite from Empirix, definitely. www.empirix.com. Respectfully, Adam Phillip Churvis Advanced Intensive ColdFusion MX Training http://www.ColdFusionTraining.com E-mail: [EMAIL PROTECTED] Phone: 770-446-8866 Team Macromedia Volunteer for ColdFusion http://www.macromedia.com/support/forums/team_macromedia/ - Original Message - From: Bryan Stevenson [EMAIL PROTECTED] To: CF-Talk [EMAIL PROTECTED] Sent: Thursday, February 13, 2003 4:01 PM Subject: load testing...please don't shoot me Hi All, I may get raked over the coals for this one but.. I'm looking for load testing software for an Oracle/ CF 5/IIS/Win2K/ site.software names, URLs, opinionsthanks Bryan Stevenson B.Comm. VP Director of E-Commerce Development Electric Edge Systems Group Inc. t. 250.920.8830 e. [EMAIL PROTECTED] - Macromedia Associate Partner www.macromedia.com - Vancouver Island ColdFusion Users Group Founder Director www.cfug-vancouverisland.com ~| Archives: http://www.houseoffusion.com/cf_lists/index.cfm?forumid=4 Subscription: http://www.houseoffusion.com/cf_lists/index.cfm?method=subscribeforumid=4 FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Your ad could be here. Monies from ads go to support these lists and provide more resources for the community. http://www.fusionauthority.com/ads.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Load Testing
For 10 users, the Microsoft tools (homer, etc) will probably be fine. Here's an ASP load testing article that's vaguely relevant http://msdn.microsoft.com/library/default.asp?url=/library/en-us/dnserv/html /server092799.asp Another option is the opensource OpenSTA tool -- I've worked w/ clients that used it and liked it. I tend more towards Empirix, but it's also mega$, so I've spent plenty of time w/ the free tools :) Regards, John Paul Ashenfelter CTO/Transitionpoint [EMAIL PROTECTED] - Original Message - From: Duane Boudreau [EMAIL PROTECTED] To: CF-Talk [EMAIL PROTECTED] Sent: Wednesday, January 22, 2003 10:48 AM Subject: Load Testing Hi All, I'm looking for some load testing suggestions to test what kind of load a site we are going to go live with soon can handle. I need to test a minimum of 10 concurrent users. Thanks. Duane ~| Archives: http://www.houseoffusion.com/cf_lists/index.cfm?forumid=4 Subscription: http://www.houseoffusion.com/cf_lists/index.cfm?method=subscribeforumid=4 FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Signup for the Fusion Authority news alert and keep up with the latest news in ColdFusion and related topics. http://www.fusionauthority.com/signup.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Load Testing
The free tools just don't have what it takes to uncover all the potential problems your site can encounter under load. There's a good reason why the big tools can command such high prices. We have a full load testing lab running Empirix e-TEST Suite and production-scale data generation tools. Designing, building, and analyzing a truly effective load test is very time intensive and therefore rather expensive. You also have to amortize the cost of the tools which, as John Paul pointed out, are very expensive. For you, Duane, I can make an exception on account of your helping me with InstallShield installer scripting way back when. :) Respectfully, Adam Phillip Churvis Advanced Intensive ColdFusion MX Training http://www.ColdFusionTraining.com E-mail: [EMAIL PROTECTED] Phone: 770-446-8866 Team Macromedia Volunteer for ColdFusion http://www.macromedia.com/support/forums/team_macromedia/ - Original Message - From: Duane Boudreau [EMAIL PROTECTED] To: CF-Talk [EMAIL PROTECTED] Sent: Wednesday, January 22, 2003 10:48 AM Subject: Load Testing Hi All, I'm looking for some load testing suggestions to test what kind of load a site we are going to go live with soon can handle. I need to test a minimum of 10 concurrent users. Thanks. Duane ~| Archives: http://www.houseoffusion.com/cf_lists/index.cfm?forumid=4 Subscription: http://www.houseoffusion.com/cf_lists/index.cfm?method=subscribeforumid=4 FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Get the mailserver that powers this list at http://www.coolfusion.com Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
RE: Load Testing
The free tools just don't have what it takes to uncover all the potential problems your site can encounter under load. There's a good reason why the big tools can command such high prices. As someone who's used tools at both extremes - Segue SilkPerformer on the high end, OpenSTA on the low end - I'd disagree with this a little bit. In my opinion, the problem with the free tools isn't necessarily that they don't have what it takes, just that they aren't nearly as easy to use, so you have to spend a lot more time learning how to get useful data from them. At this point, I feel comfortable using OpenSTA for most testing needs, although I'd certainly prefer an unlimited SilkPerformer 5 user license! Designing, building, and analyzing a truly effective load test is very time intensive and therefore rather expensive. This is certainly the truth, even with the most accessible tools out there. There's often a large logistical burden in doing these tests - if you can't test in a preconfigured lab environment, there's the considerable work of setting up a test network. There are different sorts of load tests, with different goals - performance tuning tests vs capacity planning tests. A capacity planning test for a large, complex public site might be a month's worth of work or more! Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ voice: (202) 797-5496 fax: (202) 797-5444 ~| Archives: http://www.houseoffusion.com/cf_lists/index.cfm?forumid=4 Subscription: http://www.houseoffusion.com/cf_lists/index.cfm?method=subscribeforumid=4 FAQ: http://www.thenetprofits.co.uk/coldfusion/faq This list and all House of Fusion resources hosted by CFHosting.com. The place for dependable ColdFusion Hosting. Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Load Testing
- Original Message - From: Dave Watts [EMAIL PROTECTED] The free tools just don't have what it takes to uncover all the potential problems your site can encounter under load. There's a good reason why the big tools can command such high prices. As someone who's used tools at both extremes - Segue SilkPerformer on the high end, OpenSTA on the low end - I'd disagree with this a little bit. In my opinion, the problem with the free tools isn't necessarily that they don't have what it takes, just that they aren't nearly as easy to use, so you have to spend a lot more time learning how to get useful data from them. I agree with the reason why you disagree! :) This is actually the main reason why I say the free ones don't hack it. It's just like the difference between doing What If scenarios on paper versus with Excel: Recalculating a business scenario on paper might take three hours, but in Excel the same recalculation would take a couple of seconds. This reason alone creates a completely different quality of results: rigorously refined versus This is the best I could come up with on paper in fifteen hours. Creating, testing, and refining a load test using e-TEST Suite lets you try dozens of refinements in just a couple of hours, whereas the freebies are not nearly as automated. This lack of automation alone will prevent the finished tests from having a level of analytical quality worth the dollars spent on creating them. A capacity planning test for a large, complex public site might be a month's worth of work or more! You ain't kiddin'. This is really hard to get across to clients who don't have experience with the nature of load testing. Most of them have the pre-conceived notion that we can find out everything we need in one day. I wish! Respectfully, Adam Phillip Churvis Advanced Intensive ColdFusion MX Training http://www.ColdFusionTraining.com E-mail: [EMAIL PROTECTED] Phone: 770-446-8866 Team Macromedia Volunteer for ColdFusion http://www.macromedia.com/support/forums/team_macromedia/ ~| Archives: http://www.houseoffusion.com/cf_lists/index.cfm?forumid=4 Subscription: http://www.houseoffusion.com/cf_lists/index.cfm?method=subscribeforumid=4 FAQ: http://www.thenetprofits.co.uk/coldfusion/faq This list and all House of Fusion resources hosted by CFHosting.com. The place for dependable ColdFusion Hosting. Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Load Testing
Creating, testing, and refining a load test using e-TEST Suite lets you try dozens of refinements in just a couple of hours, whereas the freebies are not nearly as automated. This lack of automation alone will prevent the finished tests from having a level of analytical quality worth the dollars spent on creating them. I hit Send too quickly! This lack of automation refers to free load testing tools, not e-TEST Suite, which is so automated that it says Bless you when I sneeze. :) Respectfully, Adam Phillip Churvis Advanced Intensive ColdFusion MX Training http://www.ColdFusionTraining.com E-mail: [EMAIL PROTECTED] Phone: 770-446-8866 Team Macromedia Volunteer for ColdFusion http://www.macromedia.com/support/forums/team_macromedia/ ~| Archives: http://www.houseoffusion.com/cf_lists/index.cfm?forumid=4 Subscription: http://www.houseoffusion.com/cf_lists/index.cfm?method=subscribeforumid=4 FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Your ad could be here. Monies from ads go to support these lists and provide more resources for the community. http://www.fusionauthority.com/ads.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Load Testing
Plus for the these cost, you get things like good probes of the app server, the database server, etc. And an easy way to generate reports. I've used eTest a bit in a previous set of gigs and love it. OpenSTA is ok, but the commercial arm of those folks sells the db probes and other useful bits. Still less than $15-30k, but not free! But original question was for a 10 concurrent user site. MS Homer is probably fine for that -- or openSTA. Neither's been a problem generating that many simultaneous threads, at least for me and distributed across a couple machines. Regards, John Paul Ashenfelter CTO/Transitionpoint [EMAIL PROTECTED] - Original Message - From: Adam Churvis [EMAIL PROTECTED] To: CF-Talk [EMAIL PROTECTED] Sent: Wednesday, January 22, 2003 4:49 PM Subject: Re: Load Testing - Original Message - From: Dave Watts [EMAIL PROTECTED] The free tools just don't have what it takes to uncover all the potential problems your site can encounter under load. There's a good reason why the big tools can command such high prices. As someone who's used tools at both extremes - Segue SilkPerformer on the high end, OpenSTA on the low end - I'd disagree with this a little bit. In my opinion, the problem with the free tools isn't necessarily that they don't have what it takes, just that they aren't nearly as easy to use, so you have to spend a lot more time learning how to get useful data from them. I agree with the reason why you disagree! :) This is actually the main reason why I say the free ones don't hack it. It's just like the difference between doing What If scenarios on paper versus with Excel: Recalculating a business scenario on paper might take three hours, but in Excel the same recalculation would take a couple of seconds. This reason alone creates a completely different quality of results: rigorously refined versus This is the best I could come up with on paper in fifteen hours. Creating, testing, and refining a load test using e-TEST Suite lets you try dozens of refinements in just a couple of hours, whereas the freebies are not nearly as automated. This lack of automation alone will prevent the finished tests from having a level of analytical quality worth the dollars spent on creating them. A capacity planning test for a large, complex public site might be a month's worth of work or more! You ain't kiddin'. This is really hard to get across to clients who don't have experience with the nature of load testing. Most of them have the pre-conceived notion that we can find out everything we need in one day. I wish! Respectfully, Adam Phillip Churvis Advanced Intensive ColdFusion MX Training http://www.ColdFusionTraining.com E-mail: [EMAIL PROTECTED] Phone: 770-446-8866 Team Macromedia Volunteer for ColdFusion http://www.macromedia.com/support/forums/team_macromedia/ ~| Archives: http://www.houseoffusion.com/cf_lists/index.cfm?forumid=4 Subscription: http://www.houseoffusion.com/cf_lists/index.cfm?method=subscribeforumid=4 FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Get the mailserver that powers this list at http://www.coolfusion.com Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Load Testing
Try http://www.websitegarage.com I haven't used it in alooong while so I am not sure how reliable they are (looks like they are with Yahoo now). Paul Giesenhagen QuillDesign http://www.quilldesign.com SiteDirector - Commerce Builder Anyone out there know of a web site where you can enter your URL and get stats on page load and size etc? I used to know one - but I've forgotten it. Also, does anyone have a recommendation for a -FREE- load tester (hopefully something you have used yourself). Thanks. __ Why Share? Dedicated Win 2000 Server · PIII 800 / 256 MB RAM / 40 GB HD / 20 GB MO/XFER Instant Activation · $99/Month · Free Setup http://www.pennyhost.com/redirect.cfm?adcode=coldfusionc FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: Load Testing
I have found OpenSTA to work quite well, it provides graphs, etc, and it's free. It's a little bit tricky the first time you use it, but after that its very easy to use. http://www.opensta.org/ + Pete Freitag ([EMAIL PROTECTED]) CTO, CFDEV.COM ColdFusion Developer Resources http://www.cfdev.com/ -Original Message- From: Mark A. Kruger - CFG [mailto:[EMAIL PROTECTED]] Sent: Tuesday, February 05, 2002 6:31 PM To: CF-Talk Subject: OT: Load Testing Anyone out there know of a web site where you can enter your URL and get stats on page load and size etc? I used to know one - but I've forgotten it. Also, does anyone have a recommendation for a -FREE- load tester (hopefully something you have used yourself). Thanks. __ Get Your Own Dedicated Windows 2000 Server PIII 800 / 256 MB RAM / 40 GB HD / 20 GB MO/XFER Instant Activation · $99/Month · Free Setup http://www.pennyhost.com/redirect.cfm?adcode=coldfusionb FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: Load testing CF
In typical Microsoft fashion, they have a free tool for performing Web App Stress Tests. I haven't used it yet... http://webtool.rte.microsoft.com -Original Message- From: Tom Dyson [mailto:[EMAIL PROTECTED]] Sent: Tuesday, October 31, 2000 1:09 AM To: CF-Talk Subject: Load testing CF Hi there Do any of you have experience of load-testing software for your CF apps? We want to simulate 100 simultaneous users for a large intranet app. We don't want to spend too much... Thanks Tom Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists or send a message with 'unsubscribe' in the body to [EMAIL PROTECTED] Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists or send a message with 'unsubscribe' in the body to [EMAIL PROTECTED]
Re: Load testing CF
At 10:08 AM 10/31/00 +0100, you wrote: Hi there Do any of you have experience of load-testing software for your CF apps? We want to simulate 100 simultaneous users for a large intranet app. We don't want to spend too much... Tom- RSW software (http://www.rswsoftware.com/) offers a good testing suite (e-tester, e-monitor, e-load, etc). I used it on many different sites, including CFVault.com and it saved me a lot of trouble. It gives you a whole new perspective on why you should lock your variables, cache your queries, use store procedures, etc. I hope this helps. Regards, Stephan Tual Editor Webmaster CFVault.com http://www.cfvault.com Daily News Updates, Jobs, Forums, Events, and in-depth Tutorials from the Allaire World. Direct Line: CFTutorials.com Ltd. +(1) 415 637 5591 Team Allaire Member Allaire Certified Trainer Allaire Certified CF Developer Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists or send a message with 'unsubscribe' in the body to [EMAIL PROTECTED]
Re: Load Testing Softwares
For Load and redundancy testing we use Segue Silk Line of Products. I think they have some sort of cross selling deal with Allaire. I think based on their client list and history in the market (Pre-CF) they are the long term solution and therefore valid to pick up. http://www.segue.com/html/s_news/press_releases/s_allaire.htm http://www.segue.com/ http://www.wirelessdevnet.com/news/2000/193/news2.html -Brian - Original Message - From: Bob Smith [EMAIL PROTECTED] To: CF-Talk [EMAIL PROTECTED] Sent: Tuesday, October 24, 2000 12:42 PM Subject: Load Testing Softwares We are evaluating various load testing softwares for our applications. Does any one have a recommendation/ list of load testing softwares with estimated prices for this purpose? Any help will be greatly appreciated. We are currently looking towards e-test suite from RSW Software. I am aware of SilkPerformer and Load Runner but do not prices/features of the software. Our budget is around $10,000/- Thanks, Bob Get free email and a permanent address at http://www.amexmail.com/?A=1 Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=sts or send a message with 'unsubscribe' in the body to [EMAIL PROTECTED] Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists or send a message with 'unsubscribe' in the body to [EMAIL PROTECTED]
Re: Load Testing Softwares
LoadRunner is in the 50K+ range. However, the features are phenomenal based a day long product demo .In the end, it wasn't worth it., which roughly translates to: the price was too high. my $0.02. Greg Bob Smith [EMAIL PROTECTED]To: CF-Talk [EMAIL PROTECTED] et cc: Subject: Load Testing Softwares 10/24/00 01:42 PM Please respond to cf-talk We are evaluating various load testing softwares for our applications. Does any one have a recommendation/ list of load testing softwares with estimated prices for this purpose? Any help will be greatly appreciated. We are currently looking towards e-test suite from RSW Software. I am aware of SilkPerformer and Load Runner but do not prices/features of the software. Our budget is around $10,000/- Thanks, Bob Get free email and a permanent address at http://www.amexmail.com/?A=1 Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists or send a message with 'unsubscribe' in the body to [EMAIL PROTECTED] Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists or send a message with 'unsubscribe' in the body to [EMAIL PROTECTED]
RE: Load Testing Softwares
SilkPerformer is 14K+ when they have specials. Looks buggy in Win2K. Doug (from autobytel) and Joe Hoffman wrote this in the list before Microsoft has a Load Generator on their site you can download to create a lot of traffic for your web server to determine how much load it can handle. http://support.microsoft.com/support/kb/articles/Q231/2/82.ASP and http://webtool.rte.microsoft.com/ "Microsoft Web Application Stress is a simulation tool that is designed to realistically reproduce multiple browsers requesting pages from a web application. It was developed by web testers. We have made the tool as easy to use as possible by masking some of the complexities of web server testing. This makes the tool desirable for anyone interested in gathering performance data on their web site." I tried the MS one, and although you could wish for a better UI, you cannot beat the price (free.) - Jaime -Original Message- From: Bob Smith [mailto:[EMAIL PROTECTED]] Sent: Tuesday, October 24, 2000 11:43 AM To: CF-Talk Subject: Load Testing Softwares We are evaluating various load testing softwares for our applications. Does any one have a recommendation/ list of load testing softwares with estimated prices for this purpose? Any help will be greatly appreciated. We are currently looking towards e-test suite from RSW Software. I am aware of SilkPerformer and Load Runner but do not prices/features of the software. Our budget is around $10,000/- Thanks, Bob Get free email and a permanent address at http://www.amexmail.com/?A=1 -- -- Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists or send a message with 'unsubscribe' in the body to [EMAIL PROTECTED] Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists or send a message with 'unsubscribe' in the body to [EMAIL PROTECTED]
RE: Load Testing
http://webtool.rte.microsoft.com a) reasonable cost It's free b) easy to learn Not too hard c) script based Yup. More or less. I have used it only a little bit, and haven't really pushed it to see if it does everything it promises, but it's docs say that it does tons of very cool things, including importing IIS scripts to automatically generate scripts for testing. It also is capable (again according to the docs) of being installed on several machines and centrally controlled for a coordinated attack on a webserver. If anyone has used this and has feedback on promises vs actual functionality, I'd be very interested in hearing about it. -Cameron Cameron Childress McRae Communications p. 770-460-7277 x.232 f. 770-460-0963 -Original Message- From: Duane Boudreau [mailto:[EMAIL PROTECTED]] Sent: Tuesday, August 01, 2000 5:11 PM To: CFTalk Subject: Load Testing Hi All, Does anyone know of a good load testing application that is: a) reasonable cost b) easy to learn c) script based Thanks, Duane Boudreau, eMPower Project Manager Director, Web Technologies Ektron, Inc. http://www.ektron.com 5 Northern Blvd, Suite 6 Amherst, NH 03031 Tel: 603-594-0249 x114 Fax: 603-594-0258 -- Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ To Unsubscribe visit http://www.houseoffusion.com/index.cfm?sidebar=listsbody=lists/cf _talk or send a message to [EMAIL PROTECTED] with 'unsubscribe' in the body. -- Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ To Unsubscribe visit http://www.houseoffusion.com/index.cfm?sidebar=listsbody=lists/cf_talk or send a message to [EMAIL PROTECTED] with 'unsubscribe' in the body.
RE: Load Testing
We found a few that cost major cash -- I think the cheap one Dave mentioned a while back was $30k. We use Microsoft's tool (W.A.S.), which is okay, but suited to ASP. I hacked a tag together "URL2Form" tag which copies all URL vars to the FORM scope since WAS doesn't seem to like posting FORM vars. Now it works fine -- I'll post the tag if anyone wants it... WAS also does multiple client computers coordinated by a master for testing, no limitation on the numbers of threads or users, supports database (but it must be access '97) and will read in any kind of delimeted file as test data for posting, and works with SSL. It doesn't, however, give times on loading dynamic images -- it just gets the html for a page, and any images that you explicitly specify. They also have responded to emails... The others were somewhat better in some ways, but not THAT much better. We didn't try Segue... Matt Below is the original message from Dave Watts: - Anyone have any urls for stress testing software, free and paid alike? Segue SilkPerformer: http://www.segue.com/ This is the tool that we use at Fig Leaf. It's very expensive, but powerful, easy to use, with good reporting capability and a good scripting language based on Pascal. RSW E-Load: http://www.rswsoftware.com/ We've evaluated this one, and it's pretty nice. It's significantly cheaper than SilkPerformer, but I didn't like its scripting and reporting as much. Mercury LoadRunner: http://www.merc-int.com/ I don't remember too much about the Mercury toolset, although I think they've changed it significantly since I last looked. Benchmark Factory: http://www.benchmarkfactory.com/ I haven't used this at all, so can't say much about it. It's the only one in the bunch that you can use for testing SMB file services, I think. Microsoft Web Application Stress Tool (free!): http://homer.rte.microsoft.com/ This one requires that you do more work than the others do, but it's free, and did I mention that it's free? Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ voice: (202) 797-5496 fax: (202) 797-5444 -- Archives: http://www.eGroups.com/list/cf-talk To Unsubscribe visit http://www.houseoffusion.com/index.cfm?sidebar=listsbody=lists/cf_talk or send a message to [EMAIL PROTECTED] with 'unsubscribe' in the body. -Original Message- From: Duane Boudreau [mailto:[EMAIL PROTECTED]] Sent: Tuesday, August 01, 2000 4:11 PM To: CFTalk Subject: Load Testing Hi All, Does anyone know of a good load testing application that is: a) reasonable cost b) easy to learn c) script based Thanks, Duane Boudreau, eMPower Project Manager Director, Web Technologies Ektron, Inc. http://www.ektron.com 5 Northern Blvd, Suite 6 Amherst, NH 03031 Tel: 603-594-0249 x114 Fax: 603-594-0258 -- Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ To Unsubscribe visit http://www.houseoffusion.com/index.cfm?sidebar=listsbody=lists/cf _talk or send a message to [EMAIL PROTECTED] with 'unsubscribe' in the body. -- Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ To Unsubscribe visit http://www.houseoffusion.com/index.cfm?sidebar=listsbody=lists/cf_talk or send a message to [EMAIL PROTECTED] with 'unsubscribe' in the body.
Re: Load Testing
Unless you are planning on going into the load testing business, hire an expert. The software costs a fortune and takes a ton of training. I am speaking specifically about SilkPerformer, but I think that it applies pretty much across the board. In the local talent department, I think that Figleaf and Allaire do load testing. Cary At 02:07 PM 4/3/00 -0400, you wrote: Can anyone recommend, tell experience with etc, load testing software such as RSW E-suite, Segue SilkPerformer, and Mercury's LoadTest? ___ Scott Rowe [EMAIL PROTECTED] Webmaster 212.208.0644 Fenics Software www.fenics.com ___ -- Archives: http://www.eGroups.com/list/cf-talk To Unsubscribe visit http://www.houseoffusion.com/index.cfm?sidebar=listsbody=lists/cf_talk or send a message to [EMAIL PROTECTED] with 'unsubscribe' in the body.
RE: Load Testing
... I agree that Silk Performer is a good tool. It just felt a bit clunky to use compared to RSW E-Suite's interface and I wanted to see if anyone had any other opinions about the other tools out there. I'd love a feature breakdown between the two but can't seem to find one anywhere. Like you said, it's a lotta money so I want to make sure about this one. You'll want to actually evaluate them both. RSW is pretty good about setting up eval copies, generally. I agree that RSW's interface is simpler, but it's more limiting; you don't have nearly as good a scripting environment. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ voice: (202) 797-5496 fax: (202) 797-5444 -- Archives: http://www.eGroups.com/list/cf-talk To Unsubscribe visit http://www.houseoffusion.com/index.cfm?sidebar=listsbody=lists/cf_talk or send a message to [EMAIL PROTECTED] with 'unsubscribe' in the body.
RE: Load Testing
a few weeks ago, i took the Allaire Performance Tuning course (taught by the estimable Dave Watts...:). i must say, i was heartily impressed with the quality of Segue's tool. my boss ordered it, (in fact, just called me to say it's here). it pretty much does EVERYTHING except making coffee for you while the test runs. apart from some minor language issues (it was written by some non-native english speakers, and there are a few quirky bits in the docs/help), it's an EXCELLENT tool. of course, don't use just my work. it IS almost 20K for the package itself (nevermind the "real simulated users" that you have to purchase/rent). Chris Olive DOHRS Website Administrator [EMAIL PROTECTED] -Original Message- From: Scott Rowe [mailto:[EMAIL PROTECTED]] Sent: Monday, April 03, 2000 2:08 PM To: CF-Talk Subject: Load Testing Can anyone recommend, tell experience with etc, load testing software such as RSW E-suite, Segue SilkPerformer, and Mercury's LoadTest? ___ Scott Rowe [EMAIL PROTECTED] Webmaster 212.208.0644 Fenics Software www.fenics.com ___ -- Archives: http://www.eGroups.com/list/cf-talk To Unsubscribe visit http://www.houseoffusion.com/index.cfm?sidebar=listsbody=lists/cf_talk or send a message to [EMAIL PROTECTED] with 'unsubscribe' in the body. -- Archives: http://www.eGroups.com/list/cf-talk To Unsubscribe visit http://www.houseoffusion.com/index.cfm?sidebar=listsbody=lists/cf_talk or send a message to [EMAIL PROTECTED] with 'unsubscribe' in the body.
RE: Load Testing
Dave Watts is your man for that. I have some experience with SilkPerformer ... I twisted enough necks to get a copy ($$$) but, haven't done anything really in-depth with it yet. RSW is supposed to be sending me a couple copies of E-Test but, the rep promised that early last week so I haven't seen product yet. SilkPerformer is a great tool and I highly recommend it, especially for advanced needs, but, it is pricey. Of course, you can test everything from Internet protocols and databases to CORBA and APIs. Though it's not mandatory I suggest a relatively hefty box for the controller if you plan on doing intensive tests. If you don't need your own copy, Allaire, Fig Leaf, and several other companies offer load/performance testing consulting with these same tools. But hey, you work for a multi-national development company so what's a hundred grand here or there, right? :) Steve -Original Message- From: Scott Rowe [mailto:[EMAIL PROTECTED]] Sent: Monday, April 03, 2000 2:08 PM To: CF-Talk Subject: Load Testing Can anyone recommend, tell experience with etc, load testing software such as RSW E-suite, Segue SilkPerformer, and Mercury's LoadTest? ___ Scott Rowe [EMAIL PROTECTED] Webmaster 212.208.0644 Fenics Software www.fenics.com ___ -- Archives: http://www.eGroups.com/list/cf-talk To Unsubscribe visit http://www.houseoffusion.com/index.cfm?sidebar=listsbody=lists/cf_talk or send a message to [EMAIL PROTECTED] with 'unsubscribe' in the body.
