On 23 March 2010 17:23, Graham Dumpleton <[email protected]> wrote: > For whatever reason I often have lots of problems with doing benchmark > testing on MacOS X. There are some known issues with MacOS X and > Apache, so possibly I am always hitting that when trying to stress > test stuff. > > As such, wandering if any eager people out there who would like to run > some tests for me on a non MacOS X platform which may give more > repeatable results. UNIX systems preferred as Windows is usually worse > than MacOS X for predictability. > > All I need for the test is a comparative set of 'ab' output for a few > different mod_wsgi configurations. The intent here is to compare the > different configurations so consistency of results is more important > than outright speed. > > Note that you MUST being using latest mod_wsgi from subversion trunk > to do this test. > > The hello world program should be that as detailed on: > > http://code.google.com/p/modwsgi/wiki/QuickConfigurationGuide > > Call the file 'hello.wsgi' and stick it in '/some/directory'. > > The first configuration is: > > Alias / /some/directory/ > > <Directory /some/directory> > AddHandler wsgi-script .wsgi
Whoops, missed: Options ExecCGI Graham > Order Deny,Allow > Allow from All > </Directory> > > The second configuration is: > > WSGIScriptAlias / /some/directory/hello.wsgi > > <Directory /some/directory> > Order Deny,Allow > Allow from All > </Directory> > > The third configuration is: > > WSGIQuickHandlerScript /some/directory/hello.wsgi > > In all cases use URL on the site as '/hello.wsgi'. > > Am happy with a test such as: > > ab -n 10000 http://localhost/hello.wsgi > > The more requests the merrier. Anything below 5000 isn't particularly > useful as too variable with respect to Apache start up costs. > > If you want to try different levels of concurrency or try different > tools, that is your call. > > Average results from some number of runs if that makes you feel > happier that getting good results. > > If using 'ab', always keep an eye on the section: > > Connection Times (ms) > min mean[+/-sd] median max > Connect: 0 0 0.1 0 6 > Processing: 0 0 0.2 0 7 > Waiting: 0 0 0.2 0 7 > Total: 0 0 0.2 0 7 > > From one run to the next, you want to get similar results for that > 'max' column and discard anything that shows some out of the ordinary > happened. For example, crap like I get on MacOS X such as: > > Connection Times (ms) > min mean[+/-sd] median max > Connect: 0 2 126.6 0 6935 > Processing: 0 0 0.3 0 10 > Waiting: 0 0 0.3 0 10 > Total: 0 3 126.6 0 6936 > > Not sure if the DNS here simply sucks or what the issue is. :-( > > Thanks in advance. > > Will explain what this is about when I see some results and know if it > makes much difference or not. > > Graham > -- You received this message because you are subscribed to the Google Groups "modwsgi" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/modwsgi?hl=en.
