For whatever reason I often have lots of problems with doing benchmark testing on MacOS X. There are some known issues with MacOS X and Apache, so possibly I am always hitting that when trying to stress test stuff.
As such, wandering if any eager people out there who would like to run some tests for me on a non MacOS X platform which may give more repeatable results. UNIX systems preferred as Windows is usually worse than MacOS X for predictability. All I need for the test is a comparative set of 'ab' output for a few different mod_wsgi configurations. The intent here is to compare the different configurations so consistency of results is more important than outright speed. Note that you MUST being using latest mod_wsgi from subversion trunk to do this test. The hello world program should be that as detailed on: http://code.google.com/p/modwsgi/wiki/QuickConfigurationGuide Call the file 'hello.wsgi' and stick it in '/some/directory'. The first configuration is: Alias / /some/directory/ <Directory /some/directory> AddHandler wsgi-script .wsgi Order Deny,Allow Allow from All </Directory> The second configuration is: WSGIScriptAlias / /some/directory/hello.wsgi <Directory /some/directory> Order Deny,Allow Allow from All </Directory> The third configuration is: WSGIQuickHandlerScript /some/directory/hello.wsgi In all cases use URL on the site as '/hello.wsgi'. Am happy with a test such as: ab -n 10000 http://localhost/hello.wsgi The more requests the merrier. Anything below 5000 isn't particularly useful as too variable with respect to Apache start up costs. If you want to try different levels of concurrency or try different tools, that is your call. Average results from some number of runs if that makes you feel happier that getting good results. If using 'ab', always keep an eye on the section: Connection Times (ms) min mean[+/-sd] median max Connect: 0 0 0.1 0 6 Processing: 0 0 0.2 0 7 Waiting: 0 0 0.2 0 7 Total: 0 0 0.2 0 7 >From one run to the next, you want to get similar results for that 'max' column and discard anything that shows some out of the ordinary happened. For example, crap like I get on MacOS X such as: Connection Times (ms) min mean[+/-sd] median max Connect: 0 2 126.6 0 6935 Processing: 0 0 0.3 0 10 Waiting: 0 0 0.3 0 10 Total: 0 3 126.6 0 6936 Not sure if the DNS here simply sucks or what the issue is. :-( Thanks in advance. Will explain what this is about when I see some results and know if it makes much difference or not. Graham -- You received this message because you are subscribed to the Google Groups "modwsgi" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/modwsgi?hl=en.
