On 25/03/2010 07:01, Jason Brittain wrote: > Very entertaining reading! Thanks Chris and Mark for re-benchmarking, > explaining, and giving your opinions on the results. I'm not entirely sure > how I missed Chris' benchmark results email, almost exactly one year ago > now. Chris: there are no units on your results numbers, and I'm not seeing > any procedure you used, nor any configurations you used, so I'm not sure how > to interpret the numbers. It would be great to get more information about > how the benchmark was conducted, which HTTP client was used, and what server > hardware was used.
Chris's original thread had most, if not all, of that info. I did have a reference to that in the blog post but it looks like it got garbled somewhere in the publishing process. I'll get that fixed. In the meantime, MarkMail should be able to find it. > I tried to write my benchmark such that it is fully documented and > repeatable all the way down to the configuration used on both the client and > the server, etc. I also wanted to be completely clear and up front about > the specific scenarios I was benchmarking -- there are many more that I > wasn't -- so I wrote the explanations into the text as well. The results > are, of course, only about the kinds of requests we're benchmarking, and > also about the configuration(s) used. I did try to think up and benchmark > the most likely use cases for serving typical webapp content, but anyone can > say their webapp isn't like that. :) Indeed. Benchmarks are useful guides to general trends but nothing is going beat benchmarking your own web application with realistic usage patterns. > Plus, I tried to write my benchmark > to both inspire others to conduct and publish more benchmarks, and also to > show a detailed example of one that others could modify and re-use. I was > hoping to see more published benchmarks by now, but each one I find is > really entertaining. I think the time it takes to do a really good benchmark is a significant barrier. I wanted to do a new benchmark for the blog post but just didn't have the time. It is on the todo list but things like Tomcat 7 and bug fixes keep getting in the way :) Mark --------------------------------------------------------------------- To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org For additional commands, e-mail: users-h...@tomcat.apache.org
