this one has confidance intervals, https://github.com/bestiejs/benchmark.js
which is what you need to detect the likehood that one run really did improve on another or if it was just a fluke. On Wed, Aug 22, 2012 at 6:34 PM, Alan Gutierrez <a...@prettyrobots.com> wrote: > On Wed, Aug 22, 2012 at 05:19:31PM +0200, Dominic Tarr wrote: >> On Wed, Aug 22, 2012 at 5:18 PM, Dominic Tarr <dominic.t...@gmail.com> wrote: >> > the best and worst run may be the most important runs. the worst run >> > in particular. >> > you may have code that usually runs well, but might have bad worst >> > case performance. >> > >> > depending on how your code is used, the biggest improvement may come >> > from improving the worst-case performance. > >> you need to use some statistics, and measure your mean, and >> std-deviation, in the least. > > Erm. So, can I do this with `node-bench` easily, or have I just signed > up for creating a benchmarking framework? Is the ease of use jsperf.com > misleading? > > Ideally, I'd like a report that says, all things being equal, a is > faster than b. I can reason about whether all things will always be > equal separately. > > -- > Alan Gutierrez - http://twitter.com/bigeasy > > -- > Job Board: http://jobs.nodejs.org/ > Posting guidelines: > https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines > You received this message because you are subscribed to the Google > Groups "nodejs" group. > To post to this group, send email to nodejs@googlegroups.com > To unsubscribe from this group, send email to > nodejs+unsubscr...@googlegroups.com > For more options, visit this group at > http://groups.google.com/group/nodejs?hl=en?hl=en -- Job Board: http://jobs.nodejs.org/ Posting guidelines: https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines You received this message because you are subscribed to the Google Groups "nodejs" group. To post to this group, send email to nodejs@googlegroups.com To unsubscribe from this group, send email to nodejs+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/nodejs?hl=en?hl=en
