> Ultimately a standard test suite like the one so helpfully > published in this thread would benchmark the baseline config, then the transcoding > config, as this one did. But for each of the combinations of the > various codecs. Then a benchmark adding each of various options, like > conferencing, recording, etc. That grid would be repeated on each of > directly comparable HW configs, like a single CPU with single core at > x-GHz, multiple of those CPUs, the same benchmarks repeated for > single/multiple multicore CPUs, each at increasing GHz.
This is very similar to the idea that Blitzrage and I discussed at Astricon Dallas. We talked about using SIPP to create a standard benchmark and testing methodology for performance metrics to create a system for classifying the performance of various hardware. We ALSO discussed the creation of a standard set of regression tests (using SIPP) to run Asterisk release candidates against and tracking the historical performance between releases. A combination of standard Dial Plan logic + SIPP scenarios could be used to test all sorts of different aspects of Asterisk. In my opinion, something like this should optimally be done by, or in close cooperation with Digium to ensure consistency, but it should also be peer-reviewed and guided by the community. Such an effort would provide a lot of valuable information for developers as to what may have changed between releases, as well as where Asterisk needs to be improved. _______________________________________________ --Bandwidth and Colocation Provided by http://www.api-digital.com-- asterisk-biz mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo/asterisk-biz