Thanks, Michael! Yes, I've already talked to Eli about this and we are going to add a 'compare' command to raptor core. I'll be working on this during the coming weeks. I still wanted to post about my raptor-compare here since it's already available and works quite well. I hope that it can already be useful for developers working on new patches and interested in testing the performance.
-stas On Wed, Oct 14, 2015 at 11:26 AM, Michael Henretty <[email protected]> wrote: > Very cool Staś! This seems pretty useful, ever consider adding it to > raptor core? > > On Mon, Oct 12, 2015 at 9:28 PM, Eli Perelman <[email protected]> > wrote: > >> Well done, glad to see some more tooling built around Raptor data! >> >> Eli Perelman >> >> On Mon, Oct 12, 2015 at 2:10 PM, Staś Małolepszy <[email protected]> >> wrote: >> >>> Hello, People of Gaia -- >>> >>> I love Raptor and how it makes it us more data-driven than ever. So I >>> created a tool to aid the data analysis and help you decide if a difference >>> observed between two or more Raptor dataset is significant, given the >>> observed variations in data. >>> >>> https://github.com/stasm/raptor-compare >>> >>> It's really easy to use: Raptor automatically saves raw measurements in >>> a metrics.ldjson file which you can feed into raptor-compare. It will >>> compute the means and the standard deviations and use that data to help you >>> gauge if the observed difference is "real", or perhaps just an artifact of >>> the random sampling. >>> >>> You can find more information in the project's readme. Let me know if >>> you have any questions! >>> >>> Happy perf testing, >>> -stas >>> >>> >>> PS If you like the tool, help me spread the word: >>> https://twitter.com/stas/status/653630744850468864 >>> >>> _______________________________________________ >>> dev-fxos mailing list >>> [email protected] >>> https://lists.mozilla.org/listinfo/dev-fxos >>> >>> >> >> _______________________________________________ >> dev-fxos mailing list >> [email protected] >> https://lists.mozilla.org/listinfo/dev-fxos >> >> >
_______________________________________________ dev-fxos mailing list [email protected] https://lists.mozilla.org/listinfo/dev-fxos
