> It would be great to have comparisons where MSE is enabled in its default > configuration and where MSE is disabled.
I assume we could have done this but we decided to keep this as simple as possible due to time/resource constraints and to remove any invariabilities in developing a baseline. ----- Original Message ----- From: "Brian Smith" <[email protected]> To: "Taras Glek" <[email protected]> Cc: "Johnny Stenback" <[email protected]>, "Boris Zbarsky" <[email protected]>, "Lawrence Mandel" <[email protected]>, "Anthony Hughes" <[email protected]>, [email protected] Sent: Tuesday, January 17, 2012 4:43:09 PM Subject: Re: cache effectiveness testing Taras Glek wrote: > On 1/17/2012 2:55 PM, Taras Glek wrote: > >> The testplan is described at > >> https://wiki.mozilla.org/Performance/Snappy/Testing:BFCache_Sprint#Reference_Test_Case Thank you for this. I would suggest the following changes to the test methodology for future tests: 1. Document how the disk cache is cleared. 2. Have the user clear the disk cache and then reboot the machine and then run the test. 3. Document which anti-virus is installed and what it's configuration is. In particular, is it set to scan when files are written? (I think that the baseline should be Microsoft Security Essentials in its default configuration, which should have such scanning enabled by default.) 4. Reboot between switches in browsers. (maybe not too important) 5. Add Chrome and/or IE. It would be great to have comparisons where MSE is enabled in its default configuration and where MSE is disabled. > > No-disk-cache followup appears to confirm that writing cache > > absolutely annihilates pageload perf. > > > > http://people.mozilla.com/~tglek/snappy/cache2.html Are the "Firefox, no-cache" numbers comparable to the first column (Run 1, Firefox) or the third column (Run 2, Firefox)? That is, were the "no-cache" numbers generated with an empty cache or with the cache in the state it would be in after Run 2? Here is the test procedure as far as I understand it: Run the test for all three sites in Firefox * This is "Firefox, Run 1" Quit Firefox and start Opera Run the test for all three sites in Opera * This is "Opera, Run 1" Quit Opera and start Firefox Run the test for all three sites in Firefox * This is "Firefox, Run 2" Quit Firefox and start Opera Run the test for all three sites in Opera Quit Opera Thanks again, Brian _______________________________________________ dev-tech-network mailing list [email protected] https://lists.mozilla.org/listinfo/dev-tech-network
