> We then tried to get a sense of how much of a win the PGO optimizations > are. Thanks to a series of measurements by dmandelin, we know that > disabling PGO/LTCG will result in a regression of about 10-20% on > benchmarks which examine DOM and layout performance such as Dromaeo and > guimark2 (and 40% in one case), but no significant regressions in the > startup time, and gmail interactions. Thanks to a series of telemetry > measurements performed by Vladan on a Nightly build we did last week > which had PGO/LTCG disabled, there are no telemetry probes which show a > significant regression on builds without PGO/LTCG. Vladan is going to > try to get this data out of a Tp5 run tomorrow as well, but we don't > have any evidence to believe that the results of that experiments will > be any different.
Are the test run stats we're using here published somewhere? We should be tracking all this testing some place (a wiki page maybe?) so people can do their own investigation. I've always wondered if the tests we run during the pgo phase are sufficient to get good coverage over the entire app. Is it possible that we don't see gains in other areas because our pgo tests don't hit those areas? (I think there was an effort under way to expose these tests so they could be modified in try runs for better experimentation.) Generally I would make disabling pgo the last option after exhausting all other options. _______________________________________________ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
