So, what you end up with is after a couple of years, the slowest test in the suite is the most significant part of the score. Further, I'll predict that the slowest test will most likely be the least relevant test, because the truly important parts of JS engines were already optimized. This has happened with Sunspider 0.9 - the regex portions of the test became the dominant factor, even though they were not nearly as prominent in the real world as they were in the benchmark. This leads to implementors optimizing for the benchmark - and that is not what we want to encourage.

How did you determine that regex performance is "not nearly as prominent in the real world?"

Geoff
_______________________________________________
webkit-dev mailing list
webkit-dev@lists.webkit.org
http://lists.webkit.org/mailman/listinfo.cgi/webkit-dev

Reply via email to