Title: [243960] trunk/Tools
Revision
243960
Author
sbar...@apple.com
Date
2019-04-05 19:05:11 -0700 (Fri, 05 Apr 2019)

Log Message

Make compare-results understand MotionMark
https://bugs.webkit.org/show_bug.cgi?id=196666

Reviewed by Yusuke Suzuki.

* Scripts/compare-results:
(PLT5Results):
(detectMotionMark):
(detectMotionMark1_1):
(motionMarkResults):
(motionMark1_1Results):
(detectBenchmark):
(biggerIsBetter):
(main):

Modified Paths

Diff

Modified: trunk/Tools/ChangeLog (243959 => 243960)


--- trunk/Tools/ChangeLog	2019-04-06 01:57:16 UTC (rev 243959)
+++ trunk/Tools/ChangeLog	2019-04-06 02:05:11 UTC (rev 243960)
@@ -1,3 +1,20 @@
+2019-04-05  Saam Barati  <sbar...@apple.com>
+
+        Make compare-results understand MotionMark
+        https://bugs.webkit.org/show_bug.cgi?id=196666
+
+        Reviewed by Yusuke Suzuki.
+
+        * Scripts/compare-results:
+        (PLT5Results):
+        (detectMotionMark):
+        (detectMotionMark1_1):
+        (motionMarkResults):
+        (motionMark1_1Results):
+        (detectBenchmark):
+        (biggerIsBetter):
+        (main):
+
 2019-04-05  Alex Christensen  <achristen...@webkit.org>
 
         Clicking "Go Back" from a safe browsing warning from an iframe should navigate the WKWebView back to the previous page

Modified: trunk/Tools/Scripts/compare-results (243959 => 243960)


--- trunk/Tools/Scripts/compare-results	2019-04-06 01:57:16 UTC (rev 243959)
+++ trunk/Tools/Scripts/compare-results	2019-04-06 02:05:11 UTC (rev 243960)
@@ -49,6 +49,8 @@
 Speedometer2 = "Speedometer2"
 JetStream2 = "JetStream2"
 PLT5 = "PLT5"
+MotionMark = "MotionMark"
+MotionMark1_1 = "MotionMark-1.1"
 
 def detectJetStream2(payload):
     return "JetStream2.0" in payload
@@ -102,6 +104,32 @@
         results.append(obj["Geometric"])
     return results
 
+def detectMotionMark(payload):
+    return "MotionMark" in payload
+
+def detectMotionMark1_1(payload):
+    return "MotionMark-1.1" in payload
+
+def motionMarkResults(payload):
+    assert detectMotionMark(payload) or detectMotionMark1_1(payload)
+    if detectMotionMark(payload):
+        payload = payload["MotionMark"]
+    else:
+        payload = payload["MotionMark-1.1"]
+    testNames = payload["tests"].keys()
+    numTests = len(payload["tests"][testNames[0]]["metrics"]["Score"]["current"])
+    results = []
+    for i in range(numTests):
+        scores = []
+        for test in testNames:
+            scores.append(payload["tests"][test]["metrics"]["Score"]["current"][i])
+        results.append(stats.gmean(scores))
+
+    return results
+
+def motionMark1_1Results(payload):
+    return motionMarkResults(payload)
+
 def detectBenchmark(payload):
     if detectJetStream2(payload):
         return JetStream2
@@ -109,6 +137,10 @@
         return Speedometer2
     if detectPLT5(payload):
         return PLT5
+    if detectMotionMark(payload):
+        return MotionMark
+    if detectMotionMark1_1(payload):
+        return MotionMark1_1
     return None
 
 def biggerIsBetter(benchmarkType):
@@ -116,6 +148,10 @@
         return True
     if benchmarkType == Speedometer2:
         return True
+    if benchmarkType == MotionMark:
+        return True
+    if benchmarkType == MotionMark1_1:
+        return True
     if benchmarkType == PLT5:
         return False
 
@@ -187,6 +223,10 @@
         ttest(typeA, JetStream2Results(a), JetStream2Results(b))
     elif typeA == Speedometer2:
         ttest(typeA, Speedometer2Results(a), Speedometer2Results(b))
+    elif typeA == MotionMark:
+        ttest(typeA, motionMarkResults(a), motionMarkResults(b))
+    elif typeA == MotionMark1_1:
+        ttest(typeA, motionMark1_1Results(a), motionMark1_1Results(b))
     elif typeA == PLT5:
         ttest(typeA, PLT5Results(a), PLT5Results(b))
     else:
_______________________________________________
webkit-changes mailing list
webkit-changes@lists.webkit.org
https://lists.webkit.org/mailman/listinfo/webkit-changes

Reply via email to