- Revision
- 139846
- Author
- [email protected]
- Date
- 2013-01-16 01:07:30 -0800 (Wed, 16 Jan 2013)
Log Message
Unreviewed gardening.
Adjusting failure expectations for fast/harness/sample-fail-mismatch-reftest.html
on all ports. The expectation for the test is now marked as a WontFix image failure.
r139786 reintroduced the possibility of running tests marked as WontFix if there is
another expectation (like Failure, ImageOnlyFailure) listed for the test.
This specific test tests that the harness correctly behaves in a case of a mismatch
reftest that matches with its baseline (i.e. that an image failure is reported). As
such every port should run it to ensure correct behavior of the ImageDiff tool in combination
with NRWT.
* platform/chromium/TestExpectations:
* platform/efl/TestExpectations:
* platform/gtk/TestExpectations:
* platform/mac/TestExpectations:
* platform/qt/TestExpectations:
* platform/win/TestExpectations:
* platform/wincairo/TestExpectations:
Modified Paths
Diff
Modified: trunk/LayoutTests/ChangeLog (139845 => 139846)
--- trunk/LayoutTests/ChangeLog 2013-01-16 09:01:42 UTC (rev 139845)
+++ trunk/LayoutTests/ChangeLog 2013-01-16 09:07:30 UTC (rev 139846)
@@ -1,3 +1,26 @@
+2013-01-16 Zan Dobersek <[email protected]>
+
+ Unreviewed gardening.
+
+ Adjusting failure expectations for fast/harness/sample-fail-mismatch-reftest.html
+ on all ports. The expectation for the test is now marked as a WontFix image failure.
+
+ r139786 reintroduced the possibility of running tests marked as WontFix if there is
+ another expectation (like Failure, ImageOnlyFailure) listed for the test.
+
+ This specific test tests that the harness correctly behaves in a case of a mismatch
+ reftest that matches with its baseline (i.e. that an image failure is reported). As
+ such every port should run it to ensure correct behavior of the ImageDiff tool in combination
+ with NRWT.
+
+ * platform/chromium/TestExpectations:
+ * platform/efl/TestExpectations:
+ * platform/gtk/TestExpectations:
+ * platform/mac/TestExpectations:
+ * platform/qt/TestExpectations:
+ * platform/win/TestExpectations:
+ * platform/wincairo/TestExpectations:
+
2013-01-16 Dominic Cooney <[email protected]>
[Chromium] Unreviewed gardening.
Modified: trunk/LayoutTests/platform/chromium/TestExpectations (139845 => 139846)
--- trunk/LayoutTests/platform/chromium/TestExpectations 2013-01-16 09:01:42 UTC (rev 139845)
+++ trunk/LayoutTests/platform/chromium/TestExpectations 2013-01-16 09:07:30 UTC (rev 139846)
@@ -254,7 +254,7 @@
# This test verifies that a mismatch reftest will fail if both results are the
# same. Because the whole point is that this test should fail when run, it's
# not SKIP, just WONTFIX.
-fast/harness/sample-fail-mismatch-reftest.html [ WontFix ]
+fast/harness/sample-fail-mismatch-reftest.html [ WontFix ImageOnlyFailure ]
# Since V8 is more interruptible than other engines, they use the standard
# long-running-script mechanism to handle very-long-running regexps too.
Modified: trunk/LayoutTests/platform/efl/TestExpectations (139845 => 139846)
--- trunk/LayoutTests/platform/efl/TestExpectations 2013-01-16 09:01:42 UTC (rev 139845)
+++ trunk/LayoutTests/platform/efl/TestExpectations 2013-01-16 09:07:30 UTC (rev 139846)
@@ -595,7 +595,7 @@
# Taken from Chromium, this test verifies that a mismatch reftest will fail if both results are the
# same. Because the whole point is that this test should fail when run, it's
# not SKIP, just WONTFIX.
-webkit.org/b/66218 fast/harness/sample-fail-mismatch-reftest.html [ WontFix ]
+webkit.org/b/66218 fast/harness/sample-fail-mismatch-reftest.html [ WontFix ImageOnlyFailure ]
# Need rebaseline after https://bugs.webkit.org/show_bug.cgi?id=105437
webkit.org/b/105437 svg/W3C-SVG-1.1-SE/filters-image-03-f.svg [ ImageOnlyFailure Pass ]
Modified: trunk/LayoutTests/platform/gtk/TestExpectations (139845 => 139846)
--- trunk/LayoutTests/platform/gtk/TestExpectations 2013-01-16 09:01:42 UTC (rev 139845)
+++ trunk/LayoutTests/platform/gtk/TestExpectations 2013-01-16 09:07:30 UTC (rev 139846)
@@ -58,7 +58,7 @@
#////////////////////////////////////////////////////////////////////////////////////////
# This test verifies that a mismatch reftest will fail as intended if both results are same.
-fast/harness/sample-fail-mismatch-reftest.html [ WontFix ]
+fast/harness/sample-fail-mismatch-reftest.html [ WontFix ImageOnlyFailure ]
# Modal dialogs will not be supported in WebKit1. These expectations should eventually
# be moved into WebKit1-specific TestExpectations file (once it's created).
Modified: trunk/LayoutTests/platform/mac/TestExpectations (139845 => 139846)
--- trunk/LayoutTests/platform/mac/TestExpectations 2013-01-16 09:01:42 UTC (rev 139845)
+++ trunk/LayoutTests/platform/mac/TestExpectations 2013-01-16 09:07:30 UTC (rev 139846)
@@ -518,7 +518,7 @@
css3/font-feature-settings-rendering.html
# This test verifies that a mismatch reftest will fail as intended if both results are same.
-fast/harness/sample-fail-mismatch-reftest.html
+fast/harness/sample-fail-mismatch-reftest.html [ WontFix ImageOnlyFailure ]
# https://bugs.webkit.org/show_bug.cgi?id=67716
media/media-controls-invalid-url.html
Modified: trunk/LayoutTests/platform/qt/TestExpectations (139845 => 139846)
--- trunk/LayoutTests/platform/qt/TestExpectations 2013-01-16 09:01:42 UTC (rev 139845)
+++ trunk/LayoutTests/platform/qt/TestExpectations 2013-01-16 09:07:30 UTC (rev 139846)
@@ -2068,7 +2068,7 @@
fast/loader/form-submission-after-beforeunload-cancel.html
# This test verifies that a mismatch reftest will fail as intended if both results are same.
-fast/harness/sample-fail-mismatch-reftest.html
+fast/harness/sample-fail-mismatch-reftest.html [ WontFix ImageOnlyFailure ]
# [Qt] fast/text/line-initial-and-final-swashes.html fails
# https://bugs.webkit.org/show_bug.cgi?id=69719
Modified: trunk/LayoutTests/platform/win/TestExpectations (139845 => 139846)
--- trunk/LayoutTests/platform/win/TestExpectations 2013-01-16 09:01:42 UTC (rev 139845)
+++ trunk/LayoutTests/platform/win/TestExpectations 2013-01-16 09:07:30 UTC (rev 139846)
@@ -1595,7 +1595,7 @@
css3/font-feature-settings-rendering.html
# This test verifies that a mismatch reftest will fail as intended if both results are same.
-fast/harness/sample-fail-mismatch-reftest.html
+fast/harness/sample-fail-mismatch-reftest.html [ WontFix ImageOnlyFailure ]
# Need DRT change: https://bugs.webkit.org/show_bug.cgi?id=66620
editing/spelling/spelling-insert-html.html
Modified: trunk/LayoutTests/platform/wincairo/TestExpectations (139845 => 139846)
--- trunk/LayoutTests/platform/wincairo/TestExpectations 2013-01-16 09:01:42 UTC (rev 139845)
+++ trunk/LayoutTests/platform/wincairo/TestExpectations 2013-01-16 09:07:30 UTC (rev 139846)
@@ -2102,7 +2102,7 @@
css3/font-feature-settings-rendering.html
# This test verifies that a mismatch reftest will fail as intended if both results are same.
-fast/harness/sample-fail-mismatch-reftest.html
+fast/harness/sample-fail-mismatch-reftest.html [ WontFix ImageOnlyFailure ]
# Need DRT change: https://bugs.webkit.org/show_bug.cgi?id=66620
editing/spelling/spelling-insert-html.html
