Skipped test should not be considered as "failed test"
------------------------------------------------------
Key: SUREFIRE-476
URL: http://jira.codehaus.org/browse/SUREFIRE-476
Project: Maven Surefire
Issue Type: Improvement
Components: report plugin
Affects Versions: 2.4.2
Reporter: Baptiste MATHUS
Attachments: surefire-report-skippedIsSuccess.patch
I guess the plugin should allow people to decide whether skipped test is the
same as a failed test, as it is at the moment in the report plugin.
As you know, with the surefire plugin (not the report one), a skipped test is
not considered as a failed one, as it doesn't make the whole test phase fail,
isn't it? So, I guess there should be at least an option to choose how to treat
skipped tests when reporting.
As a small modification, I'm attaching a small patch to not lower the "success
rate" (for example, with two tests one successful, one skipped, the success
rate stays 100%). This patch uses an option -DskippedIsFailed=false that lets
the current behaviour be if you don't use this switch (the testcase was also
updated to test this new switch).
I think there could be a good idea to introduce a specific part in the report
showing the skipped tests. What do you think? If you agree, I could try and
propose a patch for it.
Cheers.
PS: the patch was applied against the 2.4.2 tag. If you want me to update it
against another source version, please let me know.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira