Skipped test should not be considered as "failed test"
------------------------------------------------------

                 Key: SUREFIRE-476
                 URL: http://jira.codehaus.org/browse/SUREFIRE-476
             Project: Maven Surefire
          Issue Type: Improvement
          Components: report plugin
    Affects Versions: 2.4.2
            Reporter: Baptiste MATHUS
         Attachments: surefire-report-skippedIsSuccess.patch

I guess the plugin should allow people to decide whether skipped test is the 
same as a failed test, as it is at the moment in the report plugin.

As you know, with the surefire plugin (not the report one), a skipped test is 
not considered as a failed one, as it doesn't make the whole test phase fail, 
isn't it? So, I guess there should be at least an option to choose how to treat 
skipped tests when reporting.

As a small modification, I'm attaching a small patch to not lower the "success 
rate" (for example, with two tests one successful, one skipped, the success 
rate stays 100%). This patch uses an option -DskippedIsFailed=false that lets 
the current behaviour be if you don't use this switch (the testcase was also 
updated to test this new switch).

I think there could be a good idea to introduce a specific part in the report 
showing the skipped tests. What do you think? If you agree, I could try and 
propose a patch for it.

Cheers.
PS: the patch was applied against the 2.4.2 tag. If you want me to update it 
against another source version, please let me know.


-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: 
http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to