[ https://issues.apache.org/jira/browse/SUREFIRE-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17278097#comment-17278097 ]
Jiri Ondrusek commented on SUREFIRE-1812: ----------------------------------------- [~tibordigana] I've created a simple reproducer: [https://github.com/JiriOndrusek/SUREFIRE-1812-reproducer] Run test via 'mvn test' and get {quote}[INFO] ------------------------------------------------------- [INFO] T E S T S [INFO] ------------------------------------------------------- [INFO] [INFO] Results: [INFO] [INFO] Tests run: 0, Failures: 0, Errors: 0, Skipped: 0 {quote} Switch maven-surefire-plugin to 3.0.0-M5 in [https://github.com/JiriOndrusek/SUREFIRE-1812-reproducer/blob/master/pom.xml#L36] Run again. Result is: {quote}INFO] ------------------------------------------------------- [INFO] T E S T S [INFO] ------------------------------------------------------- [INFO] Running reproducer.eproducerTest [WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.004 s - in reproducer.eproducerTest [INFO] [INFO] Results: [INFO] [WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS {quote} (you can not have environmental variable with name *TEST_ENV* - see [https://github.com/JiriOndrusek/SUREFIRE-1812-reproducer/blob/master/src/test/java/reproducer/ReproducerTest.java#L8]) > Skipped tests (by annotation @EnabledIfEnvironmentVariable on the test class) > are not reported > ---------------------------------------------------------------------------------------------- > > Key: SUREFIRE-1812 > URL: https://issues.apache.org/jira/browse/SUREFIRE-1812 > Project: Maven Surefire > Issue Type: Bug > Components: Maven Surefire Plugin > Affects Versions: 3.0.0-M4, 3.0.0-M5 > Reporter: Jiri Ondrusek > Priority: Major > > I'm upgrading surefire plugin from 2.22.2 and there is a different behavior > started from 3.0.0-M4. > When the test class is ignored by using @EnabledIfEnvironmentVariable(...), > final report shows bad information: (3.0.0.-M4, M5, master) > {quote}[INFO] Results: > [INFO] > [INFO] Tests run: 0, Failures: 0, Errors: 0, Skipped: 0 > {quote} > The same test executed with 3.0.0-M3 shows: > {quote}[INFO] Results: > [INFO] > [WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1 > {quote} -- This message was sent by Atlassian Jira (v8.3.4#803005)