[ https://issues.apache.org/jira/browse/SUREFIRE-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276293#comment-17276293 ]
Jiri Ondrusek commented on SUREFIRE-1812: ----------------------------------------- Hi [~tibordigana], I've retested my scenario and problem is still there. How to reproduce: * get camel-quarkus from my branch: [https://github.com/JiriOndrusek/camel-quarkus/tree/upgrading-maven-surefire-plugin] * build (mvn clen install -DskipTests) * run jvm test of braintree (`mvn test -fintegration-tests/braintree`), which uses maven-surefire-plugin 3.0.0-M5 * result is: {quote}[INFO] ------------------------------------------------------- [INFO] T E S T S [INFO] ------------------------------------------------------- [INFO] [INFO] Results: [INFO] [INFO] Tests run: 0, Failures: 0, Errors: 0, Skipped: 0 {quote} * revert last commit (which returns maven-surefire-plugin to 2.22.2) * run the same test * result is {quote}[INFO] ------------------------------------------------------- [INFO] T E S T S [INFO] ------------------------------------------------------- [INFO] Running org.apache.camel.quarkus.component.braintree.it.BraintreeTest [WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.004 s - in org.apache.camel.quarkus.component.braintree.it.BraintreeTest [INFO] [INFO] Results: [INFO] [WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1{quote} Annotation is here: https://github.com/JiriOndrusek/camel-quarkus/blob/upgrading-maven-surefire-plugin/integration-tests/braintree/src/test/java/org/apache/camel/quarkus/component/braintree/it/BraintreeTest.java#L29-L31 > Skipped tests (by annotation @EnabledIfEnvironmentVariable on the test class) > are not reported > ---------------------------------------------------------------------------------------------- > > Key: SUREFIRE-1812 > URL: https://issues.apache.org/jira/browse/SUREFIRE-1812 > Project: Maven Surefire > Issue Type: Bug > Components: Maven Surefire Plugin > Affects Versions: 3.0.0-M4, 3.0.0-M5 > Reporter: Jiri Ondrusek > Priority: Major > > I'm upgrading surefire plugin from 2.22.2 and there is a different behavior > started from 3.0.0-M4. > When the test class is ignored by using @EnabledIfEnvironmentVariable(...), > final report shows bad information: (3.0.0.-M4, M5, master) > {quote}[INFO] Results: > [INFO] > [INFO] Tests run: 0, Failures: 0, Errors: 0, Skipped: 0 > {quote} > The same test executed with 3.0.0-M3 shows: > {quote}[INFO] Results: > [INFO] > [WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1 > {quote} -- This message was sent by Atlassian Jira (v8.3.4#803005)