[ https://issues.apache.org/jira/browse/SUREFIRE-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17487654#comment-17487654 ]
Alexander Kriegisch edited comment on SUREFIRE-2004 at 2/6/22, 9:34 AM: ------------------------------------------------------------------------ I did not say anything about versions prior 2.4, but about versions 2.4+. Why would you want me to check the integration tests? I am reporting something which is not working as expected for single-module projects, namely that in the case of a requested aggregate report the plugin should be smart enough to figure out that the reporter actually does not need to aggregate anything, because the aggregate for a single-module project is simply the same as a non-aggregate report for the same module. The reporter works for a pom-packaged root POM with a single child module, so I am expecting it to work for a single, jar-packaged module, too. The plugin reports 0 executed tests, which is simply wrong and therefore a bug, no matter if that bug exists since plugin version 2.4 or maybe even 1.0. was (Author: kriegaex): I did not say anything to versions prior 2.4, but about versions 2.4+. Why would you want me to check the integration tests? I am reporting something which is not working as expected for single-module projects, namely that in the case of a requested aggregate report the plugin should be smart enough to figure out that the reporter actually does not need to aggregate anything, because the aggregate for a single-module project is simply the same as a non-aggregate report for the same module. The reporter works for a pom-packaged root POM with a single child module, so I am expecting it to work for a single, jar-packaged module, too. The plugin reports 0 executed tests, which is simply wrong and therefore a bug, no matter if that bug exists since plugin version 2.4 or maybe even 1.0. > Empty report for single-module project with 'aggregate=true' > ------------------------------------------------------------ > > Key: SUREFIRE-2004 > URL: https://issues.apache.org/jira/browse/SUREFIRE-2004 > Project: Maven Surefire > Issue Type: Bug > Components: Maven Surefire Report Plugin > Affects Versions: 2.4, 3.0.0-M5 > Reporter: Alexander Kriegisch > Priority: Major > > Using either {{-Daggregate=true}} on CLI or {{<aggregate>true</aggregate>}} > in the plugin configuration leads to an empty report (i.e. zero tests > reported) when e.g. executing > {code:none} > mvn -Dmaven.test.failure.ignore=true -Daggregate=true clean verify > surefire-report:report-only > {code} > in the context of a single-module project. As soon as I make the root module > pom-packaged and move the tests to into a child module, the aggregate report > works. > FYI, if I do not define the plugin and its version in my POM at all, the > default version 2.4 used by Maven on my workstation has the same problem, so > this does not seem to be a 3.0.0-M5 issue only. > ---- > Background info about how and why I actually stumbled across this problem: I > have an OSS multi-module project with lots of expensive UI tests. The full > build can take 2.5 hours. I wanted to test a few CLI settings before creating > an additional GitHub CI build workflow which can be run on demand and always > runs all tests in all modules (ignoring errors and failures), no matter what. > In the end, it is supposed to create a single-file aggregate HTML report > which can easily be attached to the build and later is available for > download, if the user so chooses in order to analyse failing tests > comfortable and without having to scroll through build logs. You get the > picture, I guess. In the original project, there is a pom-packaged root POM, > so the problem described in this issue does not occur there. I simply created > a single-module dummy project in order to verify the effect of certain build > options quickly and not having to wait for the slow original build to finish. > Eventually, I noticed the issue described above. -- This message was sent by Atlassian Jira (v8.20.1#820001)