A little more info. I forgot to mention that the problem seems to be that surefire ignores some of our test suites when counting the total number of processed tests.
We have 11 seperate test suites (not 9 as mentioned before) and 4 of these test suites are not included in the list of test results. Surefire builds xml reports for these 4 test suites, but they are still not included. HHansen wrote: > > Hi, > > We've been using TeamCity to build and test a project. The project builds > and all tests are run, but TeamCity displays an incorrect number of tests > in the output. This is the end of the console output from TeamCity: > > Failed tests: > [12:02:11]: [bt6] > [12:02:11]: [bt6] Tests run: 740, Failures: 5, Errors: 0, Skipped: 0 > [12:02:11]: [bt6] > [12:02:11]: [bt6] [INFO] > ------------------------------------------------------------------------ > [12:02:11]: [bt6] [ERROR] BUILD FAILURE > [12:02:11]: [bt6] [INFO] > ------------------------------------------------------------------------ > [12:02:11]: [bt6] [INFO] There are test failures. > [12:02:11]: [bt6] > [12:02:11]: [bt6] Please refer to > /usr/local/TeamCity/buildAgent/work/b5b991b90c73d0c9/target/surefire-reports > for the individual test results. > [12:02:11]: [bt6] [INFO] > ------------------------------------------------------------------------ > [12:02:11]: [bt6] [INFO] For more information, run Maven with the -e > switch > [12:02:11]: [bt6] [INFO] > ------------------------------------------------------------------------ > [12:02:11]: [bt6] [INFO] Total time: 11 minutes > [12:02:11]: [bt6] [INFO] Finished at: Tue Jan 08 12:02:11 CET 2008 > [12:02:11]: [bt6] [INFO] Final Memory: 13M/94M > [12:02:11]: [bt6] [INFO] > ------------------------------------------------------------------------ > [12:02:11]: [bt6] Process exit code: 1 > [12:02:11]: [bt6] Number of processed tests: 485 > [12:02:11]: [bt6] Publishing artifacts > [12:02:11]: [Publishing artifacts] Will process paths: [teamcity-info.xml] > [12:02:11]: [bt6] Publishing artifacts 'teamcity-info.xml' to root > artifacts directory > [12:02:12]: [bt6] Artifacts path teamcity-info.xml not found > [12:02:12]: [bt6] Build finished > > > As you can see above, 740 tests are (with 5 failures), however TeamCity > only finds 485 tests run. > > We have seperated our tests into 9 testsuites, and all surefire xml > reports are generated on the build machine, so the tests are run with > correct number of failures. > > We've looked at a comment on the TeamCity site regarding Maven 2.0.4 and > Surefire 2.2: http://www.jetbrains.net/confluence/display/TCD3/Maven2 > http://www.jetbrains.net/confluence/display/TCD3/Maven2 > > We're using the following: > > Maven 2.0.4 > Surefire 2.4 (taken from maven surefire staging repo; > http://people.apache.org/~dfabulich/staging-repo) > TeamCity 3.0.1 > > The pom.xml file surefire snippet: > > <plugin> > <groupId>org.apache.maven.plugins</groupId> > <artifactId>maven-surefire-plugin</artifactId> > <version>2.4</version> > <configuration> > <forkMode>always</forkMode> > <argLine>-Xmx768m -XX:MaxPermSize=384m > -Dtest.use.mysql=true</argLine> > <printSummary>true</printSummary> > <includes> > <include>**/*TestSuite.java</include> > </includes> > <excludes> > <exclude>**/NormalTestSuite.java</exclude> > <exclude>**/test/utils/*TestSuite.java</exclude> > </excludes> > </configuration> > </plugin> > > > We see there's a fix for the above mentioned problem with maven 2.0.4 and > surefire 2.2 here: http://jira.codehaus.org/browse/SUREFIRE-122 > http://jira.codehaus.org/browse/SUREFIRE-122 > > Could it be a regression problem? > > Your response is kindly appreciated. > -- View this message in context: http://www.nabble.com/Number-of-reported-tests-is-incorrect-%28regression-%29-tp14688448s177p14707898.html Sent from the Maven - Users mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
