There is an integration test (TestMultipleMethodsIT) that runs the project located at SVN in
https://svn.apache.org/repos/asf/maven/surefire/trunk/surefire-integration-tests/src/test/resources/junit48-multiple-methods https://svn.apache.org/repos/asf/maven/surefire/trunk/surefire-integration-tests/src/test/resources/junit44-multiple-methods This test passed using this command: mvn -Dtest=junit4.BasicTest#testSuccessOne+testFailOne,junit4.TestThree#testSuccessTwo -Dsurefire.version=2.12.1 test Is this a documentation problem or is there some other issue ? Please try to reproduce in terms of the existing IT projects if you can. As for TestNG, I do not believe this is supported (neither JUnit3). I will update the official feature matrix (http://maven.apache.org/plugins/maven-surefire-plugin-2.12.1/plugins/maven-surefire-plugin/featurematrix.html) and mark this as not supported for TestNG/JUnit3. I will redeploy the site sometime tomorrow. Since we traditionally do not cancel votes due to documentation changes, I'm not cancelling this vote until there's a clear proof of a bug. If necessary I'll extend the vote period so we're sure. Kristian mvn -Dsurefire.version=2.12.1 -Dtest=test.mavenproject2.AppNGTest#testMain,test.mavenproject2.AppNGTest#testMain2 test 2012/7/30 Milos Kleint <[email protected]>: > -1 > > surefire 1.12.1 + testng 6.5.2 or 6.7: > "mvn > -Dtest=test.mavenproject2.AppNGTest#testMain,test.mavenproject2.AppNGTest#testMain2 > test" > doesn't work (no tests run), even though running just 1 test method > will succeed. > > surefire 1.12.1 + junit 4.10: > "mvn > -Dtest=test.mavenproject1.AppTest#testMain2,test.mavenproject1.AppTest#testMain > test" > doesn't work either, will run just one test, ignore the other. > If I have 2 test classes each with 2 failing tests and attempt to > execute all of them, then only one per class file is executed. > > the variants with 1 test method being executed work fine. > > variant with multiple test classes (not methods) does work in both > testng and junit4. > > Milos > > On Sun, Jul 29, 2012 at 10:45 PM, Kristian Rosenvold > <[email protected]> wrote: >> Hi, >> >> This is a bugfix release. >> >> We solved a few issues: >> >> Bug >> >> [SUREFIRE-659] - Maven PDF plugin:showSuccess=false creates empty >> table causing error >> [SUREFIRE-825] - NPE in JUnit4TestChecker if >> org.junit.runner.RunWith class can't be loaded by testClassloader >> [SUREFIRE-827] - Surefire 2.12 cannot run a single test, >> regression from 2.11 >> [SUREFIRE-828] - testng test need a excludedGroups element to not fail >> [SUREFIRE-832] - JUnit categories only work when junit47 provider >> is explicitly set >> [SUREFIRE-836] - regression with surefire 2.12 plugin and SecurityManager >> [SUREFIRE-844] - "test" parameter no longer working with JUnit in >> 2.12 (worked in 2.9 - 2.11) >> [SUREFIRE-847] - surefire cannot run single testng test >> [SUREFIRE-858] - Running a single unit test in Windows >> [SUREFIRE-865] - surefire 2.12 with parallel=methods does not >> execute junit 4.7+ tests in parallel >> [SUREFIRE-869] - Parallel test execution on class level runs not >> all tests but some twice >> [SUREFIRE-871] - Output of forked tests with non-zero exit code not >> retained >> [SUREFIRE-877] - Surefire doesn't support "mixed" TestNG 6.5.x >> config parameter >> [SUREFIRE-879] - maven-surefire-report-plugin fails some times >> with ConcurrentModificationException when running parallel TestNG >> [SUREFIRE-880] - ObjectFactory no longer works with TestNG 6.5.2 >> [SUREFIRE-883] - Cannot run tests in parallel >> >> Improvement >> >> [SUREFIRE-745] - -Dtest supports multiple test classes but not >> multiple test methods >> [SUREFIRE-876] - surefire-junit47 does not work in an OSGi >> classloader environment >> [SUREFIRE-881] - use plugins annotations >> [SUREFIRE-889] - JUnit | supprot inheritance of test's categories/groups >> >> We unresolved 1 issue; which had to be reverted because it was the >> root cause of several of the above issues: >> >> https://jira.codehaus.org/browse/SUREFIRE-800 >> >> >> There are still lots of issues left in JIRA: >> >> http://jira.codehaus.org/secure/IssueNavigator.jspa?reset=true&mode=hide&jqlQuery=project+%3D+SUREFIRE+AND+resolution+%3D+Unresolved+ORDER+BY+updated+DESC >> >> Staging repo: >> https://repository.apache.org/content/repositories/maven-096/ >> >> Staging site: (Sync pending) >> http://maven.apache.org/surefire/staging/ (Links to sub-sites work >> when transfered to production) >> http://maven.apache.org/plugins/maven-failsafe-plugin-2.12.1/ >> http://maven.apache.org/plugins/maven-surefire-plugin-2.12.1/ >> http://maven.apache.org/plugins/maven-surefire-reports-plugin-2.12.1/ >> >> Guide to testing staged releases: >> http://maven.apache.org/guides/development/guide-testing-releases.html >> >> Vote open for 72 hours. >> >> >> [ ] +1 >> [ ] +0 >> [ ] -1 >> >> And here's my +1 >> >> >> Kristian >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: [email protected] >> For additional commands, e-mail: [email protected] >> > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
