[ https://issues.apache.org/jira/browse/BUILDR-301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12741624#action_12741624 ]
Martin Grotzke commented on BUILDR-301: --------------------------------------- I added a new testmodule2 that contains two tests Test1 and Test2, where Test2 has a test method that fails. When running `buildr clean test' the bulid completes successfully with this output: [grot...@mescalin testmodule2]$ buildr clean test (in /home/grotzke/proj/buildr-sandbox, development) Cleaning buildr-sandbox:testmodule2 Testing buildr-sandbox:testmodule2 Compiling buildr-sandbox:testmodule2 into /home/grotzke/proj/buildr-sandbox/testmodule2/target/classes Compiling buildr-sandbox:testmodule2:test into /home/grotzke/proj/buildr-sandbox/testmodule2/target/test/classes Running tests in buildr-sandbox:testmodule2 Running TestNG in buildr-sandbox:testmodule2 [Parser] Running: buildr-sandbox-testmodule2 PASSED: testBase FAILED: testClass1 java.lang.AssertionError: this test failed. at de.javakaffee.buildr.sandbox.testmodule2.Test2.testClass1(Test2.scala:10) ... Removed 23 stack frames =============================================== Command line test Tests run: 2, Failures: 1, Skips: 0 =============================================== =============================================== buildr-sandbox-testmodule2 Total tests run: 2, Failures: 1, Skips: 0 =============================================== Completed in 3.764s > Build completes successfully on configuration failures and skipped tests > ------------------------------------------------------------------------ > > Key: BUILDR-301 > URL: https://issues.apache.org/jira/browse/BUILDR-301 > Project: Buildr > Issue Type: Bug > Components: Test frameworks > Affects Versions: 1.3.4 > Environment: Tested on Linux (Fedora, Debian/Ubuntu) > Reporter: Martin Grotzke > > This issue is related to the report on the mailing list: > http://n2.nabble.com/Build-completes-successfully-on-configuration-failures-and-skipped-tests-td3332816.html#a3332816 > I reproduced what we encountered in a simple project that has these test > classes > - a BaseTest with a beforMethod that fails and a test method (that is skipped) > - a Test1 that extends BaseTest, with a test method that is also skipped. > This is the output of a `buildr clean test': > [grot...@mescalin testmodule]$ buildr clean test > (in /home/grotzke/proj/buildr-sandbox, development) > Cleaning buildr-sandbox:testmodule > Testing buildr-sandbox:testmodule > Compiling buildr-sandbox:testmodule into > /home/grotzke/proj/buildr-sandbox/testmodule/target/classes > Compiling buildr-sandbox:testmodule:test into > /home/grotzke/proj/buildr-sandbox/testmodule/target/test/classes > Running tests in buildr-sandbox:testmodule > Running TestNG in buildr-sandbox:testmodule > [Parser] Running: > buildr-sandbox-testmodule > FAILED CONFIGURATION: @BeforeMethod beforeBaseTestMethod > java.lang.RuntimeException: s.th. failed here... > at > de.javakaffee.buildr.sandbox.testmodule.BaseTest.beforeBaseTestMethod(BaseTest.scala:10) > ... Removed 24 stack frames > SKIPPED CONFIGURATION: @BeforeMethod beforeBaseTestMethod > SKIPPED CONFIGURATION: @BeforeMethod beforeBaseTestMethod > SKIPPED: testBase > SKIPPED: testClass1 > SKIPPED: testBase > =============================================== > Command line test > Tests run: 3, Failures: 0, Skips: 3 > Configuration Failures: 1, Skips: 2 > =============================================== > =============================================== > buildr-sandbox-testmodule > Total tests run: 3, Failures: 0, Skips: 3 > Configuration Failures: 1, Skips: 2 > =============================================== > Completed in 4.305s > The project can be found here: > http://github.com/magro/buildr-sandbox/tree/master -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.