Thank you Enrico and Tibor for verifying it is a probable new issue. I cannot upload this project (customer product/private repo) but will make a project that reproduces it and reply again.
On Sat, Jun 13, 2020 at 8:24 AM Enrico Olivelli <eolive...@gmail.com> wrote: > Il Sab 13 Giu 2020, 15:07 Jeff Jensen <jjen...@apache.org> ha scritto: > > > Hi Enrico, > > Thanks for the reply. > > > > Surefire 2.22.2 correctly fails the build. This is with Java 8 and JUnit > > 5. > > > > > This sounds interesting. > > It looks like a big bug to me and it is worth a JIRA > > It would help a lot if you could attach a simple reproducer for the > problem. > If you know surefire codebase it would also help a lot to create the > reproducer as an integration test > > Thanks > > Enrico > > > > > > On Sat, Jun 13, 2020 at 12:41 AM Enrico Olivelli <eolive...@gmail.com> > > wrote: > > > > > Jeff > > > > > > Il Sab 13 Giu 2020, 00:15 Jeff Jensen < > jeffjen...@upstairstechnology.com > > > > > > ha scritto: > > > > > > > I looked for this issue in JIRA but haven't found anything yet. > Anyone > > > > know if this has been reported and/or fixed? > > > > > > > > Our scenario is a failure occurs at startup of tests but Surefire > > doesn't > > > > fail the build. Specifically, Spring controller tests aren't failing > > > when > > > > there is a Spring configuration problem. > > > > > > > > Spring top-level thrown exception is: > > > > java.lang.IllegalStateException: Failed to load ApplicationContext > > > > > > > > but Surefire doesn't report fail. Surefire output results is: > > > > Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, > > > > > > > > Running the tests in an IDE correctly fail for the setup problem. > > > > > > > > > > Which IDE? > > > > > > Did you try other versions of surefire? Like the latest from 2.x > release > > > line? > > > > > > Regards > > > Enrico > > > > > >
