yes, the reproducible project would be great to have. Thx On Sat, Jun 13, 2020 at 4:04 PM Jeff Jensen <jjen...@apache.org> wrote:
> Thank you Enrico and Tibor for verifying it is a probable new issue. > > I cannot upload this project (customer product/private repo) but will make > a project that reproduces it and reply again. > > > On Sat, Jun 13, 2020 at 8:24 AM Enrico Olivelli <eolive...@gmail.com> > wrote: > > > Il Sab 13 Giu 2020, 15:07 Jeff Jensen <jjen...@apache.org> ha scritto: > > > > > Hi Enrico, > > > Thanks for the reply. > > > > > > Surefire 2.22.2 correctly fails the build. This is with Java 8 and > JUnit > > > 5. > > > > > > > > > This sounds interesting. > > > > It looks like a big bug to me and it is worth a JIRA > > > > It would help a lot if you could attach a simple reproducer for the > > problem. > > If you know surefire codebase it would also help a lot to create the > > reproducer as an integration test > > > > Thanks > > > > Enrico > > > > > > > > > > On Sat, Jun 13, 2020 at 12:41 AM Enrico Olivelli <eolive...@gmail.com> > > > wrote: > > > > > > > Jeff > > > > > > > > Il Sab 13 Giu 2020, 00:15 Jeff Jensen < > > jeffjen...@upstairstechnology.com > > > > > > > > ha scritto: > > > > > > > > > I looked for this issue in JIRA but haven't found anything yet. > > Anyone > > > > > know if this has been reported and/or fixed? > > > > > > > > > > Our scenario is a failure occurs at startup of tests but Surefire > > > doesn't > > > > > fail the build. Specifically, Spring controller tests aren't > failing > > > > when > > > > > there is a Spring configuration problem. > > > > > > > > > > Spring top-level thrown exception is: > > > > > java.lang.IllegalStateException: Failed to load > ApplicationContext > > > > > > > > > > but Surefire doesn't report fail. Surefire output results is: > > > > > Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, > > > > > > > > > > Running the tests in an IDE correctly fail for the setup problem. > > > > > > > > > > > > > Which IDE? > > > > > > > > Did you try other versions of surefire? Like the latest from 2.x > > release > > > > line? > > > > > > > > Regards > > > > Enrico > > > > > > > > > > -- Cheers Tibor