[
https://issues.apache.org/jira/browse/NETBEANS-5863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eirik Bakke updated NETBEANS-5863:
----------------------------------
Description:
In NetBeans 12.4, test results displayed in the "Test results" pane will get
randomly cleared while the tests are running. The final output thus ends up not
including all tests that were run. See the attached series of screenshots.
Sometimes the "Test results" pane will end up showing a green bar with "Tests
passed: 100.00 %" even when there were test failures.
My application's test suite is JUnit in a maven-based NetBeans module running
maven-surefire-plugin version 3.0.0-M4. Using an older version of the surefire
plugin (2.18.1, which I used to use to avoid NETBEANS-458 ) did not solve the
problem.
This problem occurs on NetBeans 12.4, but not on NetBeans 12.1. (I verified
this by running my application's test suite on both NetBeans versions, without
changing surefire versions or anything else.)
was:
In NetBeans 12.4, test results displayed in the "Test results" pane will get
randomly cleared while the tests are running. The final output thus ends up not
including all tests that were run. See the attached series of screenshots.
Sometimes the "Test results" pane will end up saying "All tests succeeded" even
when there were test failures.
My application's test suite is JUnit in a maven-based NetBeans module running
maven-surefire-plugin version 3.0.0-M4. Using an older version of the surefire
plugin (2.18.1, which I used to use to avoid NETBEANS-458 ) did not solve the
problem.
This problem occurs on NetBeans 12.4, but not on NetBeans 12.1. (I verified
this by running my application's test suite on both NetBeans versions, without
changing surefire versions or anything else.)
> "Test results" spuriously clears tests during run, and shows success despite
> failure
> ------------------------------------------------------------------------------------
>
> Key: NETBEANS-5863
> URL: https://issues.apache.org/jira/browse/NETBEANS-5863
> Project: NetBeans
> Issue Type: Bug
> Components: java - JUnit, utilities - Test Runner
> Affects Versions: 12.4
> Environment: NetBeans 12.4 on 64-bit Windows 10 on OpenJDK 11.0.11.
> Reporter: Eirik Bakke
> Priority: Major
> Attachments: Failure became success!.png, Test results dropped.png
>
>
> In NetBeans 12.4, test results displayed in the "Test results" pane will get
> randomly cleared while the tests are running. The final output thus ends up
> not including all tests that were run. See the attached series of
> screenshots. Sometimes the "Test results" pane will end up showing a green
> bar with "Tests passed: 100.00 %" even when there were test failures.
> My application's test suite is JUnit in a maven-based NetBeans module running
> maven-surefire-plugin version 3.0.0-M4. Using an older version of the
> surefire plugin (2.18.1, which I used to use to avoid NETBEANS-458 ) did not
> solve the problem.
> This problem occurs on NetBeans 12.4, but not on NetBeans 12.1. (I verified
> this by running my application's test suite on both NetBeans versions,
> without changing surefire versions or anything else.)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@netbeans.apache.org
For additional commands, e-mail: commits-h...@netbeans.apache.org
For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists
