[jira] [Updated] (SUREFIRE-2065) Test Reports Inconsistencies with Parameterized and junit4

2023-02-06 Thread Olivier Lamy (Jira)


 [ 
https://issues.apache.org/jira/browse/SUREFIRE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Olivier Lamy updated SUREFIRE-2065:
---
Fix Version/s: 3.0.0-M9

> Test Reports Inconsistencies with Parameterized and junit4
> --
>
> Key: SUREFIRE-2065
> URL: https://issues.apache.org/jira/browse/SUREFIRE-2065
> Project: Maven Surefire
>  Issue Type: Bug
>  Components: Junit 4.x support
>Affects Versions: 3.0.0-M5, 3.0.0-M6, 3.0.0-M7
>Reporter: Christian Marquez Grabia
>Priority: Minor
> Fix For: 3.0.0-M9
>
>
> Running parameterized tests with the junit-platform provider causes tests to 
> be counted as single test (unlike using junit4 provider). This makes the 
> tests to be marked as 'Flaky' and marks the build as successful if the retry 
> failed count is greater than zero. Reports also show a single test run even 
> if there were multiple tests with different parameters.
> For a sample project with the problem see 
> [surefire-flaky-issue|https://github.com/chalmagr/surefire-flaky-report] 
> This is also a possibly related to issue SUREFIRE-2010 and may help in the 
> resolution of it.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (SUREFIRE-2065) Test Reports Inconsistencies with Parameterized and junit4

2022-04-08 Thread Christian Marquez Grabia (Jira)


 [ 
https://issues.apache.org/jira/browse/SUREFIRE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Christian Marquez Grabia updated SUREFIRE-2065:
---
Summary: Test Reports Inconsistencies with Parameterized and junit4  (was: 
JUnit4 Parameterized Tests Grouping Incorrectly)

> Test Reports Inconsistencies with Parameterized and junit4
> --
>
> Key: SUREFIRE-2065
> URL: https://issues.apache.org/jira/browse/SUREFIRE-2065
> Project: Maven Surefire
>  Issue Type: Bug
>  Components: Junit 4.x support
>Affects Versions: 3.0.0-M5, 3.0.0-M6, 3.0.0-M7
>Reporter: Christian Marquez Grabia
>Priority: Minor
>
> Running parameterized tests with the junit-platform provider causes tests to 
> be counted as single test (unlike using junit4 provider). This makes the 
> tests to be marked as 'Flaky' and marks the build as successful if the retry 
> failed count is greater than zero. Reports also show a single test run even 
> if there were multiple tests with different parameters.
> For a sample project with the problem see 
> [surefire-flaky-issue|https://github.com/chalmagr/surefire-flaky-report] 
> This is also a possibly related to issue SUREFIRE-2010 and may help in the 
> resolution of it.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)