[ 
https://issues.apache.org/jira/browse/CXF-8393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andriy Redko updated CXF-8393:
------------------------------
    Description: 
There are a number of tests which are flaky and fail the builds from time to 
time. We should address those by fixing or at last, removing them altogether.

Adding test retry to the offending modules 
([https://maven.apache.org/surefire/maven-surefire-plugin/examples/rerun-failing-tests.html])
 should help.
{noformat}
[INFO] Results:
[INFO] 
[WARNING] Flakes: 
[WARNING] 
org.apache.cxf.transport.jms.RequestResponseTest.testRequestQueueResponseTempQueue
[ERROR]   Run 1: 
RequestResponseTest.testRequestQueueResponseTempQueue:41->sendAndReceiveMessages:99->AbstractJMSTester.waitForReceiveInMessage:306
 Can't receive the Conduit Message in 10 seconds
[INFO]   Run 2: PASS
[INFO] 
[WARNING] 
org.apache.cxf.transport.jms.RequestResponseTest.testRequestTopicResponseStaticQueue
[ERROR]   Run 1: 
RequestResponseTest.testRequestTopicResponseStaticQueue:64->sendAndReceiveMessages:99->AbstractJMSTester.waitForReceiveInMessage:306
 Can't receive the Conduit Message in 10 seconds
[ERROR]   Run 2: 
RequestResponseTest.testRequestTopicResponseStaticQueue:63->sendAndReceiveMessages:95->AbstractJMSTester.sendMessage:165->AbstractJMSTester.sendoutMessage:187
 » Runtime Timeout receiving message with correlationId 
eb382e0774ca4c4f9f5bae1ae4dd147d0000000000000001
[INFO]   Run 3: PASS
[INFO] 
[INFO] 
[WARNING] Tests run: 65, Failures: 0, Errors: 0, Skipped: 1, Flakes: 2{noformat}
While the retrying does not fix the flaky tests, it should help reduce the 
number of builds that fail. The end goal is to fix the flaky tests.

  was:There are a number of tests which are flaky and fail the builds from time 
to time. We should address those by fixing or at last, removing them altogether.


> Umbrella issue to address fixing flaky tests 
> ---------------------------------------------
>
>                 Key: CXF-8393
>                 URL: https://issues.apache.org/jira/browse/CXF-8393
>             Project: CXF
>          Issue Type: Bug
>            Reporter: Andriy Redko
>            Assignee: Andriy Redko
>            Priority: Major
>
> There are a number of tests which are flaky and fail the builds from time to 
> time. We should address those by fixing or at last, removing them altogether.
> Adding test retry to the offending modules 
> ([https://maven.apache.org/surefire/maven-surefire-plugin/examples/rerun-failing-tests.html])
>  should help.
> {noformat}
> [INFO] Results:
> [INFO] 
> [WARNING] Flakes: 
> [WARNING] 
> org.apache.cxf.transport.jms.RequestResponseTest.testRequestQueueResponseTempQueue
> [ERROR]   Run 1: 
> RequestResponseTest.testRequestQueueResponseTempQueue:41->sendAndReceiveMessages:99->AbstractJMSTester.waitForReceiveInMessage:306
>  Can't receive the Conduit Message in 10 seconds
> [INFO]   Run 2: PASS
> [INFO] 
> [WARNING] 
> org.apache.cxf.transport.jms.RequestResponseTest.testRequestTopicResponseStaticQueue
> [ERROR]   Run 1: 
> RequestResponseTest.testRequestTopicResponseStaticQueue:64->sendAndReceiveMessages:99->AbstractJMSTester.waitForReceiveInMessage:306
>  Can't receive the Conduit Message in 10 seconds
> [ERROR]   Run 2: 
> RequestResponseTest.testRequestTopicResponseStaticQueue:63->sendAndReceiveMessages:95->AbstractJMSTester.sendMessage:165->AbstractJMSTester.sendoutMessage:187
>  » Runtime Timeout receiving message with correlationId 
> eb382e0774ca4c4f9f5bae1ae4dd147d0000000000000001
> [INFO]   Run 3: PASS
> [INFO] 
> [INFO] 
> [WARNING] Tests run: 65, Failures: 0, Errors: 0, Skipped: 1, Flakes: 
> 2{noformat}
> While the retrying does not fix the flaky tests, it should help reduce the 
> number of builds that fail. The end goal is to fix the flaky tests.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to