[jira] [Updated] (HUDI-4712) Flaky Tests w/ azure CI
[
https://issues.apache.org/jira/browse/HUDI-4712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo updated HUDI-4712:
Component/s: clustering
flink
table-service
> Flaky Tests w/ azure CI
> ---
>
> Key: HUDI-4712
> URL: https://issues.apache.org/jira/browse/HUDI-4712
> Project: Apache Hudi
> Issue Type: Test
> Components: clustering, flink, table-service
>Reporter: sivabalan narayanan
>Priority: Major
>
> In our azure CI runs, last 4 to 5 runs have failed. Mostly its related to
> Flink It tests.
>
> Tracking the failures here.
> [https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_apis/build/builds/10911/logs/24]
> {code:java}
> 2022-08-24T02:57:19.7513911Z [INFO] Running
> org.apache.hudi.table.ITTestHoodieDataSource
> 2022-08-24T03:13:47.5967799Z [INFO] Tests run: 96, Failures: 0, Errors: 0,
> Skipped: 0, Time elapsed: 987.826 s - in
> org.apache.hudi.table.ITTestHoodieDataSource
> 2022-08-24T03:13:47.5997817Z [INFO] Running
> org.apache.hudi.sink.compact.ITTestHoodieFlinkCompactor
> 2022-08-24T03:15:01.9378742Z [ERROR] Tests run: 7, Failures: 0, Errors: 1,
> Skipped: 0, Time elapsed: 74.337 s <<< FAILURE! - in
> org.apache.hudi.sink.compact.ITTestHoodieFlinkCompactor
> 2022-08-24T03:15:01.9381479Z [ERROR]
> testHoodieFlinkCompactorWithPlanSelectStrategy{boolean}[1] Time elapsed:
> 7.976 s <<< ERROR!
> 2022-08-24T03:15:01.9382198Z
> org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
> 2022-08-24T03:15:01.9383171Z Caused by:
> org.apache.flink.runtime.JobException: Recovery is suppressed by
> NoRestartBackoffTimeStrategy
> 2022-08-24T03:15:01.9383730Z Caused by:
> org.apache.hudi.exception.HoodieIOException: IOException when reading log
> file
> 2022-08-24T03:15:01.9384878Z Caused by: java.io.FileNotFoundException: File
> file:/tmp/junit4630651021120836419/par4/.d6675c02-f0f4-40ba-9f5e-986b84f73cb6_20220824031447463.log.1_0-4-0
> does not exist
> 2022-08-24T03:15:01.9650641Z
> 2022-08-24T03:15:01.9651540Z [INFO] Running
> org.apache.hudi.sink.cluster.ITTestHoodieFlinkClustering
> 2022-08-24T03:15:21.1311853Z [INFO] Tests run: 2, Failures: 0, Errors: 0,
> Skipped: 0, Time elapsed: 19.189 s - in
> org.apache.hudi.sink.cluster.ITTestHoodieFlinkClustering
> 2022-08-24T03:15:21.1324486Z [INFO] Running
> org.apache.hudi.sink.ITTestDataStreamWrite
> 2022-08-24T03:17:40.5148801Z [ERROR] Tests run: 9, Failures: 1, Errors: 0,
> Skipped: 0, Time elapsed: 139.379 s <<< FAILURE! - in
> org.apache.hudi.sink.ITTestDataStreamWrite
> 2022-08-24T03:17:40.5149895Z [ERROR]
> testWriteMergeOnReadWithCompaction{String}[1] Time elapsed: 21.725 s <<<
> FAILURE!
> 2022-08-24T03:17:40.5150555Z org.opentest4j.AssertionFailedError: expected:
> but was:
> 2022-08-24T03:17:40.5151262Z at
> org.apache.hudi.sink.ITTestDataStreamWrite.testWriteToHoodie(ITTestDataStreamWrite.java:252)
> 2022-08-24T03:17:40.5152067Z at
> org.apache.hudi.sink.ITTestDataStreamWrite.testWriteToHoodie(ITTestDataStreamWrite.java:182)
> 2022-08-24T03:17:40.5153086Z at
> org.apache.hudi.sink.ITTestDataStreamWrite.testWriteMergeOnReadWithCompaction(ITTestDataStreamWrite.java:156)
> 2022-08-24T03:17:40.5153593Z
> 2022-08-24T03:17:41.0381772Z [INFO]
> 2022-08-24T03:17:41.0382573Z [INFO] Results:
> 2022-08-24T03:17:41.0383977Z [INFO]
> 2022-08-24T03:17:41.0384447Z [ERROR] Failures:
> 2022-08-24T03:17:41.0385833Z [ERROR]
> ITTestDataStreamWrite.testWriteMergeOnReadWithCompaction:156->testWriteToHoodie:182->testWriteToHoodie:252
> expected: but was:
> 2022-08-24T03:17:41.0386560Z [ERROR] Errors:
> 2022-08-24T03:17:41.0387330Z [ERROR]
> ITTestHoodieFlinkCompactor.testHoodieFlinkCompactorWithPlanSelectStrategy »
> JobExecution
> 2022-08-24T03:17:41.0387896Z [INFO] {code}
> [https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_apis/build/builds/10911/logs/24]
> {code:java}
> 2022-08-24T02:57:18.8817403Z [INFO]
> ---
> 2022-08-24T02:57:19.7513911Z [INFO] Running
> org.apache.hudi.table.ITTestHoodieDataSource
> 2022-08-24T03:13:47.5967799Z [INFO] Tests run: 96, Failures: 0, Errors: 0,
> Skipped: 0, Time elapsed: 987.826 s - in
> org.apache.hudi.table.ITTestHoodieDataSource
> 2022-08-24T03:13:47.5997817Z [INFO] Running
> org.apache.hudi.sink.compact.ITTestHoodieFlinkCompactor
> 2022-08-24T03:15:01.9378742Z [ERROR] Tests run: 7, Failures: 0, Errors: 1,
> Skipped: 0, Time elapsed: 74.337 s <<< FAILURE! - in
> org.apache.hudi.sink.compact.ITTestHoodieFlinkCompactor
> 2022-08-24T03:15:01.9381479Z [ERROR]
> testHoodieFlinkCompactorWithPlanSelectStrategy{boolean}[1] Time elapsed:
> 7.976 s <<< ERROR!
> 2022-08-24T03:15:01.9382198Z
> org.apache.flink.runtime.client.JobExecut
[jira] [Updated] (HUDI-4712) Flaky Tests w/ azure CI
[
https://issues.apache.org/jira/browse/HUDI-4712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-4712:
--
Epic Link: HUDI-4302
> Flaky Tests w/ azure CI
> ---
>
> Key: HUDI-4712
> URL: https://issues.apache.org/jira/browse/HUDI-4712
> Project: Apache Hudi
> Issue Type: Test
>Reporter: sivabalan narayanan
>Priority: Major
>
> In our azure CI runs, last 4 to 5 runs have failed. Mostly its related to
> Flink It tests.
>
> Tracking the failures here.
> [https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_apis/build/builds/10911/logs/24]
> {code:java}
> 2022-08-24T02:57:19.7513911Z [INFO] Running
> org.apache.hudi.table.ITTestHoodieDataSource
> 2022-08-24T03:13:47.5967799Z [INFO] Tests run: 96, Failures: 0, Errors: 0,
> Skipped: 0, Time elapsed: 987.826 s - in
> org.apache.hudi.table.ITTestHoodieDataSource
> 2022-08-24T03:13:47.5997817Z [INFO] Running
> org.apache.hudi.sink.compact.ITTestHoodieFlinkCompactor
> 2022-08-24T03:15:01.9378742Z [ERROR] Tests run: 7, Failures: 0, Errors: 1,
> Skipped: 0, Time elapsed: 74.337 s <<< FAILURE! - in
> org.apache.hudi.sink.compact.ITTestHoodieFlinkCompactor
> 2022-08-24T03:15:01.9381479Z [ERROR]
> testHoodieFlinkCompactorWithPlanSelectStrategy{boolean}[1] Time elapsed:
> 7.976 s <<< ERROR!
> 2022-08-24T03:15:01.9382198Z
> org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
> 2022-08-24T03:15:01.9383171Z Caused by:
> org.apache.flink.runtime.JobException: Recovery is suppressed by
> NoRestartBackoffTimeStrategy
> 2022-08-24T03:15:01.9383730Z Caused by:
> org.apache.hudi.exception.HoodieIOException: IOException when reading log
> file
> 2022-08-24T03:15:01.9384878Z Caused by: java.io.FileNotFoundException: File
> file:/tmp/junit4630651021120836419/par4/.d6675c02-f0f4-40ba-9f5e-986b84f73cb6_20220824031447463.log.1_0-4-0
> does not exist
> 2022-08-24T03:15:01.9650641Z
> 2022-08-24T03:15:01.9651540Z [INFO] Running
> org.apache.hudi.sink.cluster.ITTestHoodieFlinkClustering
> 2022-08-24T03:15:21.1311853Z [INFO] Tests run: 2, Failures: 0, Errors: 0,
> Skipped: 0, Time elapsed: 19.189 s - in
> org.apache.hudi.sink.cluster.ITTestHoodieFlinkClustering
> 2022-08-24T03:15:21.1324486Z [INFO] Running
> org.apache.hudi.sink.ITTestDataStreamWrite
> 2022-08-24T03:17:40.5148801Z [ERROR] Tests run: 9, Failures: 1, Errors: 0,
> Skipped: 0, Time elapsed: 139.379 s <<< FAILURE! - in
> org.apache.hudi.sink.ITTestDataStreamWrite
> 2022-08-24T03:17:40.5149895Z [ERROR]
> testWriteMergeOnReadWithCompaction{String}[1] Time elapsed: 21.725 s <<<
> FAILURE!
> 2022-08-24T03:17:40.5150555Z org.opentest4j.AssertionFailedError: expected:
> but was:
> 2022-08-24T03:17:40.5151262Z at
> org.apache.hudi.sink.ITTestDataStreamWrite.testWriteToHoodie(ITTestDataStreamWrite.java:252)
> 2022-08-24T03:17:40.5152067Z at
> org.apache.hudi.sink.ITTestDataStreamWrite.testWriteToHoodie(ITTestDataStreamWrite.java:182)
> 2022-08-24T03:17:40.5153086Z at
> org.apache.hudi.sink.ITTestDataStreamWrite.testWriteMergeOnReadWithCompaction(ITTestDataStreamWrite.java:156)
> 2022-08-24T03:17:40.5153593Z
> 2022-08-24T03:17:41.0381772Z [INFO]
> 2022-08-24T03:17:41.0382573Z [INFO] Results:
> 2022-08-24T03:17:41.0383977Z [INFO]
> 2022-08-24T03:17:41.0384447Z [ERROR] Failures:
> 2022-08-24T03:17:41.0385833Z [ERROR]
> ITTestDataStreamWrite.testWriteMergeOnReadWithCompaction:156->testWriteToHoodie:182->testWriteToHoodie:252
> expected: but was:
> 2022-08-24T03:17:41.0386560Z [ERROR] Errors:
> 2022-08-24T03:17:41.0387330Z [ERROR]
> ITTestHoodieFlinkCompactor.testHoodieFlinkCompactorWithPlanSelectStrategy »
> JobExecution
> 2022-08-24T03:17:41.0387896Z [INFO] {code}
> [https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_apis/build/builds/10911/logs/24]
> {code:java}
> 2022-08-24T02:57:18.8817403Z [INFO]
> ---
> 2022-08-24T02:57:19.7513911Z [INFO] Running
> org.apache.hudi.table.ITTestHoodieDataSource
> 2022-08-24T03:13:47.5967799Z [INFO] Tests run: 96, Failures: 0, Errors: 0,
> Skipped: 0, Time elapsed: 987.826 s - in
> org.apache.hudi.table.ITTestHoodieDataSource
> 2022-08-24T03:13:47.5997817Z [INFO] Running
> org.apache.hudi.sink.compact.ITTestHoodieFlinkCompactor
> 2022-08-24T03:15:01.9378742Z [ERROR] Tests run: 7, Failures: 0, Errors: 1,
> Skipped: 0, Time elapsed: 74.337 s <<< FAILURE! - in
> org.apache.hudi.sink.compact.ITTestHoodieFlinkCompactor
> 2022-08-24T03:15:01.9381479Z [ERROR]
> testHoodieFlinkCompactorWithPlanSelectStrategy{boolean}[1] Time elapsed:
> 7.976 s <<< ERROR!
> 2022-08-24T03:15:01.9382198Z
> org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
> 2022-08-24T03:15:01.9383171Z Caused by:
> org.apache.f
