ulysses you created SPARK-34166:
-----------------------------------
Summary: Fix flaky test in DecommissionWorkerSuite
Key: SPARK-34166
URL: https://issues.apache.org/jira/browse/SPARK-34166
Project: Spark
Issue Type: Improvement
Components: Tests
Affects Versions: 3.2.0
Reporter: ulysses you
The test `decommission workers ensure that shuffle output is regenerated even
with shuffle service` assumes it has two executor and both of two tasks can
execute concurrently.
The two tasks will execute serially if there only have one executor. The result
is test is unexpceted. E.g.
```
[info] 5 did not equal 4 Expected 4 tasks but got List(0:0:0:0-SUCCESS,
0:0:1:0-FAILED, 0:0:1:1-SUCCESS, 0:1:0:0-SUCCESS, 1:0:0:0-SUCCESS)
(DecommissionWorkerSuite.scala:190)
```
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
