Github user BryanCutler commented on the issue:
https://github.com/apache/spark/pull/23236
True, the test is not that long under light resources. Locally, I saw a
couple seconds difference with the changes I mentioned. The weird thing is the
unmodified test completes after the 11th batch with errors
```
['0.67', '0.71', '0.78', '0.7', '0.75', '0.74', '0.73', '0.69', '0.62',
'0.71', '0.31']
```
Compared to the error values from the test failures above, they match up
until the 10th batch but then these continue until the 16th where it has a
timeout
```
0.67, 0.71, 0.78, 0.7, 0.75, 0.74, 0.73, 0.69, 0.62, 0.71, 0.69, 0.75,
0.72, 0.77, 0.71, 0.74
```
I would expect the seed to produce the same values (or all diff if the
random func is different), which makes me think something else is going on..
Anyway, I think it's fine to increase the timeout and if it's still flaky,
we can look at making changes.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
