Github user gaborgsomogyi commented on the issue: https://github.com/apache/spark/pull/20888 I mean on my machine the stage ID is zero for long long time here: ``` DataFrameRangeSuite.stageToKill = TaskContext.get().stageId() ``` and after 200 seconds the other thread still stands on this (increased the timeout to play): ``` eventually(timeout(300.seconds), interval(1.millis)) { assert(DataFrameRangeSuite.stageToKill != DataFrameRangeSuite.INVALID_STAGE_ID) } ``` and `cancelStage` never called. Based on that the first non-invalid stage ID on my machine is 0. The actual code miss that edge case. When I start the whole suite then other tests are pre-initializing something and the ID is not 0 anymore.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org