jerrypeng commented on code in PR #59523:
URL: https://github.com/apache/spark/pull/59523#discussion_r4408493282
##########
core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala:
##########
@@ -10113,6 +10334,20 @@ class DAGSchedulerSuite extends SparkFunSuite with
TempLocalSparkContext with Ti
}
}
+ private def assertPersistedPipelinedConsumerRejected(
Review Comment:
Agreed. assertPersistedPipelinedConsumerRejected now delegates to
assertPipelinedRejectedBeforeStageRegistration, using one parameterized
expected-reason helper. This checks the exact condition, SQLSTATE, and reason,
submits twice, and verifies task/stage/result cleanup and that the SparkContext
remains alive.
The wrapper now snapshots and verifies the storage level and
local-checkpoint marker of the actual persisted RDD. This fixes the
narrow-descendant and cached-middle cases, where checking the uncached final
RDD only compared NONE with NONE. The pending-checkpoint and persisted self-zip
cases use this wrapper too. The channel test also uses checkError for the exact
error.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
