tgravescs commented on pull request #31437: URL: https://github.com/apache/spark/pull/31437#issuecomment-773366575
ok, please update the description with those details. maybe cluster mode doesn't matter here because application master would be killed anyway. The original change I believe was before we could handle application master being killed and restarted. I think that is handled ok now. so just to verify with this change, the application master gets preempted and killed and application master gets restarted and the driver process continue, correct? The only thing better would be if yarn told us this was a preempt case, did you look at that at all? its been a while since I looked into the yarn code. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org