Github user liyinan926 commented on the issue: https://github.com/apache/spark/pull/19954 @vanzin @mccheah @foxish Variables names have been shortened in https://github.com/apache/spark/pull/19954/commits/d50c61e46c43049b9ede615ffabd89a55c4adb0c, and traits with only a single implementation have been removed in https://github.com/apache/spark/pull/19954/commits/5b82fc06a5fff2a3ff2062c46a21d069640eeec7. Regarding the documentation of the concepts around steps and orchestrators and how they fit together, I would suggest that we have a separate PR for the architecture docs. I also think we can refactor the orchestrator logic in a future PR to also cover executor pods so we use the same mechanism for both the driver and executor pods. WDYT?
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org