Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/8911#issuecomment-143349924 There's code in different places that set `SPARK_YARN_MODE`, but there's no code to unset it. So, to follow your example, if you start a context with yarn-client and later start another one in standalone mode, the latter will use the YARN version of the utils class. Other than that, looks sane. This is another piece of code that will need some serious thought when trying to fix the "Spark doesn't allow multiple contexts" issue, though.
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org