Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/539#issuecomment-41349740
Yeah, it looks like even if we set `SPARK_YARN_APP_NAME` it will never get
propagated to the YARN client. I agree that switching around the two conditions
will correct this, but how will the other configs be affected?
More generally, what semantics should we provide here? Should env vars
always take precedence over the corresponding value in `spark.*` configuration
options?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---