[ https://issues.apache.org/jira/browse/AIRFLOW-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arthur Wiedmer resolved AIRFLOW-2380. ------------------------------------- Resolution: Fixed Fix Version/s: 1.10.0 Issue resolved by pull request #3268 [https://github.com/apache/incubator-airflow/pull/3268] > Add support for environment variables in Spark submit operator > -------------------------------------------------------------- > > Key: AIRFLOW-2380 > URL: https://issues.apache.org/jira/browse/AIRFLOW-2380 > Project: Apache Airflow > Issue Type: Improvement > Components: contrib, operators > Reporter: Cristòfol Torrens > Assignee: Cristòfol Torrens > Priority: Minor > Fix For: 1.10.0 > > > Add support for environment variables in Spark submit operator. > For example, to pass the *HADOOP_CONF_DIR* in case of use same Spark cluster > with multiple HDFS. > The idea is to pass as a dict, and resolve it in the case of using > *yarn-*_client/cluster_*,* and *standalone-*_client_ mode. > In *standalone-*_cluster_ mode is not possible to do this. -- This message was sent by Atlassian JIRA (v7.6.3#76005)