[ https://issues.apache.org/jira/browse/AIRFLOW-6949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17047470#comment-17047470 ]
ASF subversion and git services commented on AIRFLOW-6949: ---------------------------------------------------------- Commit 7978bf778fb26f3393fa6456ca5594635a870877 in airflow's branch refs/heads/v1-10-test from Fokko Driesprong [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=7978bf7 ] [AIRFLOW-6949] Respect explicit `spark.kubernetes.namespace` conf to SparkSubmitOperator (#7575) This means the value from the Operator/dag file takes precedence over the connection The previous behaviour was to emit one line from the conf arg, but then a later one from the connection: ``` --conf spark.kubernetes.namespace=airflow \ --conf spark.kubernetes.namespace=default \ ``` > SparkSubitOperator ignores explicit spark.kubernetes.namespace config option > ---------------------------------------------------------------------------- > > Key: AIRFLOW-6949 > URL: https://issues.apache.org/jira/browse/AIRFLOW-6949 > Project: Apache Airflow > Issue Type: Bug > Components: hooks > Affects Versions: 1.10.9 > Reporter: Ash Berlin-Taylor > Assignee: Ash Berlin-Taylor > Priority: Minor > Fix For: 1.10.10 > > > If a user explicitly passes {{spark.kubernetes.namespace}} in the config > attribute, we should respect that over what is given in the connection. -- This message was sent by Atlassian Jira (v8.3.4#803005)