[AIRFLOW-1085] Enhance the SparkSubmitOperator
- Allow the Spark home to be set on per connection
basis to obviate
the need for the spark-submit to be on the PATH,
and allows different
versions of Spark to be easily used.
- Enable the use of the --driver-memory parameter
on the spark-submit
Repository: incubator-airflow
Updated Branches:
refs/heads/master 35e43f506 -> 0ade066f4
[AIRFLOW-1085] Enhance the SparkSubmitOperator
- Allow the Spark home to be set on per connection
basis to obviate
the need for the spark-submit to be on the PATH,
and allows different
versions of Spar
Repository: incubator-airflow
Updated Branches:
refs/heads/v1-8-test 0fa593e38 -> ceb2ac366
[AIRFLOW-1085] Enhance the SparkSubmitOperator
- Allow the Spark home to be set on per connection
basis to obviate
the need for the spark-submit to be on the PATH,
and allows different
versions of S