[
https://issues.apache.org/jira/browse/AIRFLOW-2079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on AIRFLOW-2079 started by Kyle Hamlin.
--------------------------------------------
> Add mesos polling to spark_submit_hook
> --------------------------------------
>
> Key: AIRFLOW-2079
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2079
> Project: Apache Airflow
> Issue Type: Improvement
> Components: contrib, hooks
> Affects Versions: 1.10.0
> Reporter: Kyle Hamlin
> Assignee: Kyle Hamlin
> Priority: Minor
> Labels: easyfix
> Fix For: 1.10.0
>
>
> The SparkSubmitHook has a method `_resolve_should_track_driver_status` which
> tells the hook whether or not to poll the spark-submit driver for its status.
> Currently, the method only checks for a master containing `spark://` in order
> to poll the driver. Since Mesos is an available master I think we should also
> include `mesos://` in this check.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
