[ 
https://issues.apache.org/jira/browse/HIVE-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rui Li resolved HIVE-7893.
--------------------------
    Resolution: Fixed

Fixed via HIVE-7439

> Find a way to get a job identifier when submitting a spark job [Spark Branch]
> -----------------------------------------------------------------------------
>
>                 Key: HIVE-7893
>                 URL: https://issues.apache.org/jira/browse/HIVE-7893
>             Project: Hive
>          Issue Type: Task
>          Components: Spark
>            Reporter: Rui Li
>            Assignee: Rui Li
>            Priority: Minor
>              Labels: Spark-M3
>
> Currently we use the {{foreach}} RDD action to submit a spark job. In order 
> to implement job monitoring functionality (HIVE-7438), we need to get a job 
> identifier when submitting the job, so that we can later register some 
> listener for that specific job.
> This task requires facilitation from spark side (SPARK-2636). I've tried to 
> use {{AsyncRDDActions}} instead of the traditional actions, and it proved to 
> be a possible way to get the job ID we need.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to