Rui Li created HIVE-7893:
----------------------------
Summary: Find a way to get a job identifier when submitting a
spark job [Spark Branch]
Key: HIVE-7893
URL: https://issues.apache.org/jira/browse/HIVE-7893
Project: Hive
Issue Type: Task
Components: Spark
Reporter: Rui Li
Assignee: Rui Li
Priority: Minor
Currently we use the {{foreach}} RDD action to submit a spark job. In order to
implement job monitoring functionality (HIVE-7438), we need to get a job
identifier when submitting the job, so that we can later register some listener
for that specific job.
This task requires facilitation from spark side (SPARK-2636). I've tried to use
{{AsyncRDDActions}} instead of the traditional actions, and it proved to be a
possible way to get the job ID we need.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
