Rui Li created HIVE-7893: ---------------------------- Summary: Find a way to get a job identifier when submitting a spark job [Spark Branch] Key: HIVE-7893 URL: https://issues.apache.org/jira/browse/HIVE-7893 Project: Hive Issue Type: Task Components: Spark Reporter: Rui Li Assignee: Rui Li Priority: Minor
Currently we use the {{foreach}} RDD action to submit a spark job. In order to implement job monitoring functionality (HIVE-7438), we need to get a job identifier when submitting the job, so that we can later register some listener for that specific job. This task requires facilitation from spark side (SPARK-2636). I've tried to use {{AsyncRDDActions}} instead of the traditional actions, and it proved to be a possible way to get the job ID we need. -- This message was sent by Atlassian JIRA (v6.2#6252)