Chengxiang Li created SPARK-2636:
------------------------------------
Summary: no where to get job identifier while submit spark job
through spark API
Key: SPARK-2636
URL: https://issues.apache.org/jira/browse/SPARK-2636
Project: Spark
Issue Type: New Feature
Reporter: Chengxiang Li
In Hive on Spark, we want to track spark job status through Spark API, the
basic idea is as following:
# create an hive-specified spark listener and register it to spark listener bus.
# hive-specified spark listener generate job status by spark listener events.
# hive driver track job status through hive-specified spark listener.
the current problem is that hive driver need job identifier to track specified
job status through spark listener, but there is no spark API to get job
identifier(like job id) while submit spark job.
I think other project whoever try to track job status with spark API would
suffer from this as well.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
