[
https://issues.apache.org/jira/browse/SPARK-2636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14086494#comment-14086494
]
Marcelo Vanzin commented on SPARK-2636:
---------------------------------------
(BTW, just checked SPARK-2321, so if you really mean the {{Job}} id, ignore my
comments, since yes, it's kind of a pain to know the ID of a job you're
submitting to the context.)
> no where to get job identifier while submit spark job through spark API
> -----------------------------------------------------------------------
>
> Key: SPARK-2636
> URL: https://issues.apache.org/jira/browse/SPARK-2636
> Project: Spark
> Issue Type: New Feature
> Reporter: Chengxiang Li
>
> In Hive on Spark, we want to track spark job status through Spark API, the
> basic idea is as following:
> # create an hive-specified spark listener and register it to spark listener
> bus.
> # hive-specified spark listener generate job status by spark listener events.
> # hive driver track job status through hive-specified spark listener.
> the current problem is that hive driver need job identifier to track
> specified job status through spark listener, but there is no spark API to get
> job identifier(like job id) while submit spark job.
> I think other project whoever try to track job status with spark API would
> suffer from this as well.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
