[
https://issues.apache.org/jira/browse/HIVE-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14250353#comment-14250353
]
Marcelo Vanzin commented on HIVE-8972:
--------------------------------------
The patch looks ok to me.
I though about creating a separate API for these kinds of RPCs - these wouldn't
be queued in the backend but executed right away. My only concern is that this
could be abused (e.g. a caller using these calls to run a Spark job before the
queue ones), but perhaps that's an app-level concern and the client shouldn't
care if someone uses it that way.
The netty framework we're using now could also make some things easier, like
adding listeners to JobHandle and reporting job state changes to the client
side when they happen (instead of the current poll-like approach?). We could
also add client-level listeners so that interesting events are reported (e.g.
"spark context up" and things like that). If there's interest in these things
we could create a new task and I'll try to find some time to work on it.
> Implement more fine-grained remote client-level events [Spark Branch]
> ---------------------------------------------------------------------
>
> Key: HIVE-8972
> URL: https://issues.apache.org/jira/browse/HIVE-8972
> Project: Hive
> Issue Type: Sub-task
> Components: Spark
> Reporter: Rui Li
> Assignee: Rui Li
> Attachments: HIVE-8972.1-spark.patch, HIVE-8972.2-spark.patch,
> HIVE-8972.3-spark.patch, HIVE-8972.3-spark.patch, HIVE-8972.4-spark.patch,
> HIVE-8972.5-spark.patch
>
>
> Follow up task of HIVE-8956.
> Fine-grained events are useful for better job monitor and failure handling.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
