Atul Payapilly created SPARK-18996:
--------------------------------------
Summary: Spark SQL support for post hooks
Key: SPARK-18996
URL: https://issues.apache.org/jira/browse/SPARK-18996
Project: Spark
Issue Type: New Feature
Components: SQL
Reporter: Atul Payapilly
Spark SQL used to support Hive execution hooks(incidentally as a side effect of
using the Hive Driver in earlier versions) but no longer does so. More details
at: https://issues.apache.org/jira/browse/SPARK-18879.
The post hook functionality where it is possible to determine which partitions
were written to is extremely useful, Eg: Suppose the data is written and then
exported to an external system, without post hooks, this is not possible to
determine.
This feature request is to provide this capability, ideally using the Hive exec
hooks API if possible so users don't need to rewrite their hooks.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
