[ 
https://issues.apache.org/jira/browse/HIVE-23018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vihang Karajgaonkar updated HIVE-23018:
---------------------------------------
    Summary: Provide a bulk API to fire multiple insert events  (was: Provide a 
bulk API to fire multiple listener events)

> Provide a bulk API to fire multiple insert events
> -------------------------------------------------
>
>                 Key: HIVE-23018
>                 URL: https://issues.apache.org/jira/browse/HIVE-23018
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Vihang Karajgaonkar
>            Assignee: Vihang Karajgaonkar
>            Priority: Major
>
> Metastore provides a API to fire a listener event (currently only supports 
> INSERT event). The problem with that API is that it only takes in one 
> partition at a time. A typical query may insert data into multiple partitions 
> at a time. In such a case query engines like HS2 or Impala will have to issue 
> multiple RPCs to metastore sequentially to fire these events. This can show 
> up as a slowdown to the user if the query engines do not return the prompt to 
> the user until all the events are fired (In case of HS2 and Impala). It would 
> be great if we have bulk API which takes in multiple partitions for a table 
> so that metastore can generate many such events in one RPC.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to