Vihang Karajgaonkar created IMPALA-9369:
-------------------------------------------
Summary: Inserts on large tables could be very slow when event
processing it turned on
Key: IMPALA-9369
URL: https://issues.apache.org/jira/browse/IMPALA-9369
Project: IMPALA
Issue Type: Improvement
Components: Catalog
Reporter: Vihang Karajgaonkar
In case where large number files are being inserted into a table, the
{{createInsertEvents}} method fires insert events to HMS for each partition one
take a time. This could be very slow for a insert statement which is added
hundreds or thousands of files.
We should see if we can fire the insert events asynchronously instead of
blocking the query from returning to the user until all the insert events are
fired.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
