Michael Smith created IMPALA-13027:
--------------------------------------
Summary: Directly create exec request for query log inserts
Key: IMPALA-13027
URL: https://issues.apache.org/jira/browse/IMPALA-13027
Project: IMPALA
Issue Type: Improvement
Reporter: Michael Smith
Inserts into {{sys.impala_query_log}} can be large, as they include the query
profile and currently 49 columns for each query. Right now inserts are executed
via an SQL statement, which needs to be parsed by Impala's Frontend. This can
take a non-trivial amount of time - on the order of seconds - when reaching the
query queue limit (1000s of queries), and also require increasing the
{{statement_expression_limit}} above 250k.
We could improve this by directly constructing the TExecRequest for the insert
in InternalServer (likely via a new function API). This would also let us avoid
needing to escape strings in the SQL statement by directly constructing the
relevant type objects.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
