[ https://issues.apache.org/jira/browse/IMPALA-11677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17620441#comment-17620441 ]
Csaba Ringhofer commented on IMPALA-11677: ------------------------------------------ [~hong7j] I have created IMPALA-11108 about switching to a batched API when creating write events. It should make FireInsertEvents much faster for Hive ACID tables. Do you think that it would help with this issue? Or non-ACID tables are also not fast enough? > FireInsertEvents function can be very slow for tables with large number of > partitions. > -------------------------------------------------------------------------------------- > > Key: IMPALA-11677 > URL: https://issues.apache.org/jira/browse/IMPALA-11677 > Project: IMPALA > Issue Type: Improvement > Components: Catalog > Affects Versions: Impala 4.1.0 > Reporter: Qihong Jiang > Assignee: Qihong Jiang > Priority: Major > > In src/compat-apache-hive-3/java/org/apache/impala/compat/MetastoreShim.java. > fireInsertEvents function can be very slow for tables with large number of > partitions. So we should use asynchronous calls.Just like in impala-3.x -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org For additional commands, e-mail: issues-all-h...@impala.apache.org