[ https://issues.apache.org/jira/browse/IMPALA-8125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tim Armstrong updated IMPALA-8125: ---------------------------------- Labels: multithreading (was: ) > Limit number of files generated by unpartitioned insert > ------------------------------------------------------- > > Key: IMPALA-8125 > URL: https://issues.apache.org/jira/browse/IMPALA-8125 > Project: IMPALA > Issue Type: Sub-task > Components: Frontend > Reporter: Tim Armstrong > Priority: Major > Labels: multithreading > > One pitfall of multithreaded execution is that, if implemented naively, the > number of files generated by an unpartitioned insert will be multiplied by > mt_dop. > We should provide a mechanism to limit the number of files generated, e.g. > limit the number of insert fragment instances (note that there a pre-existing > problem with unpartitioned inserts generating too many files). -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org For additional commands, e-mail: issues-all-h...@impala.apache.org