[jira] [Created] (KYLIN-5556) A large amount of tables to be loaded from datasources in a once request will dramatically decrease the performance of querying and cleaning operations

Tue, 06 Jun 2023 05:12:34 -0700 

Guangyuan Feng created KYLIN-5556:
-------------------------------------

             Summary: A large amount of tables to be loaded from datasources in 
a once request will dramatically decrease the performance of querying and 
cleaning operations 
                 Key: KYLIN-5556
                 URL: https://issues.apache.org/jira/browse/KYLIN-5556
             Project: Kylin
          Issue Type: Improvement
          Components: Modeling
            Reporter: Guangyuan Feng


Currently `TableExtService#loadDbTables` method will calling Spark to load all 
the tables in that datasource, without limit the number of tables to be 
returned. If too many tables loaded, it will dramatically decrease the 
performance of querying and cleaning operations.

So it will be great that Kylin supplies a similar method with a threshold, say 
1000, to limit the most amount of the tables to be returned in a once request.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to