Jay Sen created GOBBLIN-832: ------------------------------- Summary: get specific tables instead of all tables from Hive DB Key: GOBBLIN-832 URL: https://issues.apache.org/jira/browse/GOBBLIN-832 Project: Apache Gobblin Issue Type: Improvement Affects Versions: 0.14.0 Reporter: Jay Sen Fix For: 0.15.0
{{HiveDataSetFinder}} uses (Hive's) {{client.get().getAllDatabases()}} and {{client.get().getAllTables(db)}} which can be inefficient when DB have thousands of tables, getting all tables wont be efficient on metastore all the time. should use methods like {{listTableNamesByFilter}} or {{getTables}} which has ways to specify table pattern as well. -- This message was sent by Atlassian JIRA (v7.6.14#76016)