[
https://issues.apache.org/jira/browse/IMPALA-12579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790874#comment-17790874
]
ASF subversion and git services commented on IMPALA-12579:
----------------------------------------------------------
Commit ac18820e7be39f1dc95c447f791b56aa012daee9 in impala's branch
refs/heads/master from stiga-huang
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=ac18820e7 ]
IMPALA-12579: Add logs for loading table list in catalogd startup
Catalogd will load db and table list from HMS at startup. It could take
long for large dbs. This patch adds logs for this step so users won't
be confused and thinking catalogd is "hanging". Also improve the
function loading logs to show the number of loaded functions.
Tests:
- Verified the logs locally
Change-Id: I280c7b490bc57b38d867aeff29ae8ffcfec40c81
Reviewed-on: http://gerrit.cloudera.org:8080/20734
Reviewed-by: Andrew Sherman <asher...@cloudera.com>
Tested-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com>
> Add logs for loading table list in catalogd startup
> ---------------------------------------------------
>
> Key: IMPALA-12579
> URL: https://issues.apache.org/jira/browse/IMPALA-12579
> Project: IMPALA
> Issue Type: Improvement
> Components: Catalog
> Reporter: Quanlong Huang
> Assignee: Quanlong Huang
> Priority: Major
> Labels: supportability
>
> Catalogd loads the db, table and function list at startup. However, only the
> progress of loading functions are logged:
> {noformat}
> I1127 21:52:49.292649 27403 CatalogServiceCatalog.java:1767] Loading native
> functions for database: tpcds_seq_snap
> I1127 21:52:49.292702 27403 CatalogServiceCatalog.java:1775] Loaded native
> functions for database: tpcds_seq_snap
> I1127 21:52:49.292730 27403 CatalogServiceCatalog.java:1790] Loading Java
> functions for database: tpcds_seq_snap
> I1127 21:52:49.292754 27403 CatalogServiceCatalog.java:1804] Loaded Java
> functions for database: tpcds_seq_snap
> I1127 21:52:49.297230 27403 CatalogServiceCatalog.java:1767] Loading native
> functions for database: tpch
> I1127 21:52:49.297310 27403 CatalogServiceCatalog.java:1775] Loaded native
> functions for database: tpch
> I1127 21:52:49.297349 27403 CatalogServiceCatalog.java:1790] Loading Java
> functions for database: tpch
> I1127 21:52:49.297379 27403 CatalogServiceCatalog.java:1804] Loaded Java
> functions for database: tpch {noformat}
> When a database contains a large number of tables, e.g. 100K, it could take
> minutes to load its table list. We should add logs like "Loading table list
> for database: db1" and "Loaded xxx tables for database: db1" to improve the
> observability and supportability.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
