[ https://issues.apache.org/jira/browse/IMPALA-12670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Quanlong Huang updated IMPALA-12670: ------------------------------------ Attachment: failed-query-profile.txt > TestConcurrentDdls.test_local_catalog_ddls_with_invalidate_metadata could > fail due to InconsistentMetadataFetchException > ------------------------------------------------------------------------------------------------------------------------ > > Key: IMPALA-12670 > URL: https://issues.apache.org/jira/browse/IMPALA-12670 > Project: IMPALA > Issue Type: Bug > Components: Frontend > Affects Versions: Impala 4.4.0 > Reporter: Quanlong Huang > Assignee: Quanlong Huang > Priority: Blocker > Attachments: failed-query-profile.txt > > > TestConcurrentDdls.test_local_catalog_ddls_with_invalidate_metadata could > fail due to InconsistentMetadataFetchException: > {code:python} > tests/custom_cluster/test_concurrent_ddls.py:72: in > test_local_catalog_ddls_with_invalidate_metadata > self._run_ddls_with_invalidation(unique_database, sync_ddl=False) > tests/custom_cluster/test_concurrent_ddls.py:148: in > _run_ddls_with_invalidation > worker[i].get(timeout=100) > toolchain/toolchain-packages-gcc10.4.0/python-2.7.16/lib/python2.7/multiprocessing/pool.py:572: > in get > raise self._value > E AssertionError: ImpalaBeeswaxException: > E INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'> > E MESSAGE: RuntimeException: java.util.concurrent.ExecutionException: > org.apache.impala.catalog.local.InconsistentMetadataFetchException: Fetching > TABLE failed. Could not find TCatalogObject(type:TABLE, catalog_version:0, > table:TTable(db_name:functional, tbl_name:alltypestiny)) > E CAUSED BY: ExecutionException: > org.apache.impala.catalog.local.InconsistentMetadataFetchException: Fetching > TABLE failed. Could not find TCatalogObject(type:TABLE, catalog_version:0, > table:TTable(db_name:functional, tbl_name:alltypestiny)) > E CAUSED BY: InconsistentMetadataFetchException: Fetching TABLE failed. > Could not find TCatalogObject(type:TABLE, catalog_version:0, > table:TTable(db_name:functional, tbl_name:alltypestiny)) > E > E assert <bound method type.is_acceptable_error of <class > 'test_concurrent_ddls.TestConcurrentDdls'>>("ImpalaBeeswaxException:\n INNER > EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>\n MESSAGE: > RuntimeException: ja...ould not find TCatalogObject(type:TABLE, > catalog_version:0, table:TTable(db_name:functional, > tbl_name:alltypestiny))\n", False) > E + where <bound method type.is_acceptable_error of <class > 'test_concurrent_ddls.TestConcurrentDdls'>> = > TestConcurrentDdls.is_acceptable_error > E + and "ImpalaBeeswaxException:\n INNER EXCEPTION: <class > 'beeswaxd.ttypes.BeeswaxException'>\n MESSAGE: RuntimeException: ja...ould > not find TCatalogObject(type:TABLE, catalog_version:0, > table:TTable(db_name:functional, tbl_name:alltypestiny))\n" = > str(ImpalaBeeswaxException()){code} > The exception in impalad.INFO: > {noformat} > I0103 11:19:32.221755 8786 jni-util.cc:302] > 3b476356afa44e74:6f637cfa00000000] java.lang.RuntimeException: > java.util.concurrent.ExecutionException: > org.apache.impala.catalog.local.InconsistentMetadataFetchException: Fetching > TABLE failed. Could not find TCatalogObject(type:TABLE, catalog_version:0, > table:TTable(db_name:functional, tbl_name:alltypestiny)) > at > org.apache.impala.catalog.local.CatalogdMetaProvider.getIfPresent(CatalogdMetaProvider.java:901) > at > org.apache.impala.catalog.local.CatalogdMetaProvider.getTableIfPresent(CatalogdMetaProvider.java:750) > at > org.apache.impala.catalog.local.LocalDb.getTableIfCached(LocalDb.java:128) > at org.apache.impala.catalog.local.LocalDb.getTable(LocalDb.java:143) > at > org.apache.impala.analysis.StmtMetadataLoader.getMissingTables(StmtMetadataLoader.java:314) > at > org.apache.impala.analysis.StmtMetadataLoader.loadTables(StmtMetadataLoader.java:169) > at > org.apache.impala.analysis.StmtMetadataLoader.loadTables(StmtMetadataLoader.java:145) > at > org.apache.impala.service.Frontend.doCreateExecRequest(Frontend.java:2348) > at > org.apache.impala.service.Frontend.getTExecRequest(Frontend.java:2110) > at > org.apache.impala.service.Frontend.createExecRequest(Frontend.java:1883) > at > org.apache.impala.service.JniFrontend.createExecRequest(JniFrontend.java:169) > Caused by: java.util.concurrent.ExecutionException: > org.apache.impala.catalog.local.InconsistentMetadataFetchException: Fetching > TABLE failed. Could not find TCatalogObject(type:TABLE, catalog_version:0, > table:TTable(db_name:functional, tbl_name:alltypestiny)) > at > java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357) > at > java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908) > at > org.apache.impala.catalog.local.CatalogdMetaProvider.getIfPresent(CatalogdMetaProvider.java:898) > ... 10 more > Caused by: > org.apache.impala.catalog.local.InconsistentMetadataFetchException: Fetching > TABLE failed. Could not find TCatalogObject(type:TABLE, catalog_version:0, > table:TTable(db_name:functional, tbl_name:alltypestiny)) > at > org.apache.impala.catalog.local.CatalogdMetaProvider.sendRequest(CatalogdMetaProvider.java:465) > at > org.apache.impala.catalog.local.CatalogdMetaProvider.access$100(CatalogdMetaProvider.java:199) > at > org.apache.impala.catalog.local.CatalogdMetaProvider$4.call(CatalogdMetaProvider.java:776) > at > org.apache.impala.catalog.local.CatalogdMetaProvider$4.call(CatalogdMetaProvider.java:768) > at > org.apache.impala.catalog.local.CatalogdMetaProvider.loadWithCaching(CatalogdMetaProvider.java:562) > at > org.apache.impala.catalog.local.CatalogdMetaProvider.loadTable(CatalogdMetaProvider.java:764) > at > org.apache.impala.catalog.local.LocalTable.loadTableMetadata(LocalTable.java:152) > at > org.apache.impala.catalog.local.LocalTable.load(LocalTable.java:104) > at org.apache.impala.catalog.local.LocalDb.getTable(LocalDb.java:147) > ... 7 more{noformat} > Other tests in TestConcurrentDdls that use local catalog mode could also hit > the same issue, e.g. test_mixed_catalog_ddls_with_invalidate_metadata. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org For additional commands, e-mail: issues-all-h...@impala.apache.org