Bikramjeet Vig created IMPALA-9114: -------------------------------------- Summary: TestKuduHMSIntegration failing: Kudu create table failing Key: IMPALA-9114 URL: https://issues.apache.org/jira/browse/IMPALA-9114 Project: IMPALA Issue Type: Bug Affects Versions: Impala 3.4.0 Reporter: Bikramjeet Vig Assignee: Hao Hao
{noformat} Error Message ImpalaBeeswaxException: ImpalaBeeswaxException: INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'> MESSAGE: AnalysisException: Cannot analyze Kudu table 't': Error determining if Kudu's integration with the Hive Metastore is enabled: cannot complete before timeout: KuduRpc(method=getHiveMetastoreConfig, tablet=null, attempt=97, TimeoutTracker(timeout=180000, elapsed=178723), Trace Summary(177842 ms): Sent(0), Received(0), Delayed(96), MasterRefresh(0), AuthRefresh(0), Truncated: false Delayed: (UNKNOWN, [ getHiveMetastoreConfig, 96 ])) Stacktrace custom_cluster/test_kudu.py:150: in test_create_managed_kudu_tables self.run_test_case('QueryTest/kudu_create', vector, use_db=unique_database) common/impala_test_suite.py:621: in run_test_case result = exec_fn(query, user=test_section.get('USER', '').strip() or None) common/impala_test_suite.py:556: in __exec_in_impala result = self.__execute_query(target_impalad_client, query, user=user) common/impala_test_suite.py:893: in __execute_query return impalad_client.execute(query, user=user) common/impala_connection.py:205: in execute return self.__beeswax_client.execute(sql_stmt, user=user) beeswax/impala_beeswax.py:187: in execute handle = self.__execute_query(query_string.strip(), user=user) beeswax/impala_beeswax.py:362: in __execute_query handle = self.execute_query_async(query_string, user=user) beeswax/impala_beeswax.py:356: in execute_query_async handle = self.__do_rpc(lambda: self.imp_service.query(query,)) beeswax/impala_beeswax.py:519: in __do_rpc raise ImpalaBeeswaxException(self.__build_error_message(b), b) E ImpalaBeeswaxException: ImpalaBeeswaxException: E INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'> E MESSAGE: AnalysisException: Cannot analyze Kudu table 't': Error determining if Kudu's integration with the Hive Metastore is enabled: cannot complete before timeout: KuduRpc(method=getHiveMetastoreConfig, tablet=null, attempt=97, TimeoutTracker(timeout=180000, elapsed=178723), Trace Summary(177842 ms): Sent(0), Received(0), Delayed(96), MasterRefresh(0), AuthRefresh(0), Truncated: false E Delayed: (UNKNOWN, [ getHiveMetastoreConfig, 96 ])) Standard Output Stopping kudu Starting kudu (Web UI - http://localhost:8051) Standard Error -- 2019-10-31 12:46:18,353 INFO MainThread: Starting cluster with command: /data/jenkins/workspace/impala-asf-master-exhaustive/repos/Impala/bin/start-impala-cluster.py '--state_store_args=--statestore_update_frequency_ms=50 --statestore_priority_update_frequency_ms=50 --statestore_heartbeat_frequency_ms=50' --cluster_size=3 --num_coordinators=3 --log_dir=/data/jenkins/workspace/impala-asf-master-exhaustive/repos/Impala/logs/custom_cluster_tests --log_level=1 '--impalad_args=-kudu_client_rpc_timeout_ms=30000 ' '--state_store_args=None ' --impalad_args=--default_query_options= 12:46:18 MainThread: Found 0 impalad/0 statestored/0 catalogd process(es) 12:46:18 MainThread: Starting State Store logging to /data/jenkins/workspace/impala-asf-master-exhaustive/repos/Impala/logs/custom_cluster_tests/statestored.INFO 12:46:18 MainThread: Starting Catalog Service logging to /data/jenkins/workspace/impala-asf-master-exhaustive/repos/Impala/logs/custom_cluster_tests/catalogd.INFO 12:46:18 MainThread: Starting Impala Daemon logging to /data/jenkins/workspace/impala-asf-master-exhaustive/repos/Impala/logs/custom_cluster_tests/impalad.INFO 12:46:18 MainThread: Starting Impala Daemon logging to /data/jenkins/workspace/impala-asf-master-exhaustive/repos/Impala/logs/custom_cluster_tests/impalad_node1.INFO 12:46:18 MainThread: Starting Impala Daemon logging to /data/jenkins/workspace/impala-asf-master-exhaustive/repos/Impala/logs/custom_cluster_tests/impalad_node2.INFO 12:46:21 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es) 12:46:21 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es) 12:46:21 MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25000 12:46:22 MainThread: Waiting for num_known_live_backends=3. Current value: 0 12:46:23 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es) 12:46:23 MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25000 12:46:23 MainThread: Waiting for num_known_live_backends=3. Current value: 0 12:46:24 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es) 12:46:24 MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25000 12:46:24 MainThread: num_known_live_backends has reached value: 3 12:46:24 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es) 12:46:24 MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25001 12:46:24 MainThread: num_known_live_backends has reached value: 3 12:46:25 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es) 12:46:25 MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25002 12:46:25 MainThread: num_known_live_backends has reached value: 3 12:46:25 MainThread: Impala Cluster Running with 3 nodes (3 coordinators, 3 executors). -- 2019-10-31 12:46:25,716 DEBUG MainThread: Found 3 impalad/1 statestored/1 catalogd process(es) -- 2019-10-31 12:46:25,716 INFO MainThread: Getting metric: statestore.live-backends from impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25010 -- 2019-10-31 12:46:25,718 INFO MainThread: Starting new HTTP connection (1): impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com -- 2019-10-31 12:46:25,719 INFO MainThread: Metric 'statestore.live-backends' has reached desired value: 4 -- 2019-10-31 12:46:25,719 DEBUG MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25000 -- 2019-10-31 12:46:25,720 INFO MainThread: Starting new HTTP connection (1): impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com -- 2019-10-31 12:46:25,721 INFO MainThread: num_known_live_backends has reached value: 3 -- 2019-10-31 12:46:25,721 DEBUG MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25001 -- 2019-10-31 12:46:25,721 INFO MainThread: Starting new HTTP connection (1): impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com -- 2019-10-31 12:46:25,722 INFO MainThread: num_known_live_backends has reached value: 3 -- 2019-10-31 12:46:25,723 DEBUG MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25002 -- 2019-10-31 12:46:25,723 INFO MainThread: Starting new HTTP connection (1): impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com -- 2019-10-31 12:46:25,724 INFO MainThread: num_known_live_backends has reached value: 3 SET client_identifier=custom_cluster/test_kudu.py::TestKuduHMSIntegration::()::test_create_managed_kudu_tables[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_thresh; -- connecting to: localhost:21000 -- connecting to localhost:21050 with impyla -- 2019-10-31 12:46:25,863 INFO MainThread: Closing active operation SET client_identifier=custom_cluster/test_kudu.py::TestKuduHMSIntegration::()::test_create_managed_kudu_tables[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_thresh; SET sync_ddl=False; -- executing against localhost:21000 DROP DATABASE IF EXISTS `test_create_managed_kudu_tables_a8d11828` CASCADE; -- 2019-10-31 12:46:25,989 INFO MainThread: Started query 654518748d4558d9:09072f1600000000 SET client_identifier=custom_cluster/test_kudu.py::TestKuduHMSIntegration::()::test_create_managed_kudu_tables[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_thresh; SET sync_ddl=False; -- executing against localhost:21000 CREATE DATABASE `test_create_managed_kudu_tables_a8d11828`; -- 2019-10-31 12:46:26,408 INFO MainThread: Started query b6472ff2ad59403b:385d4ec500000000 -- 2019-10-31 12:46:26,410 INFO MainThread: Created database "test_create_managed_kudu_tables_a8d11828" for test ID "custom_cluster/test_kudu.py::TestKuduHMSIntegration::()::test_create_managed_kudu_tables[protocol: beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format: text/none]" SET client_identifier=custom_cluster/test_kudu.py::TestKuduHMSIntegration::()::test_create_managed_kudu_tables[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_thresh; -- executing against localhost:21000 use test_create_managed_kudu_tables_a8d11828; -- 2019-10-31 12:46:26,417 INFO MainThread: Started query c54a078aaf47706a:7be99df800000000 SET client_identifier=custom_cluster/test_kudu.py::TestKuduHMSIntegration::()::test_create_managed_kudu_tables[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_thresh; SET kudu_read_mode=READ_AT_SNAPSHOT; SET batch_size=0; SET num_nodes=0; SET disable_codegen_rows_threshold=0; SET disable_codegen=False; SET abort_on_error=1; SET exec_single_node_rows_threshold=0; -- 2019-10-31 12:46:26,420 INFO MainThread: Starting new HTTP connection (1): localhost -- executing against localhost:21000 create table t primary key (id) partition by hash (id) partitions 3 stored as kudu as select id, int_col from functional.alltypestiny;{noformat} -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org For additional commands, e-mail: issues-all-h...@impala.apache.org