[
https://issues.apache.org/jira/browse/IMPALA-9114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17062590#comment-17062590
]
Norbert Luksa edited comment on IMPALA-9114 at 3/19/20, 1:56 PM:
-----------------------------------------------------------------
Found a similar exception during a [data-loading
test|https://master-02.jenkins.cloudera.com/job/impala-asf-master-core-data-load/941/]
in create-functional-query-exhaustive-impala-generated-kudu-none-none.sql:
{code:sql}
ERROR: CREATE TABLE functional_kudu.alltypes (
id INT PRIMARY KEY,
bool_col BOOLEAN,
tinyint_col TINYINT,
smallint_col SMALLINT,
int_col INT,
bigint_col BIGINT,
float_col FLOAT,
double_col DOUBLE,
date_string_col STRING,
string_col STRING,
timestamp_col TIMESTAMP,
year INT,
month INT
)
PARTITION BY HASH (id) PARTITIONS 3 STORED AS KUDU
Traceback (most recent call last):
File
"/data/jenkins/workspace/impala-asf-master-core-data-load/repos/Impala/bin/load-data.py",
line 208, in exec_impala_query_from_file
result = impala_client.execute(query)
File
"/data/jenkins/workspace/impala-asf-master-core-data-load/repos/Impala/tests/beeswax/impala_beeswax.py",
line 187, in execute
handle = self.__execute_query(query_string.strip(), user=user)
File
"/data/jenkins/workspace/impala-asf-master-core-data-load/repos/Impala/tests/beeswax/impala_beeswax.py",
line 363, in __execute_query
handle = self.execute_query_async(query_string, user=user)
File
"/data/jenkins/workspace/impala-asf-master-core-data-load/repos/Impala/tests/beeswax/impala_beeswax.py",
line 357, in execute_query_async
handle = self.__do_rpc(lambda: self.imp_service.query(query,))
File
"/data/jenkins/workspace/impala-asf-master-core-data-load/repos/Impala/tests/beeswax/impala_beeswax.py",
line 520, in __do_rpc
raise ImpalaBeeswaxException(self.__build_error_message(b), b)
ImpalaBeeswaxException: ImpalaBeeswaxException:
INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
MESSAGE: AnalysisException: Cannot analyze Kudu table 'alltypes': Error
determining if Kudu's integration with the Hive Metastore is enabled: too many
attempts: KuduRpc(method=getHiveMetastoreConfig, tablet=null, attempt=101,
TimeoutTracker(timeout=180000, elapsed=171248), Trace Summary(170894 ms):
Sent(0), Received(0), Delayed(100), MasterRefresh(0), AuthRefresh(0),
Truncated: false
Delayed: (UNKNOWN, [ getHiveMetastoreConfig, 100 ]))
{code}
was (Author: norbertluksa):
Found a similar exception during a [data-loading
test|https://master-02.jenkins.cloudera.com/job/impala-asf-master-core-data-load/941/]:
{code:sql}
ERROR: CREATE TABLE functional_kudu.alltypes (
id INT PRIMARY KEY,
bool_col BOOLEAN,
tinyint_col TINYINT,
smallint_col SMALLINT,
int_col INT,
bigint_col BIGINT,
float_col FLOAT,
double_col DOUBLE,
date_string_col STRING,
string_col STRING,
timestamp_col TIMESTAMP,
year INT,
month INT
)
PARTITION BY HASH (id) PARTITIONS 3 STORED AS KUDU
Traceback (most recent call last):
File
"/data/jenkins/workspace/impala-asf-master-core-data-load/repos/Impala/bin/load-data.py",
line 208, in exec_impala_query_from_file
result = impala_client.execute(query)
File
"/data/jenkins/workspace/impala-asf-master-core-data-load/repos/Impala/tests/beeswax/impala_beeswax.py",
line 187, in execute
handle = self.__execute_query(query_string.strip(), user=user)
File
"/data/jenkins/workspace/impala-asf-master-core-data-load/repos/Impala/tests/beeswax/impala_beeswax.py",
line 363, in __execute_query
handle = self.execute_query_async(query_string, user=user)
File
"/data/jenkins/workspace/impala-asf-master-core-data-load/repos/Impala/tests/beeswax/impala_beeswax.py",
line 357, in execute_query_async
handle = self.__do_rpc(lambda: self.imp_service.query(query,))
File
"/data/jenkins/workspace/impala-asf-master-core-data-load/repos/Impala/tests/beeswax/impala_beeswax.py",
line 520, in __do_rpc
raise ImpalaBeeswaxException(self.__build_error_message(b), b)
ImpalaBeeswaxException: ImpalaBeeswaxException:
INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
MESSAGE: AnalysisException: Cannot analyze Kudu table 'alltypes': Error
determining if Kudu's integration with the Hive Metastore is enabled: too many
attempts: KuduRpc(method=getHiveMetastoreConfig, tablet=null, attempt=101,
TimeoutTracker(timeout=180000, elapsed=171248), Trace Summary(170894 ms):
Sent(0), Received(0), Delayed(100), MasterRefresh(0), AuthRefresh(0),
Truncated: false
Delayed: (UNKNOWN, [ getHiveMetastoreConfig, 100 ]))
{code}
> TestKuduHMSIntegration failing: Kudu create table failing
> ---------------------------------------------------------
>
> Key: IMPALA-9114
> URL: https://issues.apache.org/jira/browse/IMPALA-9114
> Project: IMPALA
> Issue Type: Bug
> Affects Versions: Impala 3.4.0
> Reporter: Bikramjeet Vig
> Assignee: Hao Hao
> Priority: Minor
> Labels: broken-build
>
> {noformat}
> Error Message
> ImpalaBeeswaxException: ImpalaBeeswaxException: INNER EXCEPTION: <class
> 'beeswaxd.ttypes.BeeswaxException'> MESSAGE: AnalysisException: Cannot
> analyze Kudu table 't': Error determining if Kudu's integration with the Hive
> Metastore is enabled: cannot complete before timeout:
> KuduRpc(method=getHiveMetastoreConfig, tablet=null, attempt=97,
> TimeoutTracker(timeout=180000, elapsed=178723), Trace Summary(177842 ms):
> Sent(0), Received(0), Delayed(96), MasterRefresh(0), AuthRefresh(0),
> Truncated: false Delayed: (UNKNOWN, [ getHiveMetastoreConfig, 96 ]))
> Stacktrace
> custom_cluster/test_kudu.py:150: in test_create_managed_kudu_tables
> self.run_test_case('QueryTest/kudu_create', vector,
> use_db=unique_database)
> common/impala_test_suite.py:621: in run_test_case
> result = exec_fn(query, user=test_section.get('USER', '').strip() or None)
> common/impala_test_suite.py:556: in __exec_in_impala
> result = self.__execute_query(target_impalad_client, query, user=user)
> common/impala_test_suite.py:893: in __execute_query
> return impalad_client.execute(query, user=user)
> common/impala_connection.py:205: in execute
> return self.__beeswax_client.execute(sql_stmt, user=user)
> beeswax/impala_beeswax.py:187: in execute
> handle = self.__execute_query(query_string.strip(), user=user)
> beeswax/impala_beeswax.py:362: in __execute_query
> handle = self.execute_query_async(query_string, user=user)
> beeswax/impala_beeswax.py:356: in execute_query_async
> handle = self.__do_rpc(lambda: self.imp_service.query(query,))
> beeswax/impala_beeswax.py:519: in __do_rpc
> raise ImpalaBeeswaxException(self.__build_error_message(b), b)
> E ImpalaBeeswaxException: ImpalaBeeswaxException:
> E INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
> E MESSAGE: AnalysisException: Cannot analyze Kudu table 't': Error
> determining if Kudu's integration with the Hive Metastore is enabled: cannot
> complete before timeout: KuduRpc(method=getHiveMetastoreConfig, tablet=null,
> attempt=97, TimeoutTracker(timeout=180000, elapsed=178723), Trace
> Summary(177842 ms): Sent(0), Received(0), Delayed(96), MasterRefresh(0),
> AuthRefresh(0), Truncated: false
> E Delayed: (UNKNOWN, [ getHiveMetastoreConfig, 96 ]))
> Standard Output
> Stopping kudu
> Starting kudu (Web UI - http://localhost:8051)
> Standard Error
> -- 2019-10-31 12:46:18,353 INFO MainThread: Starting cluster with
> command:
> /data/jenkins/workspace/impala-asf-master-exhaustive/repos/Impala/bin/start-impala-cluster.py
> '--state_store_args=--statestore_update_frequency_ms=50
> --statestore_priority_update_frequency_ms=50
> --statestore_heartbeat_frequency_ms=50' --cluster_size=3 --num_coordinators=3
> --log_dir=/data/jenkins/workspace/impala-asf-master-exhaustive/repos/Impala/logs/custom_cluster_tests
> --log_level=1 '--impalad_args=-kudu_client_rpc_timeout_ms=30000 '
> '--state_store_args=None ' --impalad_args=--default_query_options=
> 12:46:18 MainThread: Found 0 impalad/0 statestored/0 catalogd process(es)
> 12:46:18 MainThread: Starting State Store logging to
> /data/jenkins/workspace/impala-asf-master-exhaustive/repos/Impala/logs/custom_cluster_tests/statestored.INFO
> 12:46:18 MainThread: Starting Catalog Service logging to
> /data/jenkins/workspace/impala-asf-master-exhaustive/repos/Impala/logs/custom_cluster_tests/catalogd.INFO
> 12:46:18 MainThread: Starting Impala Daemon logging to
> /data/jenkins/workspace/impala-asf-master-exhaustive/repos/Impala/logs/custom_cluster_tests/impalad.INFO
> 12:46:18 MainThread: Starting Impala Daemon logging to
> /data/jenkins/workspace/impala-asf-master-exhaustive/repos/Impala/logs/custom_cluster_tests/impalad_node1.INFO
> 12:46:18 MainThread: Starting Impala Daemon logging to
> /data/jenkins/workspace/impala-asf-master-exhaustive/repos/Impala/logs/custom_cluster_tests/impalad_node2.INFO
> 12:46:21 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
> 12:46:21 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
> 12:46:21 MainThread: Getting num_known_live_backends from
> impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25000
> 12:46:22 MainThread: Waiting for num_known_live_backends=3. Current value: 0
> 12:46:23 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
> 12:46:23 MainThread: Getting num_known_live_backends from
> impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25000
> 12:46:23 MainThread: Waiting for num_known_live_backends=3. Current value: 0
> 12:46:24 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
> 12:46:24 MainThread: Getting num_known_live_backends from
> impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25000
> 12:46:24 MainThread: num_known_live_backends has reached value: 3
> 12:46:24 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
> 12:46:24 MainThread: Getting num_known_live_backends from
> impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25001
> 12:46:24 MainThread: num_known_live_backends has reached value: 3
> 12:46:25 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
> 12:46:25 MainThread: Getting num_known_live_backends from
> impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25002
> 12:46:25 MainThread: num_known_live_backends has reached value: 3
> 12:46:25 MainThread: Impala Cluster Running with 3 nodes (3 coordinators, 3
> executors).
> -- 2019-10-31 12:46:25,716 DEBUG MainThread: Found 3 impalad/1
> statestored/1 catalogd process(es)
> -- 2019-10-31 12:46:25,716 INFO MainThread: Getting metric:
> statestore.live-backends from
> impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25010
> -- 2019-10-31 12:46:25,718 INFO MainThread: Starting new HTTP connection
> (1): impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com
> -- 2019-10-31 12:46:25,719 INFO MainThread: Metric
> 'statestore.live-backends' has reached desired value: 4
> -- 2019-10-31 12:46:25,719 DEBUG MainThread: Getting
> num_known_live_backends from
> impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25000
> -- 2019-10-31 12:46:25,720 INFO MainThread: Starting new HTTP connection
> (1): impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com
> -- 2019-10-31 12:46:25,721 INFO MainThread: num_known_live_backends has
> reached value: 3
> -- 2019-10-31 12:46:25,721 DEBUG MainThread: Getting
> num_known_live_backends from
> impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25001
> -- 2019-10-31 12:46:25,721 INFO MainThread: Starting new HTTP connection
> (1): impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com
> -- 2019-10-31 12:46:25,722 INFO MainThread: num_known_live_backends has
> reached value: 3
> -- 2019-10-31 12:46:25,723 DEBUG MainThread: Getting
> num_known_live_backends from
> impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com:25002
> -- 2019-10-31 12:46:25,723 INFO MainThread: Starting new HTTP connection
> (1): impala-ec2-centos74-m5-4xlarge-ondemand-0645.vpc.cloudera.com
> -- 2019-10-31 12:46:25,724 INFO MainThread: num_known_live_backends has
> reached value: 3
> SET
> client_identifier=custom_cluster/test_kudu.py::TestKuduHMSIntegration::()::test_create_managed_kudu_tables[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_thresh;
> -- connecting to: localhost:21000
> -- connecting to localhost:21050 with impyla
> -- 2019-10-31 12:46:25,863 INFO MainThread: Closing active operation
> SET
> client_identifier=custom_cluster/test_kudu.py::TestKuduHMSIntegration::()::test_create_managed_kudu_tables[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_thresh;
> SET sync_ddl=False;
> -- executing against localhost:21000
> DROP DATABASE IF EXISTS `test_create_managed_kudu_tables_a8d11828` CASCADE;
> -- 2019-10-31 12:46:25,989 INFO MainThread: Started query
> 654518748d4558d9:09072f1600000000
> SET
> client_identifier=custom_cluster/test_kudu.py::TestKuduHMSIntegration::()::test_create_managed_kudu_tables[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_thresh;
> SET sync_ddl=False;
> -- executing against localhost:21000
> CREATE DATABASE `test_create_managed_kudu_tables_a8d11828`;
> -- 2019-10-31 12:46:26,408 INFO MainThread: Started query
> b6472ff2ad59403b:385d4ec500000000
> -- 2019-10-31 12:46:26,410 INFO MainThread: Created database
> "test_create_managed_kudu_tables_a8d11828" for test ID
> "custom_cluster/test_kudu.py::TestKuduHMSIntegration::()::test_create_managed_kudu_tables[protocol:
> beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0,
> 'disable_codegen_rows_threshold': 0, 'disable_codegen': False,
> 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
> text/none]"
> SET
> client_identifier=custom_cluster/test_kudu.py::TestKuduHMSIntegration::()::test_create_managed_kudu_tables[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_thresh;
> -- executing against localhost:21000
> use test_create_managed_kudu_tables_a8d11828;
> -- 2019-10-31 12:46:26,417 INFO MainThread: Started query
> c54a078aaf47706a:7be99df800000000
> SET
> client_identifier=custom_cluster/test_kudu.py::TestKuduHMSIntegration::()::test_create_managed_kudu_tables[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_thresh;
> SET kudu_read_mode=READ_AT_SNAPSHOT;
> SET batch_size=0;
> SET num_nodes=0;
> SET disable_codegen_rows_threshold=0;
> SET disable_codegen=False;
> SET abort_on_error=1;
> SET exec_single_node_rows_threshold=0;
> -- 2019-10-31 12:46:26,420 INFO MainThread: Starting new HTTP connection
> (1): localhost
> -- executing against localhost:21000
> create table t primary key (id) partition by hash (id) partitions 3
> stored as kudu
> as select id, int_col from functional.alltypestiny;{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
