Praneeth Putha created HIVE-23199:
-------------------------------------
Summary: Apache Hive Upgrade 3.1.2 each query is taking 10 seconds
additional
Key: HIVE-23199
URL: https://issues.apache.org/jira/browse/HIVE-23199
Project: Hive
Issue Type: Bug
Components: HiveServer2
Affects Versions: 3.1.2
Reporter: Praneeth Putha
We upgraded Apache Hive Server2 and Metastore service from 2.3.4 to 3.1.2 and
hadoop jars from 2.8.5 to 3.2.0.
Use <database> or show databases is taking 10.2 seconds before upgrade it is
0.2 seconds.
Observations:
when i run use database. Compiling comand is completed in 0.73 seconds and to
start execution query it took 10 seconds.
2020-04-14T12:22:48,173 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main]
conf.HiveConf: Using the default value passed in for log id:
58ad961c-26a8-41a0-a628-eb56c18e7ae2
2020-04-14T12:22:48,246 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main]
ql.Driver: Compiling
command(queryId=root_20200414122248_aa6e88cc-9490-4ec2-aee5-ea0bc076dbb2): use
test_database
2020-04-14T12:22:48,915 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main]
ql.Driver: Concurrency mode is disabled, not creating a lock manager
2020-04-14T12:22:48,942 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main]
ql.Driver: Semantic Analysis Completed (retrial = false)
2020-04-14T12:22:48,944 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main]
ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null)
2020-04-14T12:22:48,949 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main]
metadata.Hive: Dumping metastore api call timing information for : compilation
phase
2020-04-14T12:22:48,949 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main]
metadata.Hive: Total time spent in this metastore function was greater than
1000ms : getTableObjectsByName_(String, List, )=2884
2020-04-14T12:22:48,949 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main]
metadata.Hive: Total time spent in this metastore function was greater than
1000ms : getTables_(String, String, TableType, )=16779
2020-04-14T12:22:48,951 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main]
ql.Driver: Completed compiling
command(queryId=root_20200414122248_aa6e88cc-9490-4ec2-aee5-ea0bc076dbb2); Time
taken: 0.73 seconds
2020-04-14T12:22:48,951 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main]
reexec.ReExecDriver: Execution #1 of query
2020-04-14T12:22:48,952 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main]
ql.Driver: Concurrency mode is disabled, not creating a lock manager
2020-04-14T12:22:48,952 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main]
ql.Driver: Executing
command(queryId=root_20200414122248_aa6e88cc-9490-4ec2-aee5-ea0bc076dbb2): use
test_database
{color:#FF0000} *– 10 seconds pause*{color}
2020-04-14T12:22:58,981 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main]
ql.Driver: Starting task [Stage-0:DDL] in serial mode
2020-04-14T12:22:59,003 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main]
ql.Driver: Completed executing
command(queryId=root_20200414122248_aa6e88cc-9490-4ec2-aee5-ea0bc076dbb2); Time
taken: 10.051 seconds
2020-04-14T12:22:59,004 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main]
ql.Driver: OK
2020-04-14T12:22:59,004 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main]
ql.Driver: Concurrency mode is disabled, not creating a lock manager
2020-04-14T12:22:59,017 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main]
CliDriver: Time taken: 10.787 seconds
2020-04-14T12:22:59,028 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main]
conf.HiveConf: Using the default value passed in for log id:
58ad961c-26a8-41a0-a628-eb56c18e7ae2
2020-04-14T12:22:59,029 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main]
session.SessionState: Resetting thread name to main
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
