Rajesh Balamohan created HIVE-25981:
---------------------------------------
Summary: Avoid checking for archived parts in analyze table
Key: HIVE-25981
URL: https://issues.apache.org/jira/browse/HIVE-25981
Project: Hive
Issue Type: Improvement
Components: HiveServer2
Reporter: Rajesh Balamohan
Analyze table on large partitioned table is expensive due to unwanted checks on
archived data.
{noformat}
at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient$SynchronizedHandler.invoke(HiveMetaStoreClient.java:3908)
- locked <0x00000003d4c4c070> (a
org.apache.hadoop.hive.metastore.HiveMetaStoreClient$SynchronizedHandler)
at com.sun.proxy.$Proxy56.listPartitionsWithAuthInfo(Unknown Source)
at org.apache.hadoop.hive.ql.metadata.Hive.getPartitions(Hive.java:3845)
at
org.apache.hadoop.hive.ql.exec.ArchiveUtils.conflictingArchiveNameOrNull(ArchiveUtils.java:299)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.validate(SemanticAnalyzer.java:13579)
at org.apache.hadoop.hive.ql.Compiler.analyze(Compiler.java:241)
at org.apache.hadoop.hive.ql.Compiler.compile(Compiler.java:104)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:196)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:615)
at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:561)
at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:555)
at
org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:127)
at
org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:204)
at
org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:265)
at org.apache.hive.service.cli.operation.Operation.run(Operation.java:285)
{noformat}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
