mahesh kumar behera created HIVE-26382:
------------------------------------------
Summary: Stats generation fails during CTAS for external
partitioned table.
Key: HIVE-26382
URL: https://issues.apache.org/jira/browse/HIVE-26382
Project: Hive
Issue Type: Bug
Components: Hive, HiveServer2
Affects Versions: 4.0.0-alpha-1
Reporter: mahesh kumar behera
Assignee: mahesh kumar behera
As part of HIVE-25990 manifest file was generated to list out the files to be
moved. The files are moved in move task by referring to the manifest file. For
partitioned table flow, the move is not done. This prevents the dynamic
partition creation as the target path will be empty. As stats task needs the
partition information, this causes the stat task to fail.
{code:java}
class="metastore.RetryingHMSHandler" level="ERROR" thread="pool-10-thread-144"]
MetaException(message:Unable to update Column stats for ext_par due to: The IN
list is empty!)
org.apache.hadoop.hive.metastore.DirectSqlUpdateStat.updatePartitionColumnStatistics(DirectSqlUpdateStat.java:634)
org.apache.hadoop.hive.metastore.MetaStoreDirectSql.updatePartitionColumnStatisticsBatch(MetaStoreDirectSql.java:2803)
org.apache.hadoop.hive.metastore.ObjectStore.updatePartitionColumnStatisticsInBatch(ObjectStore.java:10001)
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43
java.lang.reflect.Method.invoke(Method.java:498)
org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97)
com.sun.proxy.$Proxy33.updatePartitionColumnStatisticsInBatch(Unknown Source)
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.updatePartitionColStatsForOneBatch(HiveMetaStore.java:7124)
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.updatePartitionColStatsInBatch(HiveMetaStore.java:7109)
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
