----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/43603/ -----------------------------------------------------------
Review request for hive and Ashutosh Chauhan. Repository: hive-git Description ------- HIVE-11160: Hive will collect table stats when set hive.stats.autogather=true during the INSERT OVERWRITE command. And then the users need to collect the column stats themselves using "Analyze" command. In this patch, the column stats will also be collected automatically. More specifically, INSERT OVERWRITE will automatically create new column stats. INSERT INTO will automatically merge new column stats with existing ones. Diffs ----- common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 3ab1dba itests/src/test/resources/testconfiguration.properties 2d0a1e3 metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java 98fbf70 metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java bcc729c metastore/src/java/org/apache/hadoop/hive/metastore/IMetaStoreClient.java 07c20bf metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreUtils.java c8859f3 metastore/src/java/org/apache/hadoop/hive/metastore/hbase/stats/ColumnStatsAggregator.java 694e53b metastore/src/java/org/apache/hadoop/hive/metastore/hbase/stats/ColumnStatsAggregatorFactory.java 8eb127b metastore/src/java/org/apache/hadoop/hive/metastore/hbase/stats/DecimalColumnStatsAggregator.java 50f4325 metastore/src/java/org/apache/hadoop/hive/metastore/hbase/stats/DoubleColumnStatsAggregator.java d945ec2 metastore/src/java/org/apache/hadoop/hive/metastore/hbase/stats/LongColumnStatsAggregator.java 068dd00 metastore/src/java/org/apache/hadoop/hive/metastore/hbase/stats/StringColumnStatsAggregator.java aeb6c39 ql/src/java/org/apache/hadoop/hive/ql/exec/ColumnStatsTask.java f9a9fd2 ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java f51e1a4 ql/src/java/org/apache/hadoop/hive/ql/metadata/SessionHiveMetaStoreClient.java ff8fdf8 ql/src/java/org/apache/hadoop/hive/ql/optimizer/Optimizer.java c06b8fc ql/src/java/org/apache/hadoop/hive/ql/parse/CalcitePlanner.java e7dc08c ql/src/java/org/apache/hadoop/hive/ql/parse/ColumnStatsAutoGatherContext.java PRE-CREATION ql/src/java/org/apache/hadoop/hive/ql/parse/ColumnStatsSemanticAnalyzer.java bb1bbad ql/src/java/org/apache/hadoop/hive/ql/parse/ParseContext.java 642c227 ql/src/java/org/apache/hadoop/hive/ql/parse/QBParseInfo.java 3a226e7 ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java 8a06582 ql/src/java/org/apache/hadoop/hive/ql/parse/TaskCompiler.java fc555ca ql/src/java/org/apache/hadoop/hive/ql/plan/ColumnStatsDesc.java c000db2 ql/src/test/queries/clientpositive/autoColumnStats.q PRE-CREATION ql/src/test/queries/clientpositive/autoColumnStats_1.q PRE-CREATION ql/src/test/queries/clientpositive/autoColumnStats_2.q PRE-CREATION ql/src/test/results/clientpositive/autoColumnStats.q.out PRE-CREATION ql/src/test/results/clientpositive/autoColumnStats_1.q.out PRE-CREATION ql/src/test/results/clientpositive/autoColumnStats_2.q.out PRE-CREATION ql/src/test/results/clientpositive/tez/autoColumnStats_2.q.out PRE-CREATION Diff: https://reviews.apache.org/r/43603/diff/ Testing ------- Thanks, pengcheng xiong
