[ https://issues.apache.org/jira/browse/HIVE-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15193250#comment-15193250 ]
Hive QA commented on HIVE-11160: -------------------------------- Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12793216/HIVE-11160.07.patch {color:red}ERROR:{color} -1 due to build exiting with an error Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/7262/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/7262/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-7262/ Messages: {noformat} **** This message was trimmed, see log for full details **** [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-metastore --- [INFO] Deleting /data/hive-ptest/working/apache-github-source-source/metastore/target [INFO] Deleting /data/hive-ptest/working/apache-github-source-source/metastore (includes = [datanucleus.log, derby.log], excludes = []) [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-no-snapshots) @ hive-metastore --- [INFO] [INFO] --- build-helper-maven-plugin:1.8:add-source (add-source) @ hive-metastore --- [INFO] Source directory: /data/hive-ptest/working/apache-github-source-source/metastore/src/model added. [INFO] Source directory: /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean added. [INFO] Source directory: /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/protobuf/gen-java added. [INFO] [INFO] --- antlr3-maven-plugin:3.4:antlr (default) @ hive-metastore --- [INFO] ANTLR: Processing source directory /data/hive-ptest/working/apache-github-source-source/metastore/src/java ANTLR Parser Generator Version 3.4 org/apache/hadoop/hive/metastore/parser/Filter.g [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hive-metastore --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hive-metastore --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] Copying 3 resources [INFO] [INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-metastore --- [INFO] Executing tasks main: [INFO] Executed tasks [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hive-metastore --- [INFO] Compiling 301 source files to /data/hive-ptest/working/apache-github-source-source/metastore/target/classes [INFO] ------------------------------------------------------------- [WARNING] COMPILATION WARNING : [INFO] ------------------------------------------------------------- [WARNING] /data/hive-ptest/working/apache-github-source-source/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java: Some input files use or override a deprecated API. [WARNING] /data/hive-ptest/working/apache-github-source-source/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java: Recompile with -Xlint:deprecation for details. [WARNING] /data/hive-ptest/working/apache-github-source-source/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreUtils.java: Some input files use unchecked or unsafe operations. [WARNING] /data/hive-ptest/working/apache-github-source-source/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreUtils.java: Recompile with -Xlint:unchecked for details. [INFO] 4 warnings [INFO] ------------------------------------------------------------- [INFO] ------------------------------------------------------------- [ERROR] COMPILATION ERROR : [INFO] ------------------------------------------------------------- [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[112838,12] an enum switch case label must be the unqualified name of an enumeration constant [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[112839,16] cannot find symbol symbol: method getRequest() location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.update_partition_column_statistics_args [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[112852,12] an enum switch case label must be the unqualified name of an enumeration constant [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[112853,16] cannot find symbol symbol: method isSetRequest() location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.update_partition_column_statistics_args [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[112947,11] cannot find symbol symbol: variable request location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.update_partition_column_statistics_args [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[112948,9] cannot find symbol symbol: variable request location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.update_partition_column_statistics_args [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[112988,23] cannot find symbol symbol: variable request location: variable struct of type org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.update_partition_column_statistics_args [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[112989,23] cannot find symbol symbol: variable request location: variable struct of type org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.update_partition_column_statistics_args [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[112990,23] cannot find symbol symbol: method setRequestIsSet(boolean) location: variable struct of type org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.update_partition_column_statistics_args [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[113983,12] an enum switch case label must be the unqualified name of an enumeration constant [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[113984,16] cannot find symbol symbol: method getStats_obj() location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.renew_column_statistics_args [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[113997,12] an enum switch case label must be the unqualified name of an enumeration constant [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[113998,16] cannot find symbol symbol: method isSetStats_obj() location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.renew_column_statistics_args [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[114092,11] cannot find symbol symbol: variable stats_obj location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.renew_column_statistics_args [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[114093,9] cannot find symbol symbol: variable stats_obj location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.renew_column_statistics_args [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[114133,23] cannot find symbol symbol: variable stats_obj location: variable struct of type org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.renew_column_statistics_args [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[114134,23] cannot find symbol symbol: variable stats_obj location: variable struct of type org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.renew_column_statistics_args [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[114135,23] cannot find symbol symbol: method setStats_objIsSet(boolean) location: variable struct of type org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.renew_column_statistics_args [INFO] 18 errors [INFO] ------------------------------------------------------------- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Hive .............................................. SUCCESS [11.108s] [INFO] Hive Shims Common ................................. SUCCESS [16.302s] [INFO] Hive Shims 0.23 ................................... SUCCESS [11.510s] [INFO] Hive Shims Scheduler .............................. SUCCESS [2.963s] [INFO] Hive Shims ........................................ SUCCESS [2.577s] [INFO] Hive Storage API .................................. SUCCESS [7.199s] [INFO] Hive ORC .......................................... SUCCESS [11.128s] [INFO] Hive Common ....................................... SUCCESS [30.192s] [INFO] Hive Serde ........................................ SUCCESS [15.260s] [INFO] Hive Metastore .................................... FAILURE [31.907s] [INFO] Hive Ant Utilities ................................ SKIPPED [INFO] Hive Llap Common .................................. SKIPPED [INFO] Hive Llap Client .................................. SKIPPED [INFO] Hive Llap Tez ..................................... SKIPPED [INFO] Hive Service RPC .................................. SKIPPED [INFO] Spark Remote Client ............................... SKIPPED [INFO] Hive Query Language ............................... SKIPPED [INFO] Hive Service ...................................... SKIPPED [INFO] Hive Accumulo Handler ............................. SKIPPED [INFO] Hive JDBC ......................................... SKIPPED [INFO] Hive Beeline ...................................... SKIPPED [INFO] Hive CLI .......................................... SKIPPED [INFO] Hive Contrib ...................................... SKIPPED [INFO] Hive HBase Handler ................................ SKIPPED [INFO] Hive HCatalog ..................................... SKIPPED [INFO] Hive HCatalog Core ................................ SKIPPED [INFO] Hive HCatalog Pig Adapter ......................... SKIPPED [INFO] Hive HCatalog Server Extensions ................... SKIPPED [INFO] Hive HCatalog Webhcat Java Client ................. SKIPPED [INFO] Hive HCatalog Webhcat ............................. SKIPPED [INFO] Hive HCatalog Streaming ........................... SKIPPED [INFO] Hive HPL/SQL ...................................... SKIPPED [INFO] Hive HWI .......................................... SKIPPED [INFO] Hive ODBC ......................................... SKIPPED [INFO] Hive Llap Server .................................. SKIPPED [INFO] Hive Shims Aggregator ............................. SKIPPED [INFO] Hive TestUtils .................................... SKIPPED [INFO] Hive Packaging .................................... SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 2:23.285s [INFO] Finished at: Mon Mar 14 09:06:09 EDT 2016 [INFO] Final Memory: 90M/704M [INFO] ------------------------------------------------------------------------ [WARNING] The requested profile "hadoop-2" could not be activated because it does not exist. [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.1:compile (default-compile) on project hive-metastore: Compilation failure: Compilation failure: [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[112838,12] an enum switch case label must be the unqualified name of an enumeration constant [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[112839,16] cannot find symbol [ERROR] symbol: method getRequest() [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.update_partition_column_statistics_args [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[112852,12] an enum switch case label must be the unqualified name of an enumeration constant [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[112853,16] cannot find symbol [ERROR] symbol: method isSetRequest() [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.update_partition_column_statistics_args [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[112947,11] cannot find symbol [ERROR] symbol: variable request [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.update_partition_column_statistics_args [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[112948,9] cannot find symbol [ERROR] symbol: variable request [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.update_partition_column_statistics_args [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[112988,23] cannot find symbol [ERROR] symbol: variable request [ERROR] location: variable struct of type org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.update_partition_column_statistics_args [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[112989,23] cannot find symbol [ERROR] symbol: variable request [ERROR] location: variable struct of type org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.update_partition_column_statistics_args [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[112990,23] cannot find symbol [ERROR] symbol: method setRequestIsSet(boolean) [ERROR] location: variable struct of type org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.update_partition_column_statistics_args [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[113983,12] an enum switch case label must be the unqualified name of an enumeration constant [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[113984,16] cannot find symbol [ERROR] symbol: method getStats_obj() [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.renew_column_statistics_args [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[113997,12] an enum switch case label must be the unqualified name of an enumeration constant [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[113998,16] cannot find symbol [ERROR] symbol: method isSetStats_obj() [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.renew_column_statistics_args [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[114092,11] cannot find symbol [ERROR] symbol: variable stats_obj [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.renew_column_statistics_args [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[114093,9] cannot find symbol [ERROR] symbol: variable stats_obj [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.renew_column_statistics_args [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[114133,23] cannot find symbol [ERROR] symbol: variable stats_obj [ERROR] location: variable struct of type org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.renew_column_statistics_args [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[114134,23] cannot find symbol [ERROR] symbol: variable stats_obj [ERROR] location: variable struct of type org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.renew_column_statistics_args [ERROR] /data/hive-ptest/working/apache-github-source-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[114135,23] cannot find symbol [ERROR] symbol: method setStats_objIsSet(boolean) [ERROR] location: variable struct of type org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.renew_column_statistics_args [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hive-metastore + exit 1 ' {noformat} This message is automatically generated. ATTACHMENT ID: 12793216 - PreCommit-HIVE-TRUNK-Build > Auto-gather column stats > ------------------------ > > Key: HIVE-11160 > URL: https://issues.apache.org/jira/browse/HIVE-11160 > Project: Hive > Issue Type: New Feature > Reporter: Pengcheng Xiong > Assignee: Pengcheng Xiong > Attachments: HIVE-11160.01.patch, HIVE-11160.02.patch, > HIVE-11160.03.patch, HIVE-11160.04.patch, HIVE-11160.05.patch, > HIVE-11160.06.patch, HIVE-11160.07.patch > > > Hive will collect table stats when set hive.stats.autogather=true during the > INSERT OVERWRITE command. And then the users need to collect the column stats > themselves using "Analyze" command. In this patch, the column stats will also > be collected automatically. More specifically, INSERT OVERWRITE will > automatically create new column stats. INSERT INTO will automatically merge > new column stats with existing ones. -- This message was sent by Atlassian JIRA (v6.3.4#6332)