[ https://issues.apache.org/jira/browse/HIVE-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13811015#comment-13811015 ]
Hive QA commented on HIVE-3959: ------------------------------- {color:red}Overall{color}: -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12611523/HIVE-3959.6.patch {color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 4547 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_bucket_num_reducers org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_bucketmapjoin7 org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_parallel_orderby {noformat} Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/95/testReport Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/95/console Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests failed with: TestsFailedException: 3 tests failed {noformat} This message is automatically generated. > Update Partition Statistics in Metastore Layer > ---------------------------------------------- > > Key: HIVE-3959 > URL: https://issues.apache.org/jira/browse/HIVE-3959 > Project: Hive > Issue Type: Improvement > Components: Metastore, Statistics > Reporter: Bhushan Mandhani > Assignee: Ashutosh Chauhan > Priority: Minor > Attachments: HIVE-3959.1.patch, HIVE-3959.2.patch, HIVE-3959.3.patch, > HIVE-3959.3.patch, HIVE-3959.4.patch, HIVE-3959.4.patch, HIVE-3959.5.patch, > HIVE-3959.6.patch, HIVE-3959.patch.1, HIVE-3959.patch.11.txt, > HIVE-3959.patch.12.txt, HIVE-3959.patch.2 > > > When partitions are created using queries ("insert overwrite" and "insert > into") then the StatsTask updates all stats. However, when partitions are > added directly through metadata-only partitions (either CLI or direct calls > to Thrift Metastore) no stats are populated even if hive.stats.reliable is > set to true. This puts us in a situation where we can't decide if stats are > truly reliable or not. > We propose that the "fast stats" (numFiles and totalSize) which don't require > a scan of the data should always be populated and be completely reliable. For > now we are still excluding rowCount and rawDataSize because that will make > these operations very expensive. Currently they are quick metadata-only ops. -- This message was sent by Atlassian JIRA (v6.1#6144)