[jira] [Commented] (HIVE-22163) CBO: Enabling CBO turns on stats estimation, even when the estimation is disabled
[ https://issues.apache.org/jira/browse/HIVE-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16929074#comment-16929074 ] Hive QA commented on HIVE-22163: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m 30s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 0s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 35s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m 40s{color} | {color:blue} ql in master has 2225 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 52s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 17s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 59s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 59s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 37s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 3m 40s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 53s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 13s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 21m 53s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-18580/dev-support/hive-personality.sh | | git revision | master / 38190f3 | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-18580/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > CBO: Enabling CBO turns on stats estimation, even when the estimation is > disabled > - > > Key: HIVE-22163 > URL: https://issues.apache.org/jira/browse/HIVE-22163 > Project: Hive > Issue Type: Bug > Components: CBO >Reporter: Gopal V >Assignee: Krisztian Kasa >Priority: Major > Attachments: HIVE-22163.1.patch, HIVE-22163.1.patch, > HIVE-22163.1.patch, HIVE-22163.2.patch, HIVE-22163.3.patch, > HIVE-22163.4.patch, HIVE-22163.4.patch, HIVE-22163.5.patch > > > {code} > create table claims(claim_rec_id bigint, claim_invoice_num string, typ_c int); > alter table claims update statistics set > ('numRows'='1154941534','rawDataSize'='1135307527922'); > set hive.stats.estimate=false; > explain extended select count(1) from claims where typ_c=3; > set hive.stats.ndv.estimate.percent=5e-7; > explain extended select count(1) from claims where typ_c=3; > {code} > Expecting the standard /2 for the single filter, but we instead get 5 rows. > {code} > 'Map Operator Tree:' > 'TableScan' > ' alias: claims' > ' filterExpr: (typ_c = 3) (type: boolean)' > ' Statistics: Num rows: 1154941534 Data size: 4388777832 > Basic stats: COMPLETE Column stats: NONE' > ' GatherStats: false' > ' Filter Operator' > 'isSamplingPred: false' > 'predicate: (typ_c = 3) (type: boolean)' > 'Statistics: Num rows: 5 Data size: 19 Basic stats: > COMPLETE Column sta
[jira] [Commented] (HIVE-22200) Hash collision may cause column resolution to fail
[ https://issues.apache.org/jira/browse/HIVE-22200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16929059#comment-16929059 ] Hive QA commented on HIVE-22200: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12980241/HIVE-22200.patch {color:red}ERROR:{color} -1 due to no test(s) being added or modified. {color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 16753 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.llap.cache.TestBuddyAllocator.testMTT[2] (batchId=361) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18579/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18579/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18579/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 1 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12980241 - PreCommit-HIVE-Build > Hash collision may cause column resolution to fail > -- > > Key: HIVE-22200 > URL: https://issues.apache.org/jira/browse/HIVE-22200 > Project: Hive > Issue Type: Bug >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Critical > Attachments: HIVE-22200.patch > > > {{ExprNodeDescUtils.getExprNodeColumnDesc}} extracts the > {{ExprNodeColumnDesc}} (column descriptors) from an expression. In fact, it > creates a map from hash to the object itself. If same hash value is generated > for two different objects, this will result in a clash in the map and some > expressions not being part of its values. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (HIVE-22200) Hash collision may cause column resolution to fail
[ https://issues.apache.org/jira/browse/HIVE-22200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16929040#comment-16929040 ] Hive QA commented on HIVE-22200: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m 30s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 57s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 40s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m 34s{color} | {color:blue} ql in master has 2225 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 51s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 18s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 58s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 58s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 41s{color} | {color:green} ql: The patch generated 0 new + 648 unchanged - 29 fixed = 648 total (was 677) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 3m 37s{color} | {color:green} ql generated 0 new + 2224 unchanged - 1 fixed = 2224 total (was 2225) {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 53s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 12s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 21m 47s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-18579/dev-support/hive-personality.sh | | git revision | master / 38190f3 | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-18579/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > Hash collision may cause column resolution to fail > -- > > Key: HIVE-22200 > URL: https://issues.apache.org/jira/browse/HIVE-22200 > Project: Hive > Issue Type: Bug >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez >Priority: Critical > Attachments: HIVE-22200.patch > > > {{ExprNodeDescUtils.getExprNodeColumnDesc}} extracts the > {{ExprNodeColumnDesc}} (column descriptors) from an expression. In fact, it > creates a map from hash to the object itself. If same hash value is generated > for two different objects, this will result in a clash in the map and some > expressions not being part of its values. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (HIVE-22163) CBO: Enabling CBO turns on stats estimation, even when the estimation is disabled
[ https://issues.apache.org/jira/browse/HIVE-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16929028#comment-16929028 ] Hive QA commented on HIVE-22163: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12980234/HIVE-22163.4.patch {color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified. {color:green}SUCCESS:{color} +1 due to 16753 tests passed Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/18578/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18578/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18578/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase {noformat} This message is automatically generated. ATTACHMENT ID: 12980234 - PreCommit-HIVE-Build > CBO: Enabling CBO turns on stats estimation, even when the estimation is > disabled > - > > Key: HIVE-22163 > URL: https://issues.apache.org/jira/browse/HIVE-22163 > Project: Hive > Issue Type: Bug > Components: CBO >Reporter: Gopal V >Assignee: Krisztian Kasa >Priority: Major > Attachments: HIVE-22163.1.patch, HIVE-22163.1.patch, > HIVE-22163.1.patch, HIVE-22163.2.patch, HIVE-22163.3.patch, > HIVE-22163.4.patch, HIVE-22163.4.patch, HIVE-22163.5.patch > > > {code} > create table claims(claim_rec_id bigint, claim_invoice_num string, typ_c int); > alter table claims update statistics set > ('numRows'='1154941534','rawDataSize'='1135307527922'); > set hive.stats.estimate=false; > explain extended select count(1) from claims where typ_c=3; > set hive.stats.ndv.estimate.percent=5e-7; > explain extended select count(1) from claims where typ_c=3; > {code} > Expecting the standard /2 for the single filter, but we instead get 5 rows. > {code} > 'Map Operator Tree:' > 'TableScan' > ' alias: claims' > ' filterExpr: (typ_c = 3) (type: boolean)' > ' Statistics: Num rows: 1154941534 Data size: 4388777832 > Basic stats: COMPLETE Column stats: NONE' > ' GatherStats: false' > ' Filter Operator' > 'isSamplingPred: false' > 'predicate: (typ_c = 3) (type: boolean)' > 'Statistics: Num rows: 5 Data size: 19 Basic stats: > COMPLETE Column stats: NONE' > {code} > The estimation is in effect, as changing the estimate.percent changes this. > {code} > ' filterExpr: (typ_c = 3) (type: boolean)' > ' Statistics: Num rows: 1154941534 Data size: 4388777832 > Basic stats: COMPLETE Column stats: NONE' > ' GatherStats: false' > ' Filter Operator' > 'isSamplingPred: false' > 'predicate: (typ_c = 3) (type: boolean)' > 'Statistics: Num rows: 230988307 Data size: 877755567 > Basic stats: COMPLETE Column stats: NONE' > {code} -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (HIVE-22194) Break up DDLSemanticAnalyzer - extract Privilege related analyzers
[ https://issues.apache.org/jira/browse/HIVE-22194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-22194: -- Attachment: HIVE-22194.03.patch > Break up DDLSemanticAnalyzer - extract Privilege related analyzers > -- > > Key: HIVE-22194 > URL: https://issues.apache.org/jira/browse/HIVE-22194 > Project: Hive > Issue Type: Sub-task >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Labels: pull-request-available, refactor-ddl > Attachments: HIVE-22194.01.patch, HIVE-22194.02.patch, > HIVE-22194.03.patch > > Time Spent: 40m > Remaining Estimate: 0h > > DDLSemanticAnalyzer is a huge class, more than 4000 lines long. The goal is > to refactor it in order to have everything cut into more handleable classes > under the packageĀ org.apache.hadoop.hive.ql.exec.ddl: > * have a separate class for each analyzers > * have a package for each operation, containing an analyzer, a description, > and an operation, so the amount of classes under a package is more manageable > Step #2: extract all the privilege related analyzers from > DDLSemanticAnalyzer, and move them under the new package. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (HIVE-22194) Break up DDLSemanticAnalyzer - extract Privilege related analyzers
[ https://issues.apache.org/jira/browse/HIVE-22194?focusedWorklogId=311901&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-311901 ] ASF GitHub Bot logged work on HIVE-22194: - Author: ASF GitHub Bot Created on: 13/Sep/19 07:41 Start Date: 13/Sep/19 07:41 Worklog Time Spent: 10m Work Description: miklosgergely commented on pull request #769: HIVE-22194 Break up DDLSemanticAnalyzer - extract Privilege related analyzers URL: https://github.com/apache/hive/pull/769#discussion_r324069305 ## File path: ql/src/java/org/apache/hadoop/hive/ql/ddl/privilege/role/showcurrent/ShowCurrentRoleAnalyzer.java ## @@ -0,0 +1,59 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements. See the NOTICE file + * distributed with this work for additional information + * regarding copyright ownership. The ASF licenses this file + * to you under the Apache License, Version 2.0 (the + * "License"); you may not use this file except in compliance + * with the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ + +package org.apache.hadoop.hive.ql.ddl.privilege.role.showcurrent; Review comment: ok, I'll move it there This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 311901) Time Spent: 40m (was: 0.5h) > Break up DDLSemanticAnalyzer - extract Privilege related analyzers > -- > > Key: HIVE-22194 > URL: https://issues.apache.org/jira/browse/HIVE-22194 > Project: Hive > Issue Type: Sub-task >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Major > Labels: pull-request-available, refactor-ddl > Attachments: HIVE-22194.01.patch, HIVE-22194.02.patch > > Time Spent: 40m > Remaining Estimate: 0h > > DDLSemanticAnalyzer is a huge class, more than 4000 lines long. The goal is > to refactor it in order to have everything cut into more handleable classes > under the packageĀ org.apache.hadoop.hive.ql.exec.ddl: > * have a separate class for each analyzers > * have a package for each operation, containing an analyzer, a description, > and an operation, so the amount of classes under a package is more manageable > Step #2: extract all the privilege related analyzers from > DDLSemanticAnalyzer, and move them under the new package. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (HIVE-21449) implement 'WITHIN GROUP' clause
[ https://issues.apache.org/jira/browse/HIVE-21449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Kasa updated HIVE-21449: -- Attachment: HIVE-21449.3.patch > implement 'WITHIN GROUP' clause > --- > > Key: HIVE-21449 > URL: https://issues.apache.org/jira/browse/HIVE-21449 > Project: Hive > Issue Type: Bug >Reporter: Laszlo Bodor >Assignee: Krisztian Kasa >Priority: Major > Attachments: HIVE-21449.1.patch, HIVE-21449.2.patch, > HIVE-21449.3.patch > > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (HIVE-21449) implement 'WITHIN GROUP' clause
[ https://issues.apache.org/jira/browse/HIVE-21449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Kasa updated HIVE-21449: -- Status: Patch Available (was: Open) > implement 'WITHIN GROUP' clause > --- > > Key: HIVE-21449 > URL: https://issues.apache.org/jira/browse/HIVE-21449 > Project: Hive > Issue Type: Bug >Reporter: Laszlo Bodor >Assignee: Krisztian Kasa >Priority: Major > Attachments: HIVE-21449.1.patch, HIVE-21449.2.patch, > HIVE-21449.3.patch > > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (HIVE-21449) implement 'WITHIN GROUP' clause
[ https://issues.apache.org/jira/browse/HIVE-21449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Kasa updated HIVE-21449: -- Status: Open (was: Patch Available) > implement 'WITHIN GROUP' clause > --- > > Key: HIVE-21449 > URL: https://issues.apache.org/jira/browse/HIVE-21449 > Project: Hive > Issue Type: Bug >Reporter: Laszlo Bodor >Assignee: Krisztian Kasa >Priority: Major > Attachments: HIVE-21449.1.patch, HIVE-21449.2.patch, > HIVE-21449.3.patch > > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (HIVE-22163) CBO: Enabling CBO turns on stats estimation, even when the estimation is disabled
[ https://issues.apache.org/jira/browse/HIVE-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16929018#comment-16929018 ] Hive QA commented on HIVE-22163: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m 33s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 59s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 36s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m 38s{color} | {color:blue} ql in master has 2225 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 52s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 18s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 59s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 59s{color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 35s{color} | {color:red} ql: The patch generated 1 new + 208 unchanged - 0 fixed = 209 total (was 208) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 3m 43s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 56s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 12s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 21m 53s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compile | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-18578/dev-support/hive-personality.sh | | git revision | master / 834e17e | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | checkstyle | http://104.198.109.242/logs//PreCommit-HIVE-Build-18578/yetus/diff-checkstyle-ql.txt | | modules | C: ql U: ql | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-18578/yetus.txt | | Powered by | Apache Yetushttp://yetus.apache.org | This message was automatically generated. > CBO: Enabling CBO turns on stats estimation, even when the estimation is > disabled > - > > Key: HIVE-22163 > URL: https://issues.apache.org/jira/browse/HIVE-22163 > Project: Hive > Issue Type: Bug > Components: CBO >Reporter: Gopal V >Assignee: Krisztian Kasa >Priority: Major > Attachments: HIVE-22163.1.patch, HIVE-22163.1.patch, > HIVE-22163.1.patch, HIVE-22163.2.patch, HIVE-22163.3.patch, > HIVE-22163.4.patch, HIVE-22163.4.patch, HIVE-22163.5.patch > > > {code} > create table claims(claim_rec_id bigint, claim_invoice_num string, typ_c int); > alter table claims update statistics set > ('numRows'='1154941534','rawDataSize'='1135307527922'); > set hive.stats.estimate=false; > explain extended select count(1) from claims where typ_c=3; > set hive.stats.ndv.estimate.percent=5e-7; > explain extended select count(1) from claims where typ_c=3; > {code} > Expecting the standard /2 for the single filter, but we instead get 5 rows. > {code} > 'Map Operator Tree:' > 'TableScan' > ' alias: claims' > ' filterExpr: (typ_c = 3) (type: boolean)' > ' Statistics: Num rows: 1154941534 Data size: 4388777832 > Basic stats: COMPLETE Column stats: NONE' > ' GatherStats: false' > ' Filter Operator' > 'isSamplingPred: false' > '