[jira] [Commented] (HIVE-7050) Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE
[ https://issues.apache.org/jira/browse/HIVE-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14162741#comment-14162741 ] Lefty Leverenz commented on HIVE-7050: -- Thanks, [~prasanth_j], especially for HIVE-7051 which had slipped through my net. Your new section is good, but needs version information -- I'll add that, plus a link to the ANALYZE syntax, and a bit of editorial tinkering. Then you can verify my changes. Would you please change the release note (which currently says "Please document the new functionality") and add one on HIVE-7051 too? Q: Does this only work for FORMATTED, not EXTENDED (although it's in both jira titles)? > Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE > - > > Key: HIVE-7050 > URL: https://issues.apache.org/jira/browse/HIVE-7050 > Project: Hive > Issue Type: Bug > Components: Statistics >Reporter: Prasanth J >Assignee: Prasanth J > Labels: TODOC14 > Fix For: 0.14.0 > > Attachments: HIVE-7050.1.patch, HIVE-7050.2.patch, HIVE-7050.3.patch, > HIVE-7050.4.patch, HIVE-7050.5.patch, HIVE-7050.6.patch > > > There is currently no way to display the column level stats from hive CLI. It > will be good to show them in DESCRIBE EXTENDED/FORMATTED TABLE -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-7050) Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE
[ https://issues.apache.org/jira/browse/HIVE-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14162699#comment-14162699 ] Prasanth J commented on HIVE-7050: -- [~leftylev] I added "Display column statistics" section here https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-Describe which should cover the features added in this jira as well as HIVE-7051. Can you take a look to see if its good? > Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE > - > > Key: HIVE-7050 > URL: https://issues.apache.org/jira/browse/HIVE-7050 > Project: Hive > Issue Type: Bug > Components: Statistics >Reporter: Prasanth J >Assignee: Prasanth J > Labels: TODOC14 > Fix For: 0.14.0 > > Attachments: HIVE-7050.1.patch, HIVE-7050.2.patch, HIVE-7050.3.patch, > HIVE-7050.4.patch, HIVE-7050.5.patch, HIVE-7050.6.patch > > > There is currently no way to display the column level stats from hive CLI. It > will be good to show them in DESCRIBE EXTENDED/FORMATTED TABLE -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-7050) Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE
[ https://issues.apache.org/jira/browse/HIVE-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14019549#comment-14019549 ] Ashutosh Chauhan commented on HIVE-7050: Ok..cool > Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE > - > > Key: HIVE-7050 > URL: https://issues.apache.org/jira/browse/HIVE-7050 > Project: Hive > Issue Type: Bug > Components: Statistics >Reporter: Prasanth J >Assignee: Prasanth J > Fix For: 0.14.0 > > Attachments: HIVE-7050.1.patch, HIVE-7050.2.patch, HIVE-7050.3.patch, > HIVE-7050.4.patch, HIVE-7050.5.patch, HIVE-7050.6.patch > > > There is currently no way to display the column level stats from hive CLI. It > will be good to show them in DESCRIBE EXTENDED/FORMATTED TABLE -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-7050) Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE
[ https://issues.apache.org/jira/browse/HIVE-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14019147#comment-14019147 ] Prasanth J commented on HIVE-7050: -- No it is not supported yet. HIVE-7051 is created to support it. > Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE > - > > Key: HIVE-7050 > URL: https://issues.apache.org/jira/browse/HIVE-7050 > Project: Hive > Issue Type: Bug > Components: Statistics >Reporter: Prasanth J >Assignee: Prasanth J > Fix For: 0.14.0 > > Attachments: HIVE-7050.1.patch, HIVE-7050.2.patch, HIVE-7050.3.patch, > HIVE-7050.4.patch, HIVE-7050.5.patch, HIVE-7050.6.patch > > > There is currently no way to display the column level stats from hive CLI. It > will be good to show them in DESCRIBE EXTENDED/FORMATTED TABLE -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-7050) Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE
[
https://issues.apache.org/jira/browse/HIVE-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14019133#comment-14019133
]
Ashutosh Chauhan commented on HIVE-7050:
[~prasanth_j] Does this also support display of column stats for a particular
partition of table? Test case doesnt cover it, so not sure. I was hoping
following syntax to work, but seems like not supported yet.
{code}
describe formatted T partition (k1=v1) c1;
{code}
> Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE
> -
>
> Key: HIVE-7050
> URL: https://issues.apache.org/jira/browse/HIVE-7050
> Project: Hive
> Issue Type: Bug
> Components: Statistics
>Reporter: Prasanth J
>Assignee: Prasanth J
> Fix For: 0.14.0
>
> Attachments: HIVE-7050.1.patch, HIVE-7050.2.patch, HIVE-7050.3.patch,
> HIVE-7050.4.patch, HIVE-7050.5.patch, HIVE-7050.6.patch
>
>
> There is currently no way to display the column level stats from hive CLI. It
> will be good to show them in DESCRIBE EXTENDED/FORMATTED TABLE
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HIVE-7050) Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE
[ https://issues.apache.org/jira/browse/HIVE-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14014789#comment-14014789 ] Xuefu Zhang commented on HIVE-7050: --- +1 > Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE > - > > Key: HIVE-7050 > URL: https://issues.apache.org/jira/browse/HIVE-7050 > Project: Hive > Issue Type: Bug >Reporter: Prasanth J >Assignee: Prasanth J > Attachments: HIVE-7050.1.patch, HIVE-7050.2.patch, HIVE-7050.3.patch, > HIVE-7050.4.patch, HIVE-7050.5.patch, HIVE-7050.6.patch > > > There is currently no way to display the column level stats from hive CLI. It > will be good to show them in DESCRIBE EXTENDED/FORMATTED TABLE -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-7050) Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE
[ https://issues.apache.org/jira/browse/HIVE-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14004039#comment-14004039 ] Prasanth J commented on HIVE-7050: -- [~xuefuz] only describe_syntax and describe_table seems to be related. Other test failures are unrelated and are tracked else where. I quickly ran describe_syntax and describe_table and found that the diffs are showing additional spaces. I will analyze more to see if those spaces valid or added as a side effect. Will post a new patch later today with the fix. > Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE > - > > Key: HIVE-7050 > URL: https://issues.apache.org/jira/browse/HIVE-7050 > Project: Hive > Issue Type: Bug >Reporter: Prasanth J >Assignee: Prasanth J > Attachments: HIVE-7050.1.patch, HIVE-7050.2.patch, HIVE-7050.3.patch, > HIVE-7050.4.patch, HIVE-7050.5.patch > > > There is currently no way to display the column level stats from hive CLI. It > will be good to show them in DESCRIBE EXTENDED/FORMATTED TABLE -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-7050) Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE
[ https://issues.apache.org/jira/browse/HIVE-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14004003#comment-14004003 ] Xuefu Zhang commented on HIVE-7050: --- [~prasanth_j] Could you give an analysis of the above test failures? > Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE > - > > Key: HIVE-7050 > URL: https://issues.apache.org/jira/browse/HIVE-7050 > Project: Hive > Issue Type: Bug >Reporter: Prasanth J >Assignee: Prasanth J > Attachments: HIVE-7050.1.patch, HIVE-7050.2.patch, HIVE-7050.3.patch, > HIVE-7050.4.patch, HIVE-7050.5.patch > > > There is currently no way to display the column level stats from hive CLI. It > will be good to show them in DESCRIBE EXTENDED/FORMATTED TABLE -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-7050) Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE
[ https://issues.apache.org/jira/browse/HIVE-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14002091#comment-14002091 ] Xuefu Zhang commented on HIVE-7050: --- Sorry, but the above comment was intended for [~prasanth_j]. :) > Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE > - > > Key: HIVE-7050 > URL: https://issues.apache.org/jira/browse/HIVE-7050 > Project: Hive > Issue Type: Bug >Reporter: Prasanth J >Assignee: Prasanth J > Attachments: HIVE-7050.1.patch, HIVE-7050.2.patch, HIVE-7050.3.patch, > HIVE-7050.4.patch, HIVE-7050.5.patch > > > There is currently no way to display the column level stats from hive CLI. It > will be good to show them in DESCRIBE EXTENDED/FORMATTED TABLE -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-7050) Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE
[ https://issues.apache.org/jira/browse/HIVE-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14002087#comment-14002087 ] Xuefu Zhang commented on HIVE-7050: --- [~prashuj] Could you take a look at the test failures above to see if they are related to your patch? > Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE > - > > Key: HIVE-7050 > URL: https://issues.apache.org/jira/browse/HIVE-7050 > Project: Hive > Issue Type: Bug >Reporter: Prasanth J >Assignee: Prasanth J > Attachments: HIVE-7050.1.patch, HIVE-7050.2.patch, HIVE-7050.3.patch, > HIVE-7050.4.patch, HIVE-7050.5.patch > > > There is currently no way to display the column level stats from hive CLI. It > will be good to show them in DESCRIBE EXTENDED/FORMATTED TABLE -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-7050) Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE
[
https://issues.apache.org/jira/browse/HIVE-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14001039#comment-14001039
]
Hive QA commented on HIVE-7050:
---
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12645388/HIVE-7050.5.patch
{color:red}ERROR:{color} -1 due to 19 failed/errored test(s), 5451 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_sortmerge_join_11
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_describe_syntax
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_describe_table
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udf_java_method
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udf_reflect
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vector_decimal_math_funcs
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_root_dir_external_table
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_stats_counter
org.apache.hadoop.hive.ql.parse.TestParse.testParse_input20
org.apache.hadoop.hive.ql.parse.TestParse.testParse_input4
org.apache.hadoop.hive.ql.parse.TestParse.testParse_input5
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimal
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimalX
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimalXY
org.apache.hive.hcatalog.templeton.TestWebHCatE2e.getHadoopVersion
org.apache.hive.hcatalog.templeton.TestWebHCatE2e.getHiveVersion
org.apache.hive.hcatalog.templeton.TestWebHCatE2e.getPigVersion
org.apache.hive.hcatalog.templeton.TestWebHCatE2e.getStatus
org.apache.hive.hcatalog.templeton.TestWebHCatE2e.invalidPath
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/226/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/226/console
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 19 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12645388
> Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE
> -
>
> Key: HIVE-7050
> URL: https://issues.apache.org/jira/browse/HIVE-7050
> Project: Hive
> Issue Type: Bug
>Reporter: Prasanth J
>Assignee: Prasanth J
> Attachments: HIVE-7050.1.patch, HIVE-7050.2.patch, HIVE-7050.3.patch,
> HIVE-7050.4.patch, HIVE-7050.5.patch
>
>
> There is currently no way to display the column level stats from hive CLI. It
> will be good to show them in DESCRIBE EXTENDED/FORMATTED TABLE
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HIVE-7050) Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE
[ https://issues.apache.org/jira/browse/HIVE-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14000671#comment-14000671 ] Xuefu Zhang commented on HIVE-7050: --- +1, pending on test result. > Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE > - > > Key: HIVE-7050 > URL: https://issues.apache.org/jira/browse/HIVE-7050 > Project: Hive > Issue Type: Bug >Reporter: Prasanth J >Assignee: Prasanth J > Attachments: HIVE-7050.1.patch, HIVE-7050.2.patch, HIVE-7050.3.patch, > HIVE-7050.4.patch, HIVE-7050.5.patch > > > There is currently no way to display the column level stats from hive CLI. It > will be good to show them in DESCRIBE EXTENDED/FORMATTED TABLE -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-7050) Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE
[
https://issues.apache.org/jira/browse/HIVE-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13999222#comment-13999222
]
Hive QA commented on HIVE-7050:
---
{color:red}Overall{color}: -1 no tests executed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12644978/HIVE-7050.4.patch
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/201/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/201/console
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12644978
> Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE
> -
>
> Key: HIVE-7050
> URL: https://issues.apache.org/jira/browse/HIVE-7050
> Project: Hive
> Issue Type: Bug
>Reporter: Prasanth J
>Assignee: Prasanth J
> Attachments: HIVE-7050.1.patch, HIVE-7050.2.patch, HIVE-7050.3.patch,
> HIVE-7050.4.patch
>
>
> There is currently no way to display the column level stats from hive CLI. It
> will be good to show them in DESCRIBE EXTENDED/FORMATTED TABLE
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HIVE-7050) Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE
[ https://issues.apache.org/jira/browse/HIVE-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997751#comment-13997751 ] Xuefu Zhang commented on HIVE-7050: --- Patch looks good. I left a couple of minor comments on rb. > Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE > - > > Key: HIVE-7050 > URL: https://issues.apache.org/jira/browse/HIVE-7050 > Project: Hive > Issue Type: Bug >Reporter: Prasanth J >Assignee: Prasanth J > Attachments: HIVE-7050.1.patch, HIVE-7050.2.patch > > > There is currently no way to display the column level stats from hive CLI. It > will be good to show them in DESCRIBE EXTENDED/FORMATTED TABLE -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-7050) Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE
[ https://issues.apache.org/jira/browse/HIVE-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996997#comment-13996997 ] Xuefu Zhang commented on HIVE-7050: --- Thanks for the patch. Minor comments/questions on RB. One clarification: are column stats shown when either EXTENDED or FORMATTED is specified? And only when column is specified? I think this is important for documentation purpose. It would be good if functional details can be put in the description area. > Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE > - > > Key: HIVE-7050 > URL: https://issues.apache.org/jira/browse/HIVE-7050 > Project: Hive > Issue Type: Bug >Reporter: Prasanth J >Assignee: Prasanth J > Attachments: HIVE-7050.1.patch > > > There is currently no way to display the column level stats from hive CLI. It > will be good to show them in DESCRIBE EXTENDED/FORMATTED TABLE -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-7050) Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE
[ https://issues.apache.org/jira/browse/HIVE-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997303#comment-13997303 ] Prasanth J commented on HIVE-7050: -- Column stats are stored only when a column is specified and only when FORMATTED is specified. It does NOT show for EXTENDED because extended output does not show the column names at the top which makes it difficult to comprehend the column stats output. > Display table level column stats in DESCRIBE EXTENDED/FORMATTED TABLE > - > > Key: HIVE-7050 > URL: https://issues.apache.org/jira/browse/HIVE-7050 > Project: Hive > Issue Type: Bug >Reporter: Prasanth J >Assignee: Prasanth J > Attachments: HIVE-7050.1.patch, HIVE-7050.2.patch > > > There is currently no way to display the column level stats from hive CLI. It > will be good to show them in DESCRIBE EXTENDED/FORMATTED TABLE -- This message was sent by Atlassian JIRA (v6.2#6252)
