[jira] [Updated] (SPARK-21213) Support collecting partition-level statistics: rowCount and sizeInBytes

2017-07-07 Thread Maria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maria updated SPARK-21213: -- Description: Support ANALYZE TABLE table PARTITION (key=value,...) COMPUTE STATISTICS [NOSCAN] SQL command to

[jira] [Commented] (SPARK-17129) Support statistics collection and cardinality estimation for partitioned tables

2017-06-26 Thread Maria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063342#comment-16063342 ] Maria commented on SPARK-17129: --- [~ZenWzh], I opened SPARK-21213 and submitted PR

[jira] [Updated] (SPARK-21213) Support collecting partition-level statistics: rowCount and sizeInBytes

2017-06-26 Thread Maria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maria updated SPARK-21213: -- Summary: Support collecting partition-level statistics: rowCount and sizeInBytes (was: Support collecting

[jira] [Updated] (SPARK-21213) Support collecting partition-level statistics

2017-06-26 Thread Maria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maria updated SPARK-21213: -- Issue Type: Sub-task (was: New Feature) Parent: SPARK-17129 > Support collecting partition-level

[jira] [Created] (SPARK-21213) Support collecting partition-level statistics

2017-06-26 Thread Maria (JIRA)
Maria created SPARK-21213: - Summary: Support collecting partition-level statistics Key: SPARK-21213 URL: https://issues.apache.org/jira/browse/SPARK-21213 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-17129) Support statistics collection and cardinality estimation for partitioned tables

2017-06-20 Thread Maria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056008#comment-16056008 ] Maria commented on SPARK-17129: --- [~ZenWzh], I happen to work with large number of partitioned tables where

[jira] [Issue Comment Deleted] (SPARK-21079) ANALYZE TABLE fails to calculate totalSize for a partitioned table

2017-06-14 Thread Maria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maria updated SPARK-21079: -- Comment: was deleted (was: [~ZenWzh], here is a PR: https://github.com/apache/spark/pull/18309) > ANALYZE

[jira] [Commented] (SPARK-21079) ANALYZE TABLE fails to calculate totalSize for a partitioned table

2017-06-14 Thread Maria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049879#comment-16049879 ] Maria commented on SPARK-21079: --- [~ZenWzh], here is a PR: https://github.com/apache/spark/pull/18309 >

[jira] [Commented] (SPARK-21079) ANALYZE TABLE fails to calculate totalSize for a partitioned table

2017-06-13 Thread Maria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048432#comment-16048432 ] Maria commented on SPARK-21079: --- [~ZenWzh], yes, I have a fix and will try to submit a PR. > ANALYZE TABLE

[jira] [Issue Comment Deleted] (SPARK-21079) ANALYZE TABLE fails to calculate totalSize for a partitioned table

2017-06-13 Thread Maria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maria updated SPARK-21079: -- Comment: was deleted (was: [~ZenWzh], I'm using partitioned table created by Hive. The data is stored in DWRF

[jira] [Commented] (SPARK-21079) ANALYZE TABLE fails to calculate totalSize for a partitioned table

2017-06-13 Thread Maria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048246#comment-16048246 ] Maria commented on SPARK-21079: --- [~ZenWzh], I'm using partitioned table created by Hive. The data is stored

[jira] [Created] (SPARK-21079) ANALYZE TABLE fails to calculate totalSize for a partitioned table

2017-06-13 Thread Maria (JIRA)
Maria created SPARK-21079: - Summary: ANALYZE TABLE fails to calculate totalSize for a partitioned table Key: SPARK-21079 URL: https://issues.apache.org/jira/browse/SPARK-21079 Project: Spark Issue

[jira] [Commented] (SPARK-17642) Support DESC FORMATTED TABLE COLUMN command to show column-level statistics

2017-06-12 Thread Maria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16046794#comment-16046794 ] Maria commented on SPARK-17642: --- [~dongjoon], where can I read more on this? I found blog post [1]

[jira] [Commented] (SPARK-17642) Support DESC FORMATTED TABLE COLUMN command to show column-level statistics

2017-06-12 Thread Maria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16046718#comment-16046718 ] Maria commented on SPARK-17642: --- [~dongjoon], thanks for such a quick response. Attached PR [1]

[jira] [Commented] (SPARK-17642) Support DESC FORMATTED TABLE COLUMN command to show column-level statistics

2017-06-12 Thread Maria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16046664#comment-16046664 ] Maria commented on SPARK-17642: --- Folks, It seems to me that column-level access control is implemented

[jira] [Commented] (SPARK-17642) support DESC FORMATTED TABLE COLUMN command to show column-level statistics

2017-06-09 Thread Maria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044798#comment-16044798 ] Maria commented on SPARK-17642: --- @gatorsmile, I'm evaluating CBO in Spark and I'm missing this feature.