[ https://issues.apache.org/jira/browse/SPARK-16669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenhua Wang updated SPARK-16669: --------------------------------- Issue Type: Sub-task (was: Bug) Parent: SPARK-17129 > Partition pruning for metastore relation size estimates for better join > selection. > ---------------------------------------------------------------------------------- > > Key: SPARK-16669 > URL: https://issues.apache.org/jira/browse/SPARK-16669 > Project: Spark > Issue Type: Sub-task > Components: SQL > Affects Versions: 2.0.0 > Reporter: Parth Brahmbhatt > > Currently the metastore statistics returns the size of entire table which > results in Join selection strategy to not use broadcast joins even when only > a single partition from a large table is selected. We should optimize the > statistic calculation at table level to apply partition pruning and only get > the size of Partition that are valid for the query. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org