[ 
https://issues.apache.org/jira/browse/SPARK-6910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529666#comment-14529666
 ] 

Michael Armbrust commented on SPARK-6910:
-----------------------------------------

Target is Spark 1.5.  In Spark 1.3 a workaround is to do something like: 
{{sqlContext.table("tableName").registerTempTable(...)}} which caches the list 
of partitions in memory on the driver.  The initial pull is expensive but it is 
much faster after that.

> Support for pushing predicates down to metastore for partition pruning
> ----------------------------------------------------------------------
>
>                 Key: SPARK-6910
>                 URL: https://issues.apache.org/jira/browse/SPARK-6910
>             Project: Spark
>          Issue Type: Sub-task
>          Components: SQL
>            Reporter: Michael Armbrust
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to