[
https://issues.apache.org/jira/browse/SPARK-2135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-2135.
-------------------------------------
Resolution: Fixed
Fix Version/s: 1.1.0
1.0.1
https://github.com/apache/spark/pull/1072
> InMemoryColumnarScan does not get planned correctly
> ---------------------------------------------------
>
> Key: SPARK-2135
> URL: https://issues.apache.org/jira/browse/SPARK-2135
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 1.0.0
> Reporter: Michael Armbrust
> Assignee: Michael Armbrust
> Fix For: 1.0.1, 1.1.0
>
>
> Right now we do not have a logical concept for in memory data. This breaks
> planning in several ways:
> This sort of query fails to analyze:
> {code}
> TestSQLContext.sql("SELECT * FROM testData").registerAsTable("selectStar")
> TestSQLContext.cacheTable("selectStar")
> TestSQLContext.sql("SELECT * FROM selectStar WHERE key = 1").collect()
> {code}
> Also, we read all of the columns even when we don't need to.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
