[
https://issues.apache.org/jira/browse/SPARK-26764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779170#comment-16779170
]
Adrian Wang commented on SPARK-26764:
-------------------------------------
Hi [~Tagar] , the idea has something common with materialized view, while we
would also make query rewriting available for Spark's cached query, and the
data materialization process will be more configurable.
> [SPIP] Spark Relational Cache
> -----------------------------
>
> Key: SPARK-26764
> URL: https://issues.apache.org/jira/browse/SPARK-26764
> Project: Spark
> Issue Type: New Feature
> Components: SQL
> Affects Versions: 2.4.0
> Reporter: Adrian Wang
> Priority: Major
> Attachments: Relational+Cache+SPIP.pdf
>
>
> In modern database systems, relational cache is a common technology to boost
> ad-hoc queries. While Spark provides cache natively, Spark SQL should be able
> to utilize the relationship between relations to boost all possible queries.
> In this SPIP, we will make Spark be able to utilize all defined cached
> relations if possible, without explicit substitution in user query, as well
> as keep some user defined cache available in different sessions. Materialized
> views in many database systems provide similar function.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
