[ https://issues.apache.org/jira/browse/SPARK-34108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17265048#comment-17265048 ]
Apache Spark commented on SPARK-34108: -------------------------------------- User 'sunchao' has created a pull request for this issue: https://github.com/apache/spark/pull/31182 > Caching with permanent view doesn't work in certain cases > --------------------------------------------------------- > > Key: SPARK-34108 > URL: https://issues.apache.org/jira/browse/SPARK-34108 > Project: Spark > Issue Type: Sub-task > Components: SQL > Affects Versions: 3.1.0 > Reporter: Chao Sun > Priority: Major > > Currently, caching a permanent view doesn't work in certain cases. For > instance, in the following: > {code:sql} > CREATE TABLE t (key bigint, value string) USING parquet > CREATE VIEW v1 AS SELECT key FROM t > CACHE TABLE v1 > SELECT key FROM t > {code} > The last SELECT query will hit the cached {{v1}}. On the other hand: > {code:sql} > CREATE TABLE t (key bigint, value string) USING parquet > CREATE VIEW v1 AS SELECT key FROM t ORDER by key > CACHE TABLE v1 > SELECT key FROM t ORDER BY key > {code} > The SELECT won't hit the cache. > It seems this is related to {{EliminateView}}. In the second case, it will > insert an extra project operator which makes the comparison on canonicalized > plan during cache lookup fail. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org