[ https://issues.apache.org/jira/browse/SPARK-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yin Huai updated SPARK-5881: ---------------------------- Description: {code} val rdd = sc.parallelize((1 to 10).map(i => s"""{"a":$i, "b":"str${i}"}""")) sqlContext.jsonRDD(rdd).registerTempTable("jt") sqlContext.sql("CACHE TABLE foo AS SELECT * FROM jt") sqlContext.sql("CACHE TABLE foo AS SELECT a FROM jt") {code} After the second CACHE TABLE command, the RDD for the first table still remains in the cache. was: {code} val rdd = sc.parallelize((1 to 10).map(i => s"""{"a":$i, "b":"str${i}"}""")) sqlContext.jsonRDD(rdd).registerTempTable("jt") sqlContext.sql("CACHE TABLE foo AS SELECT * FROM jt") sqlContext.sql("CACHE TABLE foo AS SELECT * FROM jt") {code} After the second CACHE TABLE command, the RDD for the first table still remains in the cache. > RDD remains cached after the table gets overridden by "CACHE TABLE" > ------------------------------------------------------------------- > > Key: SPARK-5881 > URL: https://issues.apache.org/jira/browse/SPARK-5881 > Project: Spark > Issue Type: Bug > Components: SQL > Reporter: Yin Huai > Priority: Blocker > > {code} > val rdd = sc.parallelize((1 to 10).map(i => s"""{"a":$i, "b":"str${i}"}""")) > sqlContext.jsonRDD(rdd).registerTempTable("jt") > sqlContext.sql("CACHE TABLE foo AS SELECT * FROM jt") > sqlContext.sql("CACHE TABLE foo AS SELECT a FROM jt") > {code} > After the second CACHE TABLE command, the RDD for the first table still > remains in the cache. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org