Re: Spark cache behaviour when the source table is modified

2016-07-12 Thread Chanh Le
Hi Anjali, The Cached is immutable you can’t update data into. They way to update cache is re-create cache. > On Jun 16, 2016, at 4:24 PM, Anjali Chadha wrote: > > Hi all, > > I am having a hard time understanding the caching concepts in Spark. > > I have a hive

Spark cache behaviour when the source table is modified

2016-06-16 Thread Anjali Chadha
Hi all, I am having a hard time understanding the caching concepts in Spark. I have a hive table("person"), which is cached in Spark. sqlContext.sql("create table person (name string, age int)") //Create a new table //Add some values to the table ... ... //Cache the table in Spark