Re: Configure Spark to run with MemSQL DB Cluster

2016-07-26 Thread yash datta
Read here: https://github.com/memsql/memsql-spark-connector Best Regards Yash On Wed, Jul 27, 2016 at 12:54 PM, Subhajit Purkayastha wrote: > All, > > > > Is it possible to integrate spark 1.6.1 with MemSQL Cluster? Any pointers > on how to start with the project will be

Re: what happened if cache a RDD for multiple time?

2016-03-24 Thread yash datta
Yes, That is correct. When you call cache on an RDD, internally it calls persist(StorageLevel.MEMORY_ONLY) which further calls persist(StorageLevel.MEMORY_ONLY, allowOverride=false) , if the RDD is not marked for localCheckpointing Below is what is finally triggered : /** * Mark this RDD for