Re: Spark 2.x OFF_HEAP persistence

2017-01-04 Thread Vin J
uxio.org/docs/master/en/File-System-API.html>. > > I hope this helps! > > Thanks, > Gene > > On Wed, Jan 4, 2017 at 10:50 AM, Vin J wrote: > >> Until Spark 1.6 I see there were specific properties to configure such as >> the external block store master url (spar

Spark 2.x OFF_HEAP persistence

2017-01-04 Thread Vin J
Until Spark 1.6 I see there were specific properties to configure such as the external block store master url (spark.externalBlockStore.url) etc to use OFF_HEAP storage level which made it clear that an external Tachyon type of block store as required/used for OFF_HEAP storage. Can someone clarify