Re: Spark checkpoint - nonstreaming

Just load it as from any other directory. > On 26. May 2017, at 17:26, Priya PM <pmpr...@gmail.com> wrote: > > > -- Forwarded message -- > From: Priya PM <pmpr...@gmail.com> > Date: Fri, May 26, 2017 at 8:54 PM > Subject: Re: Spark checkpoint

Re: Spark checkpoint - nonstreaming

Do you have some source code? Did you set the checkpoint directory ? > On 26. May 2017, at 16:06, Priya wrote: > > Hi, > > With nonstreaming spark application, did checkpoint the RDD and I could see > the RDD getting checkpointed. I have killed the application after >

Re: Spark checkpoint - nonstreaming

In non streaming Spark checkpoints aren't for inter-application recovery, rather you can think of them as doing persist but to a HDFS rather than each nodes local memory / storage. On Fri, May 26, 2017 at 3:06 PM Priya wrote: > Hi, > > With nonstreaming spark application,