Re: Is checkpointing in Spark Streaming Synchronous or Asynchronous ?

2017-04-11 Thread kant kodali
all your state every time. And we will be making this > asynchronous soon. > > On Fri, Apr 7, 2017 at 3:19 AM, kant kodali <kanth...@gmail.com> wrote: > >> Hi All, >> >> Is checkpointing in Spark Streaming Synchronous or Asynchronous ? other >> words can

Re: Is checkpointing in Spark Streaming Synchronous or Asynchronous ?

2017-04-10 Thread Tathagata Das
nth...@gmail.com> wrote: > Hi All, > > Is checkpointing in Spark Streaming Synchronous or Asynchronous ? other > words can spark continue processing the stream while checkpointing? > > Thanks! >

Is checkpointing in Spark Streaming Synchronous or Asynchronous ?

2017-04-07 Thread kant kodali
Hi All, Is checkpointing in Spark Streaming Synchronous or Asynchronous ? other words can spark continue processing the stream while checkpointing? Thanks!