Thank you so much! On Mon, Apr 10, 2017 at 2:47 PM, Tathagata Das <[email protected]> wrote:
> As of now (Spark 2.2), Structured Streaming does checkpoint of the state > data synchronously in every trigger. But the checkpointing is incremental, > so it wont be writing all your state every time. And we will be making this > asynchronous soon. > > On Fri, Apr 7, 2017 at 3:19 AM, kant kodali <[email protected]> wrote: > >> Hi All, >> >> Is checkpointing in Spark Streaming Synchronous or Asynchronous ? other >> words can spark continue processing the stream while checkpointing? >> >> Thanks! >> > >
