This is a quick question about Checkpoint. The question is: if the
StreamingContext is not stopped gracefully, will the checkpoint be
consistent?
Or I should always gracefully shutdown the application even in order to
use the checkpoint?
Thank you very much!
-
Hi, can someone help to confirm the behavior? Thank you!
-Original Message-
From: Haopu Wang
Sent: Friday, June 12, 2015 4:57 PM
To: user
Subject: If not stop StreamingContext gracefully, will checkpoint data
be consistent?
This is a quick question about Checkpoint. The question is: if
Haopu Wang
> Sent: Friday, June 12, 2015 4:57 PM
> To: user
> Subject: If not stop StreamingContext gracefully, will checkpoint data
> be consistent?
>
> This is a quick question about Checkpoint. The question is: if the
> StreamingContext is not stopped gracefully, will the checkpoint
15, 2015 3:48 PM
To: Haopu Wang
Cc: user
Subject: Re: If not stop StreamingContext gracefully, will checkpoint
data be consistent?
I think it should be fine, that's the whole point of check-pointing (in
case of driver failure etc).
Thanks
Best Regards
On Mon, Jun 15, 2015 at 6:
gt;
>
>
> Please correct me if the understanding is wrong, thanks again!
>
>
> --
>
> *From:* Akhil Das [mailto:ak...@sigmoidanalytics.com]
> *Sent:* Monday, June 15, 2015 3:48 PM
> *To:* Haopu Wang
> *Cc:* user
> *Subject:* Re: If n
it?
Much thanks!
From: Akhil Das [mailto:ak...@sigmoidanalytics.com]
Sent: Tuesday, June 16, 2015 3:26 PM
To: Haopu Wang
Cc: user
Subject: Re: If not stop StreamingContext gracefully, will checkpoint
data be consistent?
Good question, with fileStream
-
>
> *From:* Akhil Das [mailto:ak...@sigmoidanalytics.com]
> *Sent:* Tuesday, June 16, 2015 3:26 PM
>
> *To:* Haopu Wang
> *Cc:* user
> *Subject:* Re: If not stop StreamingContext gracefully, will checkpoint
> data be consistent?
>
>
>
> Good question, with f
