<
vincent.gromakow...@gmail.com> wrote:
> Checkpointing is only used for failure recovery not for app upgrades. You
> need to manually code the unload/load and save it to a persistent store
>
> Le mar. 18 déc. 2018 à 17:29, Priya Matpadi a écrit :
>
>> Using checkpointing
Using checkpointing for graceful updates is my understanding as well, based
on the writeup in
https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html#recovering-from-failures-with-checkpointing,
and some prototyping. Have you faced any missed events?
On Mon, Dec 17, 2018
if you are deploying your spark application on YARN cluster,
1. ssh into master node
2. List the currently running application and retreive the application_id
yarn application --list
3. Kill the application using application_id of the form
application_x_ from output of list command
