Anyone has experience to share regarding graceful shutdown in production
for spark streaming?
Thanks!
Best Regards,
Jesper Lundgren
others experience with this :)
Thanks!
(PS i am launching a Spark Streaming application)
// Jesper Lundgren
an
exception to force spark to try again with that data on another node? As an
example: a program that writes data to an sql database using foreachRDD.
One worker node might have connection issues to the database, so it has to
let another node finish the output operation.
Thanks!
-- Jesper