Graceful shutdown in spark streaming

2014-12-22 Thread Jesper Lundgren
Anyone has experience to share regarding graceful shutdown in production for spark streaming? Thanks! Best Regards, Jesper Lundgren

How to kill/upgrade/restart driver launched in Spark standalone cluster+supervised mode?

2014-11-16 Thread Jesper Lundgren
others experience with this :) Thanks! (PS i am launching a Spark Streaming application) // Jesper Lundgren

Spark Streaming: foreachRDD network output

2014-09-25 Thread Jesper Lundgren
an exception to force spark to try again with that data on another node? As an example: a program that writes data to an sql database using foreachRDD. One worker node might have connection issues to the database, so it has to let another node finish the output operation. Thanks! -- Jesper