I think when you do a ssc.stop it will stop your entire application and by "update a transformation function" you mean modifying the driver program? In that case even if you checkpoint your application, it won't be able to recover from its previous state.
A simpler approach would be to add certain conditions inside your transformation function and switch them accordingly instead of modifying the transformation. Thanks Best Regards On Wed, Jun 3, 2015 at 4:27 AM, Paolo Platter <paolo.plat...@agilelab.it> wrote: > Hi all, > > Has anyone tried to add Scripting capabilities to spark streaming using > groovy? > I would like to stop the streaming context, update a transformation > function written in groovy( for example to manipulate json ), restart the > streaming context and obtain a new behavior without re-submit the > application. > > Is it possible? Do you think it makes sense or there is a smarter way to > accomplish that? > > Thanks > Paolo > > Inviata dal mio Windows Phone >
