Okie. That makes sense. Any recommendations on how to manage changes to my spark streaming app and achieving fault tolerance at the same time
On Mon, Apr 11, 2016 at 8:16 PM, Shixiong(Ryan) Zhu <shixi...@databricks.com > wrote: > You cannot. Streaming doesn't support it because code changes will break > Java serialization. > > On Mon, Apr 11, 2016 at 4:30 PM, Siva Gudavalli <gss.su...@gmail.com> > wrote: > >> hello, >> >> i am writing a spark streaming application to read data from kafka. I am >> using no receiver approach and enabled checkpointing to make sure I am not >> reading messages again in case of failure. (exactly once semantics) >> >> i have a quick question how checkpointing needs to be configured to >> handle code changes in my spark streaming app. >> >> can you please suggest. hope the question makes sense. >> >> thank you >> >> regards >> shiv >> > >
