Re: Does mapWithState need checkpointing to be specified in Spark Streaming?

2017-07-16 Thread Yuval.Itzchakov
Yes, you do. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Does-mapWithState-need-checkpointing-to-be-specified-in-Spark-Streaming-tp28858p28862.html Sent from the Apache Spark User List mailing list archive at Nabble.com

Re: Does mapWithState need checkpointing to be specified in Spark Streaming?

2017-07-13 Thread swetha kasireddy
gt; >> >> -- >> View this message in context: http://apache-spark-user-list. >> 1001560.n3.nabble.com/Does-mapWithState-need-checkpointing- >> to-be-specified-in-Spark-Streaming-tp28858.html >> Sent from the Apache Spark User List mailing list archive at N

Re: Does mapWithState need checkpointing to be specified in Spark Streaming?

2017-07-13 Thread Tathagata Das
y checkpointing for mapWithState just like we do for > updateStateByKey? > > Thanks, > Swetha > > > > -- > View this message in context: http://apache-spark-user-list. > 1001560.n3.nabble.com/Does-mapWithState-need- > checkpointing-to-be-specified-in-Spark-Streaming-tp2

Does mapWithState need checkpointing to be specified in Spark Streaming?

2017-07-13 Thread SRK
Hi, Do we need to specify checkpointing for mapWithState just like we do for updateStateByKey? Thanks, Swetha -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Does-mapWithState-need-checkpointing-to-be-specified-in-Spark-Streaming-tp28858.html Sent from