Re: mapWithState handle timeout

2016-08-08 Thread jackerli
- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/mapWithState-handle-timeout-tp27422p27492.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe e-mail

mapWithState handle timeout

2016-08-06 Thread 李剑
I go an error: Cannot update the state that is timing out Because I set the timeout: val newStateDstream = newActionDstream.mapWithState(StateSpec.function(mappingFunc).timeout(Seconds(3600)).initialState(initialRDD)) In the spark code :

Re: mapWithState handle timeout

2016-08-06 Thread jackerli
any ideas? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/mapWithState-handle-timeout-tp27422p27489.html Sent from the Apache Spark User List mailing list archive at Nabble.com