Re: [MARKETING] Spark Streaming stateful transformation mapWithState function getting error scala.MatchError: [Ljava.lang.Object]

2016-03-14 Thread Vinti Maheshwari
ari [mailto:vinti.u...@gmail.com] > *Sent:* 12 March 2016 22:10 > *To:* user > *Subject:* [MARKETING] Spark Streaming stateful transformation > mapWithState function getting error scala.MatchError: [Ljava.lang.Object] > > > > Hi All, > > I wanted to replace my upda

Spark Streaming stateful transformation mapWithState function getting error scala.MatchError: [Ljava.lang.Object]

2016-03-12 Thread Vinti Maheshwari
Hi All, I wanted to replace my updateStateByKey function with mapWithState function (Spark 1.6) to improve performance of my program. I was following these two documents: https://databricks.com/blog/2016/02/01/faster-stateful-stream-processing-in-spark-streaming.html