Hi Haopu, please check these threads:
http://stackoverflow.com/questions/24331815/spark-streaming-historical-state
https://databricks.gitbooks.io/databricks-spark-reference-applications/content/logs_analyzer/chapter1/total.html
Alonso Isidoro Roman
[image: https://]about.me/alonso.isidoro.roman
Can someone look at my questions? Thanks again!
From: Haopu Wang
Sent: 2016年6月12日 16:40
To: user@spark.apache.org
Subject: Should I avoid "state" in an Spark application?
I have a Spark application whose structure is below:
var ts: Long = 0L
