Re: Regarding sliding window example from Databricks for DStream

2016-01-12 Thread Cassa L
Any thoughts over this? I want to know when window duration is complete and not the sliding window. Is there a way I can catch end of Window Duration or do I need to keep track of it and how? LCassa On Mon, Jan 11, 2016 at 3:09 PM, Cassa L wrote: > Hi, > I'm trying to

Regarding sliding window example from Databricks for DStream

2016-01-11 Thread Cassa L
Hi, I'm trying to work with sliding window example given by databricks. https://databricks.gitbooks.io/databricks-spark-reference-applications/content/logs_analyzer/chapter1/windows.html It works fine as expected. My question is how do I determine when the last phase of of slider has reached. I