Re: Counting streaks in stateful structured streaming

2020-03-01 Thread Zahid Rahman
>From this paragraph it appears the answer to your query is YES. page 334 Spark the definitive guide states : "Stream processing is the act of *continuously incorporating new data* to compute a result. In stream processing, the input data is *unbounded *and has *no predetermined beginning or

Counting streaks in stateful structured streaming

2020-03-01 Thread nimrod
Hi all, I have a stream with a list of values and I want to count consecutive values a period of 1 minute (even if it is across samples). Can it be done at all? Nimrod -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/