Re: Structured Streaming, Reading and Updating a variable

esday, May 15, 2018 9:59 PM To: Martin Engen; user@spark.apache.org Subject: Re: Structured Streaming, Reading and Updating a variable Do you have a code sample, and detailed error message/exception to show? From: Martin Engen <martin.en...@outlook.com> Date: Tuesday, May 15, 2018 at 9:24

Re: Structured Streaming, Reading and Updating a variable

Do you have a code sample, and detailed error message/exception to show? From: Martin Engen <martin.en...@outlook.com> Date: Tuesday, May 15, 2018 at 9:24 AM To: "user@spark.apache.org" <user@spark.apache.org> Subject: Structured Streaming, Reading and Updating a variabl

Re: Structured Streaming, Reading and Updating a variable

You use a windowed aggregation for this On Tue, May 15, 2018, 09:23 Martin Engen wrote: > Hello, > > > > I'm working with Structured Streaming, and I need a method of keeping a > running average based on last 24hours of data. > > To help with this, I can use

Structured Streaming, Reading and Updating a variable

Hello, I'm working with Structured Streaming, and I need a method of keeping a running average based on last 24hours of data. To help with this, I can use Exponential Smoothing, which means I really only need to store 1 value from a previous calculation into the new, and update this variable