Why not compare current time in every batch and it meets certain condition emit the data? On 9 Mar 2016 00:19, "Abhishek Anand" <abhis.anan...@gmail.com> wrote:
> I have a spark streaming job where I am aggregating the data by doing > reduceByKeyAndWindow with inverse function. > > I am keeping the data in memory for upto 2 hours and In order to output > the reduced data to an external storage I conditionally need to puke the > data to DB say at every 15th minute of the each hour. > > How can this be achieved. > > > Regards, > Abhi >
