I have a spark streaming job where I am aggregating the data by doing reduceByKeyAndWindow with inverse function.
I am keeping the data in memory for upto 2 hours and In order to output the reduced data to an external storage I conditionally need to puke the data to DB say at every 15th minute of the each hour. How can this be achieved. Regards, Abhi