RE: Spark 2.0 Continuous Processing

2016-06-30 Thread kmat
From: ml-node+s1001560n27250...@n3.nabble.com To: kurianmath...@hotmail.com Subject: Re: Spark 2.0 Continuous Processing it also supports interactive and batch queries. With Spark 2.0, DataFrames and Datasets are being combined and which ensures that an event or file is processed once

Spark 2.0 Continuous Processing

2016-06-24 Thread kmat
Is there a way to checkpoint sink(s) to facilitate rewind processing from a specific offset. For example a continuous query aggregated by month. On the 10 month would like to re-compute information between 4th to 8th months. -- View this message in context: