Spark CEP

2018-08-14 Thread Esa Heikkinen
Hi I would want to know more about Spark CEP (Complex Event Processing). Are there exist some simple (but also complex) examples with input data (log files ?). Whether Spark CEP is based on Siddhi ? If yes, it is better to use Siddhi directly ? I know CEP engines are intended to stream data

Spark CEP with files and no streams ?

2018-02-07 Thread Esa Heikkinen
Hello I am trying to use CEP of Spark for log files (as batch job), but not for streams (as realtime). Is that possible ? If yes, do you know examples Scala codes about that ? Or should I convert the log files (with time stamps) into streams ? But how to handle time stamps in Spark ? If I can