Re: Flink CEP with files and no streams?

2018-02-07 Thread Fabian Hueske
you have > any good Scala code examples about this ? > > > > Esa > > > > *From:* Fabian Hueske [mailto:fhue...@gmail.com] > *Sent:* Wednesday, February 7, 2018 11:21 AM > *To:* Esa Heikkinen > *Cc:* user@flink.apache.org > *Subject:* Re: Flink CEP with files an

RE: Flink CEP with files and no streams?

2018-02-07 Thread Esa Heikkinen
Hi Thanks for the reply, but because I am a newbie with Flink, do you have any good Scala code examples about this ? Esa From: Fabian Hueske [mailto:fhue...@gmail.com] Sent: Wednesday, February 7, 2018 11:21 AM To: Esa Heikkinen Cc: user@flink.apache.org Subject: Re: Flink CEP with files and

Re: Flink CEP with files and no streams?

2018-02-07 Thread Fabian Hueske
Hi Esa, you can also read files as a stream. However, you have to be careful in which order you read the files and how you generate watermarks. The easiest approach is to implement a non-parallel source function that reads the files in the right order and generates watermarks. Things become more t

Flink CEP with files and no streams?

2018-02-07 Thread Esa Heikkinen
Hello I am trying to use CEP of Flink for log files (as batch job), but not for streams (as realtime). Is that possible ? If yes, do you know examples Scala codes about that ? Or should I convert the log files (with time stamps) into streams ? But how to handle time stamps in Flink ? If I can n