Re: Calculating metrics real time

2017-10-05 Thread Fabian Hueske
That depends on the state backend [1] that you are using. If you use the RocksDBStateBackend, state is written to RocksDB which persists to disk. [1] https://ci.apache.org/projects/flink/flink-docs-release-1.3/ops/state_backends.html 2017-10-05 14:41 GMT+02:00 Rahul Raj

Re: Calculating metrics real time

2017-10-05 Thread Rahul Raj
Thanks for the response. So, i am guessing windows in flink will store the records in memory before processing them. Correct? Rahul Raj On Oct 5, 2017 17:50, "Fabian Hueske" wrote: > Hi, > > I'd suggest to have a look at the window operators [1]. For example a > tumbling

Calculating metrics real time

2017-10-05 Thread Rahul Raj
Hi, I have to calculate some complicated metrics like click through rate , click value rate and conversions on real time data using flink. But I am not sure what functionality of flink should I use to program this because it involves collection of some records in memory for certain time may be 1