Re: State in the Scala DataStream API

2018-08-08 Thread Fabian Hueske
Hi Juan, The state will be purged if you return None instead of a Some. However, this only happens when the function is called for a specific key, i.e., state won't be automatically removed after some time. If this is your use case, you have to implement a ProcessFunction and use timers to manuall

State in the Scala DataStream API

2018-08-08 Thread Juan Gentile
Hello, I'm looking at the following page of the documentation https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/state/state.html particularly at this piece of code: val stream: DataStream[(String, Int)] = ... val counts: DataStream[(String, Int)] = stream .keyBy(_._1) .m