Github user fhueske commented on the issue:
https://github.com/apache/flink/pull/3629
The problem with the state clean-up is that we always keep some state for
each key. If the keys of the stream are moving (i.e., there is not a fixed set
of keys) then the size of the state will grow infinitely.
So we should add a configuration option that defines when the state of a
key can be cleaned, i.e., a min and max duration how long we keep the state of
a key without any updates. This should be similar to the RocksDB TTL, but I
would like to have this not only for RocksDB but for all backends by
registering timers that clear the state.
I don't think we have to add this for this PR but should address this issue
before the 1.3 release.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
