GitHub user kl0u opened a pull request:
https://github.com/apache/flink/pull/2277
[FLINK-4207] WindowOperator becomes very slow with allowed lateness
Fixes the slowdown due to the allowedLateness.
The problem was the deleteCleanupTimer that was called on cleanup() for
each window.
This was causing a traversal of the whole list of timers in order to delete
the correct one.
Now we let the timer be processed as a regular timer (even if the state has
already been cleaned) and if the state is already cleaned up then we do nothing
and just ignore it.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/kl0u/flink window_slowdown_inv
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/2277.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2277
----
commit 0454a211d7711d6ed484577e8e64bafb669336e5
Author: kl0u <[email protected]>
Date: 2016-07-18T09:37:06Z
[FLINK-4207] WindowOperator becomes very slow with allowed lateness
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
