Flink metrics related problems/questions

Background: We are using a job using ProcessFunction which reads data from kafka fires ~5-10K timers per second and sends matched events to KafkaSink. We are collecting metrics for collecting no of active timers, no of timers scheduled etc. We use statsd reporter and monitor using Grafana dashboard

Re: Custom timer implementation using Flink

Hi Gordon I somehow missed this in the docs. Looks really helpful for this use case. Thanks. I now have some other ideas for this use case. I will post here if I use this or not. If not, will post the approach which I will take. -- View this message in context: http://apache-flink-user-mailin

Custom timer implementation using Flink

I have a use case which I am trying to solve using Flink. Need an advice to decide on the correct approach. Use case: -- I have a stream of events partitioned by a key. For some events, I need to start a timer (conside this as a SLA i.e. if something is not done in x secs/minutes do some

Re: AW: Problem with CEPPatternOperator when taskmanager is killed

Hi Fabian My JIRA user is: jaxbihani I have created a pull request for the fix : https://github.com/apache/flink/pull/2568 -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Problem-with-CEPPatternOperator-when-taskmanager-is-killed

Re: Problem with CEPPatternOperator when taskmanager is killed

Fabian Had a discussion with Frank. As he has no means to reproduce/test the bug I will submit a patch for this. -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Problem-with-CEPPatternOperator-when-taskmanager-is-killed-tp9024p9097.html Sent

Re: Problem with CEPPatternOperator when taskmanager is killed

@Frank : Thanks. I verified changing that and it works fine. (I still need to copy the user jar to the lib dir which ideally shouldn't be required but I think that is because of userCodeClassLoader() related problem. Will look into that) About implementation I feel instead of initializing priorit

Re: Problem with CEPPatternOperator when taskmanager is killed

Updated attachment containing exceptions stacktrace -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Problem-with-CEPPatternOperator-whe

Problem with CEPPatternOperator when taskmanager is killed

*Problem :* I have created a PatternStream with "custom type" and added an event pattern. This works fine in both local and cluster setup. But when I tried to take one of the taskmanager down (on which task was executing), flink tries to restart a job but restart fails with the exception : "Could