Re: Debugging, logging and measuring operator subtask performance

2017-01-26 Thread Robert Metzger
Hi Dominik, You could measure the throughput at each task in your job to see if one operator is causing the slowdown (for example using Flink's metrics system) Maybe the backpressure view already helps finding the task that causes the issue. Did you check if there are enough resources available

Debugging, logging and measuring operator subtask performance

2017-01-25 Thread Dominik Safaric
Hi, As I am experiencing certain performance degradations in a streaming job, I want to determine the root cause of it by measuring subtask performance in terms of resource utilisation - e.g. CPU utilisation of the thread. Is this somehow possible? Does Flink log scheduled and executed