Re: [Question] Good way to monitor data skewness

Hello, Thanks for feedback. I'll try to add setup in the internal Grafana. BR, JUNG 2023년 8월 16일 (수) 오후 6:29, Hang Ruan 님이 작성: > Hi, Dennis. > > As Ron said, we could judge this situation by the metrics. > We are usually reporting the metrics to the external system like > Prometheus by the metr

Re: [Question] Good way to monitor data skewness

Hi, Dennis. As Ron said, we could judge this situation by the metrics. We are usually reporting the metrics to the external system like Prometheus by the metric reporter[1]. And these metrics could be shown by some other tools like grafana[2]. Best, Hang [1] https://nightlies.apache.org/flink/fl

Re: [Question] Good way to monitor data skewness

Hi, Dennis, Although all operators are chained together, each operator metrics is there, you can view the metrcis related to the corresponding operator's input and output records through the UI, as following: [image: image.png] Best, Ron Dennis Jung 于2023年8月16日周三 14:13写道： > Hello people, > I'

[Question] Good way to monitor data skewness

Hello people, I'm trying to monitor data skewness with 'web-ui', between TaskManagers. Currently all operators has been chained, so I cannot find how data has been skewed to TaskManagers (or subtasks). But if I disable chaining, AFAIK, it can degrade performance. https://nightlies.apache.org/flin