dybyte commented on PR #9833: URL: https://github.com/apache/seatunnel/pull/9833#issuecomment-3265383254
Hi @qiaoborui , Thanks for raising this important point! My understanding is that the root cause is `removeMetrics` not executing properly due to heavy contention on the single key. As a result, finished job metrics were not cleared in time, which caused `runningJobMetrics` to grow indefinitely. With this PR, since metrics are partitioned, lock contention should be significantly reduced, so `removeMetrics` is expected to work more efficiently. This may help prevent `runningJobMetrics` from growing indefinitely, even under heavy load. I’ll keep monitoring this behavior, and if you have further feedback or see this problem persist, please let me know! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
