Jungtaek Lim created SPARK-56537:
------------------------------------
Summary: Some stateful operator metrics are not reset in no batch
trigger progress event
Key: SPARK-56537
URL: https://issues.apache.org/jira/browse/SPARK-56537
Project: Spark
Issue Type: Bug
Components: Structured Streaming
Affects Versions: 4.2.0
Reporter: Jungtaek Lim
[https://github.com/apache/spark/pull/55331#discussion_r3103933756]
We reset several metrics (about num rows) on stateful operator metrics for no
batch trigger progress event, but still we have more metrics to be audited.
This ticket tracks the effort.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
