L. C. Hsieh created SPARK-34270:
-----------------------------------
Summary: Combine StateStoreMetrics should not override individual
StateStoreCustomMetric
Key: SPARK-34270
URL: https://issues.apache.org/jira/browse/SPARK-34270
Project: Spark
Issue Type: Bug
Components: Structured Streaming
Affects Versions: 3.2.0
Reporter: L. C. Hsieh
Assignee: L. C. Hsieh
For stateful join in structured streaming, we need to combine StateStoreMetrics
from both left and right side. Currently we simply take arbitrary one from
custom metrics with same name from left and right. By doing this we miss half
of metric number.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
