It actually looks like I might have the answers via these following links: [Design] Metrics in Structured Streaming <https://docs.google.com/document/d/1NIdcGuR1B3WIe8t7VxLrt58TJB4DtipWEbj5I_mzJys/edit#heading=h.x0p1eeu47fs9>
JIRA - Structured Streaming - Metrics <https://issues.apache.org/jira/browse/SPARK-22052?jql=project%20%3D%20SPARK%20AND%20component%20%3D%20%22Structured%20Streaming%22%20AND%20text%20~%20%22streaming%20metrics%22> Thanks. -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org