Venkata krishnan Sowrirajan created SPARK-36038:
---------------------------------------------------
Summary: Basic speculation metrics at stage level
Key: SPARK-36038
URL: https://issues.apache.org/jira/browse/SPARK-36038
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 3.1.2
Reporter: Venkata krishnan Sowrirajan
Currently there are no speculation metrics available either at application
level or at stage level. With in our platform, we have added speculation
metrics at stage level as a summary similarly to the stage level metrics
tracking numTotalSpeculated, numCompleted (successful), numFailed, numKilled
etc. This enables us to effectively understand speculative execution feature at
an application level and helps in further tuning the speculation configs.
cc [~ron8hu]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
