[
https://issues.apache.org/jira/browse/SPARK-53157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan reassigned SPARK-53157:
-------------------------------------------
Assignee: Victor Sunderland
> Decouple driver and executor heartbeat intervals
> ------------------------------------------------
>
> Key: SPARK-53157
> URL: https://issues.apache.org/jira/browse/SPARK-53157
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 4.1.0
> Reporter: Victor Sunderland
> Assignee: Victor Sunderland
> Priority: Minor
> Labels: pull-request-available
>
> Decouple driver and executor heartbeat intervals. Due to sampling frequencies
> in memory metric reporting intervals we do not have a 100% accurate view of
> stats at drivers and executors. This is particularly observed at the driver,
> where we don't have the benefit of a larger sample size of metrics from N
> executors in application. We should provide a way to increase the rate of
> collection of metrics at the driver, to aid in overcoming the sampling
> problem, without requiring users to also increase executor heartbeat
> frequencies.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
