Yang Jie created SPARK-40490:
--------------------------------
Summary: `YarnShuffleIntegrationSuite` no longer verifies
`registeredExecFile` reload after SPARK-17321
Key: SPARK-40490
URL: https://issues.apache.org/jira/browse/SPARK-40490
Project: Spark
Issue Type: Improvement
Components: Tests, YARN
Affects Versions: 3.4.0
Reporter: Yang Jie
After SPARK-17321, YarnShuffleService will persist data to local shuffle state
db and reload data from local shuffle state db only when Yarn NodeManager
start with `YarnConfiguration#NM_RECOVERY_ENABLED = true` , but
`YarnShuffleIntegrationSuite` not set this config and the default value of the
configuration is false, so `YarnShuffleIntegrationSuite` will neither trigger
data persistence to the db nor verify the reload of data
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
