Re: Need help understanding tuning docs

2024-08-14 Thread Subhasis Mukherjee
where storage will always have more priority than execution and will never be released to execution. Regards, Subhasis Mukherjee From: Sreyan Chakravarty Sent: Wednesday, August 14, 2024 9:00:45 PM To: user@spark.apache.org Subject: Need help understanding tuning

Need help understanding tuning docs

2024-08-14 Thread Sreyan Chakravarty
https://spark.apache.org/docs/latest/tuning.html#memory-management-overview What is the meaning of : "Execution may evict storage if necessary, but only until total storage memory usage falls under a certain threshold (R). In other words, R describes a subregion within M where cached blocks are ne