kalyan
> Date 02/6/2024 10:08
> To Jay Han
> Cc Ashish Singh ,
> Mridul Muralidharan ,
> dev ,
>
>
> Subject Re: [Spark-Core] Improving Reliability of spark when Executors
> OOM
> Hey,
> Disk space not enough is also a reliability concern, but might need
Hey all,
Thanks for this discussion, the timing of this couldn't be better!
At Pinterest, we recently started to look into reducing OOM failures while
also reducing memory consumption of spark applications. We considered the
following options.
1. Changing core count on executor to change memory
