Hi, I'm looking for suggestions on the ideal number of executors per machine. I run my jobs on 64G 32 core machines, and at the moment I have one executor running per machine, on the spark standalone cluster.
I could not find many guidelines for figuring out the ideal number of executors; the Spark official documentation merely recommends not having more than 64G per executor to avoid GC issues. Anyone have and advice on this? thank you.