Hi, I am working on the project and as a resource I have provided 40 executors and 14 gb memory per executor.
I am trying to optimize my spark job in such a way that spark will evenly distribute the spark job between the executors. Could you please give me some advice? Kind regards,