Hey Could you provide some pseudo code ? Also what kind of machine are you using per executor ? How many cores per executor ? What's the size of input data and what's the size of the output ? What kind of errors are you getting ?
Best Tufan On Sun, 17 Jul 2022 at 00:31, Orkhan Dadashov <dadashov.ork...@gmail.com> wrote: > Hi, > > I am working on the project and as a resource I have provided 40 executors > and 14 gb memory per executor. > > I am trying to optimize my spark job in such a way that spark will evenly > distribute the spark job between the executors. > > Could you please give me some advice? > > Kind regards, > > >
