Hello all,
I have a naive question regarding how spark uses the executors in a cluster
of machines. Imagine the scenario in which I do not know the input size of
my data in execution A, so I set Spark to use 20 (out of my 25 nodes, for
instance). At the same time, I also launch a second execution
r Yarn or Mesos to schedule the system.
> The same issues will come up, but they have a much broader range of
> approaches that you can take to solve the problem.
>
>
>
> Dave
>
>
>
> *From:* Luis Guerra [mailto:luispelay...@gmail.com]
> *Sent:* Monday, January 12, 201
Re: Spark executors resources. Blocking?
Thanks for your answer David,
It is as I thought then. When you write that there could be some approaches
to solve this using Yarn or Mesos, can you give any idea about this? Or
better yet, is there any site with documentation about this issue?
Currently, we are